Outliers Identification Model in Point-of-Sales Data Using Enhanced Normal Distribution Method

    Forskningsoutput: Kapitel i bok/konferenshandlingKonferensbidragVetenskapligPeer review

    1 Citeringar (Scopus)
    6 Nedladdningar (Pure)

    Sammanfattning

    Data Mining extrapolates patterns drawing conclusions from data. Outliers detection identifies those objects that fall some standard deviations away from the mean and is an important tool of commercial data mining. Characterizing the manner of outliers can lead to new knowledge, such as the manner of fraudulent transactions. However, outliers may represent meaningless aberrations and hence there is no rigid mathematical or statistical definition of what constitutes an outlier, and, in many scenarios, determination of the outlier is ultimately a subjective exercise. Standard deviation is a central actor in outlier detection and yet exhibits sensitivity to values and can be distorted, inflated, by a single or even a few observations of borderline and extreme values. It can mask the situation where less extreme outliers or anomalies go undetected because of the existence of the most extreme outliers. This study proposes a novel outlier identification model using an enhanced normal distribution method. The model can explore different types of outliers giving an end-user the ability to fully or partially eliminate outliers found in a retail point of sale (POS) dataset. Experiments revealed that the enhanced normal distribution method appeared more accurate than the standard normal distribution method, and results were also evaluated subjectively by the client, who found most of the outliers to be truly outliers and some representing potentially fraudulent transactions.

    OriginalspråkOdefinierat/okänt
    Titel på värdpublikation2019 International Conference on Machine Learning and Data Engineering (iCMLDE)
    RedaktörerPhill Kyu Rhee, Kuo-Yuan Hwa, Tun-Wen Pai, Daniel Howard, Md Rezaul Bashar
    FörlagIEEE
    Sidor72–78
    ISBN (tryckt)978-1-7281-0404-1
    DOI
    StatusPublicerad - 2019
    MoE-publikationstypA4 Artikel i en konferenspublikation
    EvenemangInternational Conference on Machine Learning and Data Engineering - 2019 International Conference on Machine Learning and Data Engineering (iCMLDE)
    Varaktighet: 2 dec. 20194 dec. 2019

    Konferens

    KonferensInternational Conference on Machine Learning and Data Engineering
    Period02/12/1904/12/19

    Nyckelord

    • Noise
    • Normal distribution
    • Outlier detection
    • Point-of-sales analysis

    Citera det här