|
This article is cited in 1 scientific paper (total in 1 paper)
Theory of probability and Mathematical statistics
On outlier detection with the chebyshev type inequalities
M. A. Chepulis, G. L. Shevlyakov Peter the Great St. Petersburg Polytechnic University, 29 Polytechnicheskaya Street, Saint Petersburg 195251, Russia
Abstract:
This work considers algorithms of outlier detection based on the Chebyshev inequality. It compares these algorithms with such classical methods as Tukey’s boxplot, the $N$-sigma rule and its robust modifications based on $MAD$ and $FQ$ scale estimates. To adjust the parameters of the algorithms, a selection procedure is proposed based on the complete knowledge of the data distribution model. Areas of suboptimal parameters are also determined in case of incomplete knowledge of the distribution model. It is concluded that the direct use of the Chebyshev inequality implies the classical $N$-sigma rule. With the non-classical Chebyshev inequality, a robust outlier detection method is obtained, which slightly outperforms other considered algorithms.
Keywords:
anomaly; outlier detection; Chebyshev inequality; robustness.
Received: 28.09.2020
Citation:
M. A. Chepulis, G. L. Shevlyakov, “On outlier detection with the chebyshev type inequalities”, Journal of the Belarusian State University. Mathematics and Informatics, 3 (2020), 28–35
Linking options:
https://www.mathnet.ru/eng/bgumi74 https://www.mathnet.ru/eng/bgumi/v3/p28
|
|