MT Method for Anomaly Detection and Classification using EM-λ Algorithm
Abstract
Purpose: In this paper, we propose a method to classify and detect normal, known anomalies, and unknown anomalies by combining the expectation–maximisation (EM-λ) algorithm and the Mahalanobis–Taguchi (MT) method.
Methodology/Approach: The proposed method learns normal data that are expected to be homogeneous and known abnormal data and performs classification and detection by parameter estimation using the EM-λ algorithm. Conventional methods perform analysis based on parameter estimation using the EM algorithm. However, the EM algorithm can degrade classification accuracy if it does not assume that the data fits the model's generative process.
Findings: We verify the performance of the proposed method using artificially generated data and real-world bean data for classification as data that do not satisfy this assumption. The validation results show up to 6% improvement over the conventional method in classification accuracy and unknown anomaly discrimination accuracy.
Research Limitation/implication: We try various patterns for the parameter of the proposed method in the verification. However, this way is computationally expensive.
Originality/Value of paper: Conventional methods perform analysis based on parameter estimation using the EM algorithm. Our proposal method seeks to improve accuracy by using the EM-λ algorithm for parameter estimation, which is expected to improve classification accuracy when the data do not conform to the generative assumptions of the EM algorithm's model.
References
t distributions. [online] Available at: https://cran.r-project.org/web/packages/mvtnorm/mvtnorm.pdf, [Accessed 01 June 2023].
Honma, K., Ohkubo, M., Eguchi, S., and Nagata, Y., 2022. Mahalanobis-Taguchi Method for Anomaly Detection and Classification. Total Quality Science, 8(1), 1-13. https://doi.org/10.17929/tqs.8.1.
Jin, X., and Chow, T. W., 2013. Anomaly detection of cooling fan and fault classification of induction motor using Mahalanobis–Taguchi system. Expert Systems with Applications, 40(15), 5787-5795. https://doi.org/10.1016/j.eswa.2013.04.024.
Lee, Y. C., and Teng, H. L., 2009. Predicting the financial crisis by Mahalanobis–Taguchi system– Examples of Taiwan’s electronic sector. Expert Systems with Applications, 36(4), 7469-7478. https://doi.org/10.1016/j.eswa.2008.09.037.
Nigam, K., McCallum, A. K., Thrun, S., and Mitchell, T., 2000. Text classification from labeled and unlabeled documents using EM. Machine Learning, 39, 103-134. https://doi.org/10.1023/A:1007692713085.
Peel, D., and McLachlan, G. J., 2000. Robust mixture modelling using the
t distribution. Statistics and computing, 10, 339-348. https://doi.org/10.1023/A:1008981510081.
Soylemezoglu, A., Jagannathan, S., and Saygin, C., 2010. Mahalanobis Taguchi system (MTS) as a prognostics tool for rolling element bearing failures. Journal of Manufacturing Science and Engineering, 132(5). https://doi.org/10.1115/1.4002545.
Taguchi, G., and Jugulum, R., 2002. The Mahalanobis-Taguchi strategy: A pattern technology system. Hoboken: John Wiley & Sons.
Tatebayashi, K., Teshima, S., and Hasegawa, R., 2008. Introduction to MT System. JUSE Publishing Co. (in Japanese).
UCI, 2020. Dry Bean Dataset. Machine Learning Repository. [online] Available at: https://doi.org/10.24432/C50S4B, [Accessed 2023-12-10].
Yang, Y., and Liu, X., 1999. A re-examination of text categorisation methods. In: Proceedings of the 22nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 42-49. https://doi.org/10.1145/312624.312647.
Zhu, X., and Goldberg, A. B., 2009. Introduction to semi-supervised learning. Synthesis Lectures on Artificial Intelligence and Machine Learning, Brachman, R.J., Dietterich, T. ed. Kentfield: Morgan and Claypool Publishers, 3(1), 1-130.
Authors
This work is licensed under a Creative Commons Attribution 4.0 International License.