MT Method for Anomaly Detection and Classification using EM-λ Algorithm
Abstract
Purpose: In this paper, we propose a method to classify and detect normal, known anomalies, and unknown anomalies by combining the expectation–maximisation (EM-λ) algorithm and the Mahalanobis–Taguchi (MT) method.
Methodology/Approach: The proposed method learns normal data that are expected to be homogeneous and known abnormal data and performs classification and detection by parameter estimation using the EM-λ algorithm. Conventional methods perform analysis based on parameter estimation using the EM algorithm. However, the EM algorithm can degrade classification accuracy if it does not assume that the data fits the model's generative process.
Findings: We verify the performance of the proposed method using artificially generated data and real-world bean data for classification as data that do not satisfy this assumption. The validation results show up to 6% improvement over the conventional method in classification accuracy and unknown anomaly discrimination accuracy.
Research Limitation/implication: We try various patterns for the parameter of the proposed method in the verification. However, this way is computationally expensive.
Originality/Value of paper: Conventional methods perform analysis based on parameter estimation using the EM algorithm. Our proposal method seeks to improve accuracy by using the EM-λ algorithm for parameter estimation, which is expected to improve classification accuracy when the data do not conform to the generative assumptions of the EM algorithm's model.
Full text article
References
Genz, A., Bretz, F., Miwa, T., Mi, X., Leisch, F., Scheipl, F., Bornkamp, B., Maechler, M., and Hothorn, T., 2023. mvtnorm: Multivariate normal and
t distributions. [online] Available at: https://cran.r-project.org/web/packages/mvtnorm/mvtnorm.pdf, [Accessed 01 June 2023].
Honma, K., Ohkubo, M., Eguchi, S., and Nagata, Y., 2022. Mahalanobis-Taguchi Method for Anomaly Detection and Classification. Total Quality Science, 8(1), 1-13. https://doi.org/10.17929/tqs.8.1.
Jin, X., and Chow, T. W., 2013. Anomaly detection of cooling fan and fault classification of induction motor using Mahalanobis–Taguchi system. Expert Systems with Applications, 40(15), 5787-5795. https://doi.org/10.1016/j.eswa.2013.04.024.
Lee, Y. C., and Teng, H. L., 2009. Predicting the financial crisis by Mahalanobis–Taguchi system– Examples of Taiwan’s electronic sector. Expert Systems with Applications, 36(4), 7469-7478. https://doi.org/10.1016/j.eswa.2008.09.037.
Nigam, K., McCallum, A. K., Thrun, S., and Mitchell, T., 2000. Text classification from labeled and unlabeled documents using EM. Machine Learning, 39, 103-134. https://doi.org/10.1023/A:1007692713085.
Peel, D., and McLachlan, G. J., 2000. Robust mixture modelling using the
t distribution. Statistics and computing, 10, 339-348. https://doi.org/10.1023/A:1008981510081.
Soylemezoglu, A., Jagannathan, S., and Saygin, C., 2010. Mahalanobis Taguchi system (MTS) as a prognostics tool for rolling element bearing failures. Journal of Manufacturing Science and Engineering, 132(5). https://doi.org/10.1115/1.4002545.
Taguchi, G., and Jugulum, R., 2002. The Mahalanobis-Taguchi strategy: A pattern technology system. Hoboken: John Wiley & Sons.
Tatebayashi, K., Teshima, S., and Hasegawa, R., 2008. Introduction to MT System. JUSE Publishing Co. (in Japanese).
UCI, 2020. Dry Bean Dataset. Machine Learning Repository. [online] Available at: https://doi.org/10.24432/C50S4B, [Accessed 2023-12-10].
Yang, Y., and Liu, X., 1999. A re-examination of text categorisation methods. In: Proceedings of the 22nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 42-49. https://doi.org/10.1145/312624.312647.
Zhu, X., and Goldberg, A. B., 2009. Introduction to semi-supervised learning. Synthesis Lectures on Artificial Intelligence and Machine Learning, Brachman, R.J., Dietterich, T. ed. Kentfield: Morgan and Claypool Publishers, 3(1), 1-130.
Authors
Copyright (c) 2024 Katsuhiko Tateishi, Hiroki Iwamoto, Shinto Eguchi, Yasushi Nagata
This work is licensed under a Creative Commons Attribution 4.0 International License.
This is an open access journal which means that all content is freely available without charge to the user or his/her institution. Users are allowed to read, download, copy, distribute, print, search, or link to the full texts of the articles in this journal without asking prior permission from the publisher or the author. This is in accordance with the BOAI definition of open access. This journal is licensed under a Creative Commons Attribution 4.0 License - http://creativecommons.org/licenses/by/4.0.
Authors who publish with the Quality Innovation Prosperity agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work.