MT Method for Anomaly Detection and Classification using EM-λ Algorithm

Katsuhiko Tateishi (1), Hiroki Iwamoto (2), Shinto Eguchi (3), Yasushi Nagata (4)
(1) Waseda University, Japan,
(2) , Japan,
(3) , Japan,
(4) , Japan

Abstract

Purpose: In this paper, we propose a method to classify and detect normal, known anomalies, and unknown anomalies by combining the expectation–maximisation (EM-λ) algorithm and the Mahalanobis–Taguchi (MT) method.


Methodology/Approach: The proposed method learns normal data that are expected to be homogeneous and known abnormal data and performs classification and detection by parameter estimation using the EM-λ algorithm. Conventional methods perform analysis based on parameter estimation using the EM algorithm. However, the EM algorithm can degrade classification accuracy if it does not assume that the data fits the model's generative process.


Findings: We verify the performance of the proposed method using artificially generated data and real-world bean data for classification as data that do not satisfy this assumption. The validation results show up to 6% improvement over the conventional method in classification accuracy and unknown anomaly discrimination accuracy.


Research Limitation/implication: We try various patterns for the parameter of the proposed method in the verification. However, this way is computationally expensive.


Originality/Value of paper: Conventional methods perform analysis based on parameter estimation using the EM algorithm. Our proposal method seeks to improve accuracy by using the EM-λ algorithm for parameter estimation, which is expected to improve classification accuracy when the data do not conform to the generative assumptions of the EM algorithm's model.

Full text article

Generated from XML file

References

Genz, A., Bretz, F., Miwa, T., Mi, X., Leisch, F., Scheipl, F., Bornkamp, B., Maechler, M., and Hothorn, T., 2023. mvtnorm: Multivariate normal and

t distributions. [online] Available at: https://cran.r-project.org/web/packages/mvtnorm/mvtnorm.pdf, [Accessed 01 June 2023].

Honma, K., Ohkubo, M., Eguchi, S., and Nagata, Y., 2022. Mahalanobis-Taguchi Method for Anomaly Detection and Classification. Total Quality Science, 8(1), 1-13. https://doi.org/10.17929/tqs.8.1.

Jin, X., and Chow, T. W., 2013. Anomaly detection of cooling fan and fault classification of induction motor using Mahalanobis–Taguchi system. Expert Systems with Applications, 40(15), 5787-5795. https://doi.org/10.1016/j.eswa.2013.04.024.

Lee, Y. C., and Teng, H. L., 2009. Predicting the financial crisis by Mahalanobis–Taguchi system– Examples of Taiwan’s electronic sector. Expert Systems with Applications, 36(4), 7469-7478. https://doi.org/10.1016/j.eswa.2008.09.037.

Nigam, K., McCallum, A. K., Thrun, S., and Mitchell, T., 2000. Text classification from labeled and unlabeled documents using EM. Machine Learning, 39, 103-134. https://doi.org/10.1023/A:1007692713085.

Peel, D., and McLachlan, G. J., 2000. Robust mixture modelling using the

t distribution. Statistics and computing, 10, 339-348. https://doi.org/10.1023/A:1008981510081.

Soylemezoglu, A., Jagannathan, S., and Saygin, C., 2010. Mahalanobis Taguchi system (MTS) as a prognostics tool for rolling element bearing failures. Journal of Manufacturing Science and Engineering, 132(5). https://doi.org/10.1115/1.4002545.

Taguchi, G., and Jugulum, R., 2002. The Mahalanobis-Taguchi strategy: A pattern technology system. Hoboken: John Wiley & Sons.

Tatebayashi, K., Teshima, S., and Hasegawa, R., 2008. Introduction to MT System. JUSE Publishing Co. (in Japanese).

UCI, 2020. Dry Bean Dataset. Machine Learning Repository. [online] Available at: https://doi.org/10.24432/C50S4B, [Accessed 2023-12-10].

Yang, Y., and Liu, X., 1999. A re-examination of text categorisation methods. In: Proceedings of the 22nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 42-49. https://doi.org/10.1145/312624.312647.

Zhu, X., and Goldberg, A. B., 2009. Introduction to semi-supervised learning. Synthesis Lectures on Artificial Intelligence and Machine Learning, Brachman, R.J., Dietterich, T. ed. Kentfield: Morgan and Claypool Publishers, 3(1), 1-130.

Authors

Katsuhiko Tateishi
k.tateishi@akane.waseda.jp (Primary Contact)
Hiroki Iwamoto
Shinto Eguchi
Yasushi Nagata
Tateishi, K., Iwamoto, H., Eguchi, S., & Nagata, Y. (2024). MT Method for Anomaly Detection and Classification using EM-λ Algorithm. Quality Innovation Prosperity, 28(1), 1–14. https://doi.org/10.12776/qip.v28i1.1964

Article Details

Similar Articles

1 2 3 4 > >> 

You may also start an advanced similarity search for this article.

No Related Submission Found