Online diagnosis of accidental faults for real-time embedded systems using a hidden Markov model

Abstract

This article proposes an approach for the online analysis of accidental faults for real-time embedded systems using hidden Markov models (HMMs). By introducing reasonable and appropriate abstraction of complex systems, HMMs are used to describe the healthy or faulty states of system’s hardware components. They are parametrized to statistically simulate the real system’s behavior. As it is not easy to obtain rich accidental fault data from a system, the Baum–Welch algorithm cannot be employed here to train the parameters in HMMs. Inspired by the principles of fault tree analysis and the maximum entropy in Bayesian probability theory, we propose to compute the failure propagation distribution to estimate the parameters in HMMs and to adapt the parameters using a backward algorithm. The parameterized HMMs are then used to online diagnose accidental faults using a vote algorithm integrated with a low-pass filter. We design a specific test bed to analyze the sensitivity, specificity, precision, accuracy and F1-score measures by generating a large amount of test cases. The test results show that the proposed approach is robust, efficient and accurate.

Keywords

Real-time embedded system simulation online diagnosis accidental fault hidden Markov model

Get full access to this article

View all access options for this article.

References

Avizienis

Laprie

Randell

. Basic concepts and taxonomy of dependable and secure computing. IEEE Trans Depend Secure Comput 2004; 1(1): 11–33.

Avizienis

Laprie

Randell

. Fundamental concepts of dependability. Technical report series, University of Newcastle upon Tyne, Computing Science, 2001.

Madan

Goševa-Popstojanova

Vaidyanathan

. A method for modeling and quantifying the security attributes of intrusion tolerant systems. Perform Eval 2004; 56(1): 167–186.

Gertler

. Fault detection and diagnosis in engineering systems, 1st edn. Boca Raton, FL: CRC Press, 1998.

Venkatasubramanian

Rengaswamy

Yin

. A review of process fault detection and diagnosis: Part I: Quantitative model-based methods. Comput Chem Eng 2003; 27(3): 293–311.

Isermann

Balle

. Trends in the application of model-based fault detection and diagnosis of technical processes. Control Eng Practice 1997; 5(5): 709–719.

Isermann

. Model-based fault-detection and diagnosis—status and applications. Ann Rev Control 2005; 29(1): 71–85.

Nakajima

Furukawa

Ueda

. Co-analysis of SYSML and Simulink models for cyber-physical systems design. In 2nd workshop on cyber-physical systems, networks, and applications, pp. 473–478.

Lee

. Cyber physical systems: Design challenges. In 11th IEEE international symposium on object oriented real-time distributed computing (ISORC). IEEE, pp. 363–369.

10.

Rabiner

Juang

. An introduction to hidden Markov models. IEEE ASSP Magazine 1986; 3(1): 4–16.

11.

Rabiner

. A tutorial on hidden Markov models and selected applications in speech recognition. Proc IEEE 1989; 77(2): 257–286.

12.

Elliott

Aggoun

Moore

. Hidden Markov Models: Estimation and Control (Applications of Mathematics). New York: Springer, 1995.

13.

Baum

. An equality and associated maximization technique in statistical estimation for probabilistic functions of Markov processes. Inequalities 1972; 3: 1–8.

14.

Viterbi

. Error bounds for convolutional codes and an asymptotically optimum decoding algorithm. IEEE Trans Informat Theory 1967; 13(2): 260–269.

15.

Clarke

Zuliani

. Statistical model checking for cyber-physical systems. In Bultan

Hsiung

(eds), Automated Technology for Verification and Analysis. New York: Springer, 2011, pp. 1–12.

16.

Boutros

Liang

. Detection and diagnosis of bearing and cutting tool faults using hidden markov models. Mech Syst Signal Process 2011; 25(6): 2102–2124.

17.

Tobon-Mejia

Medjaher

Zerhouni

. A data-driven failure prognostics method based on mixture of gaussians hidden Markov models. IEEE Trans Reliab 2012; 61(2): 491–503.

18.

Smyth

. Hidden Markov models for fault detection in dynamic systems. Pattern Recognition 1994; 27(1): 149–164.

19.

Ying

Kirubarajan

Pattipati

. A hidden Markov model-based algorithm for fault diagnosis with partial and imperfect tests. IEEE Trans Syst Man Cybernet C 2000; 30(4): 463–473.

20.

Hertz

Krogh

Palmer

. Introduction to the theory of neural computation ( Advanced book program , vol. 1). Reading, MA: Addison-Wesley, 1991.

21.

Silverman

. Density estimation for statistics and data analysis ( Chapman & Hall/CRC Monographs on Statistics & Applied Probability , vol. 26). Boca Raton, FL: CRC Press, 1986.

22.

Rosenblatt

. A central limit theorem and a strong mixing condition. Proc Natl Acad Sci USA 1956; 42(1): 43.

23.

Nakajima

Pantel

. Efficient online analysis of accidental fault localization for dynamic systems using hidden Markov model. In Proceedings of the Symposium on Theory of Modeling & Simulation-DEVS Integrative M&S Symposium. Society for Computer Simulation International, p. 16.

24.

Fielding

Bell

. A review of methods for the assessment of prediction errors in conservation presence/absence models. Environ Conserv 1997; 24(01): 38–49.

25.

Nakajima

Pantel

. Hidden Markov model based automated fault localization for integration testing. In 4th IEEE international conference on software engineering and service science (ICSESS). IEEE, pp. 184–187.