Abstract
In the field of system health monitoring, system performance degradation or fault occurrence will decrease the system reliability to some degree. However, traditional reliability analysis is of limited usefulness in evaluating the reliability of an individual product under dynamic operating and environmental conditions. In this case, research on performance reliability as well as real-time reliability has attracted extensive attentions. Considering the characteristics of fuzzy reliability theory, a performance reliability based on profust reliability theory has its advantage on tracking system’s continuous degradation. On the basis of our previous work, this paper proposes a modified profust-performance-reliability (PPR) algorithm as a supplement to the profust reliability based approach to prognostics and health management. In the modified PPR algorithm, the item of transition probability among system’s multi-states is replaced with the real-time distribution of system’s health status, which achieves an easier implementation of PPR’s calculation in practice with higher real-time capability and accuracy. Then, its application in the performance evaluation and prediction of dynamic systems are comprehensively proposed. Finally, a simulation of a quadrotor with partial loss of actuator effectiveness is presented to validate the availability and effectiveness of the proposed method.
Introduction
System health monitoring (SHM) has been highly concerned in the system engineering field, where information extracted from SHM can be used to understand the system behavior and improve the system utilization based on optimal component replacement and maintenance strategies [1]. In the field of SHM, the system degradation is identified by comparing the system’s real-time performance with its normal operational performance [2], and system degradation or fault occurrence will lead to a decrease of the system reliability. Thus, it is reasonable to relate the system reliability with its performance.
In the performance reliability research, the system degradation is firstly modeled based on the information extracted from some system or component variables which are highly correlated with the system performance [3–5]. Then, the performance reliability is defined and calculated with the distribution of system variables at a specific time index during the operation life. Reference [6] comprehensively reviewed the existing performance reliability analysis methods, which were classified into two types in terms of system degradation modeling method: the time series analysis [3, 4] and the regression analysis [7]. Besides the two methods above, some efforts have been made in the performance reliability research based on the stochastic process analysis and the filtering-based method [6–12]. In the stochastic process analysis, the system degradation path is modeled as a stochastic process, such as the Markov chain [8, 9], or the Wiener process [10, 11]. Then, the performance reliability is calculated using the Bayes’ theorem. For the filtering-based method, a system model containing system performance variables is always firstly obtained. Then, Kalman filtering [4] or particle filtering [6, 12] is employed to estimate and predict the distribution of performance variables, and the performance reliability is calculated on this basis. In [6], a modified particle filtering algorithm was proposed to estimate the system fault in a nonlinear model of a three-vessel water tank system. Then, the exponential smoothing method was effectively used to achieve fault prediction, and system’s performance reliability was calculated according to the fault prediction results by using the Monte Carlo strategy.
By reviewing the research above, a system or product is always considered to be failed when the corresponding performance variable reaches a predetermined and fixed threshold, and the performance reliability is defined on the binary failure threshold. Actually, a system evolving from normal to failure goes through a series of degradation states. It is inappropriate to characterize the system degradation with a fixed failure threshold. According to this, reference [13] defined the performance reliability based on an adaptive failure threshold and the distribution of performance degradation data. Comparing with a fixed failure threshold, an adaptive one is relatively flexible. Nevertheless, a definition of performance reliability based on a binary failure threshold is still of limited usefulness in characterizing the system continuous degradation to some degree, especially for a complex system which can work in a degraded condition. As a part of fuzzy reliability theory [14–21], profust reliability theory extends the traditional binary state space {0, 1} to the fuzzy state space [0, 1], and models fuzzy state transitions for a component or system representing various degrees of success and failure. Therefore, a performance reliability definition based on profust reliability theory has its advantage on tracking continuous degradation for a system or product. On the basis of [14, 15], a novel profust reliability algorithm was proposed in our previous paper [22], which can be viewed as a definition of performance reliability based on profust reliability theory, namely profust-performance-reliability (PPR) here. In [22], the implementation process of the system health evaluation and prediction was comprehensively presented by using the PPR as a health indicator, where transition probabilities among fuzzy system states acted as an essential role in the definition of PPR. For the PPR’s calculation, the transition probability among system’s multi-states was dynamically acquired in the PPR evaluation process based on statistical results rather than a predetermined and fixed value. This was more suitable in the real-time performance evaluation, but still inaccurate and insufficient to reflect the system degradation without abundant data samples. Furthermore, the PPR prediction process was based on the update of transition probabilities, which was somewhat complex to implement and time-consuming. This leads to an inconvenience of real-time SHM in engineering applications. Also, it should be noted that the PPR evaluation and prediction presented in [22] was a pure data-driven method, which may decrease the evaluation and prediction accuracy without taking the system model information into consideration.
For such a purpose, this paper proposes a modified PPR algorithm, where the item of transition probability among system’s multi-states is replaced with the real-time distribution of system’s health status. Then, the application of the proposed algorithm in the performance evaluation and prediction of dynamic systems is comprehensively proposed. For a dynamic system, the performance reliability has its ability to describe the system performance, whereas it is difficult to define and also difficult to calculate. In this paper, the performance reliability of the dynamic system is defined on the performance reliability of its system-state-variables (SSVs), where a single SSV’s performance reliability is calculated by the proposed PPR algorithm. In detail, for the system performance evaluation, Extended Kalman filtering (EKF) is firstly employed to estimate the real-time distribution of SSVs with a dynamic system model, where both the mean values and error variances of SSVs are obtained. Then, the real-time health status distribution of each SSV is obtained based on the estimated SSV’s distribution and its health status classification. On this basis, the performance reliability of each SSV is calculated with the modified PPR algorithm in real time, and the performance reliability of a dynamic system is evaluated by the results of each SSV’s PPR. For the process of system performance prediction, an exponential smoothing method is employed to predict the distribution of SSVs, and a similar PPR calculation process is performed.
In order to validate the availability and effectiveness of the proposed method, a simulation of a quadrotor with partial loss of actuator effectiveness is presented. A quadrotor is a multirotor helicopter that is lifted and propelled by four rotors. It is classified as rotorcraft, as opposed to fixed-wing aircraft, because their lift is generated by a set of rotors (vertically oriented propellers). By changing the speed of each rotor it is possible to specifically generate a desired total thrust; to locate for the center of thrust both laterally and longitudinally; and to create a desired total torque, or turning force. Recently, more and more quadrotors are adopted in both military and civil applications such as search and rescue, border patrol, military surveillance and agricultural production. A fault or failure in any part of the quadrotor may lead to catastrophic disasters. Therefore, in order to ensure safety, it is necessary for a quadrotor to have a performance evaluation and prediction module so that it can automatically change the control strategy and mission planning after detecting a performance anomaly.
This paper makes three major contributions. First, this paper proposes a modified system performance evaluation and prediction method based on profust reliability theory, which is a supplement to the profust reliability based approach to Prognostics and Health Management (PHM) presented in [22]. Compared to our previous work [22], the modified PPR algorithm is easier to implement with a higher real-time capability and accuracy in practice. Secondly, this paper applies the modified PPR-based PHM approach to practical dynamic systems, where the comprehensive process of the system performance evaluation and prediction method is put forward. This work characterizes the performance of a dynamic system and its SSVs with a unified health indicator, namely PPR. Thirdly, the modified PPR-based system performance evaluation and prediction method takes model information of the studied objective into account, which is an improvement of a pure data-driven method presented in [22].
The remainder of this paper is organized as follows. Section 2 proposes the theory of the modified PPR algorithm. Section 3 presents the whole implementation process of the performance evaluation and prediction of dynamic systems. Section 4 uses a case of quadrotor with partial loss of actuator effectiveness to simulate the proposed algorithm presented in Section 2 and the implementation process presented in Section 3, where simulation results are given and discussed. Section 5 gives a conclusion, and indicates future development of the proposed method.
Theory of modified PPR algorithm
For a discrete domain U ={ S1, S2, ⋯ S
n
}. In the domain U, fuzzy success states are defined as
For the purpose of real-time performance monitoring, reference [22] proposed a new profust reliability definition. Define fuzzy events A is {T SF does not occur during time interval [t0, t]}, and B is {The system performance is in fuzzy success state at initial time t0}.Then, For S i , S j ∈ U, and a time interval [t0, t], the profust reliability R (t) is defined as (1) at the bottom of the page [22]. In (1), φ S i (t0) is the health state probability of state S i at time t0. Here, the time interval [t0, t] can be viewed as a sliding calculation interval during the real-time reliability calculation.
Before developing further, an assumption is introduced. Without loss of generality, let μ F (S n ) ≤ μ F (Sn-1) ≤ ⋯ ≤ μ F (S2) ≤ μ F (S1).
During the process of real-time PPR calculation, the system performance might be in a fully successful status, or operate in a degraded level at the start point t0 of the calculation interval. Theorem 1 covers all situations that might appear at the beginning of the evaluation interval. Based on Theorem 1, two corollaries are further obtained.
Then, the PPR is
Furthermore, if μ F (S n ) = 0, the PPR is
For the purpose of performing the modified PPR algorithm on engineering applications, a process of performance evaluation and prediction for dynamic systems is comprehensively presented.
Problem formulation
The following nonlinear discrete time dynamic system is considered in this part,
Considering the tight connection between the system performance and the system reliability, the main objective of this part is to evaluate and predict the performance reliability of dynamic systems based on the modified PPR algorithm as shown in Section 2. In practice, the performance of a dynamic system will be reflected in the variation of SSVs. Therefore, a definition of the performance reliability of dynamic systems should be given on this basis. In this paper, for system (5), the performance reliability at time t
k
is defined as
The PPR of other SSVs in
So far, the main task in this part is to calculate the PPR of each SSV. In (7), PPR is mainly defined with the real-time health status distribution, which cannot be directly acquired from the unknown value of a SSV. Thus, the main difficulty in this process is how to obtain the real-time distribution of the SSV, and further the real-time distribution of SSV’s health status. In this paper, EKF and the exponential smoothing method are employed to estimate and predict the real-time distribution of SSVs, respectively, where both the mean values and error variances of SSVs are obtained. Then, the real-time health status distribution of each SSV is obtained based on the obtained SSV’s distribution and its health status classification.
To evaluate the performance of the dynamic system presented in (5), following steps are required as shown in Fig. 1.
In the presented procedure, the PPR of each SSV is firstly calculated, and then the performance of the dynamic system is evaluated according to (6). For the process of PPR calculation of a single SSV, EKF is firstly employed to estimate the real-time distribution of the SSV, where both the mean value and error variance of the SSV are obtained. Then, considering the true but unknown value of the SSV at a specific time index conforms to a normal distribution, the real-time health status distribution of the SSV can be obtained based on the estimation results of the SSV and its health status classification. On this basis, the PPR of the studied SSV is calculated in real time with the proposed PPR algorithm presented in Section 2. Here, a specific SSV x
m
∈
Real-time distribution estimation of SSV
In order to acquire the estimate of the system state vector
According to the results of EKF, it is obtained that
Suppose x
m
∈ [a, b], the health status of SSV can be classified into discrete health states according to the value of x
m
,
From the former two steps, the real-time distribution of x m (t k ), and its health status classification are obtained. On this basis, its real-time health status distribution is obtained in the following.
For i = 2, 3, ⋯ , n, combining (10), (11), and (12), Equation (14) at the bottom of the page can be obtained, where Φ is denoted as the cumulative distribution function of standard normal distribution [24]. For the case i = 1,
To sum up, Equation (15) at the bottom of the page can be obtained.
Following the above steps, Equation (2) can be directly employed to calculate the PPR of x m . Note that the PPR of other SSVs can be also calculated following the above steps.
System performance reliability calculation
Following the PPR algorithm of a single SSV, the PPR calculation results of all SSVs in (5) are obtained in real time as
For a specific evaluation interval [t0, t k ], the procedure of the system performance evaluation at time t k of the dynamic system (5) with performing the modified PPR algorithm is summarized as shown in Table 1.
Performance prediction of dynamic systems
The process of the system performance prediction is similar to the evaluation process presented above. The PPR of each SSV is firstly predicted, and then the system performance is determined with the predicted value of the system performance reliability.
Here, the SSV x
m
is further cited as an example. In order to predict the PPR of x
m
at a future time index tk+l, the distribution of x
m
should be firstly predicted as
By following the above steps, for the system (5), the PPR prediction result of all SSVs can be obtained. Then, the system performance reliability at time tk+l is predicted as shown in (18) at the bottom of the next page.
In the PPR prediction process of a single SSV, the most critical part is to accurately predict the distribution of the SSV. Here, multiple methods can be employed to predict the distribution of the SSV as stated in (19). The Holt-Winters double exponential smoothing [3] is implemented here as an alternative method to perform short-term prediction. For the SSV x
m
, given the results from EKF in (9), the smoothed value of SSV is computed as
For a specific prediction interval [t k , tk+l], the procedure of the system performance prediction at time tk+l with performing the modified PPR algorithm is summarized as shown in Table 2.
In this section, a simulation of a quadrotor with partial loss of actuator effectiveness is presented to validate the availability and effectiveness of the proposed PPR-based performance evaluation and prediction method.
Quadrotor model
Scholars have studied the dynamics of quadrotor [25–29]. Equation (20) presents a general dynamic model:
To obtain the discrete dynamic model of the presented quadrotor, Equation (20) is discretized through the Euler method [30]. Considering the system noise and measurement noise, the discrete model is written as
The parameters of the studied quadrotor is shown in Table 3.
In this simulation, the quadrotor is required to perform a persistent surveillance mission. It is desired that the quadrotor hovers at a height of 10m, while the attitude angles remains stable.
In the studied hovering maneuver, the roll, pitch, yaw angle, and the position component in z-direction can totally reflect the quadrotor’s performance. In this case, according to (6), the quadrotor’s performance reliability is given with two alternative forms as
Considering the hovering characteristics, trapezoidal membership functions are selected as the fuzzy success function of the SSVs. The functions of μ S (φ) , μ S (θ) , μ S (ψ) , μ S (z), and the corresponding health status classification are presented in Appendix D.
For the performance evaluation and prediction of the quadrotor, three scenarios are presented here to validate the effectiveness of the proposed PPR-based method, including a fault-free scenario, a fixed-fault scenario, and a gradual-degradation scenario. In all the scenarios, the simulation step T is set to be 0.1s, and the total simulation time is 80s.
In this part, the rotors of quadrotors are completely healthy. Thus, in (22), we have
Figure 2 shows the variations of the SSVs φ, θ, ψ, z estimated by EKF. With performing the proposed PPR-based algorithm, the system performance is evaluated per 0.2 second ([t0, t k ] in Theorem 1) as depicted in Fig. 3.
Fixed-fault scenario
In this part, the two of four rotors of quadrotors confront to fixed partial loss of effectiveness. In (22), for t
k
∈ [0, 30], let
Such kind of fault may happen due to severe weather conditions damaging the rotors or physical collision with obstacles [25].
Under this scenario, Fig. 4 shows the variations of the SSVs φ, θ, ψ, z estimated by EKF. With performing the proposed PPR-based algorithm, the system performance is also evaluated per 0.2 second as depicted in Fig. 5. It should be noted that the PPRs of θ and ψ keep at 1. That is because although there also exists deviation of the variation of θ and ψ, the deviation is tolerant according to the configuration of the employed membership functions. If it is required to improve sensitivity to the emerged fault, thresholds of membership functions might be adjusted according to engineering requirements.
Gradual-degradation scenario
In this part, the two of four rotors of quadrotors confront to gradual-degradation of effectiveness. In (22), this phenomenon is addressed as follows:
Such kind of gradual-degradation may be caused by continuous wear or corrosion in the lifecycle, which is independent of fault occurrence. Actually, this part can be viewed as a simulation of accelerated aging experiment of quadrotors.
Under this scenario, Fig. 6 shows the variations of the SSVs φ, θ, ψ, z estimated by EKF. Furthermore, the calculated PPRs of φ, θ, ψ, z, and the quadrotor are depicted in Fig. 7.
In order to validate the proposed PPR-based performance prediction method, a 10-step SSVs’ prediction is implemented by the Holt-Winters double exponential smoothing method. Then, the PPR is predicted in short-term based on the predicted distribution of SSVs. Figure 8 shows the 10-step prediction result of the SSVs φ, θ, ψ, z, and the corresponding PPR prediction result is depicted in Fig. 9. Note that a few data points that have not converged at the initial stage of prediction process are ignored here.
Summary
A simulation of quadrotor with partial loss of actuator effectiveness is presented to validate the availability and effectiveness of the proposed PPR-based performance evaluation and prediction method. In this simulation, a quadrotor’s dynamic model is firstly presented. Then, the PPR-based system performance evaluation method is implemented under a fault-free scenario, a fixed-fault scenario, and a gradual-degradation scenario, respectively. Furthermore, the system performance is predicted in short-term under the gradual-degradation. The simulation results show that the system performance can be effectively evaluated by the proposed PPR-based algorithm. Meanwhile, the proposed PPR-based system performance prediction method is also easy to implement and effective with a high accuracy.
Conclusion
This paper proposes a modified PPR algorithm, which is then applied to the performance evaluation and prediction of dynamic systems. The simulation results show that the PPR is effectively evaluated to characterize the system performance, and the PPR prediction is also effectively achieved with tolerant errors. The advantages of the PPR based performance evaluation and prediction method presented in this paper are summarized in four aspects. First of all, the PPR has an ability to monitor real-time performance, and the modified PPR algorithm presented in this paper is convenient to implement in practice with higher real-time capability. Secondly, the SSV’s real-time distribution obtained by EKF is used in PPR calculation rather than a single value, which reduces the uncertainties caused by system noise, observation noise and external disturbance. Thirdly, during the performance evaluation of dynamic systems by the proposed PPR algorithm, the system performance is determined on an integration of all SSVs’ performance, which obtains a more comprehensive evaluation result. Finally, the modified PPR-based performance evaluation and prediction method is applied to a quadrotor in the simulation part. Actually, the proposed method can be also applied to other dynamic systems following the procedures presented in this paper. This indicates that the proposed PPR algorithm has some degree of flexibility and robustness in performance evaluation and prediction. In future research, different prediction methods of SSVs distributions will be incorporated into the proposed PPR framework to satisfy system performance prediction under other fault patterns. Furthermore, the proposed method will be applied to the performance evaluation of other dynamic systems.
Footnotes
Appendix
Acknowledgments
This work was supported by the National Natural Science Foundation of China under Grant 61473012.
