This paper addresses the stochastic stability problem of positive Markov jump linear systems (PMJLSs). A necessary and sufficient condition of stochastic stability for PMJLSs is given which can be checked by solving linear programming feasibility problems due to the positivity property. A common co-positive Lyapunov function is constructed to solve the problem, and the equivalence among stochastic stability, 1-moment stability and exponential mean stability is proved afterwards. Considering the uncertain transition rates situation, PMJLSs with partially known transition rate matrix are investigated, and a necessary and sufficient condition for robust stochastic stability is proposed in linear programming form. Numerical examples are presented to show the effectiveness of the proposed results.
BolzernPColaneriP (2015) Positive Markov jump linear systems. Foundations and Trends in Systems and Control2(3–4): 275–427.
2.
BolzernPColaneriPNicolaoGD (2014) Stochastic stability of positive Markov jump linear systems. Automatica50(4): 1181–1187.
3.
BoukasEK (2007) Stochastic Switching Systems: Analysis and Design. London: Springer.
4.
ChangMH (1995) Weak infinitesimal generator for a stochastic partial differential equation with time delay. International Journal of Stochastic Analysis8(2): 115–138.
5.
ChenGYangY (2014) Finite-time stability of switched positive linear systems. International Journal of Robust and Nonlinear Control24(1): 179–190.
6.
ChenXLamJLamHK (2015) Positive filtering for positive Takagi–Sugeno fuzzy systems under l1 performance. Information Sciences299: 32–41.
7.
ChenXLamJLiPet al. (2013) l1-induced norm and controller synthesis of positive systems. Automatica49(5): 1377–1385.
8.
CostaOLVFragosoMarquesRP (2006) Discrete-Time Markov Jump Linear Systems. London: Springer.
9.
CostaOLVFragosoMTodorovMG (2012) Continuous-Time Markov Jump Linear Systems. London: Springer.
10.
DuBLamJZouYet al. (2013) Stability analysis of Markovian jump time-delay systems with partially unknown transition rates. IEEE Transactions on Circuits and Systems-I: Regular Papers60(2): 341–351.
11.
DuBLamJShuZet al. (2016) On reachable sets for positive linear systems under constrained exogenous inputs. Automatica74: 230–237.
12.
FarinaLRinaldiS (2000) Positive Linear Systems: Theory and Applications. New York: Wiley.
13.
FengXLoparoKAJiYet al. (1992) Stochastic stability properties of jump linear systems. IEEE Transactions on Automatic Control37(1): 38–53.
14.
FengZShiP (2017) Sliding mode control of singular stochastic Markov jump systems. IEEE Transactions on Automatic Control62(8): 4266–4273.
15.
GuoY (2016) Stabilization of positive Markov jump systems. Journal of the Franklin Institute353(14): 3428–3440.
16.
LiHShiPYaoD (2017) Adaptive sliding-mode control of Markov jump nonlinear systems with actuator faults. IEEE Transactions on Automatic Control62(4): 1933–1939.
17.
LiSXiangZ (2016) Stochastic stability analysis and l∞-gain controller design for positive Markov jump systems with time-varying delays. Nonlinear Analysis: Hybrid Systems22: 31–42.
18.
LiuX (2009) Constrained control of positive systems with delays. IEEE Transactions on Automatic Control54(7): 1596–1600.
19.
LiXLamJGaoHet al. (2016) H∞ and H2 filtering for linear systems with uncertain Markov transitions. Automatica67: 252–266.
20.
MaoX (1999) Stability of stochastic differential equations with Markovian switching. Stochastic Processes and Their Applications79(1): 45–67.
21.
MesquineFHmamedABenhayounMet al. (2015) Robust stabilization of constrained uncertain continuous-time fractional positive systems. Journal of the Franklin Institute352(1): 259–270.
22.
OguraMPreciadoVM (2016) Stability of Markov regenerative switched linear systems. Automatica69: 169–175.
23.
QiuLXuBLiS (2010) Stability analysis and controller design for networked control systems based on hidden Markov model. In: Proceedings of the 8th IEEE international conference on control and automation, Xiamen, China, June 2010, pp. 1316–1320.
24.
ShenJLamJ (2014) l∞-gain analysis for positive systems with distributed delays. Automatica50(1): 175–179.
25.
ShenJLamJ (2015a) h∞ model reduction for discrete-time positive systems with inhomogeneous initial conditions. International Journal of Robust and Nonlinear Control25(1): 88–102.
26.
ShenJLamJ (2015b) -gain analysis for positive linear systems with unbounded time-varying delays. IEEE Transactions on Automatic Control60(3): 857–862.
27.
ShenJLamJ (2015c) On static output-feedback stabilization for multi-input multi-output positive systems. International Journal of Robust and Nonlinear Control25(16): 3154–3162.
28.
ShenJLamJ (2016a) Static output-feedback stabilization with optimal L1-gain for positive linear systems. Automatica63: 248–253.
29.
ShenJLamJ (2016b) Stability and performance analysis for positive fractional-order systems with time-varying delays. IEEE Transactions on Automatic Control61(9): 2676–2681.
30.
ShenHWuZParkJH (2015) Reliable mixed passive and filtering for semi-Markov jump systems with randomly occurring uncertainties and sensor failures. International Journal of Robust and Nonlinear Control25(17): 3231–3251.
31.
ShenHZhuYZhangLet al. (2017) Extended dissipative state estimation for Markov jump neural networks with unreliable links. IEEE Transactions on Neural Networks and Learning Systems28(2): 346–358.
32.
SkorohodAV (1989) Asymptotic Methods in the Theory of Stochastic Differential Equations. Providence: American Mathematical Society.
33.
SongYYangJYangTet al. (2016) Almost sure stability of switching Markov jump linear systems. IEEE Transactions on Automatic Control61(9): 2638–2643.
34.
YinXLiZZhangLet al. (2016) Distributed state estimation of sensor-network systems subject to Markovian channel switching with application to a chemical process. IEEE Transactions on Systems, Man, and Cybernetics: Systems DOI: 10.1109/TSMC.2016.2632155. In press.
35.
ZhangJHanZZhuF (2014) Stochastic stability and stabilization of positive systems with Markovian jump parameters. Nonlinear Analysis: Hybrid Systems12: 147–155.
36.
ZhangLLamJ (2010) Necessary and sufficient conditions for analysis and synthesis of Markov jump linear systems with incomplete transition descriptions. IEEE Transactions on Automatic Control55(7): 1695–1701.
37.
ZhangLZhuYZhengW (2016) Synchronization and state estimation of a class of hierarchical hybrid neural networks with time-varying delays. IEEE transactions on neural networks and learning systems27(2): 459–470.
38.
ZhuSHanQZhangC (2014) l1-gain performance analysis and positive filter design for positive discrete-time Markov jump linear systems: A linear programming approach. Automatica50(8): 2098–2107.
39.
ZhuYZhongZZhengWet al. (2017) HMM-based filtering for discrete-time Markov jump LPV systems over unreliable communication channels. IEEE Transactions on Systems, Man, and Cybernetics: Systems DOI: 10.1109/TSMC.2017.2723038. In press.
