Abstract
Markovian jump systems are a special class of hybrid and stochastic systems which can be used to describe many real world applications, such as manufacturing systems, power systems, chemical systems, economic systems, communication and control, etc. In this paper, a survey on recent developments of modeling, analysis and design of Markovian jump systems is presented. First, stability issues on Markovian jump systems are addressed. Then a variety of control and filter design methods are systematically recalled. Furthermore, the new trends of Markovian jump systems with uncertain transition rates as well as semi-Markovian jump systems are also discussed.
Similar content being viewed by others
References
M. S. Mahmoud and P. Shi, Methodologies for Control of Jump Time-Delay Systems, Kluwer Academic Publishers, Boston, 2003.
M, Aoki, “Optimal control of partially observable Markovian systems,” J. Franklin Inst., vol. 280, no. 5, pp. 367–386, 1965.
W. P. Blair and D. D. Sworder, “Feedback control of a class of linear discrete systems with jump parameters and quadratic cost criteria,” Int. J. Contr., vol. 21, no. 5, pp. 833–841, 1975.
H. J. Chizeck, A. S. Willsky, and D. Castanon, “Discrete-time Markovian-jump linear quadratic optimal control,” Int. J. Contr., vol. 43, no. 1, pp. 213–231, 1986.
W. Gersch and F. Kozin, “Optimal control of multiplicatively perturbed Markov stochastic systems,” Proc. 1st Ann. Allerton Conf., (Urbana, Ill.), pp. 621–631, 1963.
D. D. Sworder, “Feedback control of a class of linear systems with jump parameters,” IEEE Trans. Automat. Contr., vol. AC-14, no. 1, pp. 9–14, 1969.
W. P. Blair and D. D. Sworder, “Feedback control of a class of linear discrete systems with jump parameters and quadratic cost criteria,” Int. J. Control, vol. 21, pp. 833–844, 1975.
D. O. Cajueiro, Stochastic Optimal Control of Jumping Markov Parameter Processes With Applications To Finance, Ph.D. Thesis, Instituto Tecnológico de Aeronáutica-ITA, Brazil, 2002.
L. E. O. Svensson and N. Williams, “Optimal monetary policy under uncertainty: a Markov jump linear-quadratic approach,” Federal Reserve of St. Louis Review, vol. 90, pp. 275–293, 2008.
W. S. Gray, O. R. González, and M. Doğan, “Stability analysis of digital linear flight controllers subject to electromagnetic disturbances,” IEEE Aerosp. Electron. Syst. Mag., vol. 36, pp. 1204–1218, 2000.
L. Li, V. A. Ugrinovskii, and R. Orsi, “Decentralized robust control of uncertain Markov jump parameter systems via output feedback,” Automatica, vol. 43, pp. 1932–1944, 2007.
K. A. Loparo and F. Abdel-Malek, “A probabilistic mechanism to dynamic power system security,” IEEE Trans. Circuits Syst., vol. 37, pp. 787–798, 1990.
V. A. Ugrinovskii and H. R. Pota, “Decentralized control of power systems via robust control of uncertain Markov jump parameter systems,” Int. J. Control, vol. 78, pp. 662–677, 2005.
O. L. V. Costa, M. D. Fragoso, and M. G. Todorov, Continuous-Time Markov Jump Linear Systems, Springer, 2013.
F. Abdollahi and K. Khorasani, “A decentralized Markovian jump H ∞ control routing strategy for mobile multi-agent networked systems,” IEEE Trans. Circuits Syst., vol. 19, pp. 269–283, 2011.
K. You, M. Fu, and L. Xie, “Mean square stability for Kalman filtering with Markovian packet losses,” Automatica, vol. 47, no. 12, pp. 2647–2657, 2011.
E. K. Boukas and H. Yang, “Exponential stabilizability of stochastic systems with Markovian jumping parameters,” Automatica, vol. 35, no. 8, pp. 1437–1441, 1999.
E. K. Boukas, Stochastic Switching Systems: Analysis and Design. Boston: Birkhauser, 2005.
Y. Cao and J. Lam, “Stochastic stabilizability and H ∞ control for discrete-time jump linear systems with time delay,” J. Franklin Inst., vol. 336, no. 8, pp. 1263–1281, 1999.
C. E. de Souza, “Robust stability and stabilization of uncertain discrete time Markovian jump linear systems,” IEEE Trans. Autom. Control, vol. 51, no. 5, pp. 836–841, 2006.
H. Gao, J. Lam, S. Xu, and C. Wang, “Stabilization and H ∞ control of two-dimensional Markovian jump systems,” IMA J. Appl. Math., vol. 21, no. 4, pp. 377–392, 2004.
Y. Ji and H. J. Chizeck, “Controllability, stabilizability and continuous-time Markovian jump linear quadratic control,” IEEE Trans. Automat. Contr., vol. 35, no. 7, pp. 777–788, 1990.
X. Mao and C. Yuan, Stochastic Differential Equations with Markovian Switching. London: Imperial College Press, 2006.
P. Shi, E. K. Boukas, and R. K. Agarwal, “Control of Markovian jump discrete-time systems with norm bounded uncertainty and unknown delay,” IEEE Trans. Automat. Contr., vol. 44, no. 11, pp. 2139–2144, 1999.
P. Shi, E. K. Boukas, and Y. Shi, “On stochastic stabilization of discrete-time Markovian jump systems with delay in state,” Stoch. Anal. Appl., vol. 21, no. 4, pp. 935–951, 2003.
M. Sun, J. Lam, S. Xu, and Y. Zou, “Robust exponential stabilization for Markovian jump systems with mode-dependent input delay,” Automatica, vol. 43, no. 10, pp. 1799–1807, 2007.
Z. Wang, H. Qiao, and K. J. Burnham, “On stabilization of bilinear uncertain time-delay stochastic systems with Markovian jumping parameters,” IEEE Trans. Autom. Control, vol. 47, no. 4, pp. 640–646, 2002.
J. Xiong, J. Lam, H. Gao, and D. W. C. Ho, “On robust stabilization of Markovian jump systems with uncertain switching probabilities,” IEEE Trans. Autom. Contr., vol. 41, no. 5, pp. 897–903, 2005.
J. Xiong and J. Lam, “Stabilization of discretetime Markovian jump linear systems via timedelayed controllers,” Automatica, vol. 42, no. 5, pp. 747–753, 2006.
M. Mariton, Jump Linear Systems in Automatic Control, Marcel Dekker, New York, 1990.
G. K. Basak, A. Bisi, and M. K. Ghosh, “Stability of a random diffusion with linear drift,” J. Math. Anal. Appl., vol. 202, pp. 604–622, 1996.
X. Mao, “Stability of stochastic differential equations with Markovian switching,” Stoch. Proc. Appl., vol. 79, pp. 45–67, 1999.
L. Shaikhet, “Stability of stochastic hereditary systems with Markov switching,” Theory Stoch. Proc., vol. 2, no. 18, pp. 180–184, 1996.
X. Mao, A. Matasov, and A. B. Piunovskiy, “Stochastic differential delay equations with Markovian switching,” Bernoulli, vol. 6, no. 1, pp. 73–90, 2000.
H. Wu and J. Sun, “p-Moment stability of stochastic differential equations with impulsive jump and Markovian switching,” Automatica, vol. 42, no. 10, pp. 1753–1759, 2006.
X. Feng, K. A. Loparo, Y. Ji, and H. J. Chizeck, “Stochastic stability properties of jump linear systems,” IEEE Trans. Automat. Contr., vol. 37, no. 1, pp. 38–53, 1992.
F. Kozin and S. Sugimoto, “Relations between sample and moment stability for linear stochastic differential equations,” Proc. Conf. Stoch. Diff. Eqn., D. Mason, Ed., Academic, New York, 1977.
Z. Hou, J. Luo, P. Shi, and S. K. Nguang, “Stochastic stability of Itô differential equations with semi-Markovian jump parameters,” IEEE Trans. Autom. Control, vol. 51, no. 8, pp. 1383–1387, 2006.
O. L. V. Costa, E. O. Assumpcao, E. K. Boukas, and R. P. Marques, “Constrained quadratic state feedback control of discrete-time Markovian jump linear systems,” Automatica, vol. 35, no. 4, pp. 617–626, 1999.
L. Hu, P. Shi, and P. M. Frank, “Robust sampleddata control for Markovian jump linear systems,” Automatica, vol. 42, no. 11, pp. 2025–2030, 2006.
F. Kozin, “On relations between moment properties and almost sure Lyapunov stability for linear stochastic systems,” J. Math. Anal. Appl., vol. 10, pp. 324–353, 1965.
F. Kozin, “A survey of stability of stochastic systems,” Automatica, vol. 5, pp. 95–112, 1969.
Y. Ji, H. J. Chizeck X. Feng, and K. A. Loparo, “Stability and control of discrete-time jump linear systems,” Control Theory Adv. Tech., vol. 7, no. 2, pp. 247–270, 1991.
O. L. V. Costa and M. D. Fragoso, “Stability results for discrete-time linear-systems with Markovian jumping parameters,” J. Math. Appl. Appl., vol. 179, no. 1, pp. 154–178, 1993.
O. L. V. Costa, M. D. Fragoso, and R. P. Marques, Discrete-Time Markov Jump Linear Systems, Springer, 2006.
V. Morio, F. Cazaurang, and P. Vernis, “Flatnessbased hypersonic reentry guidance of a liftingbody vehicle,” Control Eng. Pract., vol. 17, no. 5, pp. 588–596, 2009.
M. Liu, D. W. C. Ho and Y. Niu, “Stabilization of Markovian jump linear system over networks with random communication delay,” Automatica, vol. 45, no. 2, pp. 416–421, 2009.
C. E. D. Souza, A. Trofino, and K. A. Barbosa, “Mode-independent H ∞ filters for Markovian jump linear systems,” IEEE Trans. Autom. Contr., vol. 51, no. 11, pp. 1837–1841, 2006.
B. Du, J. Lam, Y. Zou, and Z. Shu, “Stability and stabilization for Markovian jump time-delay systems with partially unknown transition rates,” IEEE Trans. Circuits Syst. I Regul. Pap., vol. 60, no. 2, pp. 341–351, 2013.
L. Zhang, E. K. Boukas, and J. Lam, “Analysis and synthesis of Markov jump linear systems with time-varying delay and partially known transition probabilities,” IEEE Trans. Autom. Contr., vol. 53, no. 10, pp. 2458–2464, 2008.
L. Zhang and E. K. Boukas, “Mode-dependent H ∞ filtering for discrete-time Markovian jump linear systems with partly unknown transition probabilities,” Automatica, vol. 45, no. 6, pp. 1462–1467, 2009.
L. Zhang and E. K. Boukas, “Stability and stabilization of Markovian jump linear systems with partially unknown transition probability,” Automatica, vol. 45, no. 2, pp. 463–468, 2009.
X. Liu and H. Xi, “On exponential stability of neutral delay Markovian jump systems with nonlinear perturbations and partially unknown transition rates,” Int. J. Control Autom. Syst., vol. 12, no. 1, pp. 1–11, 2014.
P. Zhang, J. Cao, and G. Wang, “Modeindependent guaranteed cost control of singular Markovian delay jump systems with switching probability rate design,” Int. J. Innov. Comput. Inf. Control, vol. 10, no. 4, pp. 1291–1303, 2014.
Z. Lin, J. Liu, W. Zhang, and Y. Niu, “Stabilization of interconnected nonlinear stochastic Markovian jump systems via dissipativity approach,” Automatica, vol. 47, no. 12, pp. 2796–2800, 2011.
M. Liu, P. Shi, L. Zhang, and X. Zhao, “Faulttolerant control for nonlinear Markovian jump systems via proportional and derivative sliding mode observer technique,” IEEE Trans. Circuits Syst. Regul. Pap., vol. 58, no. 11, pp. 2755–2764, 2011.
X. Yao and L. Guo, “Composite anti-disturbance control for Markovian jump nonlinear systems via disturbance observer,” Automatica, vol. 49, no. 8, pp. 2538–2545, 2013.
H. Bo and G. Wang, “General observer-based controller design for singular Markovian jump systems,” Int. J. Innov. Comput. Inf. Control, vol. 10, no. 5, pp. 1897–1913, 2014.
J. Wen, L. Peng, and S. K. Nguang, “Receding horizon control for constrained jump bilinear systems,” Int. J. Innov. Comput. Inf. Control, vol. 8, no. 12, pp. 8501–8514, 2012.
E. K. Boukas, “H ∞ control of discrete-time Markov jump systems with bounded transition probabilities,” Optim. Control Appl. Met., vol. 30, no. 5, pp. 477–494, 2009.
S. Aberkane, “Stochastic stabilization of a class of nonhomogeneous Markovian jump linear systems,” Syst. Control Lett., vol. 60, no. 3, pp. 156–160, 2011.
J. Wen, L. Peng, and S. K. Nguang, “Finite-time control for discrete-time Markovian jump systems with deterministic switching and time-delay,” Int. J. Control Autom. Syst., vol. 12, no. 3, pp. 473–485, 2014.
O. L. V. Costa, J. B. R. do Val, and J. C. Geromel, “Continuous-time state-feedback H 2-control of Markovian jump linear system via convex analysis,” Automatica, vol. 35, no. 2, pp. 259–268, 1999.
J. B. R. do Val, J. C. Geromel, and A. P. C. Goncalves, “The H 2-control of jump linear systems: cluster observations of the Markov state,” Automatica, vol. 38, no. 2, pp. 343–349, 2002.
E. K. Boukas, P. Shi, and S. K. Nguang, “Robust H ∞ control for linear Markovian jump systems with unknown nonlinearities,” J. Math. Appl. Appl., vol. 282, no. 1, pp. 241–255, 2003.
Z. Wu, H. Su, and J. Chu, “Delay-dependent H ∞ control for singular Markovian jump systems with time delay,” Optim. Control Appl. Met., vol. 30, no. 5, pp. 443–461, 2009.
C. E. de Souza and M. D. Fragoso, “H ∞ filtering for Markovian jump linear systems,” Int. J. Syst. Sci., vol. 33, no. 11, pp. 909–915, 2002.
C. E. de Souza and M. D. Fragoso, “H ∞ filtering for discrete-time linear systems with Markovian jumping parameters,” Int. J. Robust Nonlinear Control, vol. 13, no. 14, pp. 1299–1316, 2003.
Z. Wu, H. Su, and J. Chu, “H ∞ filtering for singular Markovian jump systems with time delay,” Int. J. Robust Nonlinear Control, vol. 20, no. 8, pp. 939–957, 2010.
P. Shi and S. P. Shue, “Robust H ∞ control for linear discrete-time systems with norm-bounded nonlinear uncertainties,” IEEE Trans. Automat. Contr., vol. 44, no. 1, pp. 108–111, 1999.
Y. Cao and J. Lam, “Robust H ∞ control of uncertain Markovian jump systems with time delay,” IEEE Trans. Autom. Control, vol. 45, no. 1, pp. 77–83, 2000.
J. Lam, Z. Shu, S. Xu, and E. K. Boukas, “Robust H ∞ control of descriptor discrete-time Markovian jump systems,” Int. J. Control, vol. 80, no. 3, pp. 374–385, 2007.
L. Wu, X. Su, and P. Shi, “Sliding mode control with bounded l 2 gain performance of Markovian jump singular time-delay systems,” Automatica, vol. 48, no. 8, pp. 1929–1933, 2012.
Z. Chen and Q. Huang, “Exponential L 2 — L 8 filtering for a class of stochastic system with Markovian jump parameters and mixed mode-dependent time-delays,” Int. J. Control Autom. Syst., vol. 12, no. 3, pp. 552–563, 2014.
L. Wu, P. Shi, and H. Gao, “State estimation and sliding-mode control of Markovian jump singular systems,” IEEE Trans. Automat. Contr., vol. 55, no. 5, pp. 1213–1219, 2010.
L. Wu, P. Shi, H. Gao, and C. Wang, “H ∞ filtering for 2D Markovian jump systems,” Automatica, vol. 44, no. 7, pp. 1849–1858, 2008.
J. Liu, Z. Gu, and S. Hu, “H ∞ filtering for Markovian jump systems with time-varying delays,” Int. J. Innov. Comput. Inf. Control, vol. 7, no. 3, pp. 1299–1310, 2011.
P. Shi, E. K. Boukas, and R. K. Agarwal, “Kalman filtering for continuous-time uncertain systems with Markovian jumping parameters,” IEEE Trans. Autom. Control, vol. 44, no. 8, pp. 1592–1597, 1999.
P. Shi, M. Mahmoud, S. Nguang, and A. Ismail, “Robust filtering for jumping systems with modedependent delays,” Signal Process., vol. 86, no. 1, pp. 140–152, 2006.
Z. Wang, J. Lam, and X. Liu, “Robust filtering for discrete-time Markovian jump delay systems,” IEEE Signal Process Lett., vol. 11, no. 8, pp. 659–662, 2004.
S. Xu, T. Chen, and J. Lam, “Robust H ∞ filtering for uncertain Markovian jump systems with modedependent time-delays,” IEEE Trans. Autom. Control, vol. 48, no. 5, pp. 900–907, 2003.
X. Yao, L. Wu, W. X. Zheng, and C. Wang, “Robust H ∞ filtering of Markovian jump stochastic systems with uncertain transition probabilities,” Int. J. Syst. Sci., vol. 42, no. 7, pp. 1219–1230, 2011.
X. Yao, L. Wu, W. X. Zheng, and C. Wang, “Quantized H ∞ filtering for Markovian jump LPV systems with intermittent measurements,” Int. J. Robust Nonlinear Control, vol. 23, no. 1, pp. 1–14, 2013.
H. Liu, D. W. C. Ho, and F. Sun, “Design of H ∞ filter for Markov jumping linear systems with nonaccessible mode information,” Automatica, vol. 44, no. 10, pp. 2655–2660, 2008.
Z. Wu, P. Shi, H. Su, and J. Chu, “l ∞–l ∞ filter design for discrete-time singular Markovian jump systems with time-varying delays,” Inform. Sciences, vol. 181, no. 24, pp. 5534–5547, 2011.
A. P. C. Goncalves, A. R. Fioravanti, and J. C. Geromel, “H ∞ filtering of discrete-time Markov jump linear systems through linear matrix inequalities,” IEEE Trans. Automat. Contr., vol. 54, no. 6, pp. 1347–1351, 2009.
N. Meskin and K. Khorasani, “Fault detection and isolation of discrete-time Markovian jump linear systems with application to a network of multiagent systems having imperfect communication channels,” Automatica, vol. 45, no. 9, pp. 2032–2040, 2009.
M. Nader and K. Khashayar, “A geometric approach to fault detection and isolation of continuous-time Markovian jump linear systems,” IEEE Trans. Autom. Control, vol. 55, no. 6, pp. 1343–1357, 2010.
L. Wu, X. Yao, and W. X. Zheng, “Generalized H 2 fault detection for Markovian jumping two-dimensional systems,” Automatica, vol. 48, no. 8, pp. 1741–1750, 2012.
X. Yao, L. Wu, and W. X. Zheng, “Fault detection filter design for Markovian jump singular systems with intermittent measurements,” IEEE Trans. Signal Process., vol. 59, no. 7, pp. 3099–3109, 2011.
M. Zhong, J. Lam, S. X. Ding, and P. Shi, “Robust fault detection of Markovian jump systems,” Circ. Syst. Signal Pr., vol. 23, no. 5, pp. 387–407, 2004.
M. Zhong, H. Ye, P. Shi, and G. Wang, “Fault detection for Markovian jump systems,” IEE Proc. Control Theor. Appl., vol. 152, no. 4, pp. 397–402, 2005.
S. He, “Fault estimation for T-S fuzzy Markovian jumping systems based on the adaptive observer,” Int. J. Control Autom. Syst., vol. 12, no. 5, pp. 977–985, 2014.
G. Kotsalis, A. Megretski and M. A. Dahleh, “Model reduction of discrete-time Markov jump linear systems,” Proc. of the American Control Conference, Minneapolis, Minnesota, USA, June 14–16, 2006, pp. 454–459.
L. Zhang, B. Huang, and J. Lam, “H ∞ model reduction of Markovian jump linear systems,” Syst. Control Lett., vol. 50, no. 2, pp. 103–118, 2003.
Y. Xia and Y. Jia, “Robust sliding mode control of uncertain time-delay systems: An LMI approach,” IEEE Trans. Automat. Contr., vol. 48, no. 6, pp. 1986–1092, 2003.
C. Y. Chan, “Discrete adaptive sliding mode control of a class of stochastic systems,” Automatica, vol. 35, no. 8, pp. 1491–1498, 1999.
Y. Niu, D. W. C. Ho, and J. Lam, “Robust integral sliding mode control mode control for uncertain stochastic systems with time-varying delay,” Automatica, vol. 41, no. 5, pp. 873–880, 2005.
P. Shi, Y. Xia, G. P. Liu, and D. Rees, “On designing of sliding-mode control for stochastic jump systems,” IEEE Trans. Autom. Control, vol. 51, no. 1, pp. 97–103, 2006.
B. Chen, J. Huang, and Y. Niu, “Sliding mode control for Markovian jumping systems with actuator nonlinearities,” Int. J. Syst. Sci., vol. 43, no. 4, pp. 656–664, 2012.
B. Chen, Y. Niu, and Y. Zou, “Adaptive sliding mode control for stochastic Markovian jumping systems with actuator degradation,” Automatica, vol. 49, no. 6, pp. 1748–1754, 2013.
S. Ma and E.-K. Boukas, “A singular system approach to robust sliding mode control for uncertain Markov jump systems,” Automatica, vol. 45, no. 11, pp. 2707–2713, 2009.
Y. Niu, D. W. C. Ho, and X. Wang, “Sliding mode control for Ito stochastic systems with Markovian switching,” Automatica, vol. 43, no. 10, pp. 1784–1790, 2007.
Z. Wu, X. Xie, P. Shi, and Y.-Q. Xia, “Backstepping controller design for a class of stochastic nonlinear systems with Markovian switching,” Automatica, vol. 45, no. 4, pp. 997–1004, 2009.
J. Nilsson, Real-time Control Systems with Delays, Ph.D. dissertation, Lund Institute of Technology, Lund, Sweden, 1998.
F. Li, X. Wang, and P. Shi, “Robust quantized H ∞ control for network control systems with Markovian jumps and time delays,” Int. J. Innov. Comput. Inf. Control, vol. 9, no. 12, pp. 4889–4902, 2013.
L. Xiao, A. Hassibi, and J. How, “Control with random communication delays via a discrete-time jump system approach,” Proc. Amer. Control Conf., Chicago, IL, pp. 2199–2204, 2000.
L. Zhang, Y. Shi, T. Chen, and B. Huang, “A new method for stabilization of networked control systems with random delays,” IEEE Trans. Autom. Control, vol. 50, no. 8, pp. 1177–1181, 2005.
J. Xiong and J. Lam, “Stabilization of linear systems over networks with bounded packet loss,” Automatica, vol. 43, no. 1, pp. 80–87, 2007.
L. Zhang, H. Gao, and O. Kaynak, “Networkinduced constraints in networked control systems-a survey,” IEEE Trans. Ind. Informat., vol. 9, no. 1, pp. 403–416, 2013.
M. Huang and S. Dey, “Stability of Kalman filtering with Markovian packet losses,” Automatica, vol. 43, no. 4, pp. 598–607, 2007.
S. Smith and P. Seiler, “Estimation with loss measurements: jump estimators for jump systems,” IEEE Trans. Autom. Control, vol. 48, no. 12, pp. 2163–2171, 2003.
J. Wu and T. Chen, “Design of networked control systems with packet dropouts,” IEEE Trans. Autom. Control, vol. 52, no. 7, pp. 1314–1319, 2007.
X. L. Luan, F. Liu, and P. Shi, “Finite-time filtering for nonlinear stochastic systems with partially known transition jump rates,” IET Contr. Theory Applicat., vol. 4, no. 5, pp. 735–745, 2010.
X. L. Luan, S. Zhao, P. Shi, and F. Liu, “H ∞ filtering for discrete-time Markov jump systems with unknown transition probabilities,” IET Contr. Theory Applicat., vol. 28, no. 2, pp. 138–148, 2014.
F. Li, L. Wu, and P. Shi, “Stochastic stability of semi-Markovian jump systems with modedependent delays,” Int. J. Robust. Nonlinear Control, vol. 24, no. 18, pp. 3317–3330, 2014.
J. Huang and Y. Shi, “Stochastic stability and robust stabilization of semi-Markov jump linear systems,” Int. J. Robust. Nonlinear Control, vol. 23, no. 18, pp. 2028–2043, 2013.
F. Li, L. Wu, P. Shi, and C. C. Lim, “State estimation and sliding-mode control for semi-Markovian jump systems with mismatched uncertainties,” Automatica, vol. 51, no. 1, pp. 385–393, 2015.
M. Ogura and C. F. Martin, “Stability analysis of positive semi-Markovian jump linear systems with state resets,” SIAM J. Control Optim., vol. 52, no. 3, pp. 1809–1831, 2014.
F. Li, P. Shi, L. Wu, M. V. Basin, and C. C. Lim, “Quantized control design for cognitive radio networks modeled as nonlinear semi-Markovian jump systems,” IEEE Trans. Ind. Electr., DOI: 10.1109/TIE.2014.2351379.
P. Balasubramaniam and T. Senthilkumar, “Delayrange-dependent robust stabilisation and H ∞ control for nonlinear uncertain stochastic fuzzy systems with mode-dependent time delays and Markovian jump parameters,” Int. J. Syst. Sci., vol. 44, no. 1, pp. 187–200, 2013.
R. Jeetendra and J. V. Vivin, “Delay rangedependent stability analysis for Markovian jumping stochastic systems with nonlinear perturbations,” Stoch. Anal. Appl., vol. 30, no. 4, pp. 590–604, 2012.
H. Ma and Y. Jia, “Input-output finite-time mean square stabilisation of stochastic systems with Markovian jump,” Int. J. Syst. Sci., vol. 45, no. 3, pp. 325–336, 2014.
H. Li and Q. Zhao, “Reliability evaluation of fault tolerant control with a semi-Markov fault detection and isolation model,” Proc. Institution of Mechanical Engineers, Part I: Journal of Systems and Control Engineering, vol. 220, no. 5, pp. 329–338, 2006.
M. Xie and C. Lai, “Reliability analysis using an additive Weibull model with bathtub-shaped failure rate function,” Reliability Engineering & System Safety, vol. 52, no. 1, pp. 87–93, 1996.
C. Schwartz, Control of Semi-Markov Jump Linear Systems with Application to The Bunch-Train Cavity Interaction, Ph.D. Dissertation, Northwestern University, 2003.
Author information
Authors and Affiliations
Corresponding author
Additional information
Peng Shi received the BSc degree in Mathematics from Harbin Institute of Technology, China; the ME degree in Systems Engineering from Harbin Engineering University, China; the PhD degree in Electrical Engineering from the University of Newcastle, Australia; the PhD degree in Mathematics from the University of South Australia; and the DSc degree from the University of Glamorgan, UK. Dr Shi was a post-doctorate and lecturer at the University of South Australia; a senior scientist in the Defence Science and Technology Organisation, Australia; and a professor at the University of Glamorgan, UK. Currently, he is a professor at The University of Adelaide; and Victoria University. Dr Shi’s research interests include system and control theory, computational and intelligent systems, and operational research. Dr Shi is a Fellow of Institute of Electrical and Electronic Engineers, a Fellow of the Institution of Engineering and Technology, and a Fellow of the Institute of Mathematics and its Applications. He has been in the editorial board of a number of international journals, including IEEE Transactions on Automatic Control; IEEE Transactions on Fuzzy Systems; IEEE Transactions on Circuits and Systems-I: Regular Papers; IEEE Transactions on Cybernetics; and Automatica. Dr Shi now serves the Chair of Control, Aerospace and Electronic Systems Chapter, IEEE South Australia Section; and a College of Expert Member, Australian Research Council.
Fanbiao Li received the BSc degree in Applied Mathematics from Mudanjiang Normal University, China, in 2008, and the MSc degree in Operational Research and Cybernetics from Heilongjiang University, China, in 2012. Currently, he is pursuing for his PhD degree in the Department of Control Science and Engineering at Harbin Institute of Technology, China; and he is a Joint Training PhD Student with the School of Electrical and Electronic Engineering, the University of Adelaide, Australia. His research interests include stochastic systems, robust control and networked control systems. He is an active reviewer for many international journals.
Rights and permissions
About this article
Cite this article
Shi, P., Li, F. A survey on Markovian jump systems: Modeling and design. Int. J. Control Autom. Syst. 13, 1–16 (2015). https://doi.org/10.1007/s12555-014-0576-4
Received:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12555-014-0576-4