×
do Val, J. B. R.; Geromel, J. C.; Costa, O. L. V.

Solutions for the linear-quadratic control problem of Markov jump linear systems. (English) Zbl 0948.49018

J. Optimization Theory Appl. 103, No. 2, 283-311 (1999).
Summary: The paper is concerned with recursive methods for obtaining the stabilizing solution of coupled algebraic Riccati equations arising in the linear-quadratic control of Markovian jump linear systems by solving at each iteration uncoupled algebraic Riccati equations. It is shown that the new updates carried out at each iteration represent approximations of the original control problem by control problems with receding horizon, for which some sequences of stopping times define the terminal time. Under this approach, unlike previous results, no initialization conditions are required to guarantee the convergence of the algorithms. The methods can be ordered in terms of number of iterations to reach convergence, and comparisons with existing methods in the current literature are also presented. Also, we extend and generalize current results in the literature for the existence of the mean-square stabilizing solution of coupled algebraic Riccati equations.

Cited in 18 Documents

MSC:

49N10 Linear-quadratic optimal control problems
93B40 Computational methods in systems theory (MSC2010)
93E20 Optimal stochastic control

Keywords:

nonstandard Riccati equation; stopping time problems; linear-quadratic control; Markovian jump linear systems
Cite Review PDF
Full Text: DOI

References:

[1] Abou-Kandil, H., Freiling, G., and Jank, G., Solution and Asymptotic Behavior of Coupled Riccati Equations in Jump Linear Systems, IEEE Transactions on Automatic Control, Vol. 39, pp. 1631–1636, 1994. · Zbl 0925.93387 · doi:10.1109/9.310038
[2] Ait-Rami, M., and El Ghaoui, L., LMI Optimization for Nonstandard Riccati Equations Arising in Stochastic Control, IEEE Transactions on Automatic Control, Vol. 41, pp. 1666–1671, 1996. · Zbl 0863.93087 · doi:10.1109/9.544005
[3] Borno, I., Parallel Computation of the Solutions of Coupled Algebraic Lyapunov Equations, Automatica, Vol. 31, pp. 1345–1347, 1995. · Zbl 0825.93992 · doi:10.1016/0005-1098(95)00037-W
[4] Costa, O. L. V., do Val, J. B. R., and Geromel, J. C., A Convex Programming Approach to 2 -Control of Discrete-Time Markovian Jump Linear Systems, International Journal of Control, Vol. 66, pp. 557–579, 1997. · Zbl 0951.93536 · doi:10.1080/002071797224595
[5] do Val, J. B. R., Geromel, J. C., and Costa, O. L. V., Uncoupled Riccati Iterations for the Linear-Quadratic Control Problem of Discrete-Time Markov Jump Linear Systems, IEEE Transactions on Automatic Control, Vol. 43, pp. 1727–1733, 1998. · Zbl 1056.93537 · doi:10.1109/9.736071
[6] Feng, X., Loparo, K. A., Ji, Y., and Chizeck, H. J., Stochastic Stability Properties of Jump Linear Systems, IEEE Transactions on Automatic Control, Vol. 37, pp. 38–53, 1992. · Zbl 0747.93079 · doi:10.1109/9.109637
[7] Gajic, Z., and Borno, I., Lyapunov Iterations for Optimal Control of Jump Linear Systems at Steady State, IEEE Transactions on Automatic Control, Vol. 40, pp. 1971–1975, 1995. · Zbl 0837.93073 · doi:10.1109/9.471227
[8] Gajic, Z., and Losada, R., Monotonicity of Algebraic Lyapunov Iterations for Optimal Control of Jump Parameter Linear Systems, Preprint, Rutgers University, 1997. · Zbl 0985.93017
[9] Ji, Y., and Chizeck, H. J., Controllability, Observability, and Continuous-Time Markovian Jump Linear-Quadratic Control, IEEE Transactions on Automatic Control, Vol. 35, pp. 777–788, 1990. · Zbl 0714.93060 · doi:10.1109/9.57016
[10] Mariton, M., Jump Linear Systems in Automatic Control, Marcel Dekker, New York, New York, 1990.
[11] Fragoso, M. D., Costa, O. L. V., and De Souza, C. E., A New Approach to Linarly Perturbed Riccati Equations Arising in Stochastic Control, Applied Mathematics and Optimization, Vol. 37, pp. 99–126, 1998. · Zbl 0895.93042 · doi:10.1007/s002459900070
[12] Davis, M. H. A., Markov Models and Optimization, Chapman and Hall, London, England, 1993. · Zbl 0780.60002
[13] Kleinman, D. L., On an Iterative Technique for Riccati Equation Computations, IEEE Transactions on Automatic Control, Vol. 13, pp. 114–115, 1968. · doi:10.1109/TAC.1968.1098829
[14] Wonham, W., On a Matrix Riccati Equation of Stochastic Control, SIAM Journal on Control and Optimization, Vol. 6, pp. 681–697, 1968. · Zbl 0182.20803 · doi:10.1137/0306044
[15] Wonham, W., Random Difference Equations in Control Theory, Probabilistic Methods in Applied Mathematics, Edited by A. Bharucha-Reid, Academic Press, New York, New York, pp. 131–212, 1971.
[16] Oliveira, M. C., Faria, D. P., and Geromel, J. C., LMIsol User’s Guide, Available at http://dt.fee.unicamp.br/\(\sim\)carvalho/#soft.
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.