Stabilization control for Itô stochastic system with indefinite state and control weight costs. (English) Zbl 1482.93676
Summary: In standard linear-quadratic (LQ) control, the first step in investigating infinite-horizon optimal control is to derive the stabilisation condition with the optimal LQ controller. This paper focuses on the stabilisation of an Itô stochastic system with indefinite control and state-weighting matrices in the cost functional. A generalised algebraic Riccati equation (GARE) is obtained via the convergence of the generalised differential Riccati equation (GDRE) in the finite-horizon case. More importantly, the necessary and sufficient stabilisation conditions for indefinite stochastic control are obtained. One of the key techniques is that the solution of the GARE is decomposed into a positive semi-definite matrix that satisfies the singular algebraic Riccati equation (SARE) and a constant matrix that is an element of the set satisfying certain linear matrix inequality conditions. Using the equivalence between the GARE and SARE, we reduce the stabilisation of the general indefinite case to that of the definite case, in which the stabilisation is studied using a Lyapunov functional defined by the optimal cost functional subject to the SARE.
MSC:
| 93E15 | Stochastic stability in control theory |
| 93E20 | Optimal stochastic control |
| 49N10 | Linear-quadratic optimal control problems |
Keywords:
indefinite stochastic linear quadratic control; generalised differential Riccati equation; convergence; stabilisationReferences:
| [1] | Albert, A., Conditions for positive and nonnegative definiteness in terms of pseudo-inverse, SIAM Journal on Optimization and Control, 17, 434-440 (1969) · Zbl 0265.15002 · doi:10.1137/0117041 |
| [2] | Bilardi, G.; Ferrante, A., The role of terminal cost/reward in finite-horizon discrete-time LQ optimal control, Linear Algebra and Its Applications, 425, 2-3, 323-344 (2007) · Zbl 1138.49028 · doi:10.1016/j.laa.2007.01.025 |
| [3] | Chen, S. P.; Li, X. J.; Zhou, X. Y., Stochastic linear quadratic regulators with indefinite control weight costs, SIAM Journal on Optimization and Control, 36, 5, 1685-1702 (1998) · Zbl 0916.93084 · doi:10.1137/S0363012996310478 |
| [4] | Davis, M. H. A., Linear estimation and stochastic control (1977), Chapman and Hall · Zbl 0437.60001 |
| [5] | Ferrante, A.; Ntogramatzidis, L., A note on finite-horizon LQ problems with indefinite cost, Automatica, 52, 290-293 (2015) · Zbl 1309.49029 · doi:10.1016/j.automatica.2014.12.008 |
| [6] | Hinrichsen, D.; Pritchard, A. J., Stochastic \(####\), SIAM Journal on Optimization and Control, 36, 5, 1504-1538 (1998) · Zbl 0914.93019 · doi:10.1137/S0363012996301336 |
| [7] | Horn, R. A.; Johnson, C. R., Matrix analysis (1990), Cambridge University Press · Zbl 0704.15002 |
| [8] | Kalman, R. E., Contribution to the theory of optimal control, Boletin Sociedad Matematica Mexicana, 5, 2, 102-119 (1960) · Zbl 0112.06303 |
| [9] | Li, X.; Zhou, X. Y.; Rami, M. A., Indefinite stochastic linear quadratic control with Markovian jumps in infinite time horizon, Journal of Global Optimization, 27, 2-3, 149-175 (2003) · Zbl 1031.93155 · doi:10.1023/A:1024887007165 |
| [10] | Ni, Y. H.; Yiu, C. K. F.; Zhang, H. S.; Zhang, J. F., Delayed optimal control of stochastic LQ problem, SIAM Journal on Optimization and Control, 55, 5, 3370-3407 (2017) · Zbl 1373.93383 · doi:10.1137/16M1100897 |
| [11] | Qi, Q. Y.; Zhang, H. S., Time-inconsistent stochastic linear quadratic control for discrete-time systems, Science China Information Sciences, 60, 12 (2017) · doi:10.1007/s11432-017-9167-3 |
| [12] | Qi, Q. Y.; Zhang, H. S.; Wu, Z., Stabilization control for linear continuous-time mean-field systems, EEE Transactions on Automatic Control, 64, 8, 3461-3468 (2019) · Zbl 1482.93679 · doi:10.1109/TAC.2018.2881141 |
| [13] | Rami, M. A.; Chen, X.; Moore, J. B.; Zhou, X. Y., Solvability and asymptotic behavior of generalized Riccati equations arising in indefinite stochastic LQ controls, IEEE Transactions on Automatic Control, 46, 3, 428-440 (2001) · Zbl 0992.93097 · doi:10.1109/9.911419 |
| [14] | Rami, M. A.; Moore, J. B.; Zhou, X. Y., Indefinite stochastic linear quadratic control and generalized differential Riccati equation, SIAM Journal on Optimization and Control, 40, 4, 1296-1311 (2001) · Zbl 1009.93082 · doi:10.1137/S0363012900371083 |
| [15] | Rami, M. A.; Zhou, X. Y., Linear matrix inequalities, Riccati equations, and indefinite stochastic linear quadratic control, IEEE Transactions on Automatic Control, 45, 6, 1131-1143 (2000) · Zbl 0981.93080 · doi:10.1109/9.863597 |
| [16] | Wonham, W. M., On a matrix Riccati equation of stochastic control, SIAM Journal on Optimization and Control, 6, 4, 681-697 (1968) · Zbl 0182.20803 · doi:10.1137/0306044 |
| [17] | Wu, H.; Zhou, X. Y., Characterizing all optimal controls for an indefinite stochastic linear quadratic control problem, IEEE Transactions on Automatic Control, 47, 7, 1119-1122 (2002) · Zbl 1364.49044 · doi:10.1109/TAC.2002.800650 |
| [18] | Xu, J. J.; Shi, J. T.; Zhang, H. S., A leader-follower stochastic linear quadratic differential game with time delay, Science China Information Sciences, 61, 11 (2018) · doi:10.1007/s11432-017-9293-4 |
| [19] | Zhang, W. H.; Chen, B. S., On stabilizability and exact observability of stochastic systems with their applications, Automatica, 40, 1, 87-94 (2004) · Zbl 1043.93009 · doi:10.1016/j.automatica.2003.07.002 |
| [20] | Zhang, H. S.; Li, L.; Xu, J. J.; Fu, M. Y., Linear quadratic regulation and stabilization of discrete-time systems with delay and multiplicative noise, IEEE Transactions on Automatic Control, 60, 10, 2599-2613 (2015) · Zbl 1360.93583 · doi:10.1109/TAC.2015.2411911 |
| [21] | Zhang, H. S.; Qi, Q. Y.; Fu, M. Y., Optimal stabilization control for discrete-time mean-field stochastic systems, IEEE Transactions on Automatic Control, 64, 3, 1125-1136 (2019) · Zbl 1482.93691 · doi:10.1109/TAC.2018.2813006 |
| [22] | Zhang, H. S.; Xu, J. J., Control for itô stochastic systems with input delay, IEEE Transactions on Automatic Control, 62, 1, 350-365 (2017) · Zbl 1359.93543 · doi:10.1109/TAC.2016.2551371 |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
