Stability and robustness analysis of minmax solutions for differential graphical games. (English) Zbl 1448.91048
Summary: Recent studies have shown that, in general, Nash equilibrium cannot be achieved by the players of a differential graphical game by using distributed control policies. Alternative solution concepts that do not necessarily lead to Nash equilibrium can be proposed to allow the players in the game determine distributed optimal strategies. This paper analyzes the performance properties of the solution concept regarded as minmax strategies. The minmax formulation is shown to provide distributed control policies for linear systems under mild assumptions. The stability and robustness characteristics of the proposed solution are studied in terms of gain and phase margins, and related to the robustness properties of the single-agent LQR controller. The results of our analysis are finally tested by means of a simulation example.
MSC:
| 91A23 | Differential games (aspects of game theory) |
| 91A43 | Games involving graphs |
| 93B35 | Sensitivity (robustness) |
| 49N70 | Differential games and control |
References:
| [1] | Basar, T.; Bernhard, P., \( H_\infty \)-optimal control and related minmax design problems (1995), Birhäuser: Birhäuser Boston, MA · Zbl 0835.93001 |
| [2] | Basar, T.; Olsder, G., Dynamic noncooperative game theory (1999), SIAM: SIAM Philadelphia, PA · Zbl 0946.91001 |
| [3] | Bernstein, D., Matrix Mathematics: theory, facts and formulas (2009), Princeton Univ. Press: Princeton Univ. Press Princeton, NJ · Zbl 1183.15001 |
| [4] | Brewer, J. W., Kronecker products and matrix calculus in system theory, IEEE Transactions on Circuits and Systems, 25, 9, 772-781 (1978) · Zbl 0397.93009 |
| [5] | Cao, H.; Ertin, E.; Arora, A., Minimax equilibrium of networked differential games, ACM Transactions on Autonomous and Adaptive Systems, 3, 4, 1-21 (2008) |
| [6] | Doyle, J.; Glover, K.; Khargonekar, P., State-space solutions to standard \(H_2\) and \(H_\infty\) control problems, IEEE Transactions on Automatic Control, 34, 8, 831-847 (1998) · Zbl 0698.93031 |
| [7] | Hong, Y.; Hu, J.; Gao, L., Tracking control for multi-agent consensus with an active leader and variable topology, Automatica, 47, 7, 1177-1182 (2006) · Zbl 1117.93300 |
| [8] | Isaacs, R., Differential games. A mathematical theory with applications to warfare and pursuit, control and optimization (1965), John Wiley & Sons, inc.: John Wiley & Sons, inc. New York, USA · Zbl 0125.38001 |
| [9] | Kamalapurkar, R., Dinh, T., Walters, P., & Dixon, W. (2013). Approximate optimal cooperative decentralized control for consensus in a topological network of agents with uncertain nonlinear dynamics. In Proceedings of the American control conference (vol. 1) (pp. 1322-1327). |
| [10] | Khalil, H. K., Nonlinear systems (1996), Prentice Hall: Prentice Hall Upper Saddle River, NJ |
| [11] | Kwakernaak, H., Robust control and \(H_\infty \)-optimization. Tutorial paper, Automatica, 29, 2, 255-273 (1993) · Zbl 0790.93036 |
| [12] | Lewis, F.; Vrabie, D.; Syrmos, V., Optimal control (2012), John Wiley & Sons, inc.: John Wiley & Sons, inc. New Jersey, USA · Zbl 1284.49001 |
| [13] | Lewis, F.; Zhang, H.; Hengster-Movric, K.; Das, A., Cooperative control of multi-agent systems: optimal and adaptive design approaches (2013), Springer-Verlag: Springer-Verlag New York, USA |
| [14] | Li, Z.; Duan, Z.; Chen, G., On \(H_\infty\) and \(H_2\) performance regions of multi-agent systems, Automatica, 47, 797-803 (2011) · Zbl 1215.93042 |
| [15] | Li, X.; Wang, X.; Chen, G., Pinning a complex dynamical network to its equilibrium, IEEE Transactions on Circuits and Systems I. Regular papers, 51, 10, 2074-2087 (2004) · Zbl 1374.94915 |
| [16] | Modares, H.; Lewis, F.; Jiang, Z., \( H_\infty\) tracking control of completely unknown continuous-time systems via off-policy reinforcement learning, IEEE Transactions on Neural Networks and Learning Systems, 26, 10, 2550-2562 (2015) |
| [17] | Olfati-Saber, R.; Fax, J.; Murray, R., Consensus and cooperation in networked multi-agent systems, Proceedings of the IEEE, 95, 1, 215-233 (2007) · Zbl 1376.68138 |
| [18] | Qu, Z., Cooperative control of dynamical systems: applications to autonomous vehicles (2009), Springer-Verlag: Springer-Verlag New York, USA · Zbl 1171.93005 |
| [19] | Qu, Z.; Simaan, M. A., A design of distributed game strategies for networked agents, IFAC Proceeding Volumes, 42, 20, 270-275 (2009) |
| [20] | Ren, W., Beard, R., & Atkins, E. (2005). A survey of consensus problems in multi-agent coordination. In Proceedings of the American control conference (pp. 1859-1864). |
| [21] | Ren, W.; Moore, K.; Chen, Y., High-order and model reference consensus algorithms in cooperative control of multivehicle systems, Journal of Dynamic Systems, Measurement, and Control, 129, 5, 678-688 (2007) |
| [22] | Safonov, M. G.; Athans, M., Gain and phase margin for multiloop LQG regulators, IEEE Transactions on Automatic Control, 22, 2, 173-179 (1977) · Zbl 0356.93016 |
| [23] | Shoham, Y.; Leyton-Brown, K., Multiagent systems. algorithmic, game-theoretic and logical foundations (2008), Cambridge University Press: Cambridge University Press New York, NY · Zbl 1163.91006 |
| [24] | Vamvoudakis, K.; Lewis, F.; Hudas, G., Multiagent differential graphical games: Online adaptive learning solution for synchronization with optimality, Automatica, 48, 1598-1611 (2012) · Zbl 1267.93190 |
| [25] | Yaghmaie, F. A.; Lewis, F. L.; Su, R., Output regulation of heterogeneous linear multi-agent systems with differential graphical game, International Journal of Robust and Nonlinear Control, 26, 2256-2278 (2016) · Zbl 1342.93014 |
| [26] | Zames, G. (1979). Feedback and optimal sensitivity: Model reference transformations, multiplicative seminorms, and approximate inverses. In Proceedings of the 17th allerton conference (pp. 744-752). |
| [27] | Zhang, H.; Feng, T.; Yang, G.; Liang, H., Distributed cooperative optimal control for multiagent systems on directed graphs: An inverse optimal approach, IEEE Transactions on Cybernetics, 45, 7, 1315-1326 (2015) |
| [28] | Zhang, H.; Li, Z.; Qu, Z.; Lewis, F., On constructing Lyapunov functions for multi-agent systems, Automatica, 58, 39-42 (2015) · Zbl 1330.93182 |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
