×

Iterative computation of noncooperative equilibria in nonzero-sum differential games with weakly coupled players. (English) Zbl 0793.90109

Summary: We study the Nash equilibria of a class of two-person nonlinear, deterministic differential games where the players are weakly coupled through the state equation and their objective functionals. The weak coupling is characterized in terms of a small perturbation parameter \(\varepsilon\). With \(\varepsilon=0\), the problem decomposes into two independent standard optimal control problems, while for \(\varepsilon\neq 0\), even though it is possible to derive the necessary and sufficient conditions to be satisfied by a Nash equilibrium solution, it is not always possible to construct such a solution. In this paper, we develop an iterative scheme to obtain an approximate Nash solution when \(\varepsilon\) lies in a small interval around zero. Further, after requiring strong time consistency and/or robustness of the Nash equilibrium solution when at least one of the players uses dynamic information, we address the issues of existence and uniqueness of these solutions for the case when both players use the same information, either closed loop or open loop, and when one player uses open-loop information and the other player uses closed-loop information. We also show that, even though the original problem is nonlinear, the higher (than zero) order terms in the Nash equilibria can be obtained as solutions to LQ optimal control problems or static quadratic optimization problems.

MSC:

91A23 Differential games (aspects of game theory)
49N10 Linear-quadratic optimal control problems
Full Text: DOI

References:

[1] Başar, T., andOlsder, G. J.,Dynamic Noncooperative Game Theory, Academic Press, New York, New York, 1982.
[2] Bensoussan, A.,Perturbation Methods in Optimal Control, John Wiley and Sons, New York, New York, 1988. · Zbl 0648.49001
[3] Pervozvanskii, A. A., andGaitsgori, G.,Theory of Suboptimal Decisions, Kluwer Academic Press, Boston, Massachusetts, 1988.
[4] Srikant, R., andBaşar, T.,Optimal Solutions in Weakly Coupled Multiple Decision Maker Markov Chains with Nonclassical Information, Proceedings of the 28th IEEE Conference on Decision and Control, Tampa, Florida, pp. 168–173, 1989.
[5] Başar, T., andSrikant, R.,Approximation Schemes for Stochastic Teams with Weakly Coupled Agents, Proceedings of the 11th IFAC World Congress, Tallinn, USSR, Vol. 3, pp. 7–12, 1990.
[6] Başar, T., andSrikant, R.,Stochastic Differential Games with Weak Spatial and Strong Informational Coupling, Paper Presented at the 9th International Conference on Analysis and Optimization of Systems, Antibes, France, 1990.
[7] Tikhonov, A. N., Vasil’eva, A. B., andSveshnikov, A. G.,Differential Equations, Springer-Verlag, New York, New York, 1985.
[8] Özgüner, ü., andPerkins, W. R.,A Series Solution to the Nash Strategy for Large-Scale Interconnected Systems, Automatica, Vol. 13, pp. 313–315, 1977. · Zbl 0357.90089 · doi:10.1016/0005-1098(77)90059-0
[9] Başar, T.,Time Consistency and Robustness of Equilibria in Noncooperative Dynamic Games, Dynamic Policy Games in Economics, Edited by F. Van Der Ploeg and A. J. Zeeuw, North-Holland, Amsterdam, Holland, pp. 9–54, 1989.
[10] Gajic, Z., Petkovski, D., andShen, X.,Singularly Perturbed and Weakly Coupled Linear Control Systems: A Recursive Approach, Springer-Verlag, New York, New York, 1989. · Zbl 0666.93031
[11] Başar, T.,Informationally Nonunique Equilibrium Solutions in Differential Games, SIAM Journal on Control and Optimization, Vol. 15, pp. 636–660, 1977. · Zbl 0356.90083 · doi:10.1137/0315041
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.