×

A probabilistic approach to classical solutions of the master equation for large population equilibria. (English) Zbl 1520.91003

Memoirs of the American Mathematical Society 1379. Providence, RI: American Mathematical Society (AMS) (ISBN 978-1-4704-5375-6/pbk; 978-1-4704-7279-5/ebook). v, 123 p. (2022).
As this text was posted on the arXiv roughly 8 years before it has appeared in print, the reader is holding in their hands (or reading on their electronic device) essentially the first result on the global in time well-posedness of a large class of master equations arising both in mean field games and mean field type control problems.
The theory of mean field games started with the seminal works of J.-M. Lasry and P.-L. Lions [C. R., Math., Acad. Sci. Paris 343, No. 9, 619–625 (2006; Zbl 1153.91009); C. R., Math., Acad. Sci. Paris 343, No. 10, 679–684 (2006; Zbl 1153.91010); Jpn. J. Math. (3) 2, No. 1, 229–260 (2007; Zbl 1156.91321)] and M. Huang et al. [Commun. Inf. Syst. 6, No. 3, 221–252 (2006; Zbl 1136.91349)] around 2007, and ever since this subject has witnessed a huge expansion both from the theoretical viewpoint and the point of view of applications.
Master equations, which encode all features of the underlying games, was first proposed by Lions in his lectures at the Collège de France. These are PDEs of hyperbolic nature set on the Cartesian product of the state space (which is typically a euclidean space) and the space of probability measures supported on the state space. As the master equation is a nonlinear and nonlocal PDE on an infinite dimensional space, its well-posedness theory requires significant new ideas, beyond the finite dimensional setting. As such, there is no debate about notions of classical solutions, while notions of weak solutions are much more subtle to even define.
The present text settles the first global in time existence and uniqueness questions for such master equations, subject to a possibly degenerate noise in the dynamics of the individual agents. In a follow up work by P. Cardaliaguet et al. [The master equation and the convergence problem in mean field games. Princeton, NJ: Princeton University Press (2019; Zbl 1430.91002)] similar results have been established also in the presence of common noise, in the periodic setting (when the state space is the flat torus \(\mathbb{T}^d\)). This work uses PDE analysis, and in contrast to the text under review, it required a non-degenerate idiosyncratic noise with constant intensity.
The text under review relies on a probabilistic approach, which nicely builds on FBSDE systems, often of McKean-Vlasov type. The heart of the analysis is the observation that the candidate for the solution of the master equation (or the derivative of such) can be seen as the decoupling field for the FBSDE. At an initial step the authors establish the solvability of the FBSDE system and its various linearizations for short time. This short time horizon depends on various Lipschitz constants of the data, but most notably on the 2-Wasserstein (\(W_2\))-Lipschitz constant of the final condition with respect to the measure variable. The various linearized FBSDE systems give rise to the representation formulas of the derivatives of the decoupling field, which are shown to exist in a suitable sense, so that the corresponding master equation has a classical solution. As a major technical work, the authors establish chain rules and Ito formulas for functions defined on the space of probability measures.
Then, as the second set of main results of the paper, under various monotonicity and convexity assumptions on the data, the authors are able to patch together short time solutions and obtain global in time classical solutions. The key element here is the propagation of the \(W_2\)-Lipschitz condition, which can be guaranteed in three different scenarios. First, when the extended Hamiltonian of the control problem is convex in both the state and control variables and when the Lasry-Lions monotonicity condition is present. Second, when the extended Hamiltonian is not convex in the position variable, but the cost functionals are bounded in the position and are linear-quadratic in the control variable, the volatility is non-degenerate and the Lasry-Lions condition is in force. Finally, in the case when convexity must hold in the state and control variables and also in the direction of the measure (in which case there is no need of the Lasry-Lions condition).
As a last remark it worth mentioning that the typical assumptions on the data are somewhat weaker than similar assumptions imposed by R. Carmona and F. Delarue [Probabilistic theory of mean field games with applications I. Mean field FBSDEs, control, and games. Cham: Springer (2018; Zbl 1422.91014); Probabilistic theory of mean field games with applications II. Mean field games with common noise and master equations. Cham: Springer (2018; Zbl 1422.91015)]. Notably, the text under review gives short time existence results and propagation of Lipschitz estimates with respect to the \(W_2\)-metric, while in the mentioned reference this is done under the \(W_1\)-metric which is stronger.
All in all, the results obtained in this text via a thorough and careful analysis, are extremely important for the study of classical solutions of master equations. These results served and continue to serve as source of inspiration for many other results on the solvability of similar master equations.

MSC:

91-02 Research exposition (monographs, survey articles) pertaining to game theory, economics, and finance
91A16 Mean field games (aspects of game theory)
49N80 Mean field games and control
35Q91 PDEs in connection with game theory, economics, social and behavioral sciences
93E20 Optimal stochastic control
60H30 Applications of stochastic analysis (to PDEs, etc.)

References:

[1] Andrews, Ben, The Ricci flow in Riemannian geometry, Lecture Notes in Mathematics, xviii+296 pp. (2011), Springer, Heidelberg · Zbl 1214.53002 · doi:10.1007/978-3-642-16286-2
[2] Bayraktar, Erhan, Analysis of a finite state many player game using its master equation, SIAM J. Control Optim., 3538-3568 (2018) · Zbl 1416.91013 · doi:10.1137/17M113887X
[3] Bayraktar, Erhan, Randomized dynamic programming principle and Feynman-Kac representation for optimal control of McKean-Vlasov dynamics, Trans. Amer. Math. Soc., 2115-2160 (2018) · Zbl 1381.93102 · doi:10.1090/tran/7118
[4] Bensoussan, Alain, The master equation in mean field theory, J. Math. Pures Appl. (9), 1441-1474 (2015) · Zbl 1325.35232 · doi:10.1016/j.matpur.2014.11.005
[5] Bensoussan, A., On the interpretation of the Master Equation, Stochastic Process. Appl., 2093-2137 (2017) · Zbl 1379.60063 · doi:10.1016/j.spa.2016.10.004
[6] Bensoussan, Alain, Control problem on space of random variables and master equation, ESAIM Control Optim. Calc. Var., Paper No. 10, 36 pp. (2019) · Zbl 1450.35305 · doi:10.1051/cocv/2018034
[7] Blackwell, David, An extension of Skorohod’s almost sure representation theorem, Proc. Amer. Math. Soc., 691-692 (1983) · Zbl 0542.60005 · doi:10.2307/2044607
[8] Buckdahn, Rainer, Mean-field stochastic differential equations and associated PDEs, Ann. Probab., 824-878 (2017) · Zbl 1402.60070 · doi:10.1214/15-AOP1076
[9] P. Cardaliaguet, Notes on mean field games, Notes from P.L. Lions’ lectures at the Coll\`ege de France, https://www.ceremade.dauphine.fr/ cardaliaguet/MFG20130420.pdf, 2013.
[10] Cardaliaguet, Pierre, The master equation and the convergence problem in mean field games, Annals of Mathematics Studies, x+212 pp. (2019), Princeton University Press, Princeton, NJ · Zbl 1430.91002 · doi:10.2307/j.ctvckq7qf
[11] Carmona, Ren\'{e}, Forward-backward stochastic differential equations and controlled McKean-Vlasov dynamics, Ann. Probab., 2647-2700 (2015) · Zbl 1322.93103 · doi:10.1214/14-AOP946
[12] Carmona, Ren\'{e}, Mean field forward-backward stochastic differential equations, Electron. Commun. Probab., no. 68, 15 pp. (2013) · Zbl 1297.93182 · doi:10.1214/ECP.v18-2446
[13] Carmona, Ren\'{e}, Probabilistic analysis of mean-field games, SIAM J. Control Optim., 2705-2734 (2013) · Zbl 1275.93065 · doi:10.1137/120883499
[14] Carmona, Ren\'{e}, Stochastic analysis and applications 2014. The master equation for large population equilibriums, Springer Proc. Math. Stat., 77-128 (2014), Springer, Cham · Zbl 1391.92036 · doi:10.1007/978-3-319-11292-3\_4
[15] Carmona, Ren\'{e}, Probabilistic theory of mean field games with applications. I, Probability Theory and Stochastic Modelling, xxv+713 pp. (2018), Springer, Cham · Zbl 1422.91014
[16] Carmona, Ren\'{e}, Probabilistic theory of mean field games with applications. II, Probability Theory and Stochastic Modelling, xxiv+697 pp. (2018), Springer, Cham · Zbl 1422.91015
[17] Carmona, Ren\'{e}, Control of McKean-Vlasov dynamics versus mean field games, Math. Financ. Econ., 131-166 (2013) · Zbl 1269.91012 · doi:10.1007/s11579-012-0089-y
[18] Carmona, Ren\'{e}, A probabilistic weak formulation of mean field games and applications, Ann. Appl. Probab., 1189-1231 (2015) · Zbl 1332.60100 · doi:10.1214/14-AAP1020
[19] Cecchin, Alekos, On the convergence problem in mean field games: a two state model without uniqueness, SIAM J. Control Optim., 2443-2466 (2019) · Zbl 1426.91025 · doi:10.1137/18M1222454
[20] Cecchin, Alekos, Convergence, fluctuations and large deviations for finite state mean field games via the master equation, Stochastic Process. Appl., 4510-4555 (2019) · Zbl 1450.60015 · doi:10.1016/j.spa.2018.12.002
[21] Cerrai, Sandra, Second order PDE’s in finite and infinite dimension, Lecture Notes in Mathematics, x+330 pp. (2001), Springer-Verlag, Berlin · Zbl 0983.60004 · doi:10.1007/b80743
[22] Chassagneux, Jean-Fran\c{c}ois, Numerical method for FBSDEs of McKean-Vlasov type, Ann. Appl. Probab., 1640-1684 (2019) · Zbl 1466.65012 · doi:10.1214/18-AAP1429
[23] Cosso, Andrea, Zero-sum stochastic differential games of generalized McKean-Vlasov type, J. Math. Pures Appl. (9), 180-212 (2019) · Zbl 1423.49039 · doi:10.1016/j.matpur.2018.12.005
[24] Delarue, Fran\c{c}ois, On the existence and uniqueness of solutions to FBSDEs in a non-degenerate case, Stochastic Process. Appl., 209-286 (2002) · Zbl 1058.60042 · doi:10.1016/S0304-4149(02)00085-6
[25] Delarue, Fran\c{c}ois, S\'{e}minaire de Probabilit\'{e}s XXXVII. Estimates of the solutions of a system of quasi-linear PDEs. A probabilistic scheme, Lecture Notes in Math., 290-332 (2003), Springer, Berlin · Zbl 1055.35029 · doi:10.1007/978-3-540-40004-2\_12
[26] Delarue, Fran\c{c}ois, Journ\'{e}es MAS 2016 de la SMAI-Ph\'{e}nom\`enes complexes et h\'{e}t\'{e}rog\`enes. Mean field games: a toy model on an Erd\"{o}s-Renyi graph, ESAIM Proc. Surveys, 1-26 (2017), EDP Sci., Les Ulis · Zbl 1407.91054 · doi:10.1051/proc/201760001
[27] Delarue, Fran\c{c}ois, Restoring uniqueness to mean-field games by randomizing the equilibria, Stoch. Partial Differ. Equ. Anal. Comput., 598-678 (2019) · Zbl 1457.60087 · doi:10.1007/s40072-019-00135-9
[28] Delarue, Fran\c{c}ois, Selection of equilibria in a linear quadratic mean-field game, Stochastic Process. Appl., 1000-1040 (2020) · Zbl 1471.91029 · doi:10.1016/j.spa.2019.04.005
[29] Delarue, Fran\c{c}ois, From the master equation to mean field game limit theory: a central limit theorem, Electron. J. Probab., Paper No. 51, 54 pp. (2019) · Zbl 1508.60032 · doi:10.1214/19-EJP298
[30] Delarue, Fran\c{c}ois, From the master equation to mean field game limit theory: large deviations and concentration of measure, Ann. Probab., 211-263 (2020) · Zbl 1445.60025 · doi:10.1214/19-AOP1359
[31] Fischer, Markus, On the connection between symmetric \(N\)-player games and mean field games, Ann. Appl. Probab., 757-810 (2017) · Zbl 1375.91009 · doi:10.1214/16-AAP1215
[32] Fleming, Wendell H., Controlled Markov processes and viscosity solutions, Applications of Mathematics (New York), xvi+428 pp. (1993), Springer-Verlag, New York · Zbl 0773.60070
[33] Friedman, Avner, Partial differential equations of parabolic type, xiv+347 pp. (1964), Prentice-Hall, Inc., Englewood Cliffs, N.J. · Zbl 0144.34903
[34] Gangbo, Wilfrid, Existence of a solution to an equation arising from the theory of mean field games, J. Differential Equations, 6573-6643 (2015) · Zbl 1359.35221 · doi:10.1016/j.jde.2015.08.001
[35] Gangbo, Wilfrid, On differentiability in the Wasserstein space and well-posedness for Hamilton-Jacobi equations, J. Math. Pures Appl. (9), 119-174 (2019) · Zbl 1419.35234 · doi:10.1016/j.matpur.2018.09.003
[36] Gomes, Diogo A., Mean field games models-a brief survey, Dyn. Games Appl., 110-154 (2014) · Zbl 1314.91048 · doi:10.1007/s13235-013-0099-2
[37] Gomes, Diogo A., Extended deterministic mean-field games, SIAM J. Control Optim., 1030-1055 (2016) · Zbl 1343.49060 · doi:10.1137/130944503
[38] Gu\'{e}ant, Olivier, Paris-Princeton Lectures on Mathematical Finance 2010. Mean field games and applications, Lecture Notes in Math., 205-266 (2011), Springer, Berlin · Zbl 1205.91027 · doi:10.1007/978-3-642-14660-2\_3
[39] Huang, Minyi, Large population stochastic dynamic games: closed-loop McKean-Vlasov systems and the Nash certainty equivalence principle, Commun. Inf. Syst., 221-251 (2006) · Zbl 1136.91349
[40] Kurtz, Thomas G., Weak and strong solutions of general stochastic models, Electron. Commun. Probab., no. 58, 16 pp. (2014) · Zbl 1301.60035 · doi:10.1214/ECP.v19-2833
[41] Lacker, Daniel, A general characterization of the mean field limit for stochastic differential games, Probab. Theory Related Fields, 581-648 (2016) · Zbl 1344.60065 · doi:10.1007/s00440-015-0641-9
[42] Lacker, Daniel, On the convergence of closed-loop Nash equilibria to the mean field game limit, Ann. Appl. Probab., 1693-1761 (2020) · Zbl 1470.91036 · doi:10.1214/19-AAP1541
[43] Lasry, Jean-Michel, Jeux \`a champ moyen. I. Le cas stationnaire, C. R. Math. Acad. Sci. Paris, 619-625 (2006) · Zbl 1153.91009 · doi:10.1016/j.crma.2006.09.019
[44] Lasry, Jean-Michel, Jeux \`a champ moyen. II. Horizon fini et contr\^ole optimal, C. R. Math. Acad. Sci. Paris, 679-684 (2006) · Zbl 1153.91010 · doi:10.1016/j.crma.2006.09.018
[45] Lasry, Jean-Michel, Mean field games, Jpn. J. Math., 229-260 (2007) · Zbl 1156.91321 · doi:10.1007/s11537-007-0657-8
[46] P.L. Lions, Th\'eorie des jeux \`a champs moyen et applications, Technical report, 2007-2008.
[47] P.L. Lions, Cours au coll\`ege de France, http://www.college-de-france.fr/site/pierre-louis-lions/seminar-2014-11-14-11h15.htm.
[48] Ma, Jin, Solving forward-backward stochastic differential equations explicitly-a four step scheme, Probab. Theory Related Fields, 339-359 (1994) · Zbl 0794.60056 · doi:10.1007/BF01192258
[49] Ma, Jin, On well-posedness of forward-backward SDEs-a unified approach, Ann. Appl. Probab., 2168-2214 (2015) · Zbl 1319.60132 · doi:10.1214/14-AAP1046
[50] Ma, Jin, On non-Markovian forward-backward SDEs and backward stochastic PDEs, Stochastic Process. Appl., 3980-4004 (2012) · Zbl 1260.60123 · doi:10.1016/j.spa.2012.08.002
[51] Nutz, Marcel, Convergence to the mean field game limit: a case study, Ann. Appl. Probab., 259-286 (2020) · Zbl 1437.91058 · doi:10.1214/19-AAP1501
[52] Pardoux, \'{E}., Stochastic partial differential equations and their applications. Backward stochastic differential equations and quasilinear parabolic partial differential equations, Lect. Notes Control Inf. Sci., 200-217 (1991), Springer, Berlin · Zbl 0766.60079 · doi:10.1007/BFb0007334
[53] Pham, Huy\^en, Dynamic programming for optimal control of stochastic McKean-Vlasov dynamics, SIAM J. Control Optim., 1069-1101 (2017) · Zbl 1361.93069 · doi:10.1137/16M1071390
[54] Pham, Huy\^en, Bellman equation and viscosity solutions for mean-field stochastic control problem, ESAIM Control Optim. Calc. Var., 437-461 (2018) · Zbl 1396.93134 · doi:10.1051/cocv/2017019
[55] Rachev, Svetlozar T., Mass transportation problems. Vol. II, Probability and its Applications (New York), xxvi+430 pp. (1998), Springer-Verlag, New York · Zbl 0990.60500
[56] Sznitman, Alain-Sol, \'{E}cole d’\'{E}t\'{e} de Probabilit\'{e}s de Saint-Flour XIX-1989. Topics in propagation of chaos, Lecture Notes in Math., 165-251 (1991), Springer, Berlin · Zbl 0732.60114 · doi:10.1007/BFb0085169
[57] Villani, C\'{e}dric, Optimal transport, Grundlehren der Mathematischen Wissenschaften [Fundamental Principles of Mathematical Sciences], xxii+973 pp. (2009), Springer-Verlag, Berlin · Zbl 1156.53003 · doi:10.1007/978-3-540-71050-9
[58] Yong, Jiongmin, Stochastic controls, Applications of Mathematics (New York), xxii+438 pp. (1999), Springer-Verlag, New York · Zbl 0943.93002 · doi:10.1007/978-1-4612-1466-3
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.