×

Existence of the uniform value in zero-sum repeated games with a more informed controller. (English) Zbl 1314.91026

Summary: We prove that in a two-player zero-sum repeated game where one of the players, say player \(1\), is more informed than his opponent and controls the evolution of information on the state, the uniform value exists.{ }This result extends previous results on Markov decision processes with partial observation [D. Rosenberg et al., Ann. Stat. 30, No. 4, 1178–1193 (2002; Zbl 1103.90402)], and repeated games with an informed controller [J. Renault, Math. Oper. Res. 37, No. 1, 154–179 (2012; Zbl 1238.91027)]. Our formal definition of a more informed player is more general than the inclusion of signals, allowing therefore for imperfect monitoring of actions. We construct an auxiliary stochastic game whose state space is the set of second order beliefs of player \(2\) (beliefs about beliefs of player \(1\) on the state variable of the original game) with perfect monitoring and we prove it has a value by using a result of Renault [loc. cit.]. A key element in this work is to prove that player \(1\) can use strategies of the auxiliary game in the original game in our general framework, from which we deduce that the value of the auxiliary game is also the value of our original game by using classical arguments.

MSC:

91A20 Multistage and repeated games
90C40 Markov and semi-Markov decision processes
91A05 2-person games
91A15 Stochastic games, stochastic differential games

References:

[1] R. J. Aumann, <em>Repeated Games with Incomplete Information,</em> with the collaboration of R. Stearns,, MIT Press (1995) · Zbl 0972.91501
[2] D. Blackwell, The big match,, The Annals of Mathematical Statistics, 39, 159 (1968) · Zbl 0164.50305 · doi:10.1214/aoms/1177698513
[3] D. Blackwell, An extension of Skorohod’s almost sure representation theorem,, Proceedings of the American Mathematical Society, 89, 691 (1983) · Zbl 0542.60005 · doi:10.2307/2044607
[4] K. Fan, Minimax theorems,, Proceedings of the National Academy of Sciences of the United States of America, 39, 42 (1953) · Zbl 0050.06501 · doi:10.1073/pnas.39.1.42
[5] L. Kantorovich, On a space of totally additive functions,, Vestnik Leningrad. Univ, 13, 52 (1958) · Zbl 0082.11001
[6] J. F. Mertens, Repeated games,, in Proceedings of the International Congress of Mathematicians, 1528 (1986) · Zbl 0741.90104
[7] J. F. Mertens, Stochastic games,, International Journal of Game Theory, 10, 53 (1981) · Zbl 0486.90096 · doi:10.1007/BF01769259
[8] J. F. Mertens, <em>Repeated Games,</em>, CORE Discussion Papers 9420 (9420)
[9] J. F. Mertens, The value of two-person zero-sum repeated games with lack of information on both sides,, International Journal of Game Theory, 1, 39 (1971) · Zbl 0232.90066 · doi:10.1007/BF01753433
[10] A. Neyman, Repeated games with public uncertain duration process,, International Journal of Game Theory 39 (2010), 39, 29 (2010) · Zbl 1211.91063 · doi:10.1007/s00182-009-0197-y
[11] A. Neyman, Existence of optimal strategies in Markov games with incomplete information,, International Journal of Game Theory, 37, 581 (2008) · Zbl 1165.91005 · doi:10.1007/s00182-008-0134-5
[12] J. Renault, The value of Markov chain games with lack of information on one side,, Mathematics of Operations Research, 31, 490 (2006) · Zbl 1276.91023 · doi:10.1287/moor.1060.0199
[13] J. Renault, Uniform value in Dynamic Programming,, Journal of the European Mathematical Society, 13, 309 (2011) · Zbl 1229.90253 · doi:10.4171/JEMS/254
[14] J. Renault, The value of repeated games with an informed controller,, Mathematics of Operations Research, 37, 154 (2012) · Zbl 1238.91027 · doi:10.1287/moor.1110.0518
[15] D. Rosenberg, Blackwell optimality in Markov decision processes with partial observation,, Annals of Statistics, 30, 1178 (2002) · Zbl 1103.90402 · doi:10.1214/aos/1031689022
[16] D. Rosenberg, Stochastic games with a single controller and incomplete information,, SIAM Journal on Control and Optimization, 43, 86 (2004) · Zbl 1101.91001 · doi:10.1137/S0363012902407107
[17] S. Sorin, “Big Match” with lack of information on one side (part I),, International Journal of Game Theory, 13, 201 (1984) · Zbl 0561.90104 · doi:10.1007/BF01769463
[18] S. Sorin, <em>A First Course on Zero-Sum Repeated games</em>,, Mathématiques & Applications (2002) · Zbl 1005.91019
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.