×

Imprecise Markov chains and their limit behavior. (English) Zbl 1183.60026

Summary: When the initial and transition probabilities of a finite Markov chain in discrete time are not well known, we should perform a sensitivity analysis. This can be done by considering as basic uncertainty models the so-called credal sets that these probabilities are known or believed to belong to and by allowing the probabilities to vary over such sets. This leads to the definition of an imprecise Markov chain. We show that the time evolution of such a system can be studied very efficiently using so-called lower and upper expectations, which are equivalent mathematical representations of credal sets. We also study how the inferred credal set about the state at time \(n\) evolves as \(n\to\infty\): under quite unrestrictive conditions, it converges to a uniquely invariant credal set, regardless of the credal set given for the initial state. This leads to a non-trivial generalization of the classical Perron-Frobenius theorem to imprecise Markov chains.

MSC:

60J10 Markov chains (discrete-time Markov processes on discrete state spaces)
60J99 Markov processes

References:

[1] DOI: 10.1287/opre.42.4.739 · Zbl 0837.90121 · doi:10.1287/opre.42.4.739
[2] Whittle, Probability via expectation (2000) · Zbl 0980.60004 · doi:10.1007/978-1-4612-0509-8
[3] DOI: 10.1016/0004-3702(95)00009-7 · doi:10.1016/0004-3702(95)00009-7
[4] Walley, Statistical reasoning with imprecise probabilities (1991) · Zbl 0732.62004 · doi:10.1007/978-1-4899-3472-7
[5] Škulj, ISIPTA ’07 – Proceedings of the fifth international symposium on imprecise probability: Theories and applications pp 405– (2007)
[6] Škulj, Soft methods for integrated uncertainty modelling pp 299– (2006)
[7] DOI: 10.2307/2047992 · Zbl 0698.47040 · doi:10.2307/2047992
[8] Kemeny, Finite markov chains (1976) · Zbl 0112.09802
[9] DOI: 10.1016/j.artint.2007.03.004 · Zbl 1168.68578 · doi:10.1016/j.artint.2007.03.004
[10] Huygens, Oeuvres complètes de Christiaan Huygens (1950)
[11] Huygens, Van Rekeningh in Spelen van Geluck (1657)
[12] DOI: 10.2307/1427899 · Zbl 0814.60060 · doi:10.2307/1427899
[13] de Finetti, Teoria delle Probabilità (1970)
[14] Hartfiel, Markov set-chains (1998) · Zbl 0904.60003 · doi:10.1007/BFb0094586
[15] DOI: 10.1016/j.jmaa.2008.05.071 · Zbl 1162.28006 · doi:10.1016/j.jmaa.2008.05.071
[16] DOI: 10.2307/3214695 · Zbl 0745.60070 · doi:10.2307/3214695
[17] De Cooman, Probability and inference: Essays in honor of Henry E. Kyburg, Jr pp 67– (2007)
[18] DOI: 10.1016/S0378-3758(01)00210-5 · Zbl 1019.90048 · doi:10.1016/S0378-3758(01)00210-5
[19] DOI: 10.1016/j.artint.2008.03.001 · Zbl 1183.60003 · doi:10.1016/j.artint.2008.03.001
[20] DOI: 10.1016/j.ijar.2004.10.003 · Zbl 1099.68111 · doi:10.1016/j.ijar.2004.10.003
[21] de Finetti, Theory of probability: A critical introductory treatment (1975) · Zbl 0328.60003
[22] DOI: 10.1016/S0004-3702(00)00029-1 · Zbl 0945.68163 · doi:10.1016/S0004-3702(00)00029-1
[23] DOI: 10.1142/S0218488594000146 · Zbl 1232.68153 · doi:10.1142/S0218488594000146
[24] DOI: 10.1016/S0925-7721(96)00023-5 · Zbl 0877.68119 · doi:10.1016/S0925-7721(96)00023-5
[25] Shafer, The art of causal conjecture (1996) · Zbl 0874.60003
[26] Shafer, A mathematical theory of evidence (1976) · Zbl 0359.62002
[27] DOI: 10.1287/opre.21.3.728 · Zbl 0286.60038 · doi:10.1287/opre.21.3.728
[28] DOI: 10.1007/s000290050028 · Zbl 0923.47031 · doi:10.1007/s000290050028
[29] DOI: 10.1287/opre.1050.0216 · Zbl 1165.90674 · doi:10.1287/opre.1050.0216
[30] DOI: 10.1007/s10472-005-9011-0 · Zbl 1092.68097 · doi:10.1007/s10472-005-9011-0
[31] DOI: 10.1016/j.ijar.2006.12.009 · Zbl 1148.68045 · doi:10.1016/j.ijar.2006.12.009
[32] Luenberger, Introduction to dynamic systems. Theory, models & applications (1979) · Zbl 0458.93001
[33] DOI: 10.1023/A:1014745904458 · Zbl 1001.65007 · doi:10.1023/A:1014745904458
[34] DOI: 10.2307/3215059 · Zbl 0855.60069 · doi:10.2307/3215059
[35] Weichselberger, Elementare Grundbegriffe einer allgemeineren Wahrscheinlichkeitsrechnung. I. Intervallwahrscheinlichkeit als umfassendes Konzept (2001) · doi:10.1007/978-3-642-57583-9
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.