Resolvent decomposition theorems and their application in denumerable Markov processes with instantaneous states. (English) Zbl 1469.60242
Summary: The basic aim of this paper is to provide a fundamental tool, the resolvent decomposition theorem, in the construction theory of denumerable Markov processes. We present a detailed analytic proof of this extremely useful tool and explain its clear probabilistic interpretation. We then apply this tool to investigate the basic problems of existence and uniqueness criteria for denumerable Markov processes with instantaneous states to which few results have been obtained even until now. Although the complete answers regarding these existence and uniqueness criteria will be given in a subsequent paper, we shall, in this paper, present part solutions of these very important problems that are closely linked with the subtle Williams \(S\) and \(N\) conditions.
MSC:
| 60J27 | Continuous-time Markov processes on discrete state spaces |
| 60J35 | Transition functions, generators and resolvents |
Keywords:
denumerable Markov processes; transition functions; resolvents; taboo probabilities; existence; uniquenessReferences:
| [1] | Anderson, W., Continuous-Time Markov Chains: An Applications-Oriented Approach (1991), New York: Springer-Verlag, New York · Zbl 0731.60067 |
| [2] | Blackwell, D., Another countable Markov process with only instantaneous states, Ann. Math. Stat., 29, 313-316 (1958) · Zbl 0085.12702 · doi:10.1214/aoms/1177706735 |
| [3] | Chen, AY; Renshaw, E., Markov branching processes with instantaneous immigration, Probab. Theor. Rel. Fields, 87, 209-240 (1990) · Zbl 0695.60080 · doi:10.1007/BF01198430 |
| [4] | Chen, AY; Renshaw, E., Existence and uniqueness criteria for conservative uni-instantaneous denumerable Markov processes, Probab. Theor. Rel. Fields, 94, 427-456 (1993) · Zbl 0791.60063 · doi:10.1007/BF01192557 |
| [5] | Chen, AY; Renshaw, E., Recurrence of Markov branching processes with immigration, Stoch. Process. Appl., 45, 231-242 (1993) · Zbl 0769.60077 · doi:10.1016/0304-4149(93)90071-B |
| [6] | Chen, AY; Renshaw, E., Markov branching processes regulated by emigration and large immigration, Stoch. Process. Appl., 57, 339-359 (1995) · Zbl 0836.60078 · doi:10.1016/0304-4149(94)00083-6 |
| [7] | Chen, AY; Renshaw, E., The M/M/1 queue with mass exodus and mass arrivals when empty, J. Appl. Probab., 34, 192-207 (1997) · Zbl 0876.60079 · doi:10.2307/3215186 |
| [8] | Chen, AY; Renshaw, E., Existence, recurrence and equilibrium properties of Markov branching processes with instantaneous immigration, Stoch. Process. Appl., 88, 177-193 (2000) · Zbl 1045.60088 · doi:10.1016/S0304-4149(99)00125-8 |
| [9] | Chen, AY; Renshaw, E., Markovian bulk-arriving queues with state-dependent control at idle time, Adv. Appl. Probab., 36, 499-524 (2004) · Zbl 1046.60080 · doi:10.1017/S0001867800013586 |
| [10] | Chen, AY; Zhang, HJ; Liu, K.; Rennolls, K., Birth-death processes with disaster and instantaneous resurrection, Adv. Appl. Probab., 36, 267-292 (2004) · Zbl 1049.60066 · doi:10.1239/aap/1077134473 |
| [11] | Chen, MF, From Markov Chains to Non-equilibrium Particle Systems (1992), Singapore: World Scientific, Singapore · Zbl 0753.60055 |
| [12] | Chung, KL, Markov Chains with Stationary Transition Probabilities (1967), New York: Springer, New York · Zbl 0146.38401 |
| [13] | Doob, JL, Markov chains—denumerable case, Trans. Am. Math. Soc., 58, 455-473 (1945) · Zbl 0063.01146 |
| [14] | Feller, W., On the integro-differential equations of purely discontinuous Markov processes, Trans. Am. Math. Soc., 48, 488-515 (1940) · JFM 66.0624.02 · doi:10.1090/S0002-9947-1940-0002697-3 |
| [15] | Freedman, D., Approximating Countable Markov Chains (1983), Berlin: Springer, Berlin · Zbl 0501.60071 |
| [16] | Hou, ZT, The uniqueness criterion for \(Q\)-processes (in Chinese), Sinica, 2, 115-130 (1974) |
| [17] | Hou, ZT; Guo, QF, Homogeneous Denumerable Markov Processes (1988), Berlin: Springer-Verlag, Berlin · Zbl 0662.60002 |
| [18] | Hou, ZT, The \(Q\)-Matrix Problem (1994), Changsha: Human Sciences Process, Changsha |
| [19] | Kendall, DG, A totally unstable denumerable Markov process, Q. J. Math. Oxford, 9, 149-160 (1958) · Zbl 0081.13301 · doi:10.1093/qmath/9.1.149 |
| [20] | Kendall, D.G., Reuter, G.E.H.: Some pathological Markov processes with a denumerable infinity of states and the associated semigroups of operators on \({\cal{L}} \). In: Proceedings of the International Congress of Mathematicians Amsterdam, vol. III, pp. 377-415, Amsterdam, North-Holland (1954) · Zbl 0073.12901 |
| [21] | Kingman, JFC, Regenerative Phenomena (1972), London: Wiley, London · Zbl 0236.60040 |
| [22] | Kolmogorov, AN, On the differentiability of the transition probabilities in stationary Markov processes with a denumerable number of states (in Russian), Moskov. Gos. Univ. Ucenye Zapiski. Mat., 148, 4, 53-59 (1951) |
| [23] | Lamb, CW, Decomposition and construction of Markov chains, Z. Wahrscheinlichkeitstheorie view. Geb., 19, 213-224 (1971) · Zbl 0206.48602 · doi:10.1007/BF00534109 |
| [24] | Neveu, J.: Lattice methods and submarkovian processes. In: Proceedings of the Fourth Berkeley Symposium on Mathematical Statistics and Probability, vol. 2, pp. 347-391. University of California Press, Berkeley, CA (1961) · Zbl 0168.38801 |
| [25] | Neveu, J.: Entrance, exit and fictitious states for Markov chains. In: Proceedings on Aarhus Colloquium Combinatorial Probability, pp. 64-68 (1962) · Zbl 0285.60052 |
| [26] | Neveu, J., Sur les, etats d’entree ef les etats fictifs d’un processus de Markov, Ann. Inst. H. Poincare’, 17, 323-337 (1962) · Zbl 0113.12601 |
| [27] | Reuter, GEH, Denumerable Markov processes and the associated semigroup on \({\cal{L}} \), Acta. Math., 97, 1-46 (1957) · Zbl 0079.34703 · doi:10.1007/BF02392391 |
| [28] | Reuter, GEH, Denumerable Markov processes (II), J. Lond. Math. Soc., 34, 81-91 (1959) · Zbl 0089.13803 · doi:10.1112/jlms/s1-34.1.81 |
| [29] | Reuter, GEH, Denumerable Markov processes (III), J. Lond. Math. Soc., 37, 63-73 (1962) · Zbl 0114.33604 · doi:10.1112/jlms/s1-37.1.63 |
| [30] | Reuter, GEH, Remarks on a Markov chain example of Kolmogorov, Z. Wabrscheinlichkeits-theor. Verw. Geb., 13, 315-320 (1969) · Zbl 0176.47803 · doi:10.1007/BF00539207 |
| [31] | Reuter, GEH, Denumerable Markov processes (IV). On C.T. Hou’s uniqueness theorm for \(Q\)-semigroups, Z. Wabrscheinlichkeitstheor. Verw. Geb., 33, 309-315 (1976) · Zbl 0361.60041 · doi:10.1007/BF00534781 |
| [32] | Rogers, LCG; Williams, D., Construction and approximation of transition matrix functions, Adv. Appl. Probab., 18, 133-160 (1986) · Zbl 0616.60065 |
| [33] | Rogers, LCG; Williams, D., Diffusions, Markov Processes and Martingales (1994), Chichester: Wiley, Chichester · Zbl 0826.60002 |
| [34] | Syski, R., Passage Times for Markov Chains (1992), Amsterdam: IOS Press, Amsterdam · Zbl 0804.60065 |
| [35] | Williams, D., A note on the \(Q\)-matrices of Markov chains, Z. Wabrscheinlichkeitstheor. Verw. Geb., 7, 116-121 (1967) · Zbl 0178.20304 · doi:10.1007/BF00536325 |
| [36] | Yang, XQ, The Construction Theory of Denumerable Markov Processes (1990), New York: Wiley, New York · Zbl 0788.60088 |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
