Abstract
In this paper, we prove that the Foster–Lyapunov drift condition is necessary and sufficient for recurrence of a Markov chain on a general state space. And then an answer in the affirmative for the question presented in the monograph of Meyn and Tweedie (Markov chains and stochastic stability. Springer, Berlin, 1993, P175) is obtained.
Similar content being viewed by others
References
Foster, F.G.: On the stochastic matrices associated with certain queueing processes. Ann. Math. Stat. 24, 335–360 (1953)
Mertens, J.F., Samuel-Cahn, E., Zamir, S.: Necessary and sufficient conditions for recurrence and transience of Markov chains, in terms of inequalities. J. Appl. Probab. 15, 848–851 (1978)
Meyn, S.P., Tweedie, R.L.: Markov Chains and Stochastic Stability. Springer, Berlin (1993)
Acknowledgements
The authors would like to thank the referees for many valuable comments and useful suggestions.
Author information
Authors and Affiliations
Corresponding author
Additional information
Research supported by National Natural Science Foundation of China (No. 11471105) and the Science Foundation of Education Department of Hubei Province (No. D20172501).
Rights and permissions
About this article
Cite this article
Xu, L., Zhang, S. & Zhang, R. A Note on Foster–Lyapunov Drift Condition for Recurrence of Markov Chains on General State Spaces. J Theor Probab 31, 1923–1928 (2018). https://doi.org/10.1007/s10959-017-0777-x
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10959-017-0777-x