×

Markov chains: ergodicity, quasi-stationarity and asymmetry. (Chinese. English summary) Zbl 1499.60255

Summary: Based on the first hitting time or return time, we review the development of Markov chain in the study of stationarity, quasi-stationarity and asymmetry. These topics include: (1) using the moments of the return time to derive the functional inequalities; (2) introducing the modified return time to describe the various transience; (3) obtaining the functional inequalities via the return times; (4) using the eigenvalues to describe the distribution of the hitting times; (5) giving the criteria for the cut-off by the hitting times; (6) obtaining the quasi-stationary distribution through the distribution of the life times; (7) developing the Dirichlet principle to judge which is better between the non-reversible Markov chain and its reversible one.

MSC:

60J10 Markov chains (discrete-time Markov processes on discrete state spaces)
37A25 Ergodicity, mixing, rates of mixing
Full Text: DOI