×

Regeneration in Markov chain samplers. (English) Zbl 0819.62082

Summary: Markov chain sampling has recently received considerable attention, in particular in the context of Bayesian computation and maximum likelihood estimation. This article discusses the use of Markov chain splitting, originally developed for the theoretical analysis of general state-space Markov chains, to introduce regeneration into Markov chain samplers. This allows the use of regenerative methods for analyzing the output of these samplers and can provide a useful diagnostic of sampler performance. The approach is applied to several samplers, including certain Metropolis samplers that can be used on their own or in hybrid samplers, and is illustrated in several examples.

MSC:

62M99 Inference from stochastic processes
60J27 Continuous-time Markov processes on discrete state spaces
65C99 Probabilistic methods, stochastic differential equations