×

Continuous-time Markov chains and compound Poisson processes with circulant intensity matrices. (English) Zbl 0878.60047

Summary: A classical result states that for a finite-state homogeneous continuous-time Markov chain \(\{X_t\}_{t\geq 0}\) with finite state space \(E=\{0,\dots,n- 1\}\) and intensity matrix \(Q= (q_{kj})\) the matrix of transition probabilities \(P_{kj}(t)= P(X_t= j\mid X_0=k)\) is given by \(P(t)= (P_{kj}(t))_{k,j\in E}=\exp(Qt)=\sum^\infty_{s= 0}Q^st^s/s!\). In contrast to this infinite series expression, we derive an explicit finite sum formula for this transition matrix for situations where \(Q\) is a circulant matrix. Our result is motivated by the compound Poisson process \(D_t= \sum^{N_t}_{j=0} Y_j\) (with discrete random i.i.d. variables \(Y_j\) and a Poisson counting process \(\{N_t\}_{t\geq 0}\)): It is shown that the stochastic process \(X_t\equiv D_t\text{ mod }n\) is a Markov process on \(E\) with a circulant intensity matrix \(Q\) and we apply the previous results to calculate, e.g., the distribution and the expectation of \(X_t\). The process \(\{X_t\}_{t\geq 0}\) provides a stochastic model for, e.g., channel assignment in telecommunication, bus occupancies, box packing etc.

MSC:

60J27 Continuous-time Markov processes on discrete state spaces
60J35 Transition functions, generators and resolvents
Full Text: DOI

References:

[1] Stegun I.A., Handbook of Mathematical Functions (1972) · Zbl 0543.33001
[2] Anderson W.J., Continuous-TIme Markor Chains: An Applications-Oriented Approach (1991) · doi:10.1007/978-1-4612-3038-0
[3] Barnett S., Methods and Applications (1990) · Zbl 0706.15001
[4] Brigham E.O., The Fast Fourier Transform and its Applications (1988)
[5] Davis P.J., Circulant Matrices (1979)
[6] Moler C., Introduction to Probability Models (1993)
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.