×

Continuous time Markov chains observed on an alternating renewal process with exponentially distributed durations. (English) Zbl 1089.60048

The paper considers a stochastic process resulted from a continuous time Markov chain observed on a system following the behavior of an alternating renewal process. This alternating renewal process is assumed to have exponentially distributed durations. The paper studies the limiting behavior of this process and the embedded processes observed at the beginning of each stage. The limiting probability distribution of the whole process is derived in terms of stationary probabilities of the embedded processes.

MSC:

60K15 Markov renewal processes, semi-Markov processes
60K37 Processes in random environments
Full Text: DOI

References:

[1] Anisimov, V., Switching processes, Cybernetics, 13, 590-595 (1977)
[2] Anisimov, V., Switching processes: averaging principle, diffusion approximation and applications, Acta Appl. Math., 40, 95-141 (1995) · Zbl 0827.60022
[3] Avi-Itzhak, B.; Naor, P., Some queueing problems with service station subject to breakdowns, Oper. Res., 10, 303-320 (1963) · Zbl 0114.34202
[4] Bailey, N., The Elements of Stochastic Processes with Applications to the Natural Sciences (1964), Wiley: Wiley New York · Zbl 0127.11203
[5] Chan, W.; Bartoszyski, R.; Pearl, D., Queues with breakdowns and customers discouragement, Probab. Math. Statist., 14, 77-87 (1993) · Zbl 0803.60090
[6] Doshi, B., Generalizations of the stochastic decomposition results for single server queues with vacations, Stoch. Models, 6, 307-333 (1990) · Zbl 0701.60094
[7] Karlin, S.; Taylor, H. M., A First Course in Stochastic Processes (1975), Academic Press: Academic Press New York · Zbl 0315.60016
[8] Kleinrock, L., Queueing Systems, vol. 1: Theory (1975), Wiley: Wiley New York · Zbl 0334.60045
[9] Mortensen, R., Alternating renewal process models for electric power system loads, IEEE Trans. Automat. Control, 35, 1245-1249 (1990) · Zbl 0721.93006
[10] Ramsay, C., The asymptotic ruin problem when the healthy and sick periods form an alternating renewal process, Insurance Math. Econom., 3, 139-143 (1984) · Zbl 0543.62092
[11] Regterschot, G. J.K.; de Smit, J. H.A., The queue M/G/1 with Markov modulated arrivals and services, Math, Oper. Res., 11, 465-483 (1986) · Zbl 0619.60093
[12] Ross, S., Stochastic Processes (1996), Wiley: Wiley New York · Zbl 0888.60002
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.