×

An approximation approach to ergodic semi-Markov control processes. (English) Zbl 1031.90062

Summary: We consider semi-Markov control models (SMCMs) with a Borel state space satisfying certain stochastic stability assumptions on the transition structure which imply the so-called \(V\)-uniform geometric ergodicity of the state process. We deal with a class of \(\varepsilon\)-perturbations of transition probability functions of the original model. First, we determine the rate of convergence of the optimal expected costs in in perturbed models to the optimal expected cost in the orginal SMCM. Next, we present a new algorithm for finding the solution to the Average Cost Optimality Equation (ACOE). The algorithm makes use of a sequence of solutions to the ACOE for the perturbed models, which can be found by a simple iterative procedure.

MSC:

90C40 Markov and semi-Markov decision processes
93E20 Optimal stochastic control
Full Text: DOI