Reachability analysis for controlled discrete time stochastic hybrid systems. (English) Zbl 1178.93069
Hespanha, João (ed.) et al., Hybrid systems: Computation and control. 9th international workshop, HSCC 2006, Santa Barbara, CA, USA, March 29–31, 2006. Proceedings. Berlin: Springer (ISBN 3-540-33170-0/pbk). Lecture Notes in Computer Science 3927, 49-63 (2006).
Summary: A model for discrete time stochastic hybrid systems whose evolution can be influenced by some control input is proposed in this paper. With reference to the introduced class of systems, a methodology for probabilistic reachability analysis is developed that is relevant to safety verification. This methodology is based on the interpretation of the safety verification problem as an optimal control problem for a certain controlled Markov process. In particular, this allows to characterize through some optimal cost function the set of initial conditions for the system such that safety is guaranteed with sufficiently high probability. The proposed methodology is applied to the problem of regulating the average temperature in a room by a thermostat controlling a heater.
For the entire collection see [Zbl 1103.68006].
For the entire collection see [Zbl 1103.68006].
MSC:
| 93C30 | Control/observation systems governed by functional relations other than differential equations (such as hybrid and switching systems) |
| 93B03 | Attainable sets, reachability |
| 93E20 | Optimal stochastic control |
