×

A POMDP framework for coordinated guidance of autonomous UAVs for multitarget tracking. (English) Zbl 1184.90169

Summary: This paper discusses the application of the theory of partially observable Markov decision processes (POMDPs) to the design of guidance algorithms for controlling the motion of unmanned aerial vehicles (UAVs) with onboard sensors to improve tracking of multiple ground targets. While POMDP problems are intractable to solve exactly, principled approximation methods can be devised based on the theory that characterizes optimal solutions. A new approximation method called nominal belief-state optimization (NBO), combined with other application-specific approximations and techniques within the POMDP framework, produces a practical design that coordinates the UAVs to achieve good long-term mean-squared-error tracking performance in the presence of occlusions and dynamic constraints. The flexibility of the design is demonstrated by extending the objective to reduce the probability of a track swap in ambiguous situations.

MSC:

90C40 Markov and semi-Markov decision processes
68T05 Learning and adaptive systems in artificial intelligence
93C95 Application models in control theory

Software:

POMDPS

References:

[1] doi:10.1109/MRA.2006.1678135 · doi:10.1109/MRA.2006.1678135
[4] doi:10.1109/MSP.2006.1593338 · doi:10.1109/MSP.2006.1593338
[5] doi:10.1109/JPROC.2007.893247 · doi:10.1109/JPROC.2007.893247
[6] doi:10.1007/978-0-387-49819-5_5 · doi:10.1007/978-0-387-49819-5_5
[7] doi:10.1016/j.dsp.2005.02.005 · doi:10.1016/j.dsp.2005.02.005
[8] doi:10.1016/j.dsp.2007.05.004 · doi:10.1016/j.dsp.2007.05.004
[13] doi:10.1016/S0004-3702(00)00033-3 · Zbl 0948.68167 · doi:10.1016/S0004-3702(00)00033-3
[17] doi:10.1023/A:1009634810396 · Zbl 0997.90037 · doi:10.1023/A:1009634810396
[18] doi:10.1109/TAC.2002.1008362 · Zbl 1364.90114 · doi:10.1109/TAC.2002.1008362
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.