Abstract
Rule-based strategies and probability models are among the most successful techniques for selecting driving behaviors of self-driving cars. However, there is still the need to explore the combination of the flexibility and conceptual clarity of deterministic rules with probabilistic models to describe the uncertainty in the spacial relationships among the entities on the road. Therefore, in this paper we propose an action policy obtained from a probabilistic logical description of a Markov decision process (MDP) as a behavior selection scheme for a self-driving car to avoid collisions with other vehicles. We consider three behaviours: keep distance, overtaking, and steady motion. The state variables of the MDP signal the presence or absence of other vehicles in the surroundings of the ego car. Simple probabilistic logic rules characterize the probability distribution of the immediate future state of the autonomous car given the current state and action. The utility model of the MDP rewards the autonomous car when no car is ahead and it penalizes two types of crashes accordingly to their severity. We simulated our proposal in 16 possible scenarios. The results show the appropriateness of both, the overall system and the decision-making strategy to choose actions that prevents potential accidents of the self-driving car.
This work was supported by UNAM-DGAPA under grant TA101222 and Consorcio de IA CIMAT-CONACYT.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Silva, O., Cordera, R., González-González, E., Nogués, S.: Environmental impacts of autonomous vehicles: a review of the scientific literature. Sci. Total Environ. 830, 154615 (2022)
Howard, D., Dai, D.: Public perceptions of self-driving cars: the case of Berkeley, California. In: Transportation Research Board 93rd Annual Meeting, vol. 14, pp. 1–16 (2014)
Xu, W., Wei, J., Dolan, J.M., Zhao, H., Zha, H.: A real-time motion planner with trajectory optimization for autonomous vehicles. In: 2012 IEEE International Conference on Robotics and Automation, pp. 2061–2067. IEEE (2012)
Bueno, T.P., Mauá, D.D., De Barros, L.N., Cozman, F.G.: Markov decision processes specified by probabilistic logic programming: representation and solution. In: 2016 5th Brazilian Conference on Intelligent Systems (BRACIS), pp. 337–342. IEEE (2016)
Fierens, D., et al.: Inference and learning in probabilistic logic programs using weighted boolean formulas. Theory Pract. Logic Program. 15(3), 358–401 (2015)
Chen, K., Yang, B., Pei, X., Guo, X.: Hierarchical control strategy towards safe driving of autonomous vehicles. J. Intell. Fuzzy Syst. 34(4), 2197–2212 (2018)
Huang, L., Liang, H., Yu, B., Li, B., Zhu, H.: Ontology-based driving scene modeling, situation assessment and decision making for autonomous vehicles. In: 2019 4th Asia-Pacific Conference on Intelligent Robot Systems (ACIRS), pp. 57–62. IEEE (2019)
Rizaldi, A., Althoff, M.: Formalising traffic rules for accountability of autonomous vehicles. In: 2015 IEEE 18th International Conference on Intelligent Transportation Systems, pp. 1658–1665. IEEE (2015)
Vennekens, J., Verbaeten, S., Bruynooghe, M.: Logic programs with annotated disjunctions. In: Demoen, B., Lifschitz, V. (eds.) ICLP 2004. LNCS, vol. 3132, pp. 431–445. Springer, Heidelberg (2004). https://doi.org/10.1007/978-3-540-27775-0_30
Sato, T., Kameya, Y.: PRISM: a language for symbolic-statistical modeling. In: IJCAI, vol. 97, pp. 1330–1339. Citeseer (1997)
Van Gelder, A., Ross, K.A., Schlipf, J.S.: The well-founded semantics for general logic programs. J. ACM (JACM) 38(3), 619–649 (1991)
Puterman, M.L.: Markov decision processes: discrete stochastic dynamic programming. John Wiley & Sons (2014)
Hoey, J., St-Aubin, R., Hu, A., Boutilier, C.: Spudd: stochastic planning using decision diagrams. In: Proceedings of International Conference on Uncertainty in Artificial Intelligence (UAI 1999) (1999)
Webots. http://www.cyberbotics.com. Open-source Mobile Robot Simulation Software
Acknowledgments
The authors would like to thank Vincent Derkinderen (KU Leuven) and Thiago P. Bueno (University of São Paulo) for their comments and guidance and the two anonymous reviewers for their insightful suggestions.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Avilés, H., Negrete, M., Machucho, R., Rivera, K., Trejo, D., Vargas, H. (2022). Probabilistic Logic Markov Decision Processes for Modeling Driving Behaviors in Self-driving Cars. In: Bicharra Garcia, A.C., Ferro, M., Rodríguez Ribón, J.C. (eds) Advances in Artificial Intelligence – IBERAMIA 2022. IBERAMIA 2022. Lecture Notes in Computer Science(), vol 13788. Springer, Cham. https://doi.org/10.1007/978-3-031-22419-5_31
Download citation
DOI: https://doi.org/10.1007/978-3-031-22419-5_31
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-22418-8
Online ISBN: 978-3-031-22419-5
eBook Packages: Computer ScienceComputer Science (R0)