Workshop for designing biofeedback of driver’s state and emotion in automated vehicles
Authors: 
Marine Capallera, Quentin Meteier, Kevin Koch, Markus Funk, Mira El Kamali, Karl Daher, Omar Abou Khaled, Elena MugelliniAuthors Info & Claims
Marine Capallera, Quentin Meteier, Kevin Koch, Markus Funk, Mira El Kamali, Karl Daher, Omar Abou Khaled, Elena MugelliniAuthors Info & ClaimsPages 171 - 174
Abstract
Different drivers’ states and emotions can affect negatively the driving performance. Recent advances in affective computing now give the opportunity to measure the users’ state or emotions using various sources of data such as physiological signals or voice samples. Conveying biofeedback in the car could help to make roads safer and improve users’ health and mental state during a ride in an autonomous car. This workshop aims at selecting the drivers’ hazardous states and emotions that are crucial to be assessed, as well as how to convey the appropriate biofeedback to the driver, using multimodal interaction in the car.
References
[1]
C. Busso, S. Lee, and Shrikanth S. Narayanan. 2009. Analysis of Emotionally Salient Aspects of Fundamental Frequency for Emotion Detection. IEEE Transactions on Audio, Speech, and Language Processing 17 (2009), 582–596.
[2]
Marine Capallera, Peïo Barbé-Labarthe, Leonardo Angelini, Omar Abou Khaled, and Elena Mugellini. 2019. Convey Situation Awareness in Conditionally Automated Driving with a Haptic Seat. In Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications: Adjunct Proceedings (Utrecht, Netherlands) (AutomotiveUI ’19). Association for Computing Machinery, New York, NY, USA, 161–165. https://doi.org/10.1145/3349263.3351309
[3]
Marine Capallera, Quentin Meteier, Emmanuel de Salis, Leonardo Angelini, Stefano Carrino, Omar Abou Khaled, and Elena Mugellini. 2019. Secondary Task and Situation Awareness, a Mobile Application for Semi-Autonomous Vehicle. In Proceedings of the 31st Conference on l’Interaction Homme-Machine (Grenoble, France) (IHM ’19). Association for Computing Machinery, New York, NY, USA, Article 12, 10 pages. https://doi.org/10.1145/3366550.3372258
[4]
L. Chen, Y. Zhao, Peng fei Ye, J. Zhang, and Junzhong Zou. 2017. Detecting driving stress in physiological signals based on multimodal feature analysis and kernel classifiers. Expert Syst. Appl. 85(2017), 279–291.
[5]
Karl Daher, Marine Capallera, Chiara Lucifora, Jacky Casas, Quentin Meteier, Mira El Kamali, Abdallah El Ali, Giorgio Mario Grosso, Gérard Chollet, Omar Abou Khaled, and Elena Mugellini. 2021. Empathic Interactions in Automated Vehicles #EmpathicCHI. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, Article 90, 4 pages. https://doi.org/10.1145/3411763.3441359
[6]
Karl Daher, Mathias Fuchs, Elena Mugellini, Denis Lalanne, and Omar Abou Khaled. 2020. Reduce stress through empathic machine to improve HCI. Advances in Intelligent Systems and Computing ; Proceedings of Human Interaction, Emerging Technologies and Future Applications II (IHIET 2020), 23-25 April, Lausanne, Switzerland CONFERENCE (2020), 6 p.https://doi.org/10.1007/978-3-030-44267-5_35
[7]
Ali Darzi, Sherif M. Gaweesh, Mohamed M. Ahmed, and Domen Novak. 2018. Identifying the Causes of Drivers’ Hazardous States Using Driver Characteristics, Vehicle Kinematics, and Physiological Measurements. Frontiers in Neuroscience 12 (2018), 568. https://doi.org/10.3389/fnins.2018.00568
[8]
Ding Ding, Klaus Gebel, Philayrath Phongsavan, Adrian E Bauman, and Dafna Merom. 2014. Driving: a road to unhealthy lifestyles and poor health outcomes. PloS one 9, 6 (2014), e94602.
[9]
Mira El Kamali, Leonardo Angelini, Omar Abou Khaled, and Elena Mugellini. 2020. NESTORE: Un compagnon multimodal pour les séniors. Workshop sur les Affects, Compagnons artificiels et Interactions. https://hal.inria.fr/hal-02933483 Poster.
[10]
Stephen H Fairclough, Andrew J Tattersall, and Kim Houston. 2006. Anxiety and performance in the British driving test. Transportation Research Part F: Traffic Psychology and Behaviour 9, 1(2006), 43–52.
[11]
Myounghoon Jeon, Bruce N Walker, and Jung-Bin Yim. 2014. Effects of specific emotions on subjective judgment, driving performance, and perceived workload. Transportation research part F: traffic psychology and behaviour 24 (2014), 197–209.
[12]
Daniel Kahneman, Alan B. Krueger, David A. Schkade, Norbert Schwarz, and Arthur A. Stone. 2004. A Survey Method for Characterizing Daily Life Experience: The Day Reconstruction Method. Science 306, 5702 (2004), 1776–1780. http://science.sciencemag.org/content/306/5702/1776.abstract
[13]
Kevin Koch, Verena Tiefenbeck, Shu Liu, Thomas Berger, Elgar Fleisch, and Felix Wortmann. 2021. Taking Mental Health & Well-Being to the Streets: An Exploratory Evaluation of In-Vehicle Interventions in the Wild. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, Article 539, 15 pages. https://doi.org/10.1145/3411764.3446865
[14]
G. Matthews and P. Desmond. 2002. Task-induced fatigue states and simulated driving performance. Quarterly Journal of Experimental Psychology 55 (2002), 659 – 686.
[15]
Quentin Meteier, Marine Capallera, Simon Ruffieux, Leonardo Angelini, Omar Abou Khaled, Elena Mugellini, Marino Widmer, and Andreas Sonderegger. 2021. Classification of Drivers’ Workload Using Physiological Signals in Conditional Automation. Frontiers in Psychology 12 (2021), 268. https://doi.org/10.3389/fpsyg.2021.596038
[16]
P. Philip, P. Sagaspe, N. Moore, J. Taillard, A. Charles, C. Guilleminault, and B. Bioulac. 2005. Fatigue, sleep restriction and driving performance.Accident; analysis and prevention 37 3 (2005), 473–8.
[17]
F. Schoeller, P. Bertrand, L. Gerry, A. Jain, Adam Haar Horowitz, and F. Zenasni. 2019. Combining Virtual Reality and Biofeedback to Foster Empathic Abilities in Humans. Frontiers in Psychology 9 (2019), 2741.
[18]
Geoffrey Underwood, Peter Chapman, Sharon Wright, and David Crundall. 1999. Anger while driving. Transportation Research Part F: Traffic Psychology and Behaviour 2, 1(1999), 55–68.
[19]
M. Young and N. Stanton. 2002. Attention and automation: New perspectives on mental underload and performance. Theoretical Issues in Ergonomics Science 3 (2002), 178 – 194.
[20]
B. Yu, J. Hu, M. Funk, and L. Feijs. 2018. DeLight: biofeedback through ambient light for stress intervention and relaxation assistance. Personal and Ubiquitous Computing 22 (2018), 787–805.
[21]
Sebastian Zepf, Monique Dittrich, Javier Hernandez, and Alexander Schmitt. 2019. Towards Empathetic Car Interfaces: Emotional Triggers while Driving. In Proceedings Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, 3312883, LBW0129.
Recommendations
Empathic Interactions in Automated Vehicles #EmpathicCHI
CHI EA '21: Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing SystemsAutomation in driving will change the role of the drivers from actor to passive supervisor. Although the vehicle will be responsible for driving manoeuvres, drivers will need to rely on automation and understand its decisions to establish a trusting ...
Driver Emotion Recognition for Intelligent Vehicles: A Survey
Driving can occupy a large portion of daily life and often can elicit negative emotional states like anger or stress, which can significantly impact road safety and long-term human health. In recent decades, the arrival of new tools to help recognize ...
Comments
Information & Contributors
Information
Published In
September 2021
234 pages
ISBN:9781450386418
DOI:10.1145/3473682
Copyright © 2021 Owner/Author.
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 22 September 2021
Check for updates
Author Tags
Qualifiers
- Extended-abstract
- Research
- Refereed limited
Conference
AutomotiveUI '21
Sponsor:
AutomotiveUI '21: 13th International Conference on Automotive User Interfaces and Interactive Vehicular Applications
September 9 - 14, 2021
Leeds, United Kingdom
Acceptance Rates
Overall Acceptance Rate 248 of 566 submissions, 44%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 135Total Downloads
- Downloads (Last 12 months)19
- Downloads (Last 6 weeks)2
Reflects downloads up to 21 Oct 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format