Work in Progress

Exploring Holistic HMI Design for Automated Vehicles: Insights from a Participatory Workshop to Bridge In-Vehicle and External Communication

Authors:

Tram Thi Minh Tran,

Rutger Verstegen,

Marius Hoggenmüller,

Mervyn Franssen,

Markus Sasalovici,

Pavlo Bazilinskyy,

Marieke MartensAuthors Info & Claims

CHI EA '24: Extended Abstracts of the CHI Conference on Human Factors in Computing Systems

Article No.: 141, Pages 1 - 9

https://doi.org/10.1145/3613905.3651086

Published: 11 May 2024 Publication History

Abstract

Human–Machine Interfaces (HMIs) for automated vehicles (AVs) are typically divided into two categories: internal HMIs for interactions within the vehicle, and external HMIs for communication with other road users. In this work, we examine the prospects of bridging these two seemingly distinct domains. Through a participatory workshop with automotive user interface researchers and practitioners, we facilitated a critical exploration of holistic HMI design by having workshop participants collaboratively develop interaction scenarios involving AVs, in-vehicle users, and external road users. The discussion offers insights into the escalation of interface elements as an HMI design strategy, the direct interactions between different users, and an expanded understanding of holistic HMI design. This work reflects a collaborative effort to understand the practical aspects of this holistic design approach, offering new perspectives and encouraging further investigation into this underexplored aspect of automotive user interfaces.

Supplemental Material

MP4 File

Talk Video

References

[1]

2019. Road Vehicles: Human Performance and State in the Context of Automated Driving: Part 2–Considerations in Designing Experiments to Investigate Transition Processes. ISO/PRF TR 21959-2. International Organization for Standardization, Geneva, Switzerland.

[2]

Russell L. Ackoff. 1973. Science in the Systems Age: Beyond IE, OR, and MS. Oper. Res. 21 (1973), 661–671.

Digital Library

[3]

Hüseyin Avsar, Fabian Utesch, Marc Wilbrink, Michael Oehl, and Caroline Schießl. 2021. Efficient communication of automated vehicles and manually driven vehicles through an external Human-Machine Interface (eHMI): Evaluation at T-junctions. In HCI International 2021-Posters: 23rd HCI International Conference, HCII 2021, Virtual Event, July 24–29, 2021, Proceedings, Part III 23. Springer, 224–232.

[4]

Liam Bannon. 2011. Reimagining HCI: Toward a More Human-Centered Perspective. (2011). https://doi.org/10.1145/1978822.1978833

Digital Library

[5]

Klaus Bengler, Michael Rettenmaier, Nicole Fritz, and Alexander Feierle. 2020. From HMI to HMIs: Towards an HMI framework for automated driving. Information (Switzerland) 11 (2 2020). Issue 2. https://doi.org/10.3390/info11020061

[6]

Mark Blythe, Marc Hassenzahl, Effie Law, and Arnold Vermeeren. 2007. An analysis framework for user experience (UX)studies: a green paper.

[7]

Barry Brown, Mathias Broth, and Erik Vinkhuyzen. 2023. The Halting Problem: Video Analysis of Self-Driving Cars in Traffic. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI ’23). Association for Computing Machinery, New York, NY, USA, Article 12, 14 pages. https://doi.org/10.1145/3544548.3581045

Digital Library

[8]

Stephen J. Cauffman, Mei Lau, Yulin Deng, Christopher Cunningham, David B. Kaber, and Jing Feng. 2022. Research and Design Considerations for Presentation of Non-Safety Related Information via In-Vehicle Displays during Automated Driving. Applied Sciences (Switzerland) 12, 20 (10 2022). https://doi.org/10.3390/app122010538

[9]

Mark Colley, Tim Fabian, and Enrico Rukzio. 2022. Investigating the Effects of External Communication and Automation Behavior on Manual Drivers at Intersections. Proc. ACM Hum.-Comput. Interact 6 (2022), 1–16.

Digital Library

[10]

Mark Colley, Bastian Wankmüller, Tim Mend, Thomas Väth, Enrico Rukzio, and Jan Gugenheimer. 2022. User gesticulation inside an automated vehicle with external communication can cause confusion in pedestrians and a lower willingness to cross. Transportation Research Part F: Traffic Psychology and Behaviour 87 (2022), 120–137. https://doi.org/10.1016/j.trf.2022.03.011

[11]

R. F. Dam and Y. S. Teo. 2023. Empathy Map – Why and How to Use It. Interaction Design Foundation - IxDF (2023). https://www.interaction-design.org/literature/article/empathy-map-why-and-how-to-use-it

[12]

Henrik Detjen, Sarah Faltaous, Bastian Pfleging, Stefan Geisler, and Stefan Schneegass. 2021. How to Increase Automated Vehicles’ Acceptance through In-Vehicle Interaction Design: A Review. International Journal of Human-Computer Interaction 37, 4 (2021), 308–330. https://doi.org/10.1080/10447318.2020.1860517

[13]

Debargha Dey, Azra Habibovic, Andreas Löcken, Philipp Wintersberger, Bastian Pfleging, Andreas Riener, Marieke Martens, and Jacques Terken. 2020. Taming the eHMI jungle: A classification taxonomy to guide, compare, and assess the design principles of automated vehicles’ external human-machine interfaces. Transportation Research Interdisciplinary Perspectives 7 (2020), 100174.

[14]

Haoyu Dong, Tram Thi Minh Tran, Pavlo Bazilinskyy, Marius Hoggenmüller, Debargha Dey, Silvia Cazacu, Mervyn Franssen, and Ruolin Gao. 2023. Holistic HMI Design for Automated Vehicles: Bridging In-Vehicle and External Communication. In Adjunct Proceedings of the 15th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Ingolstadt, Germany) (AutomotiveUI ’23 Adjunct). Association for Computing Machinery, New York, NY, USA, 237–240. https://doi.org/10.1145/3581961.3609837

Digital Library

[15]

Elena Fratini, Ruth Welsh, and Pete Thomas. 2023. Ranking Crossing Scenario Complexity for eHMIs Testing: A Virtual Reality Study. Multimodal Technologies and Interaction 7, 2 (2023). https://doi.org/10.3390/mti7020016

[16]

Hendrik-jorn Gunther, Oliver Trauer, and Lars Wolf. 2015. The potential of collective perception in vehicular ad-hoc networks. In 2015 14th International Conference on ITS Telecommunications (ITST). IEEE, 1–5.

[17]

John Harding, Gregory Powell, Rebecca Yoon, Joshua Fikentscher, Charlene Doyle, Dana Sade, Mike Lukuc, Jim Simons, Jing Wang, 2014. Vehicle-to-vehicle communications: readiness of V2V technology for application.Technical Report. United States. National Highway Traffic Safety Administration.

[18]

Marc Hassenzahl. 2008. User Experience (UX): Towards an experiential perspective on product quality. IHM 2008.

Digital Library

[19]

Marc Hassenzahl. 2010. Experience Design: Technology for All the Right Reasons. Synthesis Lectures on Human-Centered Informatics 3 (1 2010), 1–95. Issue 1. https://doi.org/10.2200/s00261ed1v01y201003hci008

[20]

Kai Hollander, Mark Colley, Enrico Rukzio, and Andreas Butz. 2021. A taxonomy of vulnerable road users for hci based on a systematic literature review. In Conference on Human Factors in Computing Systems - Proceedings. https://doi.org/10.1145/3411764.3445480

Digital Library

[21]

Kai Holländer, Andy Krüger, and Andreas Butz. 2020. Save the Smombies: App-Assisted Street Crossing. In 22nd International Conference on Human-Computer Interaction with Mobile Devices and Services (Oldenburg, Germany) (MobileHCI ’20). Association for Computing Machinery, New York, NY, USA, Article 22, 11 pages. https://doi.org/10.1145/3379503.3403547

Digital Library

[22]

Evangelos Karapanos. 2013. Modeling Users’ Experiences with Interactive Systems. https://doi.org/10.1007/978-3-642-31000-3

[23]

Ning Lu, Nan Cheng, Ning Zhang, Xuemin Shen, and Jon W Mark. 2014. Connected vehicles: Solutions and challenges. IEEE internet of things journal 1, 4 (2014), 289–299.

[24]

Vassilis Papakostopoulos, Dimitris Nathanael, Evangelia Portouli, and Angelos Amditis. 2021. Effect of external HMI for automated vehicles (AVs) on drivers’ ability to infer the AV motion intention: A field experiment. Transportation research part F: traffic psychology and behaviour 82 (2021), 32–42.

[25]

Uma D Parameswaran, Jade L Ozawa-Kirk, and Gwen Latendresse. 2020. To live (code) or to not: A new method for coding in qualitative research. Qualitative Social Work 19, 4 (2020), 630–644. https://doi.org/10.1177/1473325019840394 arXiv:https://doi.org/10.1177/1473325019840394

[26]

Sébastien Point and Yehuda Baruch. 2023. (Re)thinking transcription strategies: Current challenges and future research directions. Scandinavian Journal of Management 39, 2 (2023), 101272. https://doi.org/10.1016/j.scaman.2023.101272

[27]

Champika Ranasinghe, Kai Holländer, Rebecca Currano, David Sirkin, Dylan Moore, Stefan Schneegass, and Wendy Ju. 2020. Autonomous Vehicle-Pedestrian Interaction Across Cultures: Towards Designing Better External Human Machine Interfaces (EHMIs). In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (Chi Ea ’20). Association for Computing Machinery, New York, NY, USA, 1–8. https://doi.org/10.1145/3334480.3382957

Digital Library

[28]

SAE. 2021. Taxonomy and definitions for terms related to driving automation systems for on-road motor vehicles. J3016, SAE International (2021). https://doi.org/10.4271/J3016_202104

[29]

Elizabeth B.-N. Sanders and Pieter Jan Stappers. 2014. Probes, toolkits and prototypes: three approaches to making in codesigning. CoDesign 10 (2014), 14 – 5. https://api.semanticscholar.org/CorpusID:108955372

[30]

Wilbert Tabone, Joost De Winter, Claudia Ackermann, Jonas Bärgman, Martin Baumann, Shuchisnigdha Deb, Colleen Emmenegger, Azra Habibovic, Marjan Hagenzieker, Peter A Hancock, 2021. Vulnerable road users and the coming wave of automated vehicles: Expert perspectives. Transportation research interdisciplinary perspectives 9 (2021), 100293.

[31]

Martin Tomitsch, Joel Fredericks, Dan Vo, Jessica Frawley, and Marcus Foth. 2021. Non-human Personas: Including Nature in the Participatory Design of Smart Cities. Interaction Design and Architecture(s) (12 2021), 102–130. Issue 50. https://doi.org/10.55612/s-5002-050-006

[32]

Tram Thi Minh Tran, Callum Parker, and Martin Tomitsch. 2021. A Review of Virtual Reality Studies on Autonomous Vehicle–Pedestrian Interaction. IEEE Transactions on Human-Machine Systems 51, 6 (2021), 641–652. https://doi.org/10.1109/thms.2021.3107517

[33]

Tram Thi Minh Tran, Callum Parker, and Martin Tomitsch. 2023. Scoping Out the Scalability Issues of Autonomous Vehicle-Pedestrian Interaction. In Proceedings of the 15th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Ingolstadt, Germany) (AutomotiveUI ’23). Association for Computing Machinery, New York, NY, USA, 167–177. https://doi.org/10.1145/3580585.3607167

Digital Library

[34]

Florian Weber, Ronee Chadowitz, Kathrin Schmidt, Julia Messerschmidt, and Tanja Fuest. 2019. Crossing the Street Across the Globe: A Study on the Effects of eHMI on Pedestrians in the US, Germany and China. In International Conference on Human-Computer Interaction. Springer, 515–530.

[35]

Marc Wilbrink 2017. D1.1 Definition of interACT use cases and scenarios. https://elib.dlr.de/116445

[36]

Terry Winograd. 1997. The design of interaction. Copernicus, USA, 149–161.

[37]

Peter Wright and Mark Blythe. 2007. User Experience Research as an Inter-discipline: Towards a UX Manifesto, E.Law, A. Vermeeren, M. Hassenzahl, and M. Blythe (Eds.). Towards a UX Manifesto - Proceedings of a cost294-affiliated workshop on BHCI 2007, 65–70.

[38]

Peter Wright, Mark Blythe, and John McCarthy. 2006. User experience and the idea of design in HCI. Lecture Notes in Computer Science 3941 LNCS, 1–14. https://doi.org/10.1007/11752707_1

Digital Library

Cited By

Chauhan VAnubhav Chang CNakazato JJavanmardi EOrsholits AIgarashi TFujiwara KTsukada M(2024)Transforming Pedestrian and Autonomous Vehicles Interactions in Shared Spaces: A Think-Tank Study on Exploring Human-Centric DesignsAdjunct Proceedings of the 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3641308.3685037(136-142)Online publication date: 22-Sep-2024
https://dl.acm.org/doi/10.1145/3641308.3685037

Index Terms

Exploring Holistic HMI Design for Automated Vehicles: Insights from a Participatory Workshop to Bridge In-Vehicle and External Communication
1. Human-centered computing
  1. Interaction design

Recommendations

Holistic HMI Design for Automated Vehicles: Bridging In-Vehicle and External Communication
AutomotiveUI '23 Adjunct: Adjunct Proceedings of the 15th International Conference on Automotive User Interfaces and Interactive Vehicular Applications

As the field of automated vehicles (AVs) advances, it has become increasingly critical to develop human-machine interfaces (HMI) for both internal and external communication. Critical dialogue is emerging around the potential necessity for a holistic ...
Multi-methods Research to Examine External HMI for Highly Automated Vehicles
HCI in Mobility, Transport, and Automotive Systems
Abstract
Will other road users know how to interact safely and effectively with highly automated and driverless vehicles (HAV’s), especially in situations where there may be uncertainty, such as turn-taking and stop intersections? Focusing on interaction-...
Participatory Design Tools: Exploring the Value of Design through Materiality
CHI EA '20: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems

As participatory design (PD) approaches become a normative part of contemporary business practice, it becomes increasingly important to ensure that PD tools and methods are accessible and understandable to a larger audience, to fully mobilise and harness ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI EA '24: Extended Abstracts of the 2024 CHI Conference on Human Factors in Computing Systems

May 2024

4761 pages

ISBN:9798400703317

DOI:10.1145/3613905

Editors:
Florian Floyd Mueller
Monash University
,
Penny Kyburz
The Australian National University
,
Julie R. Williamson
University of Glasgow
,
Corina Sas
Lancaster University

Copyright © 2024 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 May 2024

Check for updates

Qualifiers

Work in progress
Research
Refereed limited

Data Availability

Talk Videohttps://dl.acm.org/doi/10.1145/3613905.3651086#3613905.3651086-talk-video.mp4

Funding Sources

China Scholarship Council

Conference

CHI '24

Sponsor:

CHI '24: CHI Conference on Human Factors in Computing Systems

May 11 - 16, 2024

HI, Honolulu, USA

Acceptance Rates

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
320
Total Downloads

Downloads (Last 12 months)320
Downloads (Last 6 weeks)80

Reflects downloads up to 19 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Chauhan VAnubhav Chang CNakazato JJavanmardi EOrsholits AIgarashi TFujiwara KTsukada M(2024)Transforming Pedestrian and Autonomous Vehicles Interactions in Shared Spaces: A Think-Tank Study on Exploring Human-Centric DesignsAdjunct Proceedings of the 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3641308.3685037(136-142)Online publication date: 22-Sep-2024
https://dl.acm.org/doi/10.1145/3641308.3685037

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Full Text

View this article in Full Text.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View full text|Download PDF

View Table of Contents