research-article

The Impact of a Virtual Agent's Non-Verbal Emotional Expression on a User's Personal Space Preferences

Authors:

Andrea Bönsch,

Jonathan Ehret,

Torsten W. KuhlenAuthors Info & Claims

IVA '20: Proceedings of the 20th ACM International Conference on Intelligent Virtual Agents

Article No.: 12, Pages 1 - 8

https://doi.org/10.1145/3383652.3423888

Published: 19 October 2020 Publication History

Abstract

Virtual-reality-based interactions with virtual agents (VAs) are likely subject to similar influences as human-human interactions. In either real or virtual social interactions, interactants try to maintain their personal space (PS), an ubiquitous, situative, flexible safety zone. Building upon larger PS preferences to humans and VAs with angry facial expressions, we extend the investigations to whole-body emotional expressions. In two immersive settings-HMD and CAVE-66 males were approached by an either happy, angry, or neutral male VA. Subjects preferred a larger PS to the angry VA when being able to stop him at their convenience (Sample task), replicating previous findings, and when being able to actively avoid him (Pass By task). In the latter task, we also observed larger distances in the CAVE than in the HMD.

References

[1]

L. Adams and D. Zuckerman. 1991. The Effect of Lighting Conditions on Personal Space Requirements. J. General Psychology 118, 4 (1991), 335--340.

[2]

R.B. Adams Jr and R.E. Kleck. 2003. Perceived Gaze Direction and the Processing of Facial Displays of Emotion. Psychol. Sci. 14, 6 (2003), 644--647.

[3]

H. Akaike. 1974. A New Look at the Statistical Model Identification. IEEE Trans. Automatic Control 19, 6 (1974), 716--723.

[4]

T. Amaoka, H. Laga, and M. Nakajima. 2009. Modeling the Personal Space of Virtual Agents for Behavior Simulation. In Internat. Conf. CyberWorlds. IEEE, 364--370.

[5]

J.N. Bailenson, J. Blascovich, A.C. Beall, and J.M. Loomis. 2001. Equilibrium Theory Revisited: Mutual Gaze and Personal Space in Virtual Environments. Presence Teleoperators Virtual Environments 10, 6 (2001), 583--598.

Digital Library

[6]

A. Bera, T.V. Randhavane, and D. Manocha. 2017. Aggressive, Tense, or Shy? Identifying Personality Traits from Crowd Videos. Internat. Jt. Conf. Artif. Intell. (2017), 112--118.

[7]

F. Berton, A.H. Olivier, J. Bruneau, L. Hoyet, and J. Pettré. 2019. Studying Gaze Behaviour During Collision Avoidance With a Virtual Walker: Influence of the Virtual Real. Setup. In Proc. 26th IEEE Conf. Virtual Real. & 3D User Interfaces. IEEE, 717--725.

[8]

A. Bönsch, S. Radke, H. Overath, L.M. Asché, J. Wendt, T. Vierjahn, U. Habel, and T.W. Kuhlen. 2018. Social VR: How Personal Space is Affected by Virtual Agents' Emotions. In Proc. 25th IEEE Conf. Virtual Real. & 3D User Interfaces. IEEE.

[9]

J. Bruneau, A.H. Olivier, and J. Pettré. 2015. Going Through, Going Around: A Study on Individual Avoidance of Groups. IEEE Comput. Graph. & Applic. 21, 4 (2015), 520--528.

Digital Library

[10]

M.A. Bühler and A. Lamontagne. 2019. Locomotor Circumvention Strategies in Response to Static Pedestrians in a Virtual and Physical Environment. Gait & Posture 68 (2019), 201--206.

[11]

A. Cafaro, H. Vilhjálmsson, T. Bickmore, D. Heylen, K.R. Jóhannsdóttir, and G.S. Valgarðsson. 2012. First Impressions: Users' Judgments of Virtual Agents' Personality and Interpersonal Attitude in First Encounters. In ACM Int. Conf. on Intelligent Virtual Agents. 67--80.

[12]

C.D. Cochran, W.D. Hale, and C.P. Hissam. 1984. Personal Space Requirements in Indoor "Versus" Outdoor Locations. J. Psychol. 117, 1 (1984), 121--123.

[13]

M. Gérin-Lajoie, C.L. Richard, J. Fung, and B.J. Mc Fadyen. 2008. Characteristics of Personal Space during Obstacle Circumvention in Physical and Virtual Environments. Gait & Posture 27, 2 (2008), 239--247.

[14]

M. Ghinea, D. Frunză, J. Chardonnet, F. Merienne, and A. Kemeny. 2018. Perception of Absolute Distances Within Different Visual. Systems: HMD and CAVE. In Internat. Conf. Augmented Real., Virtual Real. & Comput. Graph. Springer, 148--161.

[15]

E.T. Hall. 1966. The Hidden Dimension. Garden City.

[16]

E.T. Hall. 1968. Proxemics. Current Anthropology 9, 2--3 (1968), 83--96.

[17]

L.A Hayduk. 1978. Personal Space: An Evaluative and Orienting Overview. Psychol. Bull. 85, 1 (1978), 117.

[18]

H. Hecht, R. Welsch, J. Viehoff, and M.R. Longo. 2019. The Shape of Personal Space. Acta Psychol. 193 (2019), 113--122.

[19]

L. Hobeika, I. Viaud-Delmon, and M. Taffou. 2018. Anisotropy of Lateral Peripersonal Space is Linked to Handedness. Experimental Brain Research 236, 2 (2018).

[20]

T. Iachini, Y. Coello, F. Frassinetti, V.P. Senese, F. Galante, and G. Ruggiero. 2016. Peripersonal and Interpersonal Space in Virtual and Real Environments: Effects of Gender and Age. J. Environmental Psychology 45 (2016), 154--164.

[21]

J. Kätsyri, K. Förger, M. Mäkäräinen, and T. Takala. 2015. A Review of Empirical Evidence on Different Uncanny Valley Hypotheses: Support for Perceptual Mismatch as one Road to the Valley of Eeriness. Frontiers in Psychology 6 (2015), 390.

[22]

P. Khooshabeh, S. Gandhe, C. McCall, J. Gratch, J. Blascovich, and D. Traum. 2011. The Effects of Virtual Agent Humor and Gaze Behavior on Human-Virtual Agent Proxemics.In ACM Int. Conf. on Intelligent Virtual Agents. 458--459.

[23]

M. Kret, J. Stekelenburg, K. Roelofs, and B. De Gelder. 2013. Perception of Face and Body Expressions Using Electromyography, Pupillometry and Gaze Measures. Frontiers in Psychology 4 (2013), 28.

[24]

F. la Torre De, W.S. Chu, X. Xiong, F. Vicente, X. Ding, and J. Cohn. 2015. IntraFace. In IEEE Int. Conf. on Automatic Face & Gesture Recognition, Vol. 1.

[25]

J. Llobera, B. Spanlang, G. Ruffini, and M. Slater. 2010. Proxemics with Multiple Dynamic Characters in an Immersive Virtual Environment. Symp. Applied Perception 8, 1 (2010), 3.

[26]

Y. Ma, H.M. Paterson, and F.E. Pollick. 2006. A Motion Capture Library for the Study of Identity, Gender, and Emotion Perception from Biological Motion. Behavior Research Methods 38, 1 (2006), 134--141.

[27]

R. McDonnell, S.Jörg, J. McHugh, F. Newell, and C. O'Sullivan. 2008. Evaluating the Emotional Content of Human Motions on Real and Virtual Characters. In Proc. 5th Symp. Applied Perception in Graph. & Visual. ACM, 67--74.

Digital Library

[28]

R. Messing and F.H. Durgin. 2005. Distance Perception and the Visual Horizon in Head-Mounted Displays. Symp. Applied Perception 2, 3 (2005), 234--250.

[29]

B. Mohler, S.H. Creem-Regehr, W.B. Thompson, and H.H. Bülthoff. 2010. The Effect of Viewing a Self-Avatar on Distance Judgments in an HMD-based Virtual Environment. Presence: Teleoperators & Virtual Environments 19, 3 (2010), 230--242.

Digital Library

[30]

C. Mousas, D. Anastasiou, and O. Spantidi. 2018. The Effects of Appearance and Motion of Virtual Characters on Emotional Reactivity. Comput. in Human Behavior 86 (2018), 99--108.

[31]

C. Mousas, A. Koilias, D. Anastasiou, B. Rekabdar, and C.N. Anagnostopoulos. 2019. Effects of Self-Avatar and Gaze on Avoidance Movement Behavior. In Proc. 26th IEEE Conf. Virtual Real. & 3D User Interfaces. IEEE, 726--734.

[32]

J. Perrinet, A.H. Olivier, and J. Pettré. 2013. Walk With Me: Interactions in Emotional Walking Situations, a Pilot Study. In Symp. Applied Perception. ACM, 59--66.

[33]

T.V. Randhavane, A. Bera, K. Kapsaskis, R. Sheth, K. Gray, and D. Manocha. 2019. EVA: Generating Emotional Behavior of Virtual Agents using Expressive Features of Gait and Gaze. ACM Symp. Appl. Percept. (2019).

[34]

W.C. Regoeczi. 2008. Crowding in Context: An Examination of the Differential Responses of Men and Women to High-Density Living Environments. J. Health & Social Behavior 49, 3 (2008), 254--268.

[35]

H.R. Riggio. 2017. Emotional Expressiveness. Encyclopedia of Personality and Individual Differences (2017).

[36]

C.L. Roether, L. Omlor, A. Christensen, and M.A. Giese. 2009. Critical Features for the Perception of Emotion From Gait. J. Vision 9, 6 (2009), 15--15.

[37]

J.A. Russell, J.A. Bachorowski, and J.M. Fernández-Dols. 2003. Facial and Vocal Expressions of Emotion. Annu. Rev. Psychol. 54, 1 (2003), 329--349.

[38]

A. Shapiro. 2011. Building a Character Animation System. Motion in Games(2011).

[39]

E. Sundstrom and I. Altman. 1976. Interpersonal Relationships and Personal Space: Research Review and Theoretical Model. Human Ecology 4, 1 (1976), 47--67.

[40]

L. Wagels, S. Radke, K. Sophia Goerlich, U. Habel, and M. Votinov. 2017. Exogenous Testosterone Decreases Men's Personal Distance in a Social Threat Context. Hormones & Behavior 90 (2017), 75--83.

[41]

R. Welsch, C. von Castell, and H. Hecht. 2019. The Anisotropy of Personal Space. PLoS One 14, 6 (2019), 1--13.

[42]

K. Zibrek, E. Kokkinara, and R. McDonnell. 2017. Don't Stand So Close To Me: Investigating the Effect of Control on the Appeal of Virtual Humans Using Immersion and a Proximity-Based Behavioral Task. Symp. Applied Perception (2017), 1--11.

Digital Library

[43]

K. Zibrek, B. Niay, and R. Mcdonnell. 2020. Walk this way: Evaluating the Effect of Perceived Gender and Attractiveness of Motion on Proximity in Virtual Reality. In Virtual Humans Crowds Immersive Environ., IEEE. 169--170.

Cited By

Bourgaize SCinelli MRaimbaud PHoyet LOlivier A(2024)Collision avoidance behaviours of young adult walkers: Influence of a virtual pedestrian's age-related appearance and gait profileACM Symposium on Applied Perception 202410.1145/3675231.3675233(1-10)Online publication date: 30-Aug-2024
https://dl.acm.org/doi/10.1145/3675231.3675233
Leblong EGrzeskowiak FThomas SDevigne LBabel MOlivier A(2024)Wheelchair Proxemics: interpersonal behaviour between pedestrians and power wheelchair drivers in real and virtual environmentsProceedings of the 30th ACM Symposium on Virtual Reality Software and Technology10.1145/3641825.3687709(1-12)Online publication date: 9-Oct-2024
https://dl.acm.org/doi/10.1145/3641825.3687709
Wei SFreeman DHarris VRovira A(2024)A randomised controlled test in virtual reality of the effects on paranoid thoughts of virtual humans’ facial animation and expressionScientific Reports10.1038/s41598-024-67534-414:1Online publication date: 24-Jul-2024
https://doi.org/10.1038/s41598-024-67534-4
Show More Cited By

Index Terms

The Impact of a Virtual Agent's Non-Verbal Emotional Expression on a User's Personal Space Preferences
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods
      1. User studies
    2. Interaction paradigms
      1. Virtual reality

Recommendations

Proxemics for Human-Agent Interaction in Augmented Reality
CHI '22: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems

Augmented Reality (AR) embeds virtual content in physical spaces, including virtual agents that are known to exert a social presence on users. Existing design guidelines for AR rarely consider the social implications of an agent’s personal space (PS) and ...
Personal space in virtual reality

Improving the sense of “presence” is a common goal of three-dimensional (3D) display technology for film, television, and virtual reality. However, there are instances in which 3D presentations may elicit unanticipated negative responses. For example, ...
Mood Worlds: A Virtual Environment for Autonomous Emotional Expression
CHI '22: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems

Immersive interactive technologies such as virtual reality (VR) have the potential to foster well-being. While VR applications have been successfully used to evoke positive emotions through the presetting of light, colour and scenery, the experiential ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

IVA '20: Proceedings of the 20th ACM International Conference on Intelligent Virtual Agents

October 2020

394 pages

ISBN:9781450375863

DOI:10.1145/3383652

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGAI: ACM Special Interest Group on Artificial Intelligence

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 October 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

German Research Foundation
Exploratory Research Space Seed Fund at RWTH Aachen University

Conference

IVA '20

Sponsor:

SIGAI

IVA '20: ACM International Conference on Intelligent Virtual Agents

October 20 - 22, 2020

Scotland, Virtual Event, UK

Acceptance Rates

Overall Acceptance Rate 53 of 196 submissions, 27%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
363
Total Downloads

Downloads (Last 12 months)100
Downloads (Last 6 weeks)6

Reflects downloads up to 24 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Bourgaize SCinelli MRaimbaud PHoyet LOlivier A(2024)Collision avoidance behaviours of young adult walkers: Influence of a virtual pedestrian's age-related appearance and gait profileACM Symposium on Applied Perception 202410.1145/3675231.3675233(1-10)Online publication date: 30-Aug-2024
https://dl.acm.org/doi/10.1145/3675231.3675233
Leblong EGrzeskowiak FThomas SDevigne LBabel MOlivier A(2024)Wheelchair Proxemics: interpersonal behaviour between pedestrians and power wheelchair drivers in real and virtual environmentsProceedings of the 30th ACM Symposium on Virtual Reality Software and Technology10.1145/3641825.3687709(1-12)Online publication date: 9-Oct-2024
https://dl.acm.org/doi/10.1145/3641825.3687709
Wei SFreeman DHarris VRovira A(2024)A randomised controlled test in virtual reality of the effects on paranoid thoughts of virtual humans’ facial animation and expressionScientific Reports10.1038/s41598-024-67534-414:1Online publication date: 24-Jul-2024
https://doi.org/10.1038/s41598-024-67534-4
Mulvaney PRooney BFriehs MLeader J(2024)Social VR design features and experiential outcomes: narrative review and relationship map for dyadic agent conversationsVirtual Reality10.1007/s10055-024-00941-028:1Online publication date: 22-Feb-2024
https://dl.acm.org/doi/10.1007/s10055-024-00941-0
Wei WZhang XNi S(2024)Enhancing Emotional Induction in Virtual Reality: Innovative Fusion of Speech and Realistic Non-Verbal Emotional ExpressionHCI International 2024 Posters10.1007/978-3-031-61932-8_38(331-337)Online publication date: 1-Jun-2024
https://doi.org/10.1007/978-3-031-61932-8_38
Hirzle TMüller FDraxler FSchmitz MKnierim PHornbæk K(2023)When XR and AI Meet - A Scoping Review on Extended Reality and Artificial IntelligenceProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581072(1-45)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581072
Xenakis IGavalas DKasapakis VDzardanova EVosinakis S(2022)Nonverbal Communication in Immersive Virtual Reality through the Lens of Presence: A Critical ReviewPRESENCE: Virtual and Augmented Reality10.1162/pres_a_0038731(147-187)Online publication date: 1-Dec-2022
https://doi.org/10.1162/pres_a_00387
Zempo KYamazaki AWakatsuki NMizutani KOkada Y(2022)Mouth-in-the-Door: The Effect of a Sound Image of an Avatar Intruding on Personal Space That Deviates in Position From the Visual ImageIEEE Access10.1109/ACCESS.2022.322280410(125772-125791)Online publication date: 2022
https://doi.org/10.1109/ACCESS.2022.3222804
Bönsch AHashem DEhret JKuhlen T(2021)Being Guided or Having Exploratory FreedomProceedings of the 21st ACM International Conference on Intelligent Virtual Agents10.1145/3472306.3478339(33-40)Online publication date: 14-Sep-2021
https://dl.acm.org/doi/10.1145/3472306.3478339
Yamazaki AWakatsuki NMizutani KOkada YZempo K(2021)Effects of Audio-Visual Information on Interpersonal Distance in Real and Virtual EnvironmentsHuman-Computer Interaction – INTERACT 202110.1007/978-3-030-85607-6_47(405-410)Online publication date: 30-Aug-2021
https://dl.acm.org/doi/10.1007/978-3-030-85607-6_47

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents