research-article

Modeling and Simulating Empathic Behavior in Social Assistive Robots

Authors:

Berardina De Carolis,

Stefano Ferilli,

Giuseppe Palestra,

Valeria CarofiglioAuthors Info & Claims

CHItaly '15: Proceedings of the 11th Biannual Conference of the Italian SIGCHI Chapter

Pages 110 - 117

https://doi.org/10.1145/2808435.2808445

Published: 28 September 2015 Publication History

Abstract

Several studies report successful results on how social assistive robots can be employed as interface in the assisted living domain. In our opinion, to plan their response and interact successfully with people, it is crucial to recognize human emotions. To this aim, features of the prosody of the speech together with facial expressions and gestures may be used to recognize the emotional state of the user. The information gained from these different sources may be fused in order to endow the robot with the capability to reason on the user's affective state. In this paper we describe how this capability has been implemented in the NAO robot and how this allows simulating empathic behaviors in the context of Ambient Assisted Living.

References

[1]

http://www.aal-europe.eu/wp-content/uploads/2012/04/AALCatalogue_onlineV4.pdf

[2]

De Carolis, B., Ferilli S., Greco D. Towards a Caring Home for Assisted Living.Workshop "The Challenge of Ageing Society: Technological Roles and Opportunities for Artificial Intelligence" co-located with the AI*IA 2013.

[3]

Hoffman, M., 2000. Empathy and Moral Development: Implications for Caring and Justice. Cambridge University Press, Cambridge, UK.

[4]

Hoffman, M. L. (1981). The development of empathy. In J. Rushton & R. Sorrentino (Eds.), Altruism and helping behavior: Social personality and developmental perspectives (pp. 41--63). Hillsdale, NJ: Erlbaum.

[5]

C. Anderson and D. Keltner (2002). The role of empathy in the formation and maintenance of social bonds. Behavioral and Brain Sciences, 25, pp 21--22.

[6]

T. Bickmore and R. W. Picard, Establishing and maintaining long-term human-computer relationships, ACM Transactions on Computer Human Interaction, 12, 2, 293--327, 2005.

Digital Library

[7]

W. S. N. Reilly. Believable Social and Emotional Agents. PhD thesis (1996)

[8]

S Brave, C Nass, and K Hutchinson. Computers that care: investigating the effects of orientation of emotion exhibited by an embodied computer agent. Int. J. of Human Computer Studies 62(2):161--178, 2005.

Digital Library

[9]

Nijholt, A., de Ruyter, B., Heylen, D. and Privender, S. Social Interfaces for Ambient Intelligence Environments. Chapter 14 in: True Visions: The Emergence of Ambient Intelligence. Aarts, E. and Encarnaçao, J., Eds. Springer, New York, 2006, 275--289.

[10]

A. Paiva, et. al. "Caring for Agents and Agents that Care: Building empathic relations with synthetic agents", AAMAS 2004, ACM Press, 2004.

Digital Library

[11]

Eisenberg, N., & Miller, P. A. (1987). The relation of empathy to prosocial and related behaviors. Psychological Bulletin, 101, 91--119.

[12]

Ortony, A., Clore, G. L. and Collins, A., 1988. The cognitive structure of emotions. Cambridge University Press.

[13]

A. Cesta, G. Cortellessa, F. Pecora and R. Rasconi, Supporting Interaction in the RoboCare Intelligent Assistive Environment, AAAI 2007 Spring Symposium, 2007.

[14]

J. Pineau, M. Montemerlo, M. Pollack, N. Roy and S. Thrun, Towards Robotic Assistants in Nursing Homes: Challenges and Results, Robotics and Autonomous Systems 42(3-4), pp. 271--281, 2003.

[15]

Graf B, Hans M, Schraft RD (2004) Care-O-bot II -- development of a next generation robotics home assistant. Auton. Robots 16, 193--205.

Digital Library

[16]

CompanionAble project (2011) http://www.companionable.net/

[17]

Cuijpers, R. H. (2012). http://ksera.ieis.tue.nl/

[18]

A. M. van Ruiten, A. M., Haitas, D., Bingley, P., Hoonhout, H. C. M., Meerbeek, B. W. and Terken, J. M. B. Attitude of elderly towards a robotic game-and-train- buddy: evaluation of empathy and objective control. In R. Cowie and F. de Rosis (Eds.) Proceedings of the Doctoral consortium, in the scope of ACII2007 Conference, 2007.

[19]

J. Broekens, M. Heerink, H. Rosendal. Assistive social robots in elderly care: a review. Gerontechnology 2009; 8(2):94--103;

[20]

Reeves and C. Nass, The media equation: how people treat computers, television, and new media like real people and places, Cambridge University Press, New York, NY, 1996.

Digital Library

[21]

Picard, R., 1997. Affective Computing. MIT Press, Cambridge, MA.

[22]

A. Paiva et al. Empathy in Social Agents. International Journal of Virtual Reality, Vol. 10, No. 1, pg. 65--68, 2011.

[23]

Klein J, Moon Y, Picard R (2002) This computer responds to user frustration: Theory, design, and results. Interacting with Computers, 14:119--140.

[24]

Prendinger H, Mori J, Ishizuka M (2005) Recognizing, modeling, and responding to users affective states. In Proceedings of User Modeling 2005, Lecture Notes in Computer Science, Volume 3538/2005, 149. 2005

Digital Library

[25]

Sabourin J, Mott B, Lester J (2011) Computational Models of Affect and Empathy for. Pedagogical Virtual Agents. Standards in Emotion Modeling, Lorentz Center International Center for workshops in the Sciences.

[26]

I. Leite and C. Martinho and A, Paiva Social Robots for Long-Term Interaction: A Survey. International Journal of Social Robotics, pg. 1--18, January, 2013.

[27]

Maja Mataric', Adriana Tapus, and David Feil-Seifer (2007) "Personalized Socially Assistive Robotics", Workshop on Intelligent Systems for Assisted Cognition, Rochester, New York, USA, October, 2007.

[28]

C. Castelfranchi and F. Paglieri, The role of beliefs in goal dynamics: Prolegomena to a constructive theory of intentions, Synthese 155, pp. 237--263, 2007.

[29]

F. V. Jensen, Bayesian Networks and Decision Graphs, Statistics for Engineering and Information Science, Springer, 2001.

Digital Library

[30]

Vogt T, Andre' E, Bee N (2008) EmoVoice - A Framework for Online Recognition of Emotions from Voice. In Proceedings of the 4th IEEE tutorial and research workshop on Perception and Interactive Technologies for Speech-Based Systems: Perception in Multimodal Dialogue Systems (PIT '08), Springer-Verlag, Berlin, 188--199.

Digital Library

[31]

Sundberg, J., Patel, S., Björkner, E., & Scherer, K. R. (2011). Interdependencies among voice source parameters in emotional speech. IEEE Transactions on Affective Computing, 2(3).

Digital Library

[32]

Reiter E, Dale R (2000) Building Natural Language Generation Systems. Studies in natural language processing. Cambridge University Press, Cambridge, United Kingdom. ISBN 0-521-62036-8.

Digital Library

[33]

http://www.aldebaran-robotics.com/ (last visited Oct 3, 2012).

[34]

Cohen, I., Looijeand, R. & Neerincx, M. A. (2011). Child's recognition of emotions in robot's face and body. In Proceedings of the 6th international conference on human-robot interaction (pp. 123--124).

Digital Library

[35]

Tielman M. Adaptive emotional expression in robot-child interaction. Proceedings of the 2014 ACM/IEEE international conference on Human-robot interaction - HRI '14. New York, New York, USA: 2014. p. 407--414.

Digital Library

[36]

Lim, A.; Okuno, H. G., "The MEI Robot: Towards Using Motherese to Develop Multimodal Emotional Intelligence," Autonomous Mental Development, IEEE Transactions on, vol.6, no.2, pp.126,138, June 2014

Digital Library

[37]

Ribeiro, T., Pereira, A., Deshmukh, A., Aylett, R., & Paiva, A. (2014, May). I'm the mayor: a robot tutor in enercities-2. In Proceedings of the 2014 international conference on Autonomous agents and multi-agent systems (pp. 1675--1676). International Foundation for Autonomous Agents and Multiagent Systems.

Digital Library

[38]

Zhang, L., Jiang, M., Farid, D., & Hossain, M. A. (2013). Intelligent facial emotion recognition and semantic-based topic detection for a humanoid robot. Expert Systems with Applications, 40(13), 5160--5168.

[39]

Johnson, D. O., Cuijpers, R. H., & van der Pol, D. (2013). Imitating human emotions with artificial facial expressions. International Journal of Social Robotics, 5(4), 503--513.

[40]

DOMEO (Domestic Robot for Elderly Assistance) (2012). www.aal-domeo.eu

[41]

MOVEMENT website (2012). http://www.is.tuwien.ac.at/fortec/reha.e/projects/movement/

[42]

Feshbach, N. D. 1987. Parental empathy and child adjustment/maladjustment. In Eisenberg, N., and Strayer, J., eds., Empathy and its development. Cambridge University Press.

[43]

Oatley, K. and Johnson-Laird, P. N., 1987. Towards a Cognitive Theory of Emotions. Cognition and Emotion, 29--50.

[44]

Elliott, C. and Siegle, G., 1993. Variables influencing the intensity of simulated affective states. In Proceedings of the AAAI Spring Symposium on Mental States.'93, 58--67.

[45]

Ekman, P. & Oster, H. (1979). Facial Expressions of Emotion. Annual Review of Psychology, 30, 527--554.

[46]

Palestra, G., Pettinicchio, A., Del Coco, M., Carcagnì, P., Leo, M., Distante, C., "Improved Performance in Facial Expression Recognition Using 32 Geometric Features". ICIAP 2015, Lecture Notes in Computer Science, Springer.

[47]

De Carolis B., Mazzotta I., Novielli N., Pizzutilo S.: User Modeling in Social Interaction with a Caring Agent. In: UMADR - User Modeling and Adaptation for Daily Routines, Springer HCI Series. Springer, 2013

[48]

A. Mehrabian. Communication without words. Psychology Today, 2:53--56, 1968.

[49]

Boersma, Paul & Weenink, David (2015). Praat: doing phonetics by computer {Computer program}. Version 5.4.09, retrieved 1 June 2015 from http://www.praat.org/

[50]

Hong Jiang, Jose M. Vidal, Michael N. Huhns, EBDI: an architecture for emotional agents, Proceedings of the 6th international joint conference on Autonomous agents and multiagent systems, May 14--18, 2007, Honolulu, Hawaii

Digital Library

Cited By

De Carolis BPalestra GCastellano GBoratto LGena CMarras MGermanakos PPopescus E(2024)Exploring the Role of Empathy in Designing Social Robots for Elderly PeopleAdjunct Proceedings of the 32nd ACM Conference on User Modeling, Adaptation and Personalization10.1145/3631700.3664887(120-125)Online publication date: 27-Jun-2024
https://dl.acm.org/doi/10.1145/3631700.3664887
Lubold NWalker EPon-Barry H(2021)Effects of adapting to user pitch on rapport perception, behavior, and state with a social robotic learning companionUser Modeling and User-Adapted Interaction10.1007/s11257-020-09267-331:1(35-73)Online publication date: 1-Mar-2021
https://dl.acm.org/doi/10.1007/s11257-020-09267-3
Robaczewski ABouchard JBouchard KGaboury S(2020)Socially Assistive Robots: The Specific Case of the NAOInternational Journal of Social Robotics10.1007/s12369-020-00664-713:4(795-831)Online publication date: 20-Jun-2020
https://doi.org/10.1007/s12369-020-00664-7

Index Terms

Modeling and Simulating Empathic Behavior in Social Assistive Robots

Recommendations

Multimodal Expression of Artificial Emotion in Social Robots Using Color, Motion and Sound
HRI '18: Proceedings of the 2018 ACM/IEEE International Conference on Human-Robot Interaction

Artificial emotion display is a key feature of social robots to communicate internal states and behaviors in familiar human terms. While humanoid robots can draw on signals such as facial expressions or voice, emotions in appearance-constrained robots ...
Simulating empathic behavior in a social assistive robot

When used as an interface in the context of Ambient Assisted Living (AAL), a social robot should not just provide a task-oriented support. It should also try to establish a social empathic relation with the user. To this aim, it is crucial to endow the ...
Adapting to My User, Engaging with My Robot: An Adaptive Affective Architecture for a Social Assistive Robot
Affective feedback from social robots is a useful technique for communicating to people whether they are interacting “well” with the robot or not. However, some users, such as people with physical or cognitive difficulties, may not be able to interact in ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

CHItaly '15: Proceedings of the 11th Biannual Conference of the Italian SIGCHI Chapter

September 2015

195 pages

ISBN:9781450336840

DOI:10.1145/2808435

General Chairs:
Paolo Bottoni,
Tiziana Catarci,
Program Chairs:
Maria De Marsico,
Daniela Fogli

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

Sapienza: Sapienza University of Rome

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 September 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

CHItaly 2015

CHItaly 2015: 11th biannual Conference of the Italian SIGCHI Chapter

September 28 - 30, 2015

Rome, Italy

Acceptance Rates

CHItaly '15 Paper Acceptance Rate 31 of 59 submissions, 53%;

Overall Acceptance Rate 109 of 242 submissions, 45%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
235
Total Downloads

Downloads (Last 12 months)21
Downloads (Last 6 weeks)6

Reflects downloads up to 24 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

De Carolis BPalestra GCastellano GBoratto LGena CMarras MGermanakos PPopescus E(2024)Exploring the Role of Empathy in Designing Social Robots for Elderly PeopleAdjunct Proceedings of the 32nd ACM Conference on User Modeling, Adaptation and Personalization10.1145/3631700.3664887(120-125)Online publication date: 27-Jun-2024
https://dl.acm.org/doi/10.1145/3631700.3664887
Lubold NWalker EPon-Barry H(2021)Effects of adapting to user pitch on rapport perception, behavior, and state with a social robotic learning companionUser Modeling and User-Adapted Interaction10.1007/s11257-020-09267-331:1(35-73)Online publication date: 1-Mar-2021
https://dl.acm.org/doi/10.1007/s11257-020-09267-3
Robaczewski ABouchard JBouchard KGaboury S(2020)Socially Assistive Robots: The Specific Case of the NAOInternational Journal of Social Robotics10.1007/s12369-020-00664-713:4(795-831)Online publication date: 20-Jun-2020
https://doi.org/10.1007/s12369-020-00664-7

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents