Modeling crossmodal attention in humanoid robots for HRI in complex social scenarios

Add to your list(s) Download to your calendar using vCal

• Di Fu, University of Hamburg
• Thursday 08 June 2023, 11:00-12:00
• Zoom: https://cl-cam-ac-uk.zoom.us/j/96901178502?pwd=ODJOZ0pDQnVaeGNleHpIUDRNTUF6QT09.

If you have a question about this talk, please contact Hatice Gunes.

Abstract: Due to the aging population and life digitalization, humanoid robots could be seen as potential assistants to accompany senior citizens, support remote work, and improve individuals’ mental or physical health. It is essential for robots to become more socialized by processing multiple social cues in a complex real-world environment. Thus, social cues integration, crossmodal attention, and conflict resolution are crucial for humanoid robots to implement social interaction. I will present a series of studies to explore the following questions: 1) how a humanoid robot could perform human-like attentional behaviors in complex environments with crossmodal conflicts; 2) how a humanoid robot interacts with humans by integrating different social cues and exhibiting different personalities; 3) how gaze and facial expressions of a humanoid robot impact on human-human-robot collaboration. Our experiments explored human crossmodal attention mechanisms with high ecological validity and proved that a humanoid robot could replicate human-like responses. Our interdisciplinary work provides important insights into how crossmodal attention can be modeled in robots and introduces future research directions for HRI .

Biography: Dr. Di Fu completed her doctoral training in human-robot interaction at the Department of Informatics, the University of Hamburg (UHH), with Prof. Stefan Wermter from 2017 to 2020, and in cognitive neuroscience at the Institute of Psychology, Chinese Academy of Sciences (CAS) with Prof. Xun Liu from 2014 to 2020. She is currently a Postdoctoral Researcher at the University of Hamburg, with research interests in audiovisual crossmodal attention, social robotics, and human-robot interaction. She had been honored as an outstanding graduate of CAS and an outstanding doctoral graduate of Beijing. She has been awarded the Kavli Summer Institute in Cognitive Neuroscience fellowship, the International postdoctoral exchange fellowship, the CAS -DAAD joint doctoral student fellowship, and the Chinese National Academic Scholarship. Her work has been published in the International Journal of Social Robotics, Public Administration Review, IEEE IROS , IEEE RO-MAN, IEEE IJCNN , etc. She also serves as a committee member of the Chinese Association for Psychological & Brain Sciences and the Chinese German Association for Biology and Medicine.

This talk is part of the Rainbow Group Seminars series.

This talk is included in these lists:

• All Talks (aka the CURE list)
• Cambridge Centre for Data-Driven Discovery (C2D3)
• Cambridge talks
• Chris Davis' list
• Department of Computer Science and Technology talks and seminars
• Interested Talks
• Rainbow Group Seminars
• School of Technology
• Trust & Technology Initiative - interesting events
• Zoom: https://cl-cam-ac-uk.zoom.us/j/96901178502?pwd=ODJOZ0pDQnVaeGNleHpIUDRNTUF6QT09
• bld31
• ndk22's list
• ob366-ai4er
• rp587

Note that ex-directory lists are not shown.