I can see what you think: The mental image revealed by gaze tracking

Add to your list(s) Download to your calendar using vCal

• Xi Wang, Technsiche Universität Berlin
• Monday 10 June 2019, 11:00-12:00
• SS03 Meeting Room, Computer Laboratory.

If you have a question about this talk, please contact Rafal Mantiuk.

Humans involuntarily move their eyes when retrieving an image from memory. This motion is often similar to actually observing the image. We suggest to exploit this behavior as a new modality in human computer interaction, using the motion of the eyes as a descriptor of the image. Interaction requires the user’s eyes to be tracked but no voluntary physical activity. We perform a controlled experiment and develop matching techniques using machine learning to investigate if images can be discriminated based on the gaze patterns recorded while users merely think about image. Our results indicate that image retrieval is possible with an accuracy significantly above chance. We also show that this result generalizes to images not used during training of the classifier and extends to uncontrolled settings in a realistic scenario.

This talk is part of the Rainbow Group Seminars series.

This talk is included in these lists:

• All Talks (aka the CURE list)
• Cambridge Centre for Data-Driven Discovery (C2D3)
• Cambridge talks
• Chris Davis' list
• Department of Computer Science and Technology talks and seminars
• Interested Talks
• Rainbow Group Seminars
• SS03 Meeting Room, Computer Laboratory
• School of Technology
• Trust & Technology Initiative - interesting events
• bld31
• ndk22's list
• ob366-ai4er
• rp587

Note that ex-directory lists are not shown.