Supervising Robot Learning with Language and Video from the Web

Add to your list(s) Download to your calendar using vCal

• Suraj Nair, Stanford University
• Thursday 18 November 2021, 15:00-16:00
• https://cam-ac-uk.zoom.us/j/97599459216?pwd=QTRsOWZCOXRTREVnbTJBdXVpOXFvdz09.

If you have a question about this talk, please contact Marinela Parovic.

While deep reinforcement learning applied to robotics has seen a number of recent successes in constrained environments, generalist robots that can operate in diverse real world settings have remained out of reach. Critically, robot learning algorithms have yet to be able to learn from a sufficient breadth of data that can enable broad generalization across tasks and environments. In this talk, I’ll discuss the paradigm of offline learning for robotics as a path towards generalist robots, and how we might supervise this offline learning process in a scalable way using crowdsourced language and videos of humans. Specifically, I’ll cover two recent papers which learn reward functions for offline reinforcement learning through language annotations of pre-collected robot datasets and human video datasets which exist on the web.

This talk is part of the Language Technology Lab Seminars series.

This talk is included in these lists:

• Cambridge Centre for Data-Driven Discovery (C2D3)
• Cambridge Forum of Science and Humanities
• Cambridge Language Sciences
• Cambridge talks
• Chris Davis' list
• Guy Emerson's list
• Interested Talks
• Language Sciences for Graduate Students
• Language Technology Lab Seminars
• Simon Baker's List
• Trust & Technology Initiative - interesting events
• bld31
• https://cam-ac-uk.zoom.us/j/97599459216?pwd=QTRsOWZCOXRTREVnbTJBdXVpOXFvdz09
• ndk22's list
• ob366-ai4er
• rp587

Note that ex-directory lists are not shown.