Real-world task assistance with GRILLBot, the winning Amazon Alexa Prize TaskBot.

Add to your list(s) Download to your calendar using vCal

• Carlos Gemmell, University of Glasgow
• Thursday 16 March 2023, 11:00-12:00
• SR 24.

If you have a question about this talk, please contact Panagiotis Fytas.

Effective virtual assistants have to guide users through long and complex tasks, be engaging, and help solve unpredictable problems along the way. This talk presents GRILL Bot, a multi-modal task-oriented assistant, as the winning system in the 2022 Amazon Alexa Prize TaskBot challenge. GRILL Bot personalizes assistance in cooking, DIY , and crafts by leveraging TaskGraphs, a novel task representation. TaskGrahps unify steps, requirements, and curated domain knowledge into dynamic graphs enabling detailed contextual explanations and adaptable task execution. Further augmentations with segmented videos and linked step images allow full use of the multi-modal experience. We will explore the critical roles language models play in GRILL Bot both in offline task augmentations like contextual jokes and in online settings with knowledge-grounded question answering and a semantic parsing approach to dialogue management. We will finally discuss the lessons learned from a full year of real-world users and showcase GRILL Bot in action.

This talk is part of the Language Technology Lab Seminars series.

This talk is included in these lists:

• Cambridge Centre for Data-Driven Discovery (C2D3)
• Cambridge Forum of Science and Humanities
• Cambridge Language Sciences
• Cambridge talks
• Chris Davis' list
• Guy Emerson's list
• Interested Talks
• Language Sciences for Graduate Students
• Language Technology Lab Seminars
• SR 24
• Simon Baker's List
• Trust & Technology Initiative - interesting events
• bld31
• ndk22's list
• ob366-ai4er
• rp587

Note that ex-directory lists are not shown.