COOKIES: By using this website you agree that we can place Google Analytics Cookies on your device for performance monitoring. |
University of Cambridge > Talks.cam > pf376's list > Real-world task assistance with GRILLBot, the winning Amazon Alexa Prize TaskBot.
Real-world task assistance with GRILLBot, the winning Amazon Alexa Prize TaskBot.Add to your list(s) Download to your calendar using vCal
If you have a question about this talk, please contact Panagiotis Fytas. Effective virtual assistants have to guide users through long and complex tasks, be engaging, and help solve unpredictable problems along the way. This talk presents GRILL Bot, a multi-modal task-oriented assistant, as the winning system in the 2022 Amazon Alexa Prize TaskBot challenge. GRILL Bot personalizes assistance in cooking, DIY , and crafts by leveraging TaskGraphs, a novel task representation. TaskGrahps unify steps, requirements, and curated domain knowledge into dynamic graphs enabling detailed contextual explanations and adaptable task execution. Further augmentations with segmented videos and linked step images allow full use of the multi-modal experience. We will explore the critical roles language models play in GRILL Bot both in offline task augmentations like contextual jokes and in online settings with knowledge-grounded question answering and a semantic parsing approach to dialogue management. We will finally discuss the lessons learned from a full year of real-world users and showcase GRILL Bot in action. This talk is part of the pf376's list series. This talk is included in these lists:Note that ex-directory lists are not shown. |
Other listsMAGDALENE FESTIVAL OF SOUND Bullard Laboratories Wednesday Seminars Type the title of a new list hereOther talksComplete and submit project choice forms Decolonial and inclusive fieldwork Group Work Probing the early Universe with the oldest stars in the Milky Way Human inborn errors of immunity: revealing key mechanisms of antiviral immunity On or Off? Interpreting episodic tremor during the Fagradalsfjall eruption 2021 |