Measuring Factuality in Text Generation: When Language Models Are Twisting the Facts

Add to your list(s) Download to your calendar using vCal

• Roee Aharoni, Google Research
• Thursday 28 October 2021, 11:00-12:00
• https://cam-ac-uk.zoom.us/j/97599459216?pwd=QTRsOWZCOXRTREVnbTJBdXVpOXFvdz09.

If you have a question about this talk, please contact Marinela Parovic.

Text generation is at the core of many NLP tasks like question answering, dialog generation, machine translation or text summarization. While current text generation models produce text that seems fluent and informative, their outputs often contain factual inconsistencies with respect to the inputs they rely on (a.k.a. “hallucinations”), making it hard to deploy such models in real-world applications.

In this talk I will present two of our recent works tackling those issues. First, I will describe KOBE (Gekhman et al., EMNLP Findings 2020), a knowledge-based approach for evaluating the quality of machine translation models, which uses multilingual entity resolution instead of human reference translations. I will then present Q^2 (Honovich et al., EMNLP 2021 ), an automatic evaluation metric that combines question generation, question answering and natural language inference to validate the outputs of dialogue generation models.

This talk is part of the Language Technology Lab Seminars series.

This talk is included in these lists:

• Cambridge Centre for Data-Driven Discovery (C2D3)
• Cambridge Forum of Science and Humanities
• Cambridge Language Sciences
• Cambridge talks
• Chris Davis' list
• Guy Emerson's list
• Interested Talks
• Language Sciences for Graduate Students
• Language Technology Lab Seminars
• Simon Baker's List
• Trust & Technology Initiative - interesting events
• bld31
• https://cam-ac-uk.zoom.us/j/97599459216?pwd=QTRsOWZCOXRTREVnbTJBdXVpOXFvdz09
• ndk22's list
• ob366-ai4er
• rp587

Note that ex-directory lists are not shown.