Knowledge Issues and Language Models

Add to your list(s) Download to your calendar using vCal

• James Thorne (KAIST)
• Friday 16 June 2023, 12:00-13:00
• Computer Lab, SS03.

If you have a question about this talk, please contact Michael Schlichtkrull.

Abstract:

As we continue to push the boundaries of natural language processing, it becomes imperative to better understand how language models interact with, incorporate, and are influenced by knowledge. In this talk, I will navigate the complex interaction between language models and knowledge.

I’ll begin by presenting a forthcoming ACL paper, studying fact verification against knowledge graphs. This demonstrates the ability to ground language model outputs against structured information sources. Following this, I’ll discuss ongoing research in multi-hop multi-set retrieval settings, and then explore how the abundance of knowledge available can potentially undermine retrieve-and-reason architectures. Lastly, I’ll put forward a hypothesis about the role of knowledge in language models and consider the potential advantages of combining generative and retrieval-based NLP approaches.

Bio:



James is Assistant Professor at the KAIST Graduate School of AI, South Korea, working on large-scale and knowledge-intensive natural language understanding. James recently completed his PhD at the University of Cambridge where he developed models and methods for automated fact verification and correction.

This talk is part of the NLIP Seminar Series series.

This talk is included in these lists:

• All Talks (aka the CURE list)
• Cambridge Centre for Data-Driven Discovery (C2D3)
• Cambridge Forum of Science and Humanities
• Cambridge Language Sciences
• Cambridge talks
• Chris Davis' list
• Computer Lab, SS03
• Department of Computer Science and Technology talks and seminars
• Graduate-Seminars
• Guy Emerson's list
• Interested Talks
• Language Sciences for Graduate Students
• NLIP Seminar Series
• PMRFPS's
• Simon Baker's List
• Trust & Technology Initiative - interesting events
• bld31
• ndk22's list
• ob366-ai4er
• rp587

Note that ex-directory lists are not shown.