GenBench -- State-of-the-art generalisation research in NLP

Add to your list(s) Download to your calendar using vCal

• Dieuwke Hupkes (Facebook AI Research, ELLIS)
• Friday 27 January 2023, 12:00-13:00
• Virtual (Zoom).

If you have a question about this talk, please contact Michael Schlichtkrull.

Abstract:

Good generalisation is of utmost importance for any artificial intelligence model. Traditionally, the generalisation capabilities of machine learning models are evaluated using random train/test splits. However, numerous recent studies have exposed substantial generalisation failures in models that perform well on such random within-distribution splits. So, if random splitting is not good for measuring how robustly models generalise to different scenarios, how should we evaluate that? In this talk, I present a taxonomy for characterising and understanding generalisation in NLP , and use it to analyse over 400 papers of the ACL anthology.

Bio:

Dieuwke Hupkes is a research scientist at FAIR . Previously, she was a post-doctoral researcher at the University of Amsterdam, where she also did her PhD. In her research, she studies neural models of language processing, in which she tries to incorporate knowledge from linguistics and philosophy of language. She is particularly excited about what neural models might teach us about language and human language processing.

Topic: NLIP Seminar Time: Jan 27, 2023 12:00 PM London

Join Zoom Meeting https://cl-cam-ac-uk.zoom.us/j/94330375053?pwd=TjRtbTg5aUdzWVdLRU15RjR0V2g0Zz09

Meeting ID: 943 3037 5053 Passcode: 768471

This talk is part of the NLIP Seminar Series series.

This talk is included in these lists:

• All Talks (aka the CURE list)
• Cambridge Centre for Data-Driven Discovery (C2D3)
• Cambridge Forum of Science and Humanities
• Cambridge Language Sciences
• Cambridge talks
• Chris Davis' list
• Computer Education Research
• Computing Education Research
• Department of Computer Science and Technology talks and seminars
• Graduate-Seminars
• Guy Emerson's list
• Interested Talks
• Language Sciences for Graduate Students
• NLIP Seminar Series
• PMRFPS's
• Simon Baker's List
• Trust & Technology Initiative - interesting events
• Virtual (Zoom)
• bld31
• ndk22's list
• ob366-ai4er
• rp587

Note that ex-directory lists are not shown.