Probing Language Models for Paraphrastic Representations of Negation and Antonymy

Add to your list(s) Download to your calendar using vCal

• Teemu Vahtola, University of Helsinki
• Thursday 18 May 2023, 11:00-12:00
• GR05, English Faculty Building, 9 West Road, Sidgwick Site.

If you have a question about this talk, please contact Panagiotis Fytas.

The ability of large language models to represent essential linguistic properties makes them applicable across a wide range of tasks. However, it is still an open question how well they address systematic compositionality and to what level of abstraction they reflect the actual meaning behind a given sentence. I present work on constructing a dedicated challenge set focusing on a specific linguistic phenomenon. In particular, the challenge set assesses the ability of language models to properly represent paraphrasticity realised in expressions that incorporate antonymy and negation.

I present a large-scale evaluation of publicly available pre-trained language models on the proposed challenge set, showing large variation between models fine-tuned for different downstream tasks.

This talk is part of the Language Technology Lab Seminars series.

This talk is included in these lists:

• Cambridge Centre for Data-Driven Discovery (C2D3)
• Cambridge Forum of Science and Humanities
• Cambridge Language Sciences
• Cambridge talks
• Chris Davis' list
• GR05, English Faculty Building, 9 West Road, Sidgwick Site
• Guy Emerson's list
• Interested Talks
• Language Sciences for Graduate Students
• Language Technology Lab Seminars
• Simon Baker's List
• Trust & Technology Initiative - interesting events
• bld31
• ndk22's list
• ob366-ai4er
• rp587

Note that ex-directory lists are not shown.