How language understanding unfolds in minds and machines

Add to your list(s) Download to your calendar using vCal

• Roger Levy (MIT)
• Friday 12 November 2021, 12:00-13:00
• Virtual (Zoom).

If you have a question about this talk, please contact Georgi Karadzhov.

Language allows us to package our thoughts into symbolic forms and transmit some approximation of them into each other’s minds. We do this hundreds of times a day as listeners, speakers, readers, and writers. How we’re able to achieve this is one of the great scientific questions in the study of mind and brain. In this talk I describe two of our research group’s recent theoretical and empirical advances in our work on this question. First, we evaluate and calibrate contemporary deep-learning models for human-like processing using numerous controlled experimental benchmarks and human behavioral datasets. Our results shed light on classic questions of the learnability of syntactic structures from linguistic input, and also highlight the continued importance of model architecture for human-like linguistic generalization. Second, we offer new results from a theory of how memory constrains human understanding: namely, that context representations are “lossy” in an information-theoretic sense. This theory novelly links memory representations for grammatical structures to the statistics of the natural language environment, explaining recent results showing how the same grammatical configuration can differ in difficulty for native speakers of different languages. The theory also predicts new generalizations about word order that we empirically confirm in multiple languages.

Joining instructions: Georgi Karadzhov is inviting you to a scheduled Zoom meeting.

Topic: NLP Seminar 12.11.2021 Time: Nov 12, 2021 12:00 PM London

Join Zoom Meeting https://cl-cam-ac-uk.zoom.us/j/99738977979?pwd=cTJWd3JmZHJpd21QRWU5ZnNPemlOQT09

Meeting ID: 997 3897 7979 Passcode: 521912 One tap mobile +13462487799,,99738977979# US (Houston) +16699006833,,99738977979# US (San Jose)

Dial by your location +1 346 248 7799 US (Houston) +1 669 900 6833 US (San Jose) +1 929 205 6099 US (New York) +1 253 215 8782 US (Tacoma) +1 301 715 8592 US (Washington DC) +1 312 626 6799 US (Chicago) Meeting ID: 997 3897 7979 Find your local number: https://cl-cam-ac-uk.zoom.us/u/ac8u5e5toO

This talk is part of the NLIP Seminar Series series.

This talk is included in these lists:

• All Talks (aka the CURE list)
• Cambridge Centre for Data-Driven Discovery (C2D3)
• Cambridge Forum of Science and Humanities
• Cambridge Language Sciences
• Cambridge talks
• Chris Davis' list
• Department of Computer Science and Technology talks and seminars
• Graduate-Seminars
• Guy Emerson's list
• Interested Talks
• Language Sciences for Graduate Students
• NLIP Seminar Series
• PMRFPS's
• Simon Baker's List
• Trust & Technology Initiative - interesting events
• Virtual (Zoom)
• bld31
• ndk22's list
• ob366-ai4er
• rp587

Note that ex-directory lists are not shown.