BEGIN:VCALENDAR
VERSION:2.0
PRODID:-//talks.cam.ac.uk//v3//EN
BEGIN:VTIMEZONE
TZID:Europe/London
BEGIN:DAYLIGHT
TZOFFSETFROM:+0000
TZOFFSETTO:+0100
TZNAME:BST
DTSTART:19700329T010000
RRULE:FREQ=YEARLY;BYMONTH=3;BYDAY=-1SU
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:+0100
TZOFFSETTO:+0000
TZNAME:GMT
DTSTART:19701025T020000
RRULE:FREQ=YEARLY;BYMONTH=10;BYDAY=-1SU
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
CATEGORIES:NLIP Seminar Series
SUMMARY:Language Modelling with Phonemes - Zebulon Youra G
 oriely (University of Cambridge)
DTSTART;TZID=Europe/London:20241025T120000
DTEND;TZID=Europe/London:20241025T130000
UID:TALK222613AThttp://talks.cam.ac.uk
URL:http://talks.cam.ac.uk/talk/index/222613
DESCRIPTION:The statistical properties of language and how the
 y may be used in language processing and language 
 acquisition have been studied for many decades. Re
 cently\, large language models have demonstrated s
 triking language-learning capabilities\, providing
  evidence for the “richness” of the linguistic sti
 mulus\, but are often trained on data that seems c
 ognitively implausible both in terms of quantity (
 thousands of human-lifetimes) and quality (written
  text\, internet sources). For these models to hel
 p us study language\, we must think far more caref
 ully about the plausibility of the input – using p
 honemes instead of letters\, using spoken sources\
 , and reducing the quantity. We must then determin
 e whether the architectures we use are suitable at
  this scale and input representation. These models
  can then give us valuable analytical insights abo
 ut the statistical properties of language and the 
 learnability of language\, as well as giving us pr
 actical benefits for tasks associated with languag
 e modelling and language understanding.\n\n*Speake
 r Biography*\n\nZebulon Goriely is a fourth-year P
 hD student working on Transformer Language Models 
 and Child Language Acquisition\, supervised by Pro
 fessor Paula Buttery.
LOCATION:Zoom link: https://cam-ac-uk.zoom.us/j/4751389294?
 pwd=Z2ZOSDk0eG1wZldVWG1GVVhrTzFIZz09
CONTACT:Suchir Salhan
END:VEVENT
END:VCALENDAR