BEGIN:VCALENDAR
VERSION:2.0
PRODID:-//talks.cam.ac.uk//v3//EN
BEGIN:VTIMEZONE
TZID:Europe/London
BEGIN:DAYLIGHT
TZOFFSETFROM:+0000
TZOFFSETTO:+0100
TZNAME:BST
DTSTART:19700329T010000
RRULE:FREQ=YEARLY;BYMONTH=3;BYDAY=-1SU
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:+0100
TZOFFSETTO:+0000
TZNAME:GMT
DTSTART:19701025T020000
RRULE:FREQ=YEARLY;BYMONTH=10;BYDAY=-1SU
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
CATEGORIES:Wednesday Seminars - Department of Computer Scienc
 e and Technology 
SUMMARY:The Quarks of Attention - Professor Pierre Baldi -
  Distinguished Professor\, Department of Computer 
 Science Director\, Institute for Genomics and Bioi
 nformatics Associate Director\, Center for Machine
  Learning and Intelligent Systems\, University of 
 California\, Irvine
DTSTART;TZID=Europe/London:20220126T150500
DTEND;TZID=Europe/London:20220126T155500
UID:TALK166579AThttp://talks.cam.ac.uk
URL:http://talks.cam.ac.uk/talk/index/166579
DESCRIPTION:Attention plays a fundamental role in both natural
  and artificial intelligence systems. In deep lear
 ning\, several attention-based neural network arch
 itectures have been proposed to tackle problems in
  natural language processing (NLP)  and beyond\, i
 ncluding transformer architectures which currently
  achieve state-of-the-art performance in NLP tasks
 . In this presentation we will: \n1) identify and 
 classify the most fundamental building blocks (qua
 rks) of attention\, both within and beyond the sta
 ndard model of deep learning\; 2) identify how the
 se building blocks are used in all current attenti
 on-based architectures\, including transformers\; 
 3) demonstrate how transformers can effectively be
  applied to new problems in physics\, from particl
 e physics to astronomy\; and 4) present a mathemat
 ical theory of attention capacity where\, paradoxi
 cally\, one of the main tools in the proofs is its
 elf an attention mechanism.\n\n\nLink to join: htt
 ps://cl-cam-ac-uk.zoom.us/j/97767639783?pwd=T09GcV
 JxZUNEUFEvRnZnbWwxeEwzQT09\n\nA recording of this 
 talk is available at the following link: https://w
 ww.cl.cam.ac.uk/seminars/wednesday/video/
LOCATION:Online
CONTACT:Ben Karniely
END:VEVENT
END:VCALENDAR