Deep Learning of Natural Language Semantics

Add to your list(s) Download to your calendar using vCal

• Prof Yoshua Bengio - Université de Montréal
• Monday 13 April 2015, 14:00-15:00
• Lecture Theatre 1, Computer Laboratory.

If you have a question about this talk, please contact David Greaves.

Extrodinary (out-of-term) Babbage Seminar

The core ingredient of deep learning is the notion of distributed representation. This talk will start by explaining its theoretical advantages for modelling language, in comparison with non-parametric methods based on counting frequencies of occurrence of observed tuples of values (like with n-grams). The talk will then explain how having multiple levels of representation, i.e., depth, can in principle give another exponential advantage. Neural language models have been extremely successful in recent years but extending their reach from language modelling to machine translation is very appealing because it forces the learned intermediate representations to capture meaning, and we found that the resulting word embeddings are qualitatively different. Recently, we introduced the notion of attention-based neural machine translation, with impressive results on several language pairs, and we applied the same ideas to caption generation, i.e., generating a sentence associated with an input image, yielding impressive results that will conclude the talk.

Yoshua Bengio is, along with Geoff Hinton and Yann LeCun, one of the machine learning researchers who has led the recent deep learning renaissance. He has made significant contributions to the understanding of deep neural networks and his work has led to advances in numerous application areas including computer vision, artificial intelligence and natural language understanding. He has won numerous awards for his work and his research has been cited over 22,000 times.

This talk is part of the Wednesday Seminars - Department of Computer Science and Technology series.

This talk is included in these lists:

• All Talks (aka the CURE list)
• Cambridge Centre for Data-Driven Discovery (C2D3)
• Cambridge Forum of Science and Humanities
• Cambridge Language Sciences
• Cambridge talks
• Chris Davis' list
• Department of Computer Science and Technology talks and seminars
• Graduate-Seminars
• Guy Emerson's list
• Interested Talks
• Lecture Theatre 1, Computer Laboratory
• School of Technology
• Trust & Technology Initiative - interesting events
• Wednesday Seminars - Department of Computer Science and Technology
• bld31
• computer science
• ndk22's list
• ob366-ai4er
• rp587
• se393's list

Note that ex-directory lists are not shown.