Modern Neural Networks: the Hinton Camp

Add to your list(s) Download to your calendar using vCal

• Richard Turner, Mark van der Wilk
• Thursday 15 November 2012, 14:30-16:00
• Engineering Department, CBL Room 438.

If you have a question about this talk, please contact Konstantina Palla.

Historically, neural networks with multiple hidden layers have been avoided because they are difficult to train. For example, training the networks with back-propagation yielded disappointing results, which were often worse than those obtained using shallower models. In this RCC we will present an alternative approach to training neural networks – a form of deep learning developed by Geoffrey Hinton. The main idea is to train deep generative models layer-by-layer in a greedy unsupervised fashion making use of a theoretical connection with Restrictive Boltzmann Machines (RBM’s). This network can then be augmented with an additional layer to perform classification, which gives a greatly increased performance over older training methods. We will focus on showing the need for deep models, describing practical algorithms, and unpacking some of the theoretical analogies used to justify the design choices.

This talk is part of the Machine Learning Reading Group @ CUED series.

This talk is included in these lists:

• All Talks (aka the CURE list)
• Cambridge Centre for Data-Driven Discovery (C2D3)
• Cambridge Forum of Science and Humanities
• Cambridge Language Sciences
• Cambridge University Engineering Department Talks
• Cambridge talks
• Centre for Smart Infrastructure & Construction
• Chris Davis' list
• Computational Continuum Mechanics Group Seminars
• Engineering Department, CBL Room 438
• Featured lists
• Guy Emerson's list
• Hanchen DaDaDash
• Inference Group Journal Clubs
• Inference Group Summary
• Information Engineering Division seminar list
• Interested Talks
• ML
• Machine Learning Reading Group
• Machine Learning Reading Group @ CUED
• Machine Learning Summary
• Quantum Matter Journal Club
• Required lists for MLG
• School of Technology
• Simon Baker's List
• TQS Journal Clubs
• Trust & Technology Initiative - interesting events
• bld31
• custom
• ndk22's list
• ob366-ai4er
• rp587
• yk373's list

Note that ex-directory lists are not shown.