COOKIES: By using this website you agree that we can place Google Analytics Cookies on your device for performance monitoring. |
Deep LearningAdd to your list(s) Download to your calendar using vCal
If you have a question about this talk, please contact Zoubin Ghahramani. I will describe an efficient, unsupervised learning procedure for a simple type of two-layer neural network called a Restricted Boltzmann Machine. I will then show how this algorithm can be used recursively to learn multiple layers of features without requiring any supervision. After this unsupervised “pre-training”, the features in all layers can be fine-tuned to be better at discriminating between classes by using the standard backpropagation procedure from the 1980s. Unsupervised pre-training greatly improves generalization to new data, especially when the number of labelled examples is small. Ten years ago, the pre-training approach initiated a revival of research on deep, feedforward neural networks. I will describe some of the major successes of deep networks for speech recognition, object recognition and machine translation and I will speculate about where this research is headed. The fact that backpropagation learning is now the method of choice for a wide variety of really difficult tasks means that neuroscientists may need to reconsider their well-worn arguments about why it cannot possibly be occurring in cortex. I shall conclude by undermining two of the commonest objections to the idea that cortex is actually backpropagating error derivatives through a hierarchy of cortical areas and I shall show that spike-time dependent plasticity is a signature of backpropagation. This talk is part of the Machine Learning @ CUED series. This talk is included in these lists:
Note that ex-directory lists are not shown. |
Other listsBiophysical Techniques Lecture Series 2015 talks Statistical Methods for Cognitive Psychologists Minimum.... or Maximum Cities? Centre for Smart Infrastructure & Construction Seminars Gypsy Roma Traveller (GRT) History MonthOther talksNonstationary Gaussian process emulators with covariance mixtures Primate tourism: opportunities and challenges Behavioural phenotypes of children born preterm: what we know and future research avenues Prescribing step counts in type 2 diabetes and hypertension:Results of the Step Monitoring to improve ARTERial health trial Future of Games in Engineering Education The Intimate Relation between Mechanics and Geometry |