Hybrids of generative and discriminative models

Add to your list(s) Download to your calendar using vCal

• Julia Lasserre (University of Cambridge/Max Planck Institute)
• Tuesday 30 June 2009, 15:00-15:20
• Large public lecture room, Microsoft Research, Roger Needham Building, 7 J J Thomson Avenue, Cambridge CB3 0FB.

If you have a question about this talk, please contact Dr Fabien Petitcolas.

Abstract: When labelled training data is plentiful, discriminative techniques are widely used since they give excellent classification results. However, hand-labelling of data can get expensive, and there is considerable interest in semi-supervised techniques based on generative models. Although the generalisation performance of generative models can often be improved by `training them discriminatively’, they can then no longer make use of unlabelled data. In an attempt to exploit the benefits of both generative and discriminative approaches, methods have been proposed which interpolate between these two extremes by taking a convex combination of the generative and discriminative objective functions. In this article, we consider that there is only one correct way to train a given model, and that a `discriminatively trained’ generative model is fundamentally a new model. From this viewpoint, generative and discriminative models correspond to specific choices for the prior over parameters, which opens the door to principled ways of interpolating between generative and discriminative extremes through alternative choices of prior. We illustrate this framework on semi- supervised learning.

This talk is part of the Microsoft Research Summer School series.

This talk is included in these lists:

• All Talks (aka the CURE list)
• Cambridge Centre for Data-Driven Discovery (C2D3)
• Cambridge talks
• Chris Davis' list
• Guy Emerson's list
• Interested Talks
• Large public lecture room, Microsoft Research, Roger Needham Building, 7 J J Thomson Avenue, Cambridge CB3 0FB
• Microsoft Research Cambridge, public talks
• Microsoft Research PhD Scholars
• Microsoft Research Summer School
• Optics for the Cloud
• PMRFPS's
• School of Technology
• Trust & Technology Initiative - interesting events
• bld31
• ndk22's list
• ob366-ai4er
• personal list
• rp587

Note that ex-directory lists are not shown.