Principled Hybrids of Generative and Discriminative Models

Add to your list(s) Download to your calendar using vCal

• Philip Sterne (University of Cambridge)
• Monday 04 February 2008, 11:10-12:45
• TCM Seminar Room, Cavendish Laboratory, Department of Physics.

If you have a question about this talk, please contact Philip Sterne.

For this journal club we will look at Principled Hybrids of Generative and Discriminative Models by Bishop and Laserre (2006)

A shortened abstract: When labelled training data is plentiful, discriminative techniques are widely used since they give excellent generalization performance. However, for large-scale applications such as object recognition, hand labelling of data is expensive, and there is much interest in semi-supervised techniques based on generative models in which the training data is unlabelled. In an attempt to gain the benefit of both generative and discriminative approaches, heuristic procedure have been proposed [2, 3] which interpolate between these two extremes.

In this paper we adopt a new perspective which says that there is only one correct way to train a given model, and that a `discriminatively trained’ generative model is fundamentally a new model [7]. From this viewpoint, generative and discriminative models correspond to specific choices for the prior over parameters.

Another related article is Generative or Discriminative? Getting the Best of Both Worlds

The journal club will be preceded by a 5-minute talk by Ignas about his undergraduate project

This talk is part of the Machine Learning Journal Club series.

This talk is included in these lists:

• Cambridge talks
• Guy Emerson's list
• Hanchen DaDaDash
• Inference Group Journal Clubs
• Inference Group Summary
• Interested Talks
• ML
• Machine Learning Journal Club
• Machine Learning Summary
• Quantum Matter Journal Club
• TCM Seminar Room, Cavendish Laboratory, Department of Physics
• TQS Journal Clubs
• rp587
• yk373's list

Note that ex-directory lists are not shown.