A Model-Learner Pattern for Bayesian Reasoning

Add to your list(s) Download to your calendar using vCal

• Andy Gordon, Microsoft Research and University of Edinburgh
• Monday 19 November 2012, 13:00-14:00
• FW26.

If you have a question about this talk, please contact Peter Sewell.

A Bayesian model consists of a pair of probability distributions, known as the prior and sampling distributions. A wide range of fundamental machine learning tasks, including regression, classification, clustering, and many others, can all be seen as Bayesian models. We propose a new probabilistic programming abstraction, a typed Bayesian model, which is a pair of probabilistic functions for the prior and sampling distributions. A sampler for a model is an algorithm to compute synthetic data from its sampling distribution, while a learner for a model is an algorithm for probabilistic inference on the model. Models, samplers, and learners form a generic programming pattern for model-based inference. They support the uniform expression of common tasks including model testing, and generic compositions such as mixture models, evidence-based model averaging, and mixtures of experts. A formal semantics supports reasoning about model equivalence and implementation correctness. By developing a series of examples and three learner implementations based on exact inference, belief-propagation, and Markov chain Monte Carlo, we demonstrate the broad applicability of this new programming pattern.

The talk is based on joint work with Mihhail Aizatulin (Open University), Johannes Borgstroem (Uppsala University), Guillaume Claret (MSR), Thore Graepel (MSR), Aditya Nori (MSR), Sriram Rajamani (MSR), and Claudio Russo (MSR).

See http://research.microsoft.com/fun

This talk is part of the Semantics Lunch (Computer Laboratory) series.

This talk is included in these lists:

• All Talks (aka the CURE list)
• Cambridge talks
• Department of Computer Science and Technology talks and seminars
• FW26
• Interested Talks
• School of Technology
• Semantics Lunch (Computer Laboratory)
• Trust & Technology Initiative - interesting events
• bld31
• yk373's list

Note that ex-directory lists are not shown.