Hessian-based Markov-Chain Monte Carlo Algorithms

Add to your list(s) Download to your calendar using vCal

• Tom Minka (Microsoft Research Ltd)
• Thursday 02 July 2009, 14:00-15:30
• Engineering Department, CBL Room 438.

If you have a question about this talk, please contact Shakir Mohamed.

Hessian-based Markov-Chain Monte Carlo Algorithms Tom Minka Microsoft Research Cambridge —— I will talk about how to make Markov-chain Monte Carlo run more efficiently in high-dimensional, continuous spaces. The idea is to shape the Markov transition density according to the local Hessian of the probability density function. This leads to a Hessian-based Metropolis-Hastings algorithm that we call HMH . A naive implementation of this idea would be quite expensive however, requiring the Hessian to be recomputed at each sample. Instead I will describe how to incrementally update the Hessian, and how to get many samples from the same Hessian (using the multiple-try Metropolis algorithm). The upshot is that, given any function where you can do efficient Hessian-based optimization, you can also do efficient sampling.

Joint work with Yuan (Alan) Qi.

Link to paper: http://www.cs.purdue.edu/homes/alanqi/papers.html

This talk is part of the Machine Learning Reading Group @ CUED series.

This talk is included in these lists:

• All Talks (aka the CURE list)
• Cambridge Centre for Data-Driven Discovery (C2D3)
• Cambridge Forum of Science and Humanities
• Cambridge Language Sciences
• Cambridge University Engineering Department Talks
• Cambridge talks
• Centre for Smart Infrastructure & Construction
• Chris Davis' list
• Computational Continuum Mechanics Group Seminars
• Engineering Department, CBL Room 438
• Featured lists
• Guy Emerson's list
• Hanchen DaDaDash
• Inference Group Journal Clubs
• Inference Group Summary
• Information Engineering Division seminar list
• Interested Talks
• ML
• Machine Learning Reading Group
• Machine Learning Reading Group @ CUED
• Machine Learning Summary
• Quantum Matter Journal Club
• Required lists for MLG
• School of Technology
• Simon Baker's List
• TQS Journal Clubs
• Trust & Technology Initiative - interesting events
• bld31
• custom
• ndk22's list
• ob366-ai4er
• rp587
• yk373's list

Note that ex-directory lists are not shown.