Approximate Bayesian Inference for Large Scale Inverse Problems: A Computational Viewpoint

Add to your list(s) Download to your calendar using vCal

• Prof. Matthias Seeger (EPFL)
• Thursday 28 July 2011, 11:30-12:30
• Engineering Department, CBL Room 438.

If you have a question about this talk, please contact Zoubin Ghahramani.

Tomographic sparse linear inverse problems are at the core of medical imaging (MRI, CT), astronomy, analysis of large scale networks, and many other applications. Viewed as a probabilistic graphical model, they are characterized by a densely, non-locally coupled likelihood and a non-Gaussian sparsity prior. Even MAP estimation is challenging for these models, yet intense recent research has produced a range of competitive MAP algorithms. However, for these underdetermined problems, there are compelling reasons to move beyond MAP towards Bayesian inference and decision making, such as increased robustness and interpretability, built-in mechanisms to fit linear or nonlinear hyperparameters, and adaptation of the measurement operator by experimental design (active learning). Unfortunately, current approximate inference algorithms are many orders of magnitude too slow to accept this challenge.

A key strategy to narrow the gap to MAP is to find ways to reduce approximate inference to subproblems of penalized likelihood structure. Using tools from convex duality, I show how to achieve such iterative decoupling for a range of commonly used variational inference relaxations. Resulting double loop algorithms are orders of magnitude faster than previous coordinate descent (or “message-passing”) algorithms. Not surprisingly, approximate inference remains harder than MAP , but the added difficulties are transparent and amenable to fast techniques from signal processing and numerical mathematics.

Time permitting, I will comment on work in progress on integrating factorization assumptions and on approximate Bayesian blind deconvolution.

This talk is part of the Machine Learning @ CUED series.

This talk is included in these lists:

• Seminar
• All Talks (aka the CURE list)
• Biology
• CBL important
• Cambridge Centre for Data-Driven Discovery (C2D3)
• Cambridge Forum of Science and Humanities
• Cambridge Language Sciences
• Cambridge Neuroscience Seminars
• Cambridge talks
• Chris Davis' list
• Creating transparent intact animal organs for high-resolution 3D deep-tissue imaging
• Engineering Department, CBL Room 438
• Featured lists
• Guy Emerson's list
• Hanchen DaDaDash
• Inference Group Summary
• Information Engineering Division seminar list
• Interested Talks
• Joint Machine Learning Seminars
• Life Science
• Life Sciences
• ML
• Machine Learning @ CUED
• Machine Learning Summary
• Neuroscience
• Neuroscience Seminars
• Neuroscience Seminars
• Required lists for MLG
• Simon Baker's List
• Stem Cells & Regenerative Medicine
• Trust & Technology Initiative - interesting events
• bld31
• dh539
• ndk22's list
• ob366-ai4er
• rp587
• yk373's list

Note that ex-directory lists are not shown.