Concentration of tempered posteriors and of their variational approximations

Add to your list(s) Download to your calendar using vCal

• Pierre Alquier, ENSAE
• Friday 16 November 2018, 16:00-17:00
• MR12.

If you have a question about this talk, please contact Dr Sergio Bacallado.

While Bayesian methods are extremely popular in statistics and machine learning, their application to massive datasets is often challenging, when possible at all. Indeed, the classical MCMC algorithms are prohibitively slow when both the model dimension and the sample size are large. Variational Bayesian methods aim at approximating the posterior by a distribution in a tractable family. Thus, MCMC are replaced by an optimization algorithm which is orders of magnitude faster. VB methods have been applied in such computationally demanding applications as including collaborative filtering, image and video processing, NLP and text processing. However, despite very nice results in practice, the theoretical properties of these approximations are usually not known. In this paper, we propose a general approach to prove the concentration of variational approximations of fractional posteriors. We apply our theory to various examples: matrix completion, Gaussian VB, nonparametric regression, mixture models and other machine learning problems.

This talk is based on joint works with James Ridgway, Nicolas Chopin and Badr-Eddine Chérief-Abdellatif

http://www.jmlr.org/papers/v17/15-290.html https://arxiv.org/abs/1706.09293 http://dx.doi.org/doi:10.1214/18-EJS1475

This talk is part of the Statistics series.

This talk is included in these lists:

• All CMS events
• All Talks (aka the CURE list)
• CMS Events
• Cambridge Forum of Science and Humanities
• Cambridge Language Sciences
• Cambridge talks
• Chris Davis' list
• DPMMS Lists
• DPMMS info aggregator
• DPMMS lists
• Guy Emerson's list
• Hanchen DaDaDash
• Interested Talks
• MR12
• Machine Learning
• School of Physical Sciences
• Statistical Laboratory info aggregator
• Statistics
• Statistics Group
• bld31
• custom
• rp587

Note that ex-directory lists are not shown.