Monte Carlo sampling with integrator snippets

Add to your list(s) Download to your calendar using vCal

• Christophe Andrieu (University of Bristol)
• Friday 19 July 2024, 14:30-15:30
• External.

If you have a question about this talk, please contact nobody.

DMLW01 - International workshop on diffusions in machine learning: foundations, generative models, and optimisation

Assume interest is in sampling from a probability distribution μ defined on (Z,Z). We develop a framework to construct sampling algorithms taking full advantage of numerical integrators of ODEs, say ψ : Z→ Z for one integration step, to explore μ  efficiently and robustly. The popular Hybrid/Hamiltonian Monte Carlo (HMC) algorithm [duane1987hybrid, neal2011mcmc] and its derivatives are example of such a use of numerical integrators. However, we show how the potential of integrators can be exploited beyond current ideas and HMC sampling in order to take into account aspects of the geometry of the target distribution. A key idea is the notion of integrator snippet, a fragment of the orbit of an ODE numerical integrator ψ , and its associate probability distribution μ ‾, which takes the form of a mixture of distributions derived from μ  and ψ . Exploiting properties of mixtures we show how samples from μ ‾ can be used to estimate expectations with respect to μ . We focus here primarily on Sequential Monte Carlo (SMC) algorithms, but the approach can be used in the context of Markov chain Monte Carlo algorithms as discussed at the end of the manuscript. We illustrate performance of these new algorithms through numerical experimentation and provide preliminary theoretical results supporting observed performance.    

This talk is part of the Isaac Newton Institute Seminar Series series.

This talk is included in these lists:

• All CMS events
• External
• Featured lists
• INI info aggregator
• Isaac Newton Institute Seminar Series
• School of Physical Sciences
• bld31

Note that ex-directory lists are not shown.