Robust adaptation of integrator snippet sampling algorithms

Add to your list(s) Download to your calendar using vCal

• Christophe Andrieu (University of Bristol)
• Tuesday 26 November 2024, 15:40-16:30
• Seminar Room 1, Newton Institute.

If you have a question about this talk, please contact nobody.

SSDW04 - Monte Carlo sampling: beyond the diffusive regime

Assume interest is in sampling from a probability distribution μ defined on Z. We develop a framework to construct sampling algorithms taking full advantage of numerical integrators of ODEs, say ψ:Z→Z for one integration step, to explore μ efficiently and robustly. The popular Hybrid/Hamiltonian Monte Carlo (HMC) algorithm [Duane et al., 1987, Neal, 2011] and its derivatives are examples of the use of numerical integrators in sampling algorithms. A key idea developed here is that of sampling integrator snippets, that is fragments of the orbit of an ODE numerical integrator ψ , and the definition of an associated probability distribution μ such that expectations with respect to μ can be estimated from integrator snippets sampled from μ . The integrator snippet μ takes the form of a mixture of pushforward distributions which suggests numerous generalisations beyond mappings arising from numerical integrators, e.g. normalising flows. Very importantly this structure also suggests new principled and robust strategies to tune the parameters of integrators, such as the discretisation stepsize and effective integration time, or number of integration steps, in a Leapfrog integrator. We focus here primarily on Sequential Monte Carlo (SMC) algorithms, but the approach can be used in the context of Markov chain Monte Carlo algorithms. We illustrate performance and, in particular, robustness through numerical experiments and provide preliminary theoretical results supporting observed performance.   Joint work with Mauro Camara Escudero and Chang Zhang   Report: arXiv:2404.13302

This talk is part of the Isaac Newton Institute Seminar Series series.

This talk is included in these lists:

• All CMS events
• Featured lists
• INI info aggregator
• Isaac Newton Institute Seminar Series
• School of Physical Sciences
• Seminar Room 1, Newton Institute
• bld31

Note that ex-directory lists are not shown.