How close are these distributions? A brief introduction to statistical distances and divergences.

Add to your list(s) Download to your calendar using vCal

• David Burt, University of Cambridge
• Wednesday 11 May 2022, 11:00-12:30
• Cambridge University Engineering Department, CBL Seminar room BE4-38.

If you have a question about this talk, please contact Elre Oldewage.

The question of whether two probability distributions are `close’ to each other arises in many contexts in statistics and machine learning, including hypothesis testing, approximate Bayesian inference and generative modelling. However, what it means for two probability distributions to be `close’ is somewhat subtle. In this reading group, we will give an overview of some of the different ways of measuring distance between probability distributions, as well as relationships between these notions of distance.

Required Reading: None.

References and Further (Optional) Reading:

1. On Integral Probability Metrics, φ-Divergences and Binary Classification. Bharath K. Sriperumbudur, Kenji Fukumizu, Arthur Gretton, Bernhard Schölkopf and Gert R.G. Lanckrie. 2009.
2. A Kernel Two-Sample Test. Arthur Gretton, Karsten M. Borgwardt, Malte J. Rasch, Bernhard Schölkopf, Alexander Smola.
3. Lecture Notes on Information Theory. Yury Polyanskiy and Yihong Wu. http://www.stat.yale.edu/~yw562/teaching/itlectures.pdf. (Particularly chapter 6 and 7 on f-divergences).
4. Optimal transport, old and new. Cedric Villani. Chapter 6.

This talk is part of the Machine Learning Reading Group @ CUED series.

This talk is included in these lists:

• All Talks (aka the CURE list)
• Cambridge Centre for Data-Driven Discovery (C2D3)
• Cambridge Forum of Science and Humanities
• Cambridge Language Sciences
• Cambridge University Engineering Department Talks
• Cambridge University Engineering Department, CBL Seminar room BE4-38
• Cambridge talks
• Centre for Smart Infrastructure & Construction
• Chris Davis' list
• Computational Continuum Mechanics Group Seminars
• Featured lists
• Guy Emerson's list
• Hanchen DaDaDash
• Inference Group Journal Clubs
• Inference Group Summary
• Information Engineering Division seminar list
• Interested Talks
• ML
• Machine Learning Reading Group
• Machine Learning Reading Group @ CUED
• Machine Learning Summary
• Quantum Matter Journal Club
• Required lists for MLG
• School of Technology
• Simon Baker's List
• TQS Journal Clubs
• Trust & Technology Initiative - interesting events
• bld31
• custom
• ndk22's list
• ob366-ai4er
• rp587
• yk373's list

Note that ex-directory lists are not shown.