Efficient and Structured Uncertainty: Challenges and Opportunities

Add to your list(s) Download to your calendar using vCal

• Andrey Malinin, Yandex Research
• Wednesday 22 July 2020, 11:00-12:00
• Virtual (see abstract for Zoom link).

If you have a question about this talk, please contact Eric T Nalisnick.

Uncertainty estimation is important for ensuring safety and robustness of AI systems. Ensembles of models yield improvements in system performance as well as principled and interpretable uncertainty estimates. However, ensemble-based uncertainty estimation comes at a computational and memory cost which may be prohibitive for many applications. This has limited both practical application and the scale of problems which are examined in research. In this talk we examine pushing the scale-limit of ensemble-based uncertainty estimation in two ways. Firstly, we introduce the task of “Ensemble Distribution Distillation”. Here, the goal is to distill an ensemble into a single model such that it emulates the ensemble, retaining both its improved predictive performance and interpretable uncertainty estimates. Secondly, we investigate principled ensemble-based uncertainty estimation for autoregressive structured prediction tasks, such as machine translation and speech recognition, an area which has received limited attention so far. Through the lens of these two scale-limits we pose possible directions of future research.

Zoom meeting: https://yandex.zoom.us/j/93618382511?pwd=cHJ0MkhZWXhobzZteG9YTUVJV25iUT09

This talk is part of the Machine Learning @ CUED series.

This talk is included in these lists:

• Seminar
• All Talks (aka the CURE list)
• Biology
• CBL important
• Cambridge Centre for Data-Driven Discovery (C2D3)
• Cambridge Forum of Science and Humanities
• Cambridge Language Sciences
• Cambridge Neuroscience Seminars
• Cambridge talks
• Chris Davis' list
• Creating transparent intact animal organs for high-resolution 3D deep-tissue imaging
• Featured lists
• Guy Emerson's list
• Hanchen DaDaDash
• Inference Group Summary
• Information Engineering Division seminar list
• Interested Talks
• Joint Machine Learning Seminars
• Life Science
• Life Sciences
• ML
• Machine Learning @ CUED
• Machine Learning Summary
• Neuroscience
• Neuroscience Seminars
• Neuroscience Seminars
• Required lists for MLG
• Simon Baker's List
• Stem Cells & Regenerative Medicine
• Trust & Technology Initiative - interesting events
• Virtual (see abstract for Zoom link)
• bld31
• dh539
• kt532's list
• ndk22's list
• ob366-ai4er
• rp587
• yk373's list

Note that ex-directory lists are not shown.