Failure Modes of Variational Autoencoders and Their Effects on Downstream Tasks

Add to your list(s) Download to your calendar using vCal

• Yaniv Yacoby, Harvard University
• Wednesday 24 March 2021, 11:00-12:30
• https://eng-cam.zoom.us/j/86068703738?pwd=YnFleXFQOE1qR1h6Vmtwbno0LzFHdz09.

If you have a question about this talk, please contact Elre Oldewage.

Variational Auto-encoders (VAEs) are deep generative latent variable models that are widely used for a number of downstream tasks—semi-supervised learning, learning compressed and disentangled representations, adversarial robustness. VAEs are widely used because they are easy to implement and train; in particular, the common choice of mean-field Gaussian (MFG) approximate posteriors for VAEs (MFG-VAE) results in an inference procedure that is straight-forward to implement and stable in training. Unfortunately, a growing body of work has demonstrated that MFG -VAEs suffer from a variety of pathologies, including learning un-informative latent codes and un-realistic data distributions. When the data consists of images or text, we often rely on “gut checks” to ensure the quality of the learned latent representations and generated data is high, but for numeric data (e.g. medical EHR data), we cannot rely on such gut checks. Existing work lacks a characterization of exactly when these pathologies occur and how they impact down-stream task performance. In this talk, we will characterize when VAE training exhibits pathologies (as global optima of the ELBO ) and connect these failure modes to undesirable effects on specific downstream tasks.

This talk is part of the Machine Learning Reading Group @ CUED series.

This talk is included in these lists:

• All Talks (aka the CURE list)
• Cambridge Centre for Data-Driven Discovery (C2D3)
• Cambridge Forum of Science and Humanities
• Cambridge Language Sciences
• Cambridge University Engineering Department Talks
• Cambridge talks
• Centre for Smart Infrastructure & Construction
• Chris Davis' list
• Computational Continuum Mechanics Group Seminars
• Featured lists
• Guy Emerson's list
• Hanchen DaDaDash
• Inference Group Journal Clubs
• Inference Group Summary
• Information Engineering Division seminar list
• Interested Talks
• ML
• Machine Learning Reading Group
• Machine Learning Reading Group @ CUED
• Machine Learning Summary
• Quantum Matter Journal Club
• Required lists for MLG
• School of Technology
• Simon Baker's List
• TQS Journal Clubs
• Trust & Technology Initiative - interesting events
• bld31
• custom
• https://eng-cam.zoom.us/j/86068703738?pwd=YnFleXFQOE1qR1h6Vmtwbno0LzFHdz09
• ndk22's list
• ob366-ai4er
• rp587
• yk373's list

Note that ex-directory lists are not shown.