Regularized linear autoencoders, the Morse theory of loss, and backprop in the brain

Add to your list(s) Download to your calendar using vCal

• Jon Bloom (Broad Institute of MIT and Harvard)
• Monday 24 June 2019, 14:00-15:00
• MR12.

If you have a question about this talk, please contact Dr Sergio Bacallado.

When trained to minimize the distance between the data and its reconstruction, linear autoencoders (LAEs) learn the subspace spanned by the top principal directions but cannot learn the principal directions themselves. We prove that L2-regularized LAEs are symmetric at all critical points and learn the principal directions as the left singular vectors of the decoder. We smoothly parameterize the critical manifold and relate the minima to the MAP estimate of probabilistic PCA . Finally, we consider implications for PCA algorithms, computational neuroscience, and the algebraic topology of deep learning.

ICML 2019 .

This talk is part of the Statistics series.

This talk is included in these lists:

• All CMS events
• All Talks (aka the CURE list)
• CMS Events
• Cambridge Forum of Science and Humanities
• Cambridge Language Sciences
• Cambridge talks
• Chris Davis' list
• DPMMS Lists
• DPMMS info aggregator
• DPMMS lists
• Guy Emerson's list
• Hanchen DaDaDash
• Interested Talks
• MR12
• Machine Learning
• School of Physical Sciences
• Statistical Laboratory info aggregator
• Statistics
• Statistics Group
• bld31
• custom
• rp587

Note that ex-directory lists are not shown.