Grammar Variational Autoencoder

Add to your list(s) Download to your calendar using vCal

• Matt Kusner, ATI and Warwick University
• Tuesday 20 February 2018, 14:00-15:00
• Centre for Mathematical Sciences, MR4.

If you have a question about this talk, please contact Damon Wischik.

Deep generative models have been wildly successful at learning coherent latent representations for continuous data such as natural images, artwork, and audio. However, generative modeling of discrete data such as arithmetic expressions and molecular structures still poses significant challenges. Crucially, state-of-the-art methods often produce outputs that are not valid.

We make the key observation that frequently, discrete data can be represented as a parse tree from a context-free grammar. We propose a variational autoencoder which directly encodes from and decodes to these parse trees, ensuring the generated outputs are always syntactically valid. Surprisingly, we show that not only does our model more often generate valid outputs, it also learns a more coherent latent space in which nearby points decode to similar discrete outputs. We demonstrate the effectiveness of our learned models by showing their improved performance in Bayesian optimization for symbolic regression and molecule generation.

This talk is part of the Mathematics and Machine Learning series.

This talk is included in these lists:

• All CMS events
• CMS Events
• Cambridge Centre for Data-Driven Discovery (C2D3)
• Cambridge talks
• Centre for Mathematical Sciences, MR4
• Chris Davis' list
• DPMMS info aggregator
• Guy Emerson's list
• Hanchen DaDaDash
• Interested Talks
• Mathematics and Machine Learning
• Mathematics and Machine Learning
• Trust & Technology Initiative - interesting events
• bld31
• ndk22's list
• ob366-ai4er
• rp587

Note that ex-directory lists are not shown.