Neural Variational Inference for NLP

Add to your list(s) Download to your calendar using vCal

• Yishu Miao, University of Oxford
• Friday 10 March 2017, 12:00-13:00
• FW26, Computer Laboratory.

If you have a question about this talk, please contact Kris Cao.

Recent advances in neural variational inference have spawned a renaissance in deep latent variable models. While traditional variational methods derive an analytic approximation for the intractable distributions over latent variables, here we discuss about introducing an inference network conditioned on the discrete text input to provide the variational distribution in the latent variable models for NLP . For models with continuous latent variables associated with particular distributions, such as Gaussians, there exist reparameterisations (Kingma & Welling, 2014; Rezende et al., 2014) of the distribution permitting unbiased and low-variance estimates of the gradients with respect to the parameters of the inference network. For models with discrete latent variables, Monte-Carlo estimates of the gradient must be employed. Generally, algorithms such as REINFORCE have been used effectively to decrease variance and improve learning (Mnih & Gregor, 2014; Mnih et al., 2014). In this talk, I will talk about the latent variable models applied for NLP with continuous or discrete latent variables, and their corresponding neural variational inference methods.

This talk is part of the NLIP Seminar Series series.

This talk is included in these lists:

• All Talks (aka the CURE list)
• Cambridge Centre for Data-Driven Discovery (C2D3)
• Cambridge Forum of Science and Humanities
• Cambridge Language Sciences
• Cambridge talks
• Chris Davis' list
• Department of Computer Science and Technology talks and seminars
• FW26, Computer Laboratory
• Graduate-Seminars
• Guy Emerson's list
• Interested Talks
• Language Sciences for Graduate Students
• NLIP Seminar Series
• PMRFPS's
• Simon Baker's List
• Trust & Technology Initiative - interesting events
• bld31
• ndk22's list
• ob366-ai4er
• rp587

Note that ex-directory lists are not shown.