Latent Variable Models for Text Generation

Add to your list(s) Download to your calendar using vCal

• Xiaoyu Shen, Saarland University / Max Planck Institute
• Thursday 10 October 2019, 11:00-12:00
• Board room, Faculty of English, 9 West Rd (Sidgwick Site).

If you have a question about this talk, please contact Edoardo Maria Ponti.

Latent variable models provide an effective way to specify prior knowledge and uncover the intermediate decision process of natural language generation. In this talk, we will go through two specific applications. The first one incorporates latent continuous variables into a dialogue generation model. The latent variable is trained to maximize the mutual information with neighboring utterances. We show the latent variable component is able to significantly enhance the connection between the generated response and its surrounding context, leading to a more engaging human-machine conversation. The second one explicitly models the content selection process with discrete latent variables. By lowering down the training variance with a variational autoencoder objective, the model is able to successfully decouple content selection from the black-box generation model on both sentence compression and data-to-text tasks, enabling us to control the content selection in an interpretable way.

This talk is part of the Language Technology Lab Seminars series.

This talk is included in these lists:

• Board room, Faculty of English, 9 West Rd (Sidgwick Site)
• Cambridge Centre for Data-Driven Discovery (C2D3)
• Cambridge Forum of Science and Humanities
• Cambridge Language Sciences
• Cambridge talks
• Chris Davis' list
• Guy Emerson's list
• Interested Talks
• Language Sciences for Graduate Students
• Language Technology Lab Seminars
• Simon Baker's List
• Trust & Technology Initiative - interesting events
• bld31
• ndk22's list
• ob366-ai4er
• rp587

Note that ex-directory lists are not shown.