University of Cambridge > Talks.cam > Language Technology Lab Seminars > Learning to Generate Textual Data

  Browse A-Z

Log in

Cambridge users (raven)details Other usersdetails No account?details

Information on

Subscribing to talksdetails Finding a talkdetails Adding a talkdetails Disseminating talksdetails Help and Documentationdetails

Learning to Generate Textual Data

Add to your list(s) Download to your calendar using vCal

If you have a question about this talk, please contact Mohammad Taher Pilehvar.

To learn text understanding models with millions of parameters one needs massive amounts of data. In this work, we argue that generating data can compensate for this need. While defining generic data generators is difficult, we propose to allow generators to be “weakly” specified in the sense that a set of parameters controls how the data is generated. Consider for example generators where the example templates, grammar, and/or vocabulary is determined by this set of parameters. Instead of manually tuning these parameters, we learn them from the limited training data at our disposal. To achieve this, we derive an efficient algorithm called GeneRe that jointly estimates the parameters of the model and the undetermined generation parameters. We illustrate its benefits by learning to solve math exam questions using a highly parametrised sequence-to-sequence neural network.

This talk is part of the Language Technology Lab Seminars series.

Tell a friend about this talk:

This talk is included in these lists:

Note that ex-directory lists are not shown.

Other lists

Medical Genetics Graduate Student Meeting Introduction to Molecular Biology Techniques Life Science Interface Seminars Biological Anthropology Lent Term Seminars 2011 rp587 Butterfly Genetics Group Lab Meeting

Other talks

Production Processes Group Seminar - 'Re-thinking biosensors for resource-limited settings' Deterministic RBF Surrogate Methods for Uncertainty Quantification, Global Optimization and Parallel HPC Applications Immigration policy-making beyond 'Western liberal democracies' NatHistFest: the 99th Conversazione and exhibition on the wonders of the natural world. Dispersion for the wave and the Schrodinger equations outside strictly convex obstacles CANCELLED DUE TO STRIKE ACTION Recent advances in understanding climate, glacier and river dynamics in high mountain Asia
 

© 2006-2024 Talks.cam, University of Cambridge. Contact Us | Help and Documentation | Privacy and Publicity