Nonparametric Bayesian Natural Language Model Domain Adaptation: A Hierarchical, Hierarchical Pitman-Yor Process Language Model

Add to your list(s) Download to your calendar using vCal

• Dr Frank Wood (UCL)
• Wednesday 17 September 2008, 14:00-15:00
• Engineering Department, CBL Room 438.

If you have a question about this talk, please contact Zoubin Ghahramani.

There are many real-world modeling problems for which one may not have a sufficient quantity of training data to reliably estimate a useful model. Obtaining sufficient quantities of training data for these “specific” modeling domains can be both costly as well as a significant logistical challenge. In some cases there may already exist a large quantity of training data from a related or more general domain. The phrase domain adaptation is used to describe modeling techniques that utilize such data (copious but general) to improve modeling of specific domains for which training data is not as readily available. Various language model domain adaptation approaches have been proposed; however, this work is the first to show how to do domain adaptation of hierarchical nonparametric Bayesian language models.

Specifically we define a hierarchy of hierarchical Pitman-Yor process language model and explain how such a model accomplishes domain adaptation (intuitively, it “backs-off” to both in- and out-of-domain models in a way that is similar in spirit to the backing-off that smoothed n-gram models do within a single domain). For estimation and inference we define a novel multi-floor Chinese restaurant franchise representation and sampler. Encouragingly, for various natural language corpora we find that our new approach to domain adaptation outperforms all of the existing approaches against which it was compared.

This talk is part of the Machine Learning @ CUED series.

This talk is included in these lists:

• Seminar
• All Talks (aka the CURE list)
• Biology
• CBL important
• Cambridge Centre for Data-Driven Discovery (C2D3)
• Cambridge Forum of Science and Humanities
• Cambridge Language Sciences
• Cambridge Neuroscience Seminars
• Cambridge talks
• Chris Davis' list
• Creating transparent intact animal organs for high-resolution 3D deep-tissue imaging
• Engineering Department, CBL Room 438
• Featured lists
• Guy Emerson's list
• Hanchen DaDaDash
• Inference Group Summary
• Information Engineering Division seminar list
• Interested Talks
• Joint Machine Learning Seminars
• Life Science
• Life Sciences
• ML
• Machine Learning @ CUED
• Machine Learning Summary
• Neuroscience
• Neuroscience Seminars
• Neuroscience Seminars
• Required lists for MLG
• Simon Baker's List
• Stem Cells & Regenerative Medicine
• Trust & Technology Initiative - interesting events
• bld31
• dh539
• kt532's list
• ndk22's list
• ob366-ai4er
• rp587
• yk373's list

Note that ex-directory lists are not shown.