GPstruct: Bayesian non-parametric structured prediction model

Add to your list(s) Download to your calendar using vCal

• Novi Quadrianto, Machine Learning, University of Cambridge
• Friday 17 January 2014, 12:00-13:00
• FW26, Computer Laboratory.

If you have a question about this talk, please contact Tamara Polajnar.

In this talk, I will introduce a conceptually novel structured prediction model, GPstruct, which is kernelised, non-parametric, and supporting Bayesian posterior inference. GPstruct can be instantiated for a wide range of structured objects such as linear chain, tree, grid, and other general graphs. As a first proof of concept, the model is benchmarked on segmentation, chunking, and named entity recognition of text processing tasks and gesture segmentation of video processing task involving a linear chain structure. One of practical issues of GPstruct is the memory demand which is quadratic in the number of latent variables and training runtime that scales cubically. This prevents GPstruct from being applied to problems involving grid factor graphs, which are prevalent in computer vision applications. In the second part of the talk, I will describe a scaling trick based on ensemble learning, with weak learners (predictors) trained on subsets of the latent variables and bootstrap data, which can easily be distributed. We show experiments with 2 millions latent variables on image segmentation. Our method outperforms widely-used conditional random field models trained with pseudo-likelihood. Moreover, it improves over recent state-of-the-art marginal optimization methods in terms of predictive performance and uncertainty calibration. Finally, it generalizes well on all training set sizes.

Joint work with Sebastien Bratieres, Zoubin Ghahramani, and Sebastian Nowozin.

This talk is part of the NLIP Seminar Series series.

This talk is included in these lists:

• All Talks (aka the CURE list)
• Cambridge Centre for Data-Driven Discovery (C2D3)
• Cambridge Forum of Science and Humanities
• Cambridge Language Sciences
• Cambridge talks
• Chris Davis' list
• Department of Computer Science and Technology talks and seminars
• FW26, Computer Laboratory
• Graduate-Seminars
• Guy Emerson's list
• Interested Talks
• Language Sciences for Graduate Students
• NLIP Seminar Series
• PMRFPS's
• Simon Baker's List
• Trust & Technology Initiative - interesting events
• bld31
• ndk22's list
• ob366-ai4er
• rp587

Note that ex-directory lists are not shown.