University of Cambridge > Talks.cam > Inference Group > Modeling text with Dirichlet compound multinomial distributions

  Browse A-Z

Log in

Cambridge users (raven)details Other usersdetails No account?details

Information on

Subscribing to talksdetails Finding a talkdetails Adding a talkdetails Disseminating talksdetails Help and Documentationdetails

Modeling text with Dirichlet compound multinomial distributions

Add to your list(s) Download to your calendar using vCal

If you have a question about this talk, please contact Christian Steinruecken.

The Dirichlet compound multinomial (DCM) distribution, also called the multivariate Polya distribution, is a generative model for documents that takes into account burstiness: the fact that if a word occurs once in a document, it is likely to occur repeatedly. I will present a new family of distributions that are close approximations to DCMs and that are an exponential family, unlike DCMs. These so-called EDCM distributions give insight into DCM properties, and lead to an algorithm for EDCM maximum-likelihood training that is 100x faster than the corresponding DCM method. Next, I will discuss expectation-maximization with EDCM components and deterministic annealing as a new clustering algorithm for documents. This algorithm is competitive with the best known methods, and superior from the point of view of finding models with low perplexity. Finally, I will explain the Fisher kernel induced by DCMs and its connection with the well-known TF-IDF heuristic for information retrieval.

This talk is part of the Inference Group series.

Tell a friend about this talk:

This talk is included in these lists:

Note that ex-directory lists are not shown.

Other lists

CISA Short Course: Higher order regularisation in imaging CUES

Other talks

The Productivity Paradox: are we too busy to get anything done? Enhanced Decision Making in Drug Discovery Value generalization during human avoidance learning Not Maggie's fault? The Thatcher government and the reemergence of global finance Whence the force of the law? John Rawls and the course of American legal philosophy Loss and damage: Insights from the front lines in Bangladesh Towards a whole brain model of perceptual learning A transmissible RNA pathway in honeybees A rose by any other name Existence of Lefschetz fibrations on Stein/Weinstein domains Simulating Neutron Star Mergers
 

© 2006-2025 Talks.cam, University of Cambridge. Contact Us | Help and Documentation | Privacy and Publicity