|COOKIES: By using this website you agree that we can place Google Analytics Cookies on your device for performance monitoring.|
Ferguson's 1973 paper on the Dirichlet process
If you have a question about this talk, please contact Richard Samworth.
In 1973, Ferguson proposed to perform nonparametric estimation in a Bayesian framework by defining a prior distribution on an infinite-dimensional parameter space (the set of probability measures over a given domain). When applied to a finite set of observations, only a finite number out of the infinitely many degrees of freedom is used to explain the data, which accounts for the term “nonparametric”. The prior model is constructed as a stochastic process, with Dirichlet marginals and pathes in the set of probability measures over a separable metric space, that Ferguson called a “Dirichlet process”. His estimation model has a conjugate form with a closed-form solution for the posterior parameters, which mimics the conjugate posteriors of the Dirichlet marginals under a multinomial sampling model. Measures drawn at random from the Dirichlet process are a.s. discrete.
I will review Ferguson’s construction and his application of the model to sample observations. I also intend to briefly discuss the two major lines of research which developed from Ferguson’s paper: One that attempts to overcome the model’s discreteness in order to construct “universal” priors, and one that exploits discreteness to generalize the notion of finite mixtures and related models.
TS Ferguson, “A Bayesian analysis of some nonparametric problems” Ann. Statist. 1 (1973), 209—230.
This talk is part of the Statistics Reading Group series.
This talk is included in these lists:
Note that ex-directory lists are not shown.
Other listsCentre for Scientific Computing Bullard Laboratories Tea Time Talks Chemical Engineering Research Theme Journal Clubs
Other talksSingle molecule approaches for studying gene expression in intact mammalian tissues. The implications of the relationship between height and mortality for historical demography. Evidence from contextual and individual approaches in 19th-Century Spain Banking and Risk Education in Africa Plagues & Metaphor Efficient Lattice Rescoring Using Recurrent Neural Network Language Models