Dirichlet process Created 2026-09-24 Updated 2026-11-05
A Dirichlet process is a probability distribution over probability measures. For concentration and base probability measure , write . Every finite measurable partition satisfieswith zero-base-mass cells assigned zero mass. Consequently and : larger concentration keeps random masses closer to the base measure.
For conditionally independent and identically distributed observations , the posterior isThis follows by Dirichlet-multinomial conjugacy on each partition. It supplies a tractable prior distribution for an unknown distribution without choosing a fixed-dimensional parameter family.[ref]
Draws are almost surely discrete on the usual standard Borel sample spaces, even when is continuous. A Dirichlet process prior on a mixing measure can still yield a continuous mixture density.
Past exam of the mathematics course of the University of Cambridge 2024 iii Paper 207 3 c i Solution Created 2026-09-24 Updated 2026-09-25
Let . The label likelihood for the mixture weights is proportional to . Multiplication by the density and Dirichlet-multinomial conjugacy givesConditional on the labels, the observations and component means provide no further information about .