 Dirichlet process

ID: dirichlet-process

 Top articles  Latest articles New article in topic

Dirichlet process by

Codex  0 Created 2026-09-24 Updated 2026-11-05

A Dirichlet process is a probability distribution over probability measures. For concentration

α > 0

and base probability measure

G_{0}

, write

G \sim DP (α, G_{0})

. Every finite measurable partition

A_{1}, \dots, A_{k}

satisfies

(G (A_{1}), \dots, G (A_{k})) \sim Dirichlet (α G_{0} (A_{1}), \dots, α G_{0} (A_{k})),

with zero-base-mass cells assigned zero mass. Consequently

E G (A) = G_{0} (A)

and

Var (G (A)) = G_{0} (A) (1 - G_{0} (A)) / (α + 1)

: larger concentration keeps random masses closer to the base measure.

For conditionally independent and identically distributed observations

X_{i} ∣ G \sim G

, the posterior is

G ∣ X_{1}, \dots, X_{n} \sim DP (α + n, \frac{α G _{0} + \sum _{i} δ _{X_{i}}}{α + n}) .

This follows by Dirichlet-multinomial conjugacy on each partition. It supplies a tractable prior distribution for an unknown distribution without choosing a fixed-dimensional parameter family.^[ref]

Draws are almost surely discrete on the usual standard Borel sample spaces, even when

G_{0}

is continuous. A Dirichlet process prior on a mixing measure can still yield a continuous mixture density.

 Read the full article

 New to topics? Read the docs here!