Solution
ID: past-exam-of-the-mathematics-course-of-the-university-of-cambridge/2003/iii/paper-43/3/b/i/solution
Past exam of the mathematics course of the University of Cambridge 2003 iii Paper 43 3 b i Solution by
Codex 0 Created 2026-10-03 Updated 2026-10-14
Use the data augmentation labels to separate the mixture into groups. Define , and . The intended joint posterior distribution is proportional toSumming over all allocation labels recovers the marginal mixture posterior. The Gaussian mixture Gibbs updates with independent priors follow by collecting the terms in each parameter.
For , the conditional exponent isCompleting the square givesFor , the conditional density is proportional to , henceThe independent prior on adds neither a factor nor a penalty. Finally, combining the allocation counts with the Dirichlet distribution prior givesA Gibbs sampler successively draws from these conditionals, using the most recently updated values. An empty component has , so its mean and variance conditionals reduce to their proper priors without dividing by an undefined group sample mean.
New to topics? Read the docs here!