Past exam of the mathematics course of the University of Cambridge 2007 iii Paper 48 5 b iii Solution Created 2026-10-03 Updated 2026-10-14
The event (m=N) represents no change within the observed sequence: every observation belongs to the first-rate segment, and the second-rate segment is empty. It is not the event ; under continuous independent rate priors that exact equality has posterior probability zero. The endpoint is instead a distinct index value with positive prior mass.
For retained Markov chain Monte Carlo draws , the direct estimate isIts consistency follows from the ergodic theorem for a positive Harris recurrent Markov chain. The draws are correlated, so an independent-binomial standard error would generally be incorrect; uncertainty should account for the Markov chain Monte Carlo asymptotic variance.
A conditional Monte Carlo alternative averages the conditional probability from the preceding solution:The tower property of conditional expectation shows that its posterior expectation is the same target. This replaces an indicator by its conditional expectation; for correlated chains one should assess efficiency rather than automatically assume its entire asymptotic variance is smaller.
An exact finite-sum check is available by integrating out both rates. The marginal posterior weights of a Poisson count change point areThese follow from the Gamma function integral . All omitted prior-normalization and factorial factors are independent of , so they cancel from this ratio. This exact calculation provides a useful independent check on either simulation estimate.
Past exam of the mathematics course of the University of Cambridge 2016 iii Paper 208 5 d Solution Created 2026-10-03 Updated 2026-10-06
The printed identity needs an expectation on its right-hand side. For fixed , condition on and use independence of :The expression inside this expectation is generally random and cannot equal the unconditional probability by itself.
For each independent Monte Carlo method replicate, draw from its given distribution. If , draw independent -variables, form and set . For the empty sum is . If may equal zero, use when , since . The law of total expectation givesSince , the estimator has statistical consistency by the strong law of large numbers. It is the conditional Monte Carlo estimator obtained by Rao-Blackwellization of the direct indicator , and the law of total variance gives .
This version assumes that the cumulative distribution function can be evaluated. An easy sampler alone does not automatically supply an easy cumulative distribution function evaluation. If only sampling is available, use the direct indicator estimator, or replace each conditional cumulative distribution function by the average of several independent indicators ; the nested version remains an unbiased estimator. With such inner draws its variance per outer replicate is .
Rao-Blackwellization Created 2026-10-06 Updated 2026-10-07
Replace an estimator by its conditional expectation given selected information. The mean is unchanged and the variance cannot increase, by the law of total variance. In simulation this produces conditional Monte Carlo estimators. Sufficiency is needed for the classical inferential strengthening, but not for the elementary variance reduction identity.