Past exam of the mathematics course of the University of Cambridge 2007 iii Paper 48 5 b iii Solution Created 2026-10-03 Updated 2026-10-14
The event (m=N) represents no change within the observed sequence: every observation belongs to the first-rate segment, and the second-rate segment is empty. It is not the event ; under continuous independent rate priors that exact equality has posterior probability zero. The endpoint is instead a distinct index value with positive prior mass.
For retained Markov chain Monte Carlo draws , the direct estimate isIts consistency follows from the ergodic theorem for a positive Harris recurrent Markov chain. The draws are correlated, so an independent-binomial standard error would generally be incorrect; uncertainty should account for the Markov chain Monte Carlo asymptotic variance.
A conditional Monte Carlo alternative averages the conditional probability from the preceding solution:The tower property of conditional expectation shows that its posterior expectation is the same target. This replaces an indicator by its conditional expectation; for correlated chains one should assess efficiency rather than automatically assume its entire asymptotic variance is smaller.
An exact finite-sum check is available by integrating out both rates. The marginal posterior weights of a Poisson count change point areThese follow from the Gamma function integral . All omitted prior-normalization and factorial factors are independent of , so they cancel from this ratio. This exact calculation provides a useful independent check on either simulation estimate.
Past exam of the mathematics course of the University of Cambridge 2015 iii Paper 37 5 b Solution Created 2026-10-03 Updated 2026-10-06
A convenient general-state-space ergodic theorem is the following. For a positive Harris recurrent Markov chain with invariant probability measure , and a measurable function with ,Here is the stationary expected value. Harris recurrence means that every set of positive irreducibility measure is visited almost surely from every state; positive recurrence supplies an invariant probability rather than only an infinite invariant measure. The ergodic theorem for a positive Harris recurrent Markov chain holds from any starting state under these Harris hypotheses. aperiodicity is not necessary just for averages.
A useful sufficient form of the central limit theorem for a geometrically ergodic Markov chain adds aperiodicity, geometric ergodicity, and for some . It givesThese are sufficient hypotheses, not a claim that irreducibility alone ensures a central limit theorem. The Markov chain Monte Carlo asymptotic variance uses stationary covariances , with . The series is absolutely convergent under the stated sufficient assumptions. If , write and , where the integrated autocorrelation time is . When , the effective sample size of a Markov chain is approximately . Negative correlations can reduce the asymptotic variance; a zero asymptotic variance gives a degenerate normal limit. For constant , variance is zero and the autocorrelation normalization is undefined.
Past exam of the mathematics course of the University of Cambridge 2015 iii Paper 37 6 i d Solution Created 2026-10-03 Updated 2026-10-06
Apply the Monte Carlo estimator to the observable :The theoretical justification is the ergodic theorem for a positive Harris recurrent Markov chain, not an independent-sample law of large numbers. The Markov chain has finite state space, is irreducible, and has the strictly positive posterior distribution as invariant law, so it is positive recurrent and Harris recurrent with counting measure. The observable is bounded: . Thus the estimator converges almost surely to the posterior expected value from any initial configuration.
Each state also has positive self-transition probability, so the chain is an aperiodic Markov chain. Finiteness then gives geometric convergence and the relevant central limit theorem; serial dependence determines the Markov chain Monte Carlo asymptotic variance if error bars are required. A fixed finite burn-in can be discarded without changing consistency, but independence of the retained states should not be assumed.
Past exam of the mathematics course of the University of Cambridge 2023 iii Paper 216 3 a Solution Created 2026-09-28 Updated 2026-10-03
Markov chain Monte Carlo asymptotic variance for a stationary Markov chain and iswhenever the limit and series exist. If a reversible Markov chain has positive spectral gap , then the spectral theorem for normal operators on a separable Hilbert space gives
If , a stationary reversible Markov chain satisfiesConsequently the variance of a sum of consecutive values is at most times the stationary variance of one value. This bounds the Markov chain Monte Carlo asymptotic variance uniformly over square-integrable functions.