Past exam of the mathematics course of the University of Cambridge 2016 iii Paper 208 4 b Solution Created 2026-10-03 Updated 2026-10-06
Let , and write for the standard normal distribution density. For importance sampling, choose the proposal density , namely the uniform distribution on the target interval. Its importance sampling weight isFor iid uniform draws ,is an unbiased estimator of the target mean, since its expectation integrates . If one chooses not to evaluate , the self-normalized importance sampling alternative has statistical consistency, but generally is not an unbiased estimator.
Alternatively, draw independent random variables with the standard normal distribution, let and , and useConditionally on , the retained draws are iid from the truncated normal distribution, so their average is an unbiased estimator with variance , where is its variance. If the ratio is undefined; one can continue drawing until a prescribed number of retained observations is obtained.
Here importance sampling uses every draw inside the interval, whereas only of the normal proposals are retained. The advantage can also be quantified. Integration using givesFor uniform importance sampling,For the retained-draw ratio with a fixed total proposal budget, its asymptotic variance coefficient is . Thus this importance choice has substantially smaller error for the same proposal count; it also avoids wasting about two thirds of the standard normal distribution draws. This comparison is specific to this well-matched importance sampling proposal; arbitrary proposal choices do not share this guarantee.
Past exam of the mathematics course of the University of Cambridge 2023 ii Paper 4 28K b Solution Created 2026-09-24 Updated 2026-09-25
Conditionally on , the cumulative distribution function of is the weighted empirical distributionFor fixed , the strong law of large numbers gives, almost surely,whileThe ratio therefore converges almost surely to . This is precisely the claimed convergence in distribution of the self-normalized importance sampling resample.
Past exam of the mathematics course of the University of Cambridge 2026 iii Paper 219 2 b Solution Created 2026-09-24 Updated 2026-09-25
The simulation catalog is a sample from the joint prior. Self-normalized importance sampling therefore estimates the posterior mean byThe likelihood weights update each simulated system according to how well its satellite resembles the measured one.