Solution

ID: past-exam-of-the-mathematics-course-of-the-university-of-cambridge/2005/iii/paper-47/4/a/solution

For independent draws from a normalized proposal , use the importance sampling identity
Thus the unbiased estimator and its variance are
The probability support condition is wherever , and the variance formula requires a finite second moment. Since both probability densities are normalized, no self-normalization of weights is needed.
In the proposed example, normalize to on . It is sampled by for uniform . Taking gives
As a check, . The second moment of one weighted observation is
so . The weight's singularity at zero does not make this variance infinite.
To prove the optimal proposal rule, apply the Cauchy-Schwarz inequality:
Equality holds when the two factors are proportional almost everywhere, giving the minimum-variance importance distribution
For the present nonnegative integrand, normalization gives
Under this proposal, is constant, so the variance is exactly zero. If sampling is wanted, its distribution function is , with inverse . In general the optimal proposal's normalizing constant can itself be the unknown integral, limiting this zero-variance construction's practical use.

New to topics? Read the docs here!