Past exam of the mathematics course of the University of Cambridge / 2003 / iii / Paper 43 / 1 / b

Write $Z={\int }_a^{\infty }{x}^{\alpha -1}{e}^{-\beta x}dx$. A proper target requires $\beta >0$, and a proper proposal requires $b>0$. Normalization gives $f(x)=x^{\alpha -1}{e}^{-\beta x}/Z$ and the Pareto distribution proposal $g(x)=b{a}^b{x}^{-b-1}$ on $x>a$. Their ratio isThe derivative of its logarithm is $(\alpha +b)/x-\beta$. It is positive before $x_{\ast }=(\alpha +b)/\beta$ and negative after it. Since $a<\alpha /\beta <x_{\ast }$, the maximum occurs within the proposal support. Consequently the tight envelope for truncated gamma rejection sampling with a Pareto envelope isThe accompanying acceptance rule can be evaluated without $Z$:

Integrating the Pareto distribution proposal yields $G(x)=1-(a/x{)}^b$ for $x\ge a$. For an independent uniform random variable $U$, solve $G(Y)=U$ to obtain the inverse transform sampling ruleEquivalently $Y=a{U}^{-1/b}$ because $1-U$ is also uniformly distributed. In implementation choose $U$ strictly between zero and one so that the inverse is finite.

Every independent proposal/uniform pair succeeds with probability $p=1/M$. The number $K$ retained from a fixed budget of 100 attempts therefore has a binomial distribution, rather than a fixed value:Conditioned on the accept/reject indicators, each retained value still has the target probability density function; the random output count is a separate issue from the correctness of those retained draws.