Past exam of the mathematics course of the University of Cambridge / 2017 / iii / Paper 216 / 3 / b

Take observation periods to have positive lengths $t_i>0$, and let $P$ be the Markov kernel of a sweep which first draws $b$ given the current $\theta$ and then draws the new vector ${\Theta }^{\prime }$. Write $A_i=a+y_i$. Conditional on $b$, independence and the gamma distribution mean and variance giveAveraging over the full conditional distribution of $b$ preserves this bound, uniformly in the current state. Therefore $PV(\theta )\le M:=1+D<\infty$. This is the mechanism in bounded conditional moments imply a geometric drift.

Choose $0<\rho <1$, $R>M/\rho$, and $C=\{\theta :V(\theta )\le R\}$. Outside $C$, $PV\le M<\rho V$; inside $C$, $PV\le M\le \rho V+M$. HenceFor completeness, $C$ is a small set, even though it approaches the boundary of the positive orthant. Choose $\delta >0$ small enough that $B=[\delta ,2\delta {]}^n\subset C$. On $C$, $s={\sum }_i{\theta }_i\le \sqrt{R-1}$. The conditional gamma distribution of $b$ has fixed shape $na+c$ and rate $1+s$ in a compact positive interval. Its probability density function therefore has a positive common lower bound on $b\in [1,2]$. For those $b$, the product probability density function of ${\Theta }^{\prime }$ similarly has a positive common lower bound on $B$, since every shape is positive and every rate $b+t_i$ lies in a compact positive interval. Integrating over $b\in [1,2]$ gives $P(\theta ,\cdot )\ge \epsilon \eta (\cdot )$ on $C$, where $\eta$ is the uniform distribution on $B$ and $\epsilon >0$.

The transition probability density function is positive throughout the positive orthant, giving an irreducible Markov chain. Since $B\subset C$, the box minorization includes starts in the same box, which gives an aperiodic Markov chain. The proper prior distributions and bounded Poisson distribution likelihood have positive finite evidence, so the invariant posterior distribution is proper. Together with the geometric drift condition, these hypotheses imply geometric ergodicity. In particular, the argument proves the required drift rather than assuming that every Gibbs sampler is geometrically ergodic.

The positive-period convention matters. If zero lengths are allowed, the printed assertion can fail: take $n=1$, $a=c=1$, $t_1=y_1=0$. Then $b\mid \theta \sim \mathrm{Gamma}(2,1+\theta )$ and ${\Theta }^{\prime }\mid b\sim \mathrm{Gamma}(1,b)$, soThis example has a proper posterior distribution but cannot satisfy a finite quadratic geometric drift condition. Thus the proof establishes the intended claim for positive observation periods, not an unrestricted extension to zero exposure.