Suppose a Markov kernel satisfies for a measurable . For and , the sublevel set gives . If is a small set, this is a geometric drift condition. The hypotheses of an irreducible Markov chain and an aperiodic Markov chain are also required for the usual geometric ergodicity theorem.
Use the shape-rate convention for every gamma distribution, with . Let and . The Poisson distribution likelihood and the Gamma–Poisson hierarchical model give
All factors involving the coordinate being updated must be retained, including from the conditional gamma distributions. The full conditional distributions are
For a blocked Gibbs sampler, draw from the second full conditional distribution, then redraw all the independently from the first ones. Repeating these two steps preserves the joint posterior distribution; observing after each complete sweep gives the Markov chain used in the next part. Standard gamma distribution sampling works for noninteger as well as integer shapes. The positive observation-period convention is used for the subsequent geometric drift condition.
Take observation periods to have positive lengths , and let be the Markov kernel of a sweep which first draws given the current and then draws the new vector . Write . Conditional on , independence and the gamma distribution mean and variance give
Averaging over the full conditional distribution of preserves this bound, uniformly in the current state. Therefore . This is the mechanism in bounded conditional moments imply a geometric drift.
Choose , , and . Outside , ; inside , . Hence
For completeness, is a small set, even though it approaches the boundary of the positive orthant. Choose small enough that . On , . The conditional gamma distribution of has fixed shape and rate in a compact positive interval. Its probability density function therefore has a positive common lower bound on . For those , the product probability density function of similarly has a positive common lower bound on , since every shape is positive and every rate lies in a compact positive interval. Integrating over gives on , where is the uniform distribution on and .
The transition probability density function is positive throughout the positive orthant, giving an irreducible Markov chain. Since , the box minorization includes starts in the same box, which gives an aperiodic Markov chain. The proper prior distributions and bounded Poisson distribution likelihood have positive finite evidence, so the invariant posterior distribution is proper. Together with the geometric drift condition, these hypotheses imply geometric ergodicity. In particular, the argument proves the required drift rather than assuming that every Gibbs sampler is geometrically ergodic.
The positive-period convention matters. If zero lengths are allowed, the printed assertion can fail: take , , . Then and , so
This example has a proper posterior distribution but cannot satisfy a finite quadratic geometric drift condition. Thus the proof establishes the intended claim for positive observation periods, not an unrestricted extension to zero exposure.
The geometric drift condition requires a measurable , a small set , constants and , and
Smallness means that for some , , and probability measure , for every . With irreducibility and aperiodicity, this drift-minorisation condition implies geometric ergodicity. The function controls the chain away from the small set; inside that set the additive constant allows unrestricted bounded drift.
Let and let be the uniform distribution on the body. The hit-and-run kernel density lower bound implies
For the last range, lies in a radius- disc about any of its points, so and . This global Doeblin condition proves irreducibility with respect to and aperiodicity. The entire state space is a small set; , , and satisfy the geometric drift condition.
In fact the conclusion is stronger. Write , where and is the residual Markov kernel. Since , also . Each transition has a probability of resetting to stationarity, and after such a reset every subsequent distribution remains stationary. Equivalently,
Thus the algorithm has uniform geometric ergodicity, using the full-dimensional and boundary conventions stated in part (a).