Tempered Gibbs sampler Created 2026-10-03 Updated 2026-11-05
Tempered Gibbs sampling combines modified full conditional distributions with state-dependent coordinate selection and importance sampling. For a positive target density , choose strictly positive normalized densities with compatible support, and defineSelect coordinate proportionally to and redraw it from . The invariant density is , not generally . For a move changing only coordinate , stationary transition weights are proportional to , symmetric in old and new values. Integrating also shows .
Under the appropriate Markov-chain law of large numbers, weighted averages with weights recover expectations under . Flattening a conditional can encourage longer moves, but omitting the weights changes the estimand. The need not be full conditionals of a common second joint distribution.[ref]