Markov chain Monte Carlo asymptotic variance for a stationary Markov chain and iswhenever the limit and series exist. If a reversible Markov chain has positive spectral gap , then the spectral theorem for normal operators on a separable Hilbert space gives
For , detailed balance says that the measure is invariant under exchanging and . ThereforeThis is precisely the defining identity for a self-adjoint operator.
By the stationary distribution property, and have the same marginal distribution . Expanding the square givesThis is the probabilistic representation of the Dirichlet form of a Markov chain.
Subtracting the expected value of does not alter either side, so suppose . Since reversibility makes a self-adjoint operator and stationarity makes it a contraction,The Discrete-time Poincaré inequality for a Markov kernel is therefore equivalent toApplying this inequality successively to yieldsConversely, the asserted variance contraction with rearranges to the Poincaré inequality. Hence the two statements are equivalent.
Part c gives the integral representationThe integrand vanishes on the diagonal . Thus the assumed off-diagonal Peskun ordering impliesfor every .
On the mean-zero subspace, the variational characterization of the spectral gap of a positive reversible kernel isIt follows immediately thatEquivalently, the energy inequality says in the Löwner order on . Positivity permits the operator monotonicity of the square root and hence ; the spectral representations in the question identify the top spectral values and give the same gap inequality.
Articles by others on the same topic
There are currently no matching articles.