For a Markov chain with transition matrix , Detailed balance with a probability distribution means
The left side is the equilibrium Probability of the directed transition ; Detailed balance equates it to the reverse flow. Summing over gives , so Detailed balance implies stationarity. Under the stationary initial law, repeated application of the pairwise identity equates a finite path's Probability to that of its reversal, establishing reversibility.[ref]
For example, take
The off-diagonal flows are both , which verifies Detailed balance and the Stationary distribution directly. A directed three-state cycle has a uniform Stationary distribution but no reverse transitions, so it is not reversible. Stationarity alone therefore does not imply Detailed balance, and Detailed balance alone does not imply rapid convergence.
Detailed balance does not imply that a Markov chain is an irreducible Markov chain: the identity transition matrix is reversible for every probability distribution. Even for an irreducible Markov chain with aperiodicity, the two-state matrix with diagonal and off-diagonal , , has uniform stationary distribution and nontrivial eigenvalue . From either fixed state its total variation distance after steps is , so convergence can be arbitrarily slow. Invariance, reachability and mixing time are distinct questions.
For a continuous-time Markov chain with transition rates , Detailed balance is
for every pair of distinct states. A probability distribution satisfying these equations is an invariant distribution of a continuous-time Markov chain, because summing over incoming rates gives . Under the standard nonexplosion assumptions, the equilibrium chain is reversible.

Ancestors (8)

  1. Reversible Markov chain
  2. Markov chain
  3. Markov process
  4. Probability theory
  5. Probability and statistics
  6. Area of mathematics
  7. Mathematics
  8. Home

Synonyms (1)

Discussion (0) New discussion

There are no discussions about this article yet.

Articles by others on the same topic (1)

Detailed balance is a principle used in statistical mechanics and thermodynamics that describes a specific condition of equilibrium in a system. It refers to the condition whereby, for every possible transition between states of a system, the rate of transitions in one direction is balanced by the rate of transitions in the reverse direction. This ensures that, over time, the system reaches a steady-state distribution of states.