Time-reversed Markov chain
ID: time-reversed-markov-chain
For a stationary Markov chain with transition matrix and Stationary distribution , the time-reversed Markov chain has transition matrixon the support . The Stationary distribution is essential: Bayes' rule gives . The quotient is not defined at a zero-mass state, so arbitrary states outside the stationary support must not be included without an extra convention.
The stationarity equations give . Also , so the reversed kernel has the same invariant law. Multiplying the pairwise identity along a finite path proves equality between its forward Probability and the Probability of the reversed path under .
The reversed chain need not be the original chain. A directed three-state cycle has uniform Stationary distribution; time reversal traverses the cycle in the opposite direction. A stationary chain is reversible exactly when , which is equivalent to Detailed balance.
New to topics? Read the docs here!