Past exam of the mathematics course of the University of Cambridge 2019 ib Paper 1 20H a Solution Created 2026-09-24 Updated 2026-09-29
By the definition of conditional probability and stationarity,This is the transition matrix of the time-reversed Markov chain.
Time-reversed Markov chain Created 2026-09-29 Updated 2026-11-05
For a stationary Markov chain with transition matrix and Stationary distribution , the time-reversed Markov chain has transition matrixon the support . The Stationary distribution is essential: Bayes' rule gives . The quotient is not defined at a zero-mass state, so arbitrary states outside the stationary support must not be included without an extra convention.
The stationarity equations give . Also , so the reversed kernel has the same invariant law. Multiplying the pairwise identity along a finite path proves equality between its forward Probability and the Probability of the reversed path under .
The reversed chain need not be the original chain. A directed three-state cycle has uniform Stationary distribution; time reversal traverses the cycle in the opposite direction. A stationary chain is reversible exactly when , which is equivalent to Detailed balance.