Stationary distribution existence for a finite Markov chain

ID: stationary-distribution-existence-for-a-finite-markov-chain

Every finite Markov chain has a stationary distribution, without requiring Markov chain irreducibility or aperiodicity. For a row-stochastic matrix , put and choose a column probability vector . Every lies in the probability simplex. Their arithmetic averages therefore lie in this compact set, while telescoping gives
A convergent subsequence has a limit in the probability simplex. Continuity of matrix multiplication gives , so is a stationary distribution. The individual iterates need not converge: a deterministic two-state swap alternates its point masses forever.

New to topics? Read the docs here!