Every finite Markov chain has a stationary distribution, without requiring Markov chain irreducibility or aperiodicity. For a row-stochastic matrix , put and choose a column probability vector . Every lies in the probability simplex. Their arithmetic averages therefore lie in this compact set, while telescoping givesA convergent subsequence has a limit in the probability simplex. Continuity of matrix multiplication gives , so is a stationary distribution. The individual iterates need not converge: a deterministic two-state swap alternates its point masses forever.
Articles by others on the same topic
There are currently no matching articles.