Markov chain invariant measure

ID: markov-chain-invariant-measure

A nonnegative row vector , not necessarily of total mass one, is an invariant measure for a Markov chain if . On an irreducible Markov chain, every nonzero invariant measure has positive coordinates: iterate stationarity and use a positive transition probability along a path.

New to topics? Read the docs here!