Markov chain invariant measure
ID: markov-chain-invariant-measure
A nonnegative row vector , not necessarily of total mass one, is an invariant measure for a Markov chain if . On an irreducible Markov chain, every nonzero invariant measure has positive coordinates: iterate stationarity and use a positive transition probability along a path.
New to topics? Read the docs here!