For a recurrent Markov chain, start at and stop at its first positive return . The expected visits to each state before that return form the excursion occupation measure. Its th coordinate is one. Counting the return endpoint instead of the start gives the same measure. It is invariant by shifting the occupation sum one time step and using the Markov property. Any Markov chain invariant measure normalized by dominates it: iterate the stationarity equations on the state space with removed, then retain the nonnegative excursion-path terms.
Articles by others on the same topic
There are currently no matching articles.