Excursion occupation measure
ID: excursion-occupation-measure
For a recurrent Markov chain, start at and stop at its first positive return . The expected visits to each state before that return form the excursion occupation measure. Its th coordinate is one. Counting the return endpoint instead of the start gives the same measure. It is invariant by shifting the occupation sum one time step and using the Markov property. Any Markov chain invariant measure normalized by dominates it: iterate the stationarity equations on the state space with removed, then retain the nonnegative excursion-path terms.
New to topics? Read the docs here!