For an irreducible positive recurrent Markov chain with stationary distribution , the expected return time to state is . More generally, expected occupation rewards in a return cycle equal their stationary rate times the expected cycle length.

Articles by others on the same topic (1)