For an irreducible positive recurrent discrete-time Markov chain with stationary distribution , the expected return time to state is . More generally, expected occupation rewards in a return cycle equal their stationary rate times the expected cycle length.

Articles by others on the same topic (1)