Past exam of the mathematics course of the University of Cambridge 2022 ib Paper 2 18H c Solution Created 2026-09-24 Updated 2026-09-25
The pair is an irreducible positive recurrent product Markov chain with stationary distributionThe stationary cycle occupation formula says that, during one return cycle to a state , the expected number of visits to a set is . TakeThenThe initial and terminal states both have , so either convention for including the endpoints gives the same count. Thus