Solution

ID: past-exam-of-the-mathematics-course-of-the-university-of-cambridge/2019/ib/paper-1/20h/b/solution

Conditional on , the random variable is the first return time . The Kac's lemma mean-recurrence formula for a finite irreducible Markov chain gives
Averaging over therefore yields

New to topics? Read the docs here!