Solution

ID: past-exam-of-the-mathematics-course-of-the-university-of-cambridge/2021/ib/paper-2/18h/a/ii/solution

The renewal-reward form of Kac's lemma says that the expected number of visits to state during one return cycle from to is
Here time spent means the number of discrete time instants at which the chain occupies between consecutive visits to .

New to topics? Read the docs here!