Solution

ID: past-exam-of-the-mathematics-course-of-the-university-of-cambridge/2025/ib/paper-4/7h/b/solution

On the closed class, the transition matrix is
Its stationary distribution is . The class is irreducible and aperiodic because of its self-loops, while the other class is transient and enters it almost surely. Hence

New to topics? Read the docs here!