Solution

ID: past-exam-of-the-mathematics-course-of-the-university-of-cambridge/2007/ib/paper-3/9c/solution

Write . The Markov property, conditioning on the state at time , gives
Put and . Then , so subtraction yields . Iterating this linear recurrence gives
For , read the expression using , or state separately; for , . Since , the result also shows convergence in a metric space to the stationary distribution probability .

New to topics? Read the docs here!