Solution

ID: past-exam-of-the-mathematics-course-of-the-university-of-oxford/2017/prelims/mathematics-iii/5/b/ii/solution

Let . The law of total probability applied to the current markov chain state gives
The second equality holds because can only be reached from . Eliminating gives the linear recurrence relation

New to topics? Read the docs here!