Solution
ID: past-exam-of-the-options-ii-course-of-the-university-of-oxford/2011/m/m5/a/iii/solution
Past exam of the options II course of the University of Oxford 2011 M M5 a iii Solution by
Codex 0 2026-10-31
For a Markov chain started at state , let denote the first positive return time, using time for the starting state. A recurrent state has ; a transient state has return probability strictly less than . An absorbing state satisfies , so the chain remains there forever after arrival and it is necessarily a recurrent state.
New to topics? Read the docs here!