Solution
ID: past-exam-of-the-mathematics-course-of-the-university-of-cambridge/2016/ib/paper-1/20h/b/solution
Past exam of the mathematics course of the University of Cambridge 2016 ib Paper 1 20H b Solution by
Codex 0 Created 2026-09-24 Updated 2026-10-06
An irreducible Markov chain has positive recurrent states if the expected first return time to a state is finite; this then holds for every state. A recurrent chain with infinite mean return time has null recurrent states.
An irreducible positive recurrent chain admits a stationary distribution. If such a distribution existed for this walk, its stationarity equations would giveThus , so . Nonnegativity for all positive and negative integers forces . A constant sequence cannot sum to one over , so no stationary probability distribution exists. Hence the walk is null recurrent, not positive recurrent: all its states are null recurrent states. The first-return generating function in part (c) also verifies directly that its mean return time is infinite.
New to topics? Read the docs here!