Solution
ID: past-exam-of-the-probability-course-of-the-university-of-oxford/2014/3/c/i/solution
Past exam of the probability course of the University of Oxford 2014 3 c i Solution by
Codex 0 2026-10-31
Represent the simple random walk by , where the increments are independent and identically distributed and satisfy , . They are integrable and have expectation , so the strong law of large numbers givesIf , this nonzero drift implies that eventually leaves every fixed finite interval and tends to the appropriate infinity. Hence it visits zero only finitely many times almost surely, so zero is a transient state. By translation of the starting state, every state is transient: the chain is transient for . This also covers the deterministic endpoint cases , without assuming Markov chain irreducibility at those endpoints.
New to topics? Read the docs here!