Past exam of the mathematics course of the University of Cambridge 2016 ib Paper 2 20H a Solution Created 2026-09-24 Updated 2026-10-06
Let be an open communicating class, and fix . There is a path of positive probability from to a state outside . Choose a shortest such path, so it does not revisit before exiting. No state reached outside can have a path back to : combined with the exit path and communication within , such a path would put it in the same communicating class. Thus with positive probability the chain never returns to . Its return probability is less than one, making a transient state. This proves transience throughout .
Conversely, suppose a finite communicating class were both closed and transient. Starting inside it, a path stays there forever. Since it has finitely many states, at least one state must be visited infinitely often. But a transient state is visited only finitely often almost surely, and the union of finitely many exceptional null events still has probability zero. This is a contradiction. Every finite transient communicating class is therefore open.
For the infinite counterexample, take the biased random walk on with independent increments of probability and of probability . All states communicate, so is one infinite closed communicating class. The strong law of large numbers gives almost surely. Consequently every fixed state is visited only finitely often, and the class is transient. Finiteness is exactly what fails in the preceding argument.