Past exam of the mathematics course of the University of Cambridge 2001 iii Paper 21 2 Solution Created 2026-10-03 Updated 2026-10-14
Write and for . For the parity correction , the conditional expectations of the increments of areThe holding move contributes zero. Thus the period-two martingale corrector for a birth-death chain exists precisely whenThis is the condition that be a harmonic function for a Markov chain. The process has integrable values from a fixed initial state because ; the Markov property therefore turns the zero conditional increments into the required martingale property. Conversely, both parities are reached with positive probability because all right and left probabilities are positive, so the two conditional equations are necessary. Expanding their numerator also gives the equivalent balance condition . Positivity makes .
Put , . The exit time is almost surely finite. Indeed, set and . From any interior point, consecutive right steps reach in at most moves, with probability at least . The Markov property gives . This is the finite-interval exit times have geometric tails argument. The walk cannot skip a boundary because its jumps have size at most one.
Under the balance condition, the stopped martingale is bounded, because the stopped position stays in . Apply the optional stopping theorem at , then dominated convergence as . Starting from zero givesWith and ,The bounded parity corrections disappear after division by ; the holding probability of a Markov chain may be positive or zero and may differ between parities.
For failure of balance, use scale increments for a birth-death chain rather than the nonexistent bounded correction. Let be the upper exit probability from for boundaries . The Markov property yieldswhere depend only on parity. Choose positive numbers with . Then satisfies these equations and boundary values. Stopping this bounded harmonic function proves that it is the exit probability. In particular,If , the positive-index sum stays bounded as , while the negative-index contribution diverges geometrically, so . If , the negative-index sum stays bounded while the positive-index sum diverges, so . Therefore the complete classification isThus a fixed nonzero imbalance drives the macroscopic exit to the corresponding side, for every positive .