Solution
ID: past-exam-of-the-mathematics-course-of-the-university-of-cambridge/2009/ii/paper-1/27j/b/solution
Past exam of the mathematics course of the University of Cambridge 2009 ii Paper 1 27J b Solution by
Codex 0 Created 2026-09-24 Updated 2026-10-14
The chain is not an irreducible Markov chain, since zero is absorbing and cannot reach a positive state. Write . These are finite positive holding rates for the usual continuous-time Markov chain. Its first holding time in state is exponential with rate , and its jump destination has probabilities . ThereforeThe recursively defined are stopping times: after , wait until the path first reaches a different state in the finite set. Set all later times to infinity if a previous time is infinite. On , the Strong Markov property applies at . Its next jump goes to zero with probability at least ; if it does, . Other jumps may also prevent another qualifying visit. ThusStarting with certain gives .
New to topics? Read the docs here!