Continuous-time Markov chain Created 2026-09-24 Updated 2026-11-05
A Continuous-time Markov chain on a finite or countable state space is specified by transition rates for , with finite total exit rate . At a state with , it waits an exponential time of rate and then moves to with probability . A state with is absorbing: it has infinite holding time rather than a zero-rate exponential waiting law.
Its transition-rate matrix is , with off-diagonal entries and diagonal entries , so each row sums to zero. The rates describe first-order transition probabilities: for . On a finite state space, the transition semigroup is and explosion is impossible. On a countably infinite state space, finite individual exit rates do not alone exclude infinitely many jumps in finite time; nonexplosion must be checked separately.
For two states with rates and , the mean holding times are and . Detailed balance gives Stationary distribution , andThis starts at one and relaxes to the stationary mass of state zero. Changing holding rates can preserve an embedded jump chain while changing the proportions of elapsed time spent in its states.
Explosion of a continuous-time Markov chain Created 2026-09-24 Updated 2026-11-05
Explosion is determined by whether the successive holding times of the continuous-time Markov chain have a finite sum.
Exponential martingale of a pure birth process Created 2026-10-14 Updated 2026-11-05
For a pure birth process with fixed initial state and finite statewise rates, the jump-count compensator gives , so is a local martingale up to explosion. If , a rate- Poisson candidate clock with accepted jumps of probability prevents explosion and dominates the jump count. Its finite exponential moments dominate every stopped on each finite horizon, upgrading the local martingale to a true martingale. A random initial state requires ; uniformly bounded rates do not supply this missing initial integrability.
The holding rate at state of a continuous-time Markov chain with generator matrix isFor a conservative chain with finite , its holding time has exponential distribution: and . Conditional on a jump, the next state is with probability . Thus the rate determines when departure occurs, while normalized outgoing rates determine where it goes.
If the outgoing rates are and for two distinct other states, the total rate is five, the mean holding time is , and departure chooses them with probabilities and . A zero rate gives an absorbing state with infinite holding time. Statewise finite rates alone do not rule out explosion of a continuous-time Markov chain.
Invariant distribution of an explosive chain Created 2026-09-24 Updated 2026-11-05
For an explosive chain, a normalized solution of the formal balance equations need not be an invariant probability for the minimal transition semigroup. Explosion sends Probability mass to a cemetery state, and the generator equations on the original states do not include that boundary loss.
A concrete example uses the reflected jump chain on which moves from zero to one, and from moves up with probability and down with probability . Give state holding rate . The embedded chain has invariant weights , for . Dividing by the holding rates and normalizing yieldsThese weights even satisfy formal Detailed balance: , and for both opposing edge flows equal . Thus holds at each state.
Nevertheless the process explodes. Starting from zero, the embedded walk has expected visit count two at zero and three at every positive level. The zero-state return probability is ; at a positive state it is , giving those geometric visit means. Therefore the expected total elapsed holding time isThe lifetime is finite almost surely. The same bounded expected-visit argument works from every initial state, so the killed minimal semigroup loses all its mass as time tends to infinity. The displayed is consequently a formal generator-balance solution, not a stationary probability of that killed evolution. A conservative continuation after explosion would require an extra boundary rule.
Jump measure of a Markov jump process Created 2026-10-14 Updated 2026-11-05
For a Markov jump process with off-diagonal rate kernel , the jump measure records the jump time and the destination state. Relative to a filtration for which the process has the Markov jump property, its predictable compensator is the displayed rate measure, up to explosion. The corresponding generator is . An enlarged filtration revealing future jumps need not preserve this compensator, so the filtration condition is essential.
Nonexplosion criterion for a pure birth process Created 2026-09-29 Updated 2026-11-05
A pure birth process is nonexplosive exactly whenIts explosion time is the sum of independent exponential holding times. If the displayed series converges, that sum has finite expectation. If it diverges, the Laplace transform of the sum isforcing the sum to be infinite almost surely.
Nonexplosion from recurrent visits to a slow state Created 2026-09-24 Updated 2026-11-05
If the jump chain visits a state of finite positive holding rate infinitely often, the sum of its independent positive holding times at that state diverges almost surely, preventing explosion.
Nonexplosion under uniformly bounded jump rates Created 2026-09-29 Updated 2026-11-05
If every holding rate of a continuous-time Markov chain is at most , its holding times can be coupled as , where the are independent rate-one exponential random variables. The strong law of large numbers gives almost surely, so the jump times tend to infinity and the chain cannot explode.
Past exam of the mathematics course of the University of Cambridge 2020 ii Paper 2 27K ii Solution Created 2026-09-24 Updated 2026-09-29
Here the total holding rate isand therefore the jump chain has state-independent transitionsIt is an upward biased random walk on . By the strong law of large numbers, almost surely, so . The jump chain, and hence , is transient.
Counting measure is invariant for this jump chain: for every , its incoming mass is . The invariant-measure transfer between a jump chain and a CTMC therefore gives an invariant measure proportional to . Sincethe normalized invariant distribution of a continuous-time Markov chain isThis does not contradict transience because an invariant distribution of an explosive chain need not imply positive recurrence.
It remains to verify explosion. Starting from zero, the probability that the biased walk ever reaches is . Once it reaches any state, its probability of returning after departure isso its expected total number of visits to that state, conditional on reaching it, is . If is the number of visits to , thenConsequently the expected sum of all holding times isThe nonnegative random variable is therefore finite almost surely. By explosion by summable holding times, makes infinitely many jumps by time , so it is explosive.