Continuous-time Markov chain Created 2026-09-24 Updated 2026-11-05
A Continuous-time Markov chain on a finite or countable state space is specified by transition rates for , with finite total exit rate . At a state with , it waits an exponential time of rate and then moves to with probability . A state with is absorbing: it has infinite holding time rather than a zero-rate exponential waiting law.
Its transition-rate matrix is , with off-diagonal entries and diagonal entries , so each row sums to zero. The rates describe first-order transition probabilities: for . On a finite state space, the transition semigroup is and explosion is impossible. On a countably infinite state space, finite individual exit rates do not alone exclude infinitely many jumps in finite time; nonexplosion must be checked separately.
For two states with rates and , the mean holding times are and . Detailed balance gives Stationary distribution , and
This starts at one and relaxes to the stationary mass of state zero. Changing holding rates can preserve an embedded jump chain while changing the proportions of elapsed time spent in its states.
Explosion of a continuous-time Markov chain Created 2026-09-24 Updated 2026-11-05
Explosion occurs when infinitely many jumps take place in finite time.
Explosion is determined by whether the successive holding times of the continuous-time Markov chain have a finite sum.
Exponential martingale of a pure birth process Created 2026-10-14 Updated 2026-11-05
For a pure birth process with fixed initial state and finite statewise rates, the jump-count compensator gives , so is a local martingale up to explosion. If , a rate- Poisson candidate clock with accepted jumps of probability prevents explosion and dominates the jump count. Its finite exponential moments dominate every stopped on each finite horizon, upgrading the local martingale to a true martingale. A random initial state requires ; uniformly bounded rates do not supply this missing initial integrability.
The holding rate at state of a continuous-time Markov chain with generator matrix is
For a conservative chain with finite , its holding time has exponential distribution: and . Conditional on a jump, the next state is with probability . Thus the rate determines when departure occurs, while normalized outgoing rates determine where it goes.
If the outgoing rates are and for two distinct other states, the total rate is five, the mean holding time is , and departure chooses them with probabilities and . A zero rate gives an absorbing state with infinite holding time. Statewise finite rates alone do not rule out explosion of a continuous-time Markov chain.
Invariant distribution of an explosive chain Created 2026-09-24 Updated 2026-11-05
For an explosive chain, a normalized solution of the formal balance equations need not be an invariant probability for the minimal transition semigroup. Explosion sends Probability mass to a cemetery state, and the generator equations on the original states do not include that boundary loss.
A concrete example uses the reflected jump chain on which moves from zero to one, and from moves up with probability and down with probability . Give state holding rate . The embedded chain has invariant weights , for . Dividing by the holding rates and normalizing yields
These weights even satisfy formal Detailed balance: , and for both opposing edge flows equal . Thus holds at each state.
Nevertheless the process explodes. Starting from zero, the embedded walk has expected visit count two at zero and three at every positive level. The zero-state return probability is ; at a positive state it is , giving those geometric visit means. Therefore the expected total elapsed holding time is
The lifetime is finite almost surely. The same bounded expected-visit argument works from every initial state, so the killed minimal semigroup loses all its mass as time tends to infinity. The displayed is consequently a formal generator-balance solution, not a stationary probability of that killed evolution. A conservative continuation after explosion would require an extra boundary rule.
Jump measure of a Markov jump process Created 2026-10-14 Updated 2026-11-05
For a Markov jump process with off-diagonal rate kernel , the jump measure records the jump time and the destination state. Relative to a filtration for which the process has the Markov jump property, its predictable compensator is the displayed rate measure, up to explosion. The corresponding generator is . An enlarged filtration revealing future jumps need not preserve this compensator, so the filtration condition is essential.
Nonexplosion criterion for a pure birth process Created 2026-09-29 Updated 2026-11-05
A pure birth process is nonexplosive exactly when
Its explosion time is the sum of independent exponential holding times. If the displayed series converges, that sum has finite expectation. If it diverges, the Laplace transform of the sum is
forcing the sum to be infinite almost surely.
Nonexplosion from recurrent visits to a slow state Created 2026-09-24 Updated 2026-11-05
If the jump chain visits a state of finite positive holding rate infinitely often, the sum of its independent positive holding times at that state diverges almost surely, preventing explosion.
Nonexplosion under uniformly bounded jump rates Created 2026-09-29 Updated 2026-11-05
If every holding rate of a continuous-time Markov chain is at most , its holding times can be coupled as , where the are independent rate-one exponential random variables. The strong law of large numbers gives almost surely, so the jump times tend to infinity and the chain cannot explode.
Here the total holding rate is
and therefore the jump chain has state-independent transitions
It is an upward biased random walk on . By the strong law of large numbers, almost surely, so . The jump chain, and hence , is transient.
Counting measure is invariant for this jump chain: for every , its incoming mass is . The invariant-measure transfer between a jump chain and a CTMC therefore gives an invariant measure proportional to . Since
the normalized invariant distribution of a continuous-time Markov chain is
This does not contradict transience because an invariant distribution of an explosive chain need not imply positive recurrence.
It remains to verify explosion. Starting from zero, the probability that the biased walk ever reaches is . Once it reaches any state, its probability of returning after departure is
so its expected total number of visits to that state, conditional on reaching it, is . If is the number of visits to , then
Consequently the expected sum of all holding times is
The nonnegative random variable is therefore finite almost surely. By explosion by summable holding times, makes infinitely many jumps by time , so it is explosive.