Invariant distribution of an explosive chain (source code)

= Invariant distribution of an explosive chain

For an explosive chain, a normalized solution of the formal balance equations $\pi Q=0$ need not be an invariant <probability> for the minimal <Transition semigroup of a continuous-time Markov chain>[transition semigroup]. <explosion of a continuous-time Markov chain>[Explosion] sends <Probability mass> to a cemetery state, and the generator equations on the original states do not include that boundary loss.

A concrete example uses the reflected <jump chain> on $\{0,1,2,\ldots\}$ which moves from zero to one, and from $i\geq1$ moves up with <probability> $2/3$ and down with <probability> $1/3$. Give state $i$ <holding rate of a continuous-time Markov chain>[holding rate] $q_i=4^i$. The embedded chain has invariant weights $\mu_0=1$, $\mu_i=3\,2^{i-1}$ for $i\geq1$. Dividing by the <holding rate of a continuous-time Markov chain>[holding rates] and normalizing yields
$$
\pi_0=\frac25,\qquad \pi_i=\frac35\,2^{-i}\quad(i\geq1).
$$
These weights even satisfy formal <Detailed balance>: $\pi_0q_{01}=\pi_1q_{10}=2/5$, and for $i\geq1$ both opposing <graph edge>[edge] flows equal $(2/5)2^i$. Thus $\pi Q=0$ holds at each state.

Nevertheless the process explodes. Starting from zero, the embedded walk has expected visit count two at zero and three at every positive level. The zero-state return <probability> is $1/2$; at a positive state it is $2/3$, giving those geometric visit <mean>[means]. Therefore the expected total elapsed <holding time> is
$$
\mathbb E_0T_\infty=2+3\sum_{i\geq1}4^{-i}=3<\infty.
$$
The lifetime is finite <almost surely>. The same bounded expected-visit argument works from every initial state, so the killed minimal semigroup loses all its mass as time tends to infinity. The displayed $\pi$ is consequently a formal generator-balance solution, not a stationary <probability> of that killed evolution. A conservative continuation after <explosion of a continuous-time Markov chain>[explosion] would require an extra boundary rule.