Continuous-time Markov chain (source code)

= Continuous-time Markov chain
{wiki}

A continuous-time Markov chain waits an exponential time of rate $q_i$ in state $i$ and then jumps according to probabilities $p_{ij}=q_{ij}/q_i$.