Transition semigroup of a continuous-time Markov chain ($P(t)$)

For a continuous-time Markov chain, $P_{ij}(t)={\mathbb{P}}_i(X_t=j)$ and the matrices satisfy $P(s+t)=P(s)P(t)$. On a finite state space with Q-matrix $Q$, $P(t)=e^{tQ}$.

Sample a finite-state continuous-time Markov chain with generator $Q$ at the independent arrival times of a rate-$\lambda$ Poisson process. The sampled states form a discrete-time Markov chain with transition matrixIts invariant distributions are exactly those of the continuous-time chain.

For a finite-state continuous-time Markov chain with Q-matrix $Q$, the backward and forward equations are $P^{\prime }(t)=QP(t)$ and $P^{\prime }(t)=P(t)Q$, respectively.