= Subsampled Markov chain
Let $(X_n)$ be a time-homogeneous <Markov chain> with <transition matrix> $P$, and let $d$ be a positive integer. Then $Y_n=X_{dn}$ is a <Markov chain> with <transition matrix> $P^d$ and the same initial distribution. The Markov property and the <Chapman-Kolmogorov equation> give $P(X_{d(n+1)}=j\mid X_0,\ldots,X_{dn})=(P^d)_{X_{dn},j}$. Conditioning again on the smaller history $(Y_0,\ldots,Y_n)$ leaves the right-hand side unchanged, since it is determined by $Y_n$. This proves the Markov property of the sampled sequence, rather than only identifying its marginal transition probabilities. Periodicity of the original chain may split the sampled chain into several closed classes.
Back to article page
