 Subsampled Markov chain

Let $(X_n)$ be a time-homogeneous Markov chain with transition matrix $P$, and let $d$ be a positive integer. Then $Y_n=X_{dn}$ is a Markov chain with transition matrix $P^d$ and the same initial distribution. The Markov property and the Chapman-Kolmogorov equation give $P(X_{d(n+1)}=j\mid X_0,\dots ,X_{dn})=(P^d{)}_{X_{dn},j}$. Conditioning again on the smaller history $(Y_0,\dots ,Y_n)$ leaves the right-hand side unchanged, since it is determined by $Y_n$. This proves the Markov property of the sampled sequence, rather than only identifying its marginal transition probabilities. Periodicity of the original chain may split the sampled chain into several closed classes.