Past exam of the mathematics course of the University of Cambridge / 2014 / ib / Paper 4 / 9H / a / Solution

The Markov property and the Chapman-Kolmogorov equation giveFor each intermediate state, one first uses the next-step transition probability and then the following one; the sampled history adds no information once $X_{2n}$ is known. Thus $W$ is a homogeneous Markov chain with transition matrix $P^2$ and initial law $\lambda$. In particular,If zero is not a state of $S$, this probability is zero.