Solution

ID: past-exam-of-the-mathematics-course-of-the-university-of-cambridge/2014/ib/paper-4/9h/a/solution

The Markov property and the Chapman-Kolmogorov equation give
For each intermediate state, one first uses the next-step transition probability and then the following one; the sampled history adds no information once is known. Thus is a homogeneous Markov chain with transition matrix and initial law . In particular,
If zero is not a state of , this probability is zero.

New to topics? Read the docs here!