Solution

ID: past-exam-of-the-probability-statistics-and-options-i-course-of-the-university-of-oxford/2010/m/2/b/solution

Condition on the full sampled history through time . The Markov property of implies that its future after depends on that history only through . Summing over the intermediate state gives
Thus is a Markov chain with transition matrix . This is a deterministic-time sampled Markov chain.

New to topics? Read the docs here!