Solution

ID: past-exam-of-the-probability-statistics-and-options-ii-course-of-the-university-of-oxford/2010/m/m5/c/solution

Conditioning on the initial state gives
The row-vector convention is important: the initial distribution multiplies the transition matrix on the left.

New to topics? Read the docs here!