Solution

ID: past-exam-of-the-options-ii-course-of-the-university-of-oxford/2010/m/m5/a/ii/solution

The transition matrix is , where . Its entries are nonnegative and each row sums to one. On states absent from a particular initial law, these probabilities specify the same chain when started from that state.

New to topics? Read the docs here!