Solution

ID: past-exam-of-the-options-ii-course-of-the-university-of-oxford/2013/m4/b/solution

Every state reaches state one by deterministic downward steps. From one, the chain can reach a given state exactly when it can jump to some with and then count down to . Therefore
If the support is bounded by , states above cannot be reached from one, so the chain on the stated infinite state space is not irreducible. Its smaller closed class can still have a stationary distribution, as in part (e).

New to topics? Read the docs here!