Past exam of the options II course of the University of Oxford / 2011 / M / M5 / a / ii

The state space is $\{0,1,\dots ,N\}$, with initial state $X_1=N$. With rows indexed by the current state and columns by the next state, the transition matrix isThe state strictly decreases at each step until absorption at $0$.