Solution (source code)

= Solution

A stopping time $T$ has $\{T\le n\}$ determined by $X_0,\ldots,X_n$. The <Strong Markov property> says that, conditional on $T\lt \infty$ and $X_T=i$, the post-$T$ chain is a fresh chain started at $i$, independent of the pre-$T$ history.