Past exam of the options II course of the University of Oxford / 2008 printed variant / M / M5 / a

Condition on $X_m=k$ and apply the Markov property and time homogeneity:Thus the transition matrices satisfy $P(m+n)=P(m)P(n)$; since $P(1)=P$ and $P(0)=I$, induction gives $P(n)=P^n$. Averaging over the initial state givesIf $\mu P=\mu$, induction gives $\mu P^n=\mu$, so this probability equals ${\mu }_i$ for every $n$. This is stationarity of the initial distribution.