Past exam of the probability course of the University of Oxford / 2023 / 3 / a / ii / Solution

The assumed identities are the detailed balance equations. Summing over $i$ and using the row sums of the transition matrix gives, for every $j$,All summands are nonnegative, so these countable sums are justified. Thusand $\pi$ is an invariant distribution.