Past exam of the mathematics course of the University of Cambridge / 2025 / ib / Paper 2 / 18H / e / Solution

Adding $\epsilon I$ leaves every invariant distribution unchanged. On the unique closed communicating class it also supplies a self-loop, making the chain aperiodic; transient states do not affect the limit. Thereforeindependently of $\epsilon \in (0,1)$.