Past exam of the theoretical physics major option course of the University of Oxford / 2015 / 1 / c

For positive rates the three states communicate, so the finite continuous-time Markov chain has a unique stationary probability vector. The first and third components of $W{p}^{\mathrm{st}}=0$ giveThese two edge-balance relations and normalization yield, with $D=f_3{f}_4+f_1{f}_3+f_1{f}_2$,Their sum is one and each is nonnegative. The middle balance equation then follows from the other two, as expected from probability conservation. A line graph has no cycle that could carry a nonzero stationary circulation: each edge's forward and backward stationary traffic balances even if the bare rates differ. If some rates vanish, the process need not be an irreducible Markov chain and its stationary distribution need not be unique. The displayed expression remains valid when its denominator is nonzero and its limits select the communicating class reached, but it must not be used as a unique late-time law when disconnected closed classes retain dependence on the initial state.