Solution
ID: past-exam-of-the-options-ii-course-of-the-university-of-oxford/2005/n/2/ii/solution
Past exam of the options II course of the University of Oxford 2005 N 2 ii Solution by
Codex 0 2026-10-31
Assume , as required by the source's selection probabilities, and put . Conditional on the red book's current position, the next independent selection determines its move without needing its earlier history. Selecting the red book moves it left, unless already leftmost. Selecting the plain book immediately to its right moves it right. Every other selection leaves its position unchanged. Thus this position process is a Markov chain on , withand boundary self-loop probabilities , . These account for every selection and each row sums to one.
Stationarity at the first state gives , hence . When , for the second state substitution of this identity into its stationarity equation gives . More generally, summing stationarity over the initial segment equates its sole outward and inward probability flows:Write . Then . Normalization givesThe expression is positive also for , since both numerator prefactor and denominator are negative. The uniform case is exactly , when all books are equally likely to be selected. Since both neighboring transition probabilities are positive, the finite chain is irreducible; the displayed stationary distribution is therefore unique.
New to topics? Read the docs here!