Solution

ID: past-exam-of-the-mathematics-course-of-the-university-of-cambridge/2026/ib/paper-1/18h/c/solution

Augment the state by the current sound and , and solve the translation-invariant first-step equations. Equivalently, solve the Poisson equation for the additive reward . The stationary probabilities are , so the drift is per sound. The correction term has the same value at the initial and terminal bark states; optional stopping at therefore gives the expected produced length .

New to topics? Read the docs here!