 Solution

Let $I_n$ count immigration events during the first $n$ transitions, and let $A_n$ count upward steps during those transitions. Write $h(k)=\theta /(k+\theta )$ for the conditional immigration probability. If $J_m$ is the indicator that transition $m$ to $m+1$ is immigration, then $J_m-h(X_m)$ is a bounded martingale difference with respect to the history that records event types as well as population sizes. The strong law for martingales with bounded increments impliesSince $h$ is bounded, the countable-state Markov chain ergodic theorem givesApplying the same argument to upward-step indicators gives $A_n/n\to {\sum }_k{\pi }_k{u}_k$ almost surely. To evaluate this denominator, sum detailed balance over all neighboring edges:Since $u_k+d_k=1$ and ${\sum }_k{\pi }_k=1$, both sums equal $1/2$. The denominator limit is positive, so division is valid and the immigration fraction among upward steps isThis is the requested answer in terms of $\pi$. Substituting part (iii) additionally gives ${\sum }_k{\pi }_k\theta /(k+\theta )=(1-r)/2$, so the fraction simplifies to $1-r=(1-2p)/(1-p)$.