Past exam of the mathematics course of the University of Cambridge / 2019 / ib / Paper 4 / 9H (Markov Chains)

Let $R$ be the number of returns to $v$ after time $0$. Since $v$ is a recurrent state, the probability of another return after each visit is one. By the stated geometric distribution description, ${\mathbb{P}}_v(R\ge k)=1$ for every positive integer $k$. Thus $R=\infty$ almost surely and ${\mathbb{E}}_{v}R=\infty$.

On the other hand, writing each visit as an indicator random variable and applying the monotone convergence theorem to the partial sums givesThe left side is infinite, proving the recurrence criterion by return probabilities in the required direction:

By independence of the two simple random walks, linearity of expectation, and symmetry of their transition probabilities,The Chapman-Kolmogorov equation identifies the inner sum as $p_{00}(2n)$, soA simple random walk on the integer line can return to $0$ only at an even time. Since it is recurrent at $0$, part (a) givesTherefore $\boxed{\mathbb{E}Z=\infty }$.