 Solution

Let $R$ be the number of returns to $v$ after time $0$. Since $v$ is a recurrent state, the probability of another return after each visit is one. By the stated geometric distribution description, ${\mathbb{P}}_v(R\ge k)=1$ for every positive integer $k$. Thus $R=\infty$ almost surely and ${\mathbb{E}}_{v}R=\infty$.

On the other hand, writing each visit as an indicator random variable and applying the monotone convergence theorem to the partial sums givesThe left side is infinite, proving the recurrence criterion by return probabilities in the required direction: