First return time

The first return time to a state $i$ is

The mean recurrence time of $i$ is ${\mathbb{E}}_i{T}_i^{+}$. In a finite irreducible Markov chain with stationary distribution $\pi$, it equals $1/{\pi }_i$.