Solution

ID: past-exam-of-the-options-ii-course-of-the-university-of-oxford/2013/m4/d/solution

The first return time has distribution . It is finite almost surely, so state one is recurrent. It is positive recurrent precisely when its mean return time is finite:
By irreducibility the same recurrence class contains every state. Thus the condition is finiteness of the expected value of the positive-integer distribution . If that mean is infinite, the chain is null recurrent, not transient.

New to topics? Read the docs here!