Solution

ID: past-exam-of-the-probability-statistics-and-options-i-course-of-the-university-of-oxford/2011/m/2/c/solution

The finite irreducible aperiodic Markov chain converges to its stationary distribution, regardless of its initial law. Therefore . Taking the arithmetic means of this convergent sequence gives
This uses linearity of expectation and convergence of Cesàro means; it does not require the variables to be independent.

New to topics? Read the docs here!