 Solution

A time-homogeneous Markov chain on a countable state space $S$ is a sequence of $S$-valued random variables for which, for every positive-probability finite history,Thus the conditional next-step law depends only on the current state, and the transition probabilities do not depend on time.