 Transition probability

The transition probability $P_{ij}$ is the conditional probability that a Markov chain moves to state $j$ on its next step given that its current state is $i$.