 Transition probability

The Transition probability $P_{ij}$ is the Conditional probability that a Markov chain moves to state $j$ on its next step given that its current state is $i$.