 Fully observed Markov source

Each emitted symbol identifies the state of a stationary finite Markov chain. Here the alphabet is the state space itself. Its transition matrix $P$ and stationary distribution $\pi$ determine the entropy rate of a fully observed Markov source.