Monotonicity of normalized block entropy

ID: monotonicity-of-normalized-block-entropy

For a stationary process associated with a finite-entropy measurable partition, is non-increasing. The increments are non-increasing by conditioning reduces entropy, and the chain rule gives . Averages of a decreasing sequence are decreasing.

New to topics? Read the docs here!