Entropy monotonicity under independent addition

ID: entropy-monotonicity-under-independent-addition

If are independent random variables taking values in a countable additive group, conditioning on makes a translate of . Consequently , and conditional entropy gives . If the two information entropies are finite, equality holds exactly when and are independent.

New to topics? Read the docs here!