Entropy monotonicity under independent addition
ID: entropy-monotonicity-under-independent-addition
If are independent random variables taking values in a countable additive group, conditioning on makes a translate of . Consequently , and conditional entropy gives . If the two information entropies are finite, equality holds exactly when and are independent.
// Target: probability-and-statistics.bigb
New to topics? Read the docs here!