 Entropy submodularity for sums

ID: entropy-submodularity-for-sums

For independent

U, V, V^{'}

with

V

and

V^{'}

identically distributed,

H (V + V^{'}) + H (U) \leq H (U + V) + H (U + V^{'}) .

This additive form of entropy submodularity follows from data processing and invariance of conditional entropy under translations.

 New to topics? Read the docs here!