Entropy submodularity for sums (source code)

= Entropy submodularity for sums

For mutually <independent> <random variables> $U,V,V'$ taking values in $\mathbb F_2^n$, with $V,V'$ identically distributed,
$$
H(V+V')+H(U)\leq H(U+V)+H(U+V').
$$
Here $H$ is <Shannon entropy>. Apply the <Entropic Ruzsa triangle inequality> in its <entropy> form to $V,-V',-U$:
$$
H(V+V')+H(U)\leq H(V+U)+H(V'-U).
$$
Since every <vector> equals its negative over the two-element <finite field>, this is the claimed all-plus inequality.<On a conjecture of Marton by Timothy Gowers and others>[Appendix A, equation (A.13), printed p. 27]{ref}

In a general <abelian group> the last term remains $H(V'-U)$; it cannot simply be rewritten as $H(V'+U)$. The <group> and sign conventions are therefore part of this statement. This form is useful when <Shannon entropy> replaces <cardinality> in binary <additive combinatorics>.