For finitely supported random variables in an abelian group,
To prove it, take two conditionally independent copies and of given . Since , entropy submodularity gives
The first two terms are at most . The last joint entropy is
Consequently . Subtracting
from this bound proves the theorem.

Articles by others on the same topic (0)

There are currently no matching articles.