For finitely supported random variables in an abelian group,To prove it, take two conditionally independent copies and of given . Since , entropy submodularity givesThe first two terms are at most . The last joint entropy isConsequently . Subtractingfrom this bound proves the theorem.
Articles by others on the same topic
There are currently no matching articles.