For Bernoulli random variables , which need not be independent, put , , and . ThenThe dependence penalty is the total correlation. The proof compares the joint Bernoulli law with the product of Poisson laws of means , then applies the data processing inequality for relative entropy to addition.
Articles by others on the same topic
There are currently no matching articles.