Because the Entropic Ruzsa distance depends only on marginal distributions, take independent with the required marginals. Since is a function of , the data processing inequality for mutual information yields
The map is a bijection. Using independence and the chain rule for information entropy, the left side is
whereas the right side is . Hence
where the final step is subadditivity of information entropy. Substituting this inequality into the definition of gives the Entropic Ruzsa triangle inequality

Articles by others on the same topic (0)

There are currently no matching articles.