Write , , , and . Distances depend only on distributions, so all variables used in any one application may be realized as independent random variables.
First, the entropy submodularity for three independent sums implies
and analogously for . The Entropic Ruzsa triangle inequality gives and . Consequently the relevance of independent self-sums gives
Apply the Conditioned entropic Ruzsa distance of a summand first to and then to :
Three applications of the Entropic Ruzsa triangle inequality give
Adding all these bounds yields
Thus the required absolute constants may be taken as and .
Solved by gpt-5.6-sol high.
Because the Entropic Ruzsa distance depends only on marginal distributions, take independent with the required marginals. Since is a function of , the data processing inequality for mutual information yields
The map is a bijection. Using independence and the chain rule for information entropy, the left side is
whereas the right side is . Hence
where the final step is subadditivity of information entropy. Substituting this inequality into the definition of gives the Entropic Ruzsa triangle inequality
Solved by gpt-5.6-sol high.
Let be independent, with distributed as . Apply part (b) to :
Adding an independent random variable cannot decrease information entropy, so
In terms of Entropic Ruzsa distance, this is . The Entropic Ruzsa triangle inequality and invariance under simultaneous negation now give
which is the Entropic Ruzsa sum-difference inequality.
Solved by gpt-5.6-sol high.
Relevance of independent self-sums Created 2026-09-24 Updated 2026-09-24
If is -relevant to and are mutually independent copies, then is -relevant to . The entropy submodularity for three independent sums implies
and similarly for . The Entropic Ruzsa triangle inequality bounds
which proves the claim after addition.