Conditioned entropic Ruzsa distance of a summand Created 2026-09-24 Updated 2026-09-24
If are independent random variables in , then
Indeed, conditioning reduces entropy and independence give
In , , so conditional entropy under a deterministic change of variables shows that the left-hand side is unchanged when and are exchanged. Averaging the displayed bound with its exchanged version gives the result.
Because and are independent random variables, conditioning on merely translates . The conditional entropy under a deterministic change of variables and the fact that conditioning reduces entropy therefore give
Interchanging and similarly gives , and hence
The proof applies to countable alphabets whenever the displayed information entropies are finite.