Conditioned entropic Ruzsa distance of a summand Created 2026-09-24 Updated 2026-09-24
If are independent random variables in , thenIndeed, conditioning reduces entropy and independence giveIn , , so conditional entropy under a deterministic change of variables shows that the left-hand side is unchanged when and are exchanged. Averaging the displayed bound with its exchanged version gives the result.
Past exam of the mathematics course of the University of Cambridge 2023 iii Paper 224 1 a Solution 2026-09-28
Because and are independent random variables, conditioning on merely translates . The conditional entropy under a deterministic change of variables and the fact that conditioning reduces entropy therefore giveInterchanging and similarly gives , and henceThe proof applies to countable alphabets whenever the displayed information entropies are finite.