For finitely supported random variables, the conditional entropic Ruzsa distance is
Thus the two conditioning values are sampled independently. If only one variable is conditioned, write .
The simultaneous conditional distance samples one value of the conditioning variable for both arguments:
It differs in general from , which uses two independently sampled conditioning values.
If are independent random variables in , then
Indeed, conditioning reduces entropy and independence give
In , , so conditional entropy under a deterministic change of variables shows that the left-hand side is unchanged when and are exchanged. Averaging the displayed bound with its exchanged version gives the result.

Articles by others on the same topic (0)

There are currently no matching articles.