Because and are independent random variables, conditioning on merely translates . The conditional entropy under a deterministic change of variables and the fact that conditioning reduces entropy therefore giveInterchanging and similarly gives , and henceThe proof applies to countable alphabets whenever the displayed information entropies are finite.
Articles by others on the same topic
There are currently no matching articles.