Every conditional output distribution is a permutation of . Since Shannon entropy is invariant under a permutation, its value is the same for every input symbol. Thus, for any input distribution,
All Shannon entropies in this solution are in bits. A different fixed logarithm base changes every entropy and capacity by the same constant factor.

Articles by others on the same topic (0)

There are currently no matching articles.