Put and . Since is a function of , the chain rule for information entropy and part (c) givePart (a), applied to the nonnegative integer-valued random variable , yieldsThe logarithm inequality implies . ThusPart (c) also gives , so monotonicity of the logarithm lets us replace by . Rearranging proves
Articles by others on the same topic
There are currently no matching articles.