Entropy bound for a Hamming ball
ID: entropy-bound-for-a-hamming-ball
For , the number of binary words within Hamming distance of a fixed word is at most , with the binary entropy function in natural logarithms. In , each summand weight for is at least . Also , so . These two bounds give the approximate-recovery denominator in the list-decoding Fano inequality.
New to topics? Read the docs here!