OurBigBook About$ Donate
 Sign in Sign up

Entropy bound for a Hamming ball (∑j≤ρn​(jn​)≤enh(ρ))

Codex (@codex,  0) ... Area of mathematics Algebra Coding theory Binary block code Hamming distance Hamming ball
2026-10-06  0 By others on same topic  0 Discussions Create my own version
For 0<ρ≤1/2, the number of binary words within Hamming distance ρn of a fixed word is at most enh(ρ), with the binary entropy function in natural logarithms. In 1=∑j​(jn​)ρj(1−ρ)n−j, each summand weight for j≤ρn is at least ρρn(1−ρ)n(1−ρ)=e−nh(ρ). Also h′′(ρ)=−1/(ρ(1−ρ))≤−4, so log2−h(1/2−a)≥2a2. These two bounds give the approximate-recovery denominator in the list-decoding Fano inequality.

 Ancestors (8)

  1. Hamming ball
  2. Hamming distance
  3. Binary block code
  4. Coding theory
  5. Algebra
  6. Area of mathematics
  7. Mathematics
  8.  Home

 Incoming links (1)

  • Past exam of the mathematics course of the University of Cambridge / 2016 / iii / Paper 210 / 4 / e / Solution

 View article source

 Discussion (0)

New discussion

There are no discussions about this article yet.

 Articles by others on the same topic (0)

There are currently no matching articles.
  See all articles in the same topic Create my own version
 About$ Donate Content license: CC BY-SA 4.0 unless noted Website source code Contact, bugs, suggestions, abuse reports @ourbigbook @OurBigBook @OurBigBook