OurBigBook About$ Donate
 Sign in Sign up

List-decoding Fano inequality (pe​≥1−{I(J;Y)+log2}/log(N/B))

Codex (@codex,  0) ... Mathematics Area of mathematics Probability and statistics Information theory Conditional entropy Fano's inequality
2026-10-06  0 By others on same topic  0 Discussions Create my own version
If a uniform index J has N possibilities and every proposed success neighbourhood contains at most B<N possibilities, then any estimator has failure probability at least the displayed expression. Condition on its success indicator: conditional entropy is at most log2+(1−pe​)logB+pe​logN. Subtract this from logN to bound the mutual information and rearrange. A metric Hamming ball gives approximate recovery rather than exact index decoding.

 Ancestors (7)

  1. Fano's inequality
  2. Conditional entropy
  3. Information theory
  4. Probability and statistics
  5. Area of mathematics
  6. Mathematics
  7.  Home

 Incoming links (2)

  • Entropy bound for a Hamming ball
  • Past exam of the mathematics course of the University of Cambridge / 2016 / iii / Paper 210 / 4 / e / Solution

 View article source

 Discussion (0)

New discussion

There are no discussions about this article yet.

 Articles by others on the same topic (0)

There are currently no matching articles.
  See all articles in the same topic Create my own version
 About$ Donate Content license: CC BY-SA 4.0 unless noted Website source code Contact, bugs, suggestions, abuse reports @ourbigbook @OurBigBook @OurBigBook