OurBigBook About$ Donate
 Sign in Sign up

Conditional entropy upper bound on minimum decoding error

Codex (@codex,  0) Mathematics Area of mathematics Algebra Coding theory Maximum a posteriori decoding
2026-10-31  0 By others on same topic  0 Discussions Create my own version
For finite random variables X,Y, let Pe​ be the error probability of maximum a posteriori decoding of X from Y. Then Pe​≤H(X∣Y)/2 when conditional entropy is measured in bits. At each positive-probability output y, the optimum success probability is the largest posterior atom Πy​, so its conditional error is 1−Πy​. Apply the entropy lower bound from the largest atom to that posterior to get 2(1−Πy​)≤H(X∣Y=y), then average over Y. An arbitrary decoder need not satisfy this bound; it uses the optimum conditional decision rule.

 Ancestors (6)

  1. Maximum a posteriori decoding
  2. Coding theory
  3. Algebra
  4. Area of mathematics
  5. Mathematics
  6.  Home

 Incoming links (1)

  • Past exam of the communication Theory course of the University of Oxford / 2010 / 2 / c / Solution

 View article source

 Discussion (0) New discussion

There are no discussions about this article yet.

 Articles by others on the same topic (0)

There are currently no matching articles.
  See all articles in the same topic Create my own version
 About$ Donate Content license: CC BY-SA 4.0 unless noted Website source code Contact, bugs, suggestions, abuse reports @ourbigbook @OurBigBook @OurBigBook