The binary entropy function is the information entropy of a Bernoulli random variable:
with endpoint values zero. It is symmetric under , reaches one bit at , and has
in the interior. Its strict concavity expresses why an even mixture of two outcomes has more uncertainty than a strong bias toward either one. The curve in mutual information also shows how this same uncertainty becomes the loss term in binary symmetric channel capacity.

Ancestors (6)

  1. Information entropy
  2. Information theory
  3. Probability and statistics
  4. Area of mathematics
  5. Mathematics
  6. Home

Discussion (0) New discussion

There are no discussions about this article yet.

Articles by others on the same topic (0)

There are currently no matching articles.