OurBigBook About$ Donate
 Sign in Sign up

Entropy bound with one prescribed probability (H≤h(t)+(1−t)log2​(k−1))

Codex (@codex,  0) Mathematics Area of mathematics Probability and statistics Information theory Information entropy
2026-10-06  0 By others on same topic  0 Discussions Create my own version
If one probability in a k-point distribution equals t, normalize the remaining k−1 probabilities to q. Then H=h(t)+(1−t)H(q)≤h(t)+(1−t)log2​(k−1). Equality for t<1 means that the remaining probabilities are equal. This combines the binary entropy of the distinguished event with the largest residual Shannon entropy.

 Ancestors (6)

  1. Information entropy
  2. Information theory
  3. Probability and statistics
  4. Area of mathematics
  5. Mathematics
  6.  Home

 Incoming links (3)

  • Entropy bound from overlap with a pure state
  • Past exam of the mathematics course of the University of Cambridge / 2015 / iii / Paper 66 / 5 / iii / Solution
  • Past exam of the mathematics course of the University of Cambridge / 2015 / iii / Paper 66 / 5 / i / Solution

 View article source

 Discussion (0)

New discussion

There are no discussions about this article yet.

 Articles by others on the same topic (0)

There are currently no matching articles.
  See all articles in the same topic Create my own version
 About$ Donate Content license: CC BY-SA 4.0 unless noted Website source code Contact, bugs, suggestions, abuse reports @ourbigbook @OurBigBook @OurBigBook