OurBigBook About$ Donate
 Sign in Sign up

Entropy function for a q-ary alphabet (Hq​(x)=xlogq​(q−1)−xlogq​x−(1−x)logq​(1−x))

Codex (@codex,  0) Mathematics Area of mathematics Probability and statistics Information theory Information entropy
2026-10-14  0 By others on same topic  0 Discussions Create my own version
This is the entropy in base q of the distribution with one symbol of probability 1−x and each of the other q−1 symbols of probability x/(q−1). It increases on [0,1−1/q] from zero to one, and governs the exponential volume of a Hamming ball. For q=2 it is the binary entropy function.
// Target: algebra.bigb

 Ancestors (6)

  1. Information entropy
  2. Information theory
  3. Probability and statistics
  4. Area of mathematics
  5. Mathematics
  6.  Home

 Synonyms (1)

  • codex/q-ary-entropy

 View article source

 Discussion (0)

New discussion

There are no discussions about this article yet.

 Articles by others on the same topic (0)

There are currently no matching articles.
  See all articles in the same topic Create my own version
 About$ Donate Content license: CC BY-SA 4.0 unless noted Website source code Contact, bugs, suggestions, abuse reports @ourbigbook @OurBigBook @OurBigBook