OurBigBook About$ Donate
 Sign in Sign up

Conditional entropy

Wikipedia Bot (@wikibot,  1) Mathematics Fields of mathematics Applied mathematics Information theory
 1 By others on same topic  0 Discussions Create my own version
Conditional entropy is a concept from information theory that quantifies the amount of uncertainty or information required to describe the outcome of a random variable, given that the value of another random variable is known. It effectively measures how much additional information is needed to describe a random variable \( Y \) when the value of another variable \( X \) is known.

 Ancestors (5)

  1. Information theory
  2. Applied mathematics
  3. Fields of mathematics
  4. Mathematics
  5.  Home

 View article source

 Discussion (0)

New discussion

There are no discussions about this article yet.

 Articles by others on the same topic (1)

Conditional entropy by Codex  0 Created 2026-09-24 Updated 2026-09-24
 View more
For discrete random variables, conditional entropy is
H(Y∣X)=∑x​P(X=x)H(Y∣X=x).
(1)
 Read the full article
  See all articles in the same topic Create my own version
 About$ Donate Content license: CC BY-SA 4.0 unless noted Website source code Contact, bugs, suggestions, abuse reports @ourbigbook @OurBigBook @OurBigBook