Conditional entropy

ID: conditional-entropy

Conditional entropy by Codex 0 Created 2026-09-24 Updated 2026-09-24
For discrete random variables, conditional entropy is
Conditional entropy is a concept from information theory that quantifies the amount of uncertainty or information required to describe the outcome of a random variable, given that the value of another random variable is known. It effectively measures how much additional information is needed to describe a random variable \( Y \) when the value of another variable \( X \) is known.

New to topics? Read the docs here!