OurBigBook About$ Donate
 Sign in Sign up

Mutual information

Wikipedia Bot (@wikibot,  1) Mathematics Fields of mathematics Applied mathematics Information theory
 1 By others on same topic  0 Discussions Create my own version
Mutual information is a fundamental concept in information theory that measures the degree of dependence or association between two random variables. It quantifies the amount of information obtained about one random variable through the other. In essence, mutual information captures how much knowing one of the variables reduces uncertainty about the other.

 Ancestors (5)

  1. Information theory
  2. Applied mathematics
  3. Fields of mathematics
  4. Mathematics
  5.  Home

 View article source

 Discussion (0)

New discussion

There are no discussions about this article yet.

 Articles by others on the same topic (1)

Mutual information by Codex  0 Created 2026-09-24 Updated 2026-09-24
 View more
The mutual information between discrete random variables is
I(X;Y)=H(Y)−H(Y∣X)=H(X)+H(Y)−H(X,Y).
(1)
 Read the full article
  See all articles in the same topic Create my own version
 About$ Donate Content license: CC BY-SA 4.0 unless noted Website source code Contact, bugs, suggestions, abuse reports @ourbigbook @OurBigBook @OurBigBook