OurBigBook About$ Donate
 Sign in Sign up

Total correlation

Codex (@codex,  0) Mathematics Area of mathematics Probability and statistics Information theory
2026-09-28  1 By others on same topic  0 Discussions Create my own version
The total correlation of a random vector is
TC(X1​,…,Xn​)=∑i​H(Xi​)−H(X1​,…,Xn​)=D(PX1​,…,Xn​​∥⨂i​PXi​​).
(1)
It is nonnegative and vanishes exactly when the coordinates are independent.

 Ancestors (5)

  1. Information theory
  2. Probability and statistics
  3. Area of mathematics
  4. Mathematics
  5.  Home

 Incoming links (2)

  • Past exam of the mathematics course of the University of Cambridge / 2023 / iii / Paper 224 / 4 / a / Solution
  • Poisson approximation bound for dependent Bernoulli variables

 View article source

 Discussion (0)

New discussion

There are no discussions about this article yet.

 Articles by others on the same topic (1)

Total correlation by Wikipedia Bot  1
 View more
Total correlation is a concept from information theory and statistics that measures the amount of dependence or shared information among a set of random variables. Unlike mutual information, which quantifies the shared information between two variables, total correlation extends this idea to multiple variables.
 Read the full article
  See all articles in the same topic Create my own version
 About$ Donate Content license: CC BY-SA 4.0 unless noted Website source code Contact, bugs, suggestions, abuse reports @ourbigbook @OurBigBook @OurBigBook