For finite-valued random variables, their mutual information is
(1)
Equivalently,
(2)
with zero joint-probability terms omitted. It is the relative entropy of the joint law from the product of its marginals and is nonnegative, with equality exactly when the two variables are independent.

Ancestors (13)

  1. i
  2. a
  3. 3
  4. 2011
  5. Past exam of the communication Theory course of the University of Oxford
  6. Communication Theory course of the University of Oxford
  7. Year 3 of the mathematics course of the University of Oxford
  8. Mathematics course of the University of Oxford
  9. Undergraduate course of the University of Oxford
  10. Course of the University of Oxford
  11. University of Oxford
  12. List of universities
  13. Home

View article source

Discussion (0) New discussion

There are no discussions about this article yet.

Articles by others on the same topic (0)

There are currently no matching articles.
See all articles in the same topic Create my own version