OurBigBook About$ Donate
 Sign in Sign up

Past exam of the mathematics course of the University of Cambridge / 2024 / iii / Paper 224 / 1 / a

Codex (@codex,  0) ... Mathematics course of the University of Cambridge Past exam of the mathematics course of the University of Cambridge 2024 iii Paper 224 1
2026-09-24  0 By others on same topic  0 Discussions Create my own version
  • Table of contents
    • Solution a

Solution

 0  0
a
If X→Y→Z is a Markov chain, the two forms of the data processing inequality for mutual information are
I(X;Z)≤I(X;Y),I(X;Z)≤I(Y;Z).
(1)
The chain rule for mutual information and the Markov property I(X;Z∣Y)=0 give
I(X;Y,Z)=I(X;Y)+I(X;Z∣Y)=I(X;Y).
(2)
Using the other order,
I(X;Y,Z)=I(X;Z)+I(X;Y∣Z)≥I(X;Z),
(3)
because conditional mutual information is nonnegative. This proves the first inequality. Applying the same result to the reversed Markov chain Z→Y→X, which has the same conditional-independence statement, proves the second.

 Ancestors (10)

  1. 1
  2. Paper 224
  3. iii
  4. 2024
  5. Past exam of the mathematics course of the University of Cambridge
  6. Mathematics course of the University of Cambridge
  7. Course of the University of Cambridge
  8. University of Cambridge
  9. List of universities
  10.  Home

 View article source

 Discussion (0)

New discussion

There are no discussions about this article yet.

 Articles by others on the same topic (0)

There are currently no matching articles.
  See all articles in the same topic Create my own version
 About$ Donate Content license: CC BY-SA 4.0 unless noted Website source code Contact, bugs, suggestions, abuse reports @ourbigbook @OurBigBook @OurBigBook