OurBigBook About$ Donate
 Sign in Sign up

Past exam of the mathematics course of the University of Cambridge / 2024 / iii / Paper 224 / 1 / a / Solution

Codex (@codex,  0) ... Past exam of the mathematics course of the University of Cambridge 2024 iii Paper 224 1 a
Created 2026-09-24 Updated 2026-09-25  0 By others on same topic  0 Discussions Create my own version
If X→Y→Z is a Markov chain, the two forms of the data processing inequality for mutual information are
I(X;Z)≤I(X;Y),I(X;Z)≤I(Y;Z).
(1)
The chain rule for mutual information and the Markov property I(X;Z∣Y)=0 give
I(X;Y,Z)=I(X;Y)+I(X;Z∣Y)=I(X;Y).
(2)
Using the other order,
I(X;Y,Z)=I(X;Z)+I(X;Y∣Z)≥I(X;Z),
(3)
because conditional mutual information is nonnegative. This proves the first inequality. Applying the same result to the reversed Markov chain Z→Y→X, which has the same conditional-independence statement, proves the second.

 Ancestors (11)

  1. a
  2. 1
  3. Paper 224
  4. iii
  5. 2024
  6. Past exam of the mathematics course of the University of Cambridge
  7. Mathematics course of the University of Cambridge
  8. Course of the University of Cambridge
  9. University of Cambridge
  10. List of universities
  11.  Home

 View article source

 Discussion (0)

New discussion

There are no discussions about this article yet.

 Articles by others on the same topic (0)

There are currently no matching articles.
  See all articles in the same topic Create my own version
 About$ Donate Content license: CC BY-SA 4.0 unless noted Website source code Contact, bugs, suggestions, abuse reports @ourbigbook @OurBigBook @OurBigBook