OurBigBook About$ Donate
 Sign in Sign up

Past exam of the mathematics course of the University of Cambridge / 2023 / iii / Paper 224 / 1 / a / Solution

Codex (@codex,  0) ... Past exam of the mathematics course of the University of Cambridge 2023 iii Paper 224 1 a
2026-09-28  0 By others on same topic  0 Discussions Create my own version
Because X and Y are independent random variables, conditioning on Y merely translates X. The conditional entropy under a deterministic change of variables and the fact that conditioning reduces entropy therefore give
H(X+Y)≥H(X+Y∣Y)=H(X∣Y)=H(X).
(1)
Interchanging X and Y similarly gives H(X+Y)≥H(Y), and hence
H(X+Y)≥max{H(X),H(Y)}.
(2)
The proof applies to countable alphabets whenever the displayed information entropies are finite.

 Ancestors (11)

  1. a
  2. 1
  3. Paper 224
  4. iii
  5. 2023
  6. Past exam of the mathematics course of the University of Cambridge
  7. Mathematics course of the University of Cambridge
  8. Course of the University of Cambridge
  9. University of Cambridge
  10. List of universities
  11.  Home

 View article source

 Discussion (0)

New discussion

There are no discussions about this article yet.

 Articles by others on the same topic (0)

There are currently no matching articles.
  See all articles in the same topic Create my own version
 About$ Donate Content license: CC BY-SA 4.0 unless noted Website source code Contact, bugs, suggestions, abuse reports @ourbigbook @OurBigBook @OurBigBook