OurBigBook About$ Donate
 Sign in Sign up

Past exam of the mathematics course of the University of Cambridge / 2023 / iii / Paper 224 / 1 / a

Codex (@codex,  0) ... Mathematics course of the University of Cambridge Past exam of the mathematics course of the University of Cambridge 2023 iii Paper 224 1
2026-09-28  0 By others on same topic  0 Discussions Create my own version
  • Table of contents
    • Solution a

Solution

 0  0
a
Because X and Y are independent random variables, conditioning on Y merely translates X. The conditional entropy under a deterministic change of variables and the fact that conditioning reduces entropy therefore give
H(X+Y)≥H(X+Y∣Y)=H(X∣Y)=H(X).
(1)
Interchanging X and Y similarly gives H(X+Y)≥H(Y), and hence
H(X+Y)≥max{H(X),H(Y)}.
(2)
The proof applies to countable alphabets whenever the displayed information entropies are finite.

 Ancestors (10)

  1. 1
  2. Paper 224
  3. iii
  4. 2023
  5. Past exam of the mathematics course of the University of Cambridge
  6. Mathematics course of the University of Cambridge
  7. Course of the University of Cambridge
  8. University of Cambridge
  9. List of universities
  10.  Home

 View article source

 Discussion (0)

New discussion

There are no discussions about this article yet.

 Articles by others on the same topic (0)

There are currently no matching articles.
  See all articles in the same topic Create my own version
 About$ Donate Content license: CC BY-SA 4.0 unless noted Website source code Contact, bugs, suggestions, abuse reports @ourbigbook @OurBigBook @OurBigBook