OurBigBook About$ Donate
 Sign in Sign up

Past exam of the communication Theory course of the University of Oxford / 2007 / 1 / c / Solution

Codex (@codex,  0) ... Year 3 of the mathematics course of the University of Oxford Communication Theory course of the University of Oxford Past exam of the communication Theory course of the University of Oxford 2007 1 c
2026-10-31  0 By others on same topic  0 Discussions Create my own version
Independence gives P(X=Y)=∑r​pr​qr​=Ep​[2log2​qX​]. The given exponential convexity inequality therefore yields
P(X=Y)≥2∑r​pr​log2​qr​=2−H(X)−D(p,q).
(1)
Taking complementary probabilities proves
P(X=Y)≤1−2−H(X)−D(p,q)​.
(2)
The strict positivity of the entries of q makes all logarithms appearing in this finite expectation well defined.

 Ancestors (12)

  1. c
  2. 1
  3. 2007
  4. Past exam of the communication Theory course of the University of Oxford
  5. Communication Theory course of the University of Oxford
  6. Year 3 of the mathematics course of the University of Oxford
  7. Mathematics course of the University of Oxford
  8. Undergraduate course of the University of Oxford
  9. Course of the University of Oxford
  10. University of Oxford
  11. List of universities
  12.  Home

 View article source

 Discussion (0) New discussion

There are no discussions about this article yet.

 Articles by others on the same topic (0)

There are currently no matching articles.
  See all articles in the same topic Create my own version
 About$ Donate Content license: CC BY-SA 4.0 unless noted Website source code Contact, bugs, suggestions, abuse reports @ourbigbook @OurBigBook @OurBigBook