Set . Given , the value of is certain, so . Applying the entropy identity in the two orders gives
(1)
because conditional entropy is nonnegative. Consequently
(2)
A deterministic coarsening can merge distinguishable source outcomes, but cannot create additional Shannon entropy.

Ancestors (13)

  1. ii
  2. a
  3. 2
  4. 2010
  5. Past exam of the communication Theory course of the University of Oxford
  6. Communication Theory course of the University of Oxford
  7. Year 3 of the mathematics course of the University of Oxford
  8. Mathematics course of the University of Oxford
  9. Undergraduate course of the University of Oxford
  10. Course of the University of Oxford
  11. University of Oxford
  12. List of universities
  13. Home

View article source

Discussion (0) New discussion

There are no discussions about this article yet.

Articles by others on the same topic (0)

There are currently no matching articles.
See all articles in the same topic Create my own version