 Chapter 2: Information Measures: Mutual Information

Online text: ocw.mit.edu/courses/6-441-information-theory-spring-2016/184197ca5d5418da2415d37e929860b9_MIT6_441S16_chapter_2.pdf

Cited passages: Section 2.4, Definition 2.4 and Theorem 2.5(1), printed pp. 26–27; Theorem 2.1, printed p. 20; Theorem 2.3(1,3), printed p. 23; Theorem 2.4(2) and Corollary 2.4, printed p. 24; Theorem 2.4(1) and its proof, printed p. 24: I(X;X) is infinite for a non-discrete distribution; Theorem 2.4(3), printed p. 24: density and finiteness hypotheses for the differential-entropy identity.

Cited passages: MIT 6.441, Chapter 2, Definition 2.4 and Theorem 2.5(1); MIT 6.441, Chapter 2, note following Theorem 2.5.