1

ID: past-exam-of-the-information-theory-course-of-the-university-of-oxford/2021/1

All logarithms have base two. In part a the information entropy differences and information expressions are interpreted where they are well defined; finite joint entropy is a sufficient hypothesis. This avoids undefined expressions such as infinity minus infinity.

New to topics? Read the docs here!