Solution

ID: past-exam-of-the-mathematics-course-of-the-university-of-cambridge/2014/iii/paper-60/2/ii/a/solution

The error indicator is a Bernoulli random variable with probabilities and . Its Shannon entropy is therefore the binary entropy
Use , so this expression also covers error probabilities zero and one.

New to topics? Read the docs here!