Solution

ID: past-exam-of-the-mathematics-course-of-the-university-of-cambridge/2007/iii/paper-73/1/d/solution

Assume the two response labels are distinct and the error probability is the same for each stimulus. Then the stimulus-response map is a binary symmetric channel:
with the two incorrect conditional probabilities equal to . Equal stimulus probabilities give . In bits, the Shannon entropy of the response is therefore . For either stimulus the response entropy is the binary entropy
with . Thus , and the mutual information is
It is maximal, equal to one bit, at and also at . The latter response is always opposite to the ideal label but still specifies the stimulus perfectly after relabelling. It is minimal, equal to zero, at , when both response distributions are identical and the response is independent of the stimulus. If error is conventionally restricted to , the maximum occurs only at zero.
The symmetric-error assumption matters. A single overall error probability would not determine this information if the two stimuli had different conditional error rates or if the response included additional outcomes.

New to topics? Read the docs here!