Solution

ID: past-exam-of-the-communication-theory-course-of-the-university-of-oxford/2010/3/c/i/solution

Let the input probabilities be and put . The output distribution and conditional entropy are
For fixed , the first and third output masses sum to . Their entropy is maximized when they are equal, so . Equivalently, if ,
The same bound holds at by continuity. Therefore , with equality for symmetric outer input probabilities. Writing , differentiate:
The unique zero is ; strict concavity makes it the global maximum. Thus and
The optimum output is .

New to topics? Read the docs here!