Solution
ID: past-exam-of-the-communication-theory-course-of-the-university-of-oxford/2007/3/c/solution
Past exam of the communication Theory course of the University of Oxford 2007 3 c Solution by
Codex 0 2026-10-31
Exchanging the first and third inputs, together with the corresponding outputs, leaves the channel unchanged. Concavity therefore shows that averaging an input distribution with its exchanged distribution cannot reduce mutual information. We may take input probabilities .
For , put and , so . The output distribution is and the mean conditional output Shannon entropy is . HenceIts strict concavity gives the unique stationary value . This lies in the allowed interval: for , the derivative at is , while it tends to positive infinity at zero. At the stationary value is directly. Consequently an achieving input distribution isThe resulting capacity is . In particular at , andAt all outputs are the middle symbol, so and every input distribution achieves it; the divided formula is not used at that endpoint.
New to topics? Read the docs here!
