Solution

ID: past-exam-of-the-information-theory-course-of-the-university-of-oxford/2021/3/c/ii/solution

Each of the three input values has two possible outputs, so their union has at most six elements. The preceding union formula also gives this bound. Choose noise values , whose two translated input alphabets are disjoint. With columns ordered the transition matrix is
Thus . Every output determines its input, explicitly , so . Consequently , with equality for a uniform input. Therefore
The extra uncertainty of which noise value occurred does not reduce information about the input: the two possible outputs for each input remain distinguishable from those of every other input.

New to topics? Read the docs here!