Solution

ID: past-exam-of-the-communication-theory-course-of-the-university-of-oxford/2011/3/a/ii/solution

A discrete memoryless channel has finite input and output alphabets and fixed conditional probabilities , whose rows sum to one. Memorylessness means that for successive uses, conditional on the input sequence, the output probabilities factor as the product of these one-use conditional probabilities.
Its information capacity in bits per use is
The maximization varies the input distribution while keeping the channel matrix fixed. The output distribution is in the row-vector convention.

New to topics? Read the docs here!