Suppose one row of a finite discrete memoryless channel is a convex combination of other rows: . Deleting input leaves the channel capacity unchanged. Given any input law with mass on , move that mass to the other symbols in proportions . The output law stays the same. By the concavity of information entropy, , so this replacement cannot increase conditional entropy and cannot decrease mutual information. Taking maxima proves the claim; the smaller channel is also trivially a restriction of the original one. If the entropy inequality is strict, every positive use of the redundant row is strictly suboptimal compared with its redistribution.

Articles by others on the same topic (0)

There are currently no matching articles.