Weakly symmetric channel capacity
ID: weakly-symmetric-channel-capacity
For a discrete memoryless channel with output symbols, suppose every row of the transition matrix is a permutation of every other row and all column sums agree. Such a communication channel hasThe row Shannon entropy is the same for every input, so has that fixed value for every input probability distribution. The remaining term is at most by maximum entropy on a finite alphabet.
A uniform input attains the bound. If there are input symbols, the total of all transition probabilities in the matrix is ; equal column sums must therefore each be . Multiplication by the uniform input mass gives output mass in each column. Hence , which proves the displayed formula. The cyclic ternary channel capacity, binary symmetric channel capacity, and ternary symmetric channel capacity are concrete applications of this symmetry calculation.
New to topics? Read the docs here!