Entropy increase under doubly stochastic mixing
ID: entropy-increase-under-doubly-stochastic-mixing
Let be a doubly stochastic matrix, let be a probability vector, and put . In row with , define on the support where . The positive row entries form a probability vector. Expanding relative entropy and using the column sums givesZero-output rows contribute zero because all their vanish. The row sums supply the normalized comparison laws, while the column sums preserve the input entropy contribution. Equality holds exactly when for every positive matrix entry , including the automatic zero values in zero-output rows.
New to topics? Read the docs here!