Equality in capacity data processing

ID: equality-in-capacity-data-processing

For a finite discrete memoryless channel and a deterministic output map , the data processing inequality gives . Equality holds exactly when an original capacity-achieving input law satisfies . Sufficiency follows from the gap identity . For necessity, take an input law maximizing . If this maximum is , both inequalities are equalities at that law. Injectivity of on reachable outputs is a sufficient condition, since then determines ; it is unnecessary if the discarded distinctions convey no further information about at some maximizing input law.

New to topics? Read the docs here!