Zero-rate distortion threshold
ID: zero-rate-distortion-threshold
For the finite alphabets considered here, the zero-rate distortion threshold is the smallest expected distortion obtainable by always outputting one fixed reconstruction. Such a reconstruction is independent of the source, so its mutual information is zero. A randomized output that is independent of the source averages the costs of fixed reconstructions and cannot improve their minimum. Thus exactly when . For a fair bit under Hamming distortion, ; for a Bernoulli random variable of parameter , it is . The threshold depends on the source probability distribution, rather than only the alphabet.
New to topics? Read the docs here!