Entropy of Lipschitz compositions
ID: entropy-of-lipschitz-compositions
Suppose outer functions in a family obey , and compose them with inner functions drawn from . Approximate the outer function within and each inner function within . The triangle inequality bounds the composed error by . Multiplying the numbers of possible net choices and taking logarithms gives the stated inequality. A uniform bound on first partial derivatives supplies for the unit ball, so the exponent of a common entropy bound for the outer and inner classes is retained under function composition.
New to topics? Read the docs here!