Gaussian concentration inequality
ID: gaussian-concentration-inequality
For a Gaussian random vector and an -Lipschitz function in the Euclidean norm, put . If , the Gaussian concentration inequality givesand thereforeWrite with a standard Gaussian random vector . The composed function has Lipschitz constant at most . The Gaussian logarithmic Sobolev inequality and Herbst argument give the exponential bound, and the Chernoff bound supplies the tails.[ref]
Probability in High Dimension by Ramon van Handel. Theorems 3.24–3.25 and their exponential-moment proof
For example, has , so its deviations depend on the largest covariance eigenvalue rather than directly on the number of coordinates. The center can still grow with dimension. If , is constant almost surely and every positive deviation has probability zero.
New to topics? Read the docs here!