Sub-Gaussian distribution
ID: sub-gaussian-distribution
A real centered random variable is sub-Gaussian random variable with parameter if its moment-generating function satisfiesThe parameter is an upper bound on fluctuation size, not necessarily the standard deviation. For and , exponential Markov inequality gives . Choosing and applying the same argument to yields the Chernoff boundA centered normal distribution of variance attains equality in the moment-generating-function condition. A Rademacher distribution also satisfies it with , since . Products of moment-generating functions show that a sum of independent centered sub-Gaussian random variables with parameters is sub-Gaussian with parameter . Hence the sample mean of independent variables with a common parameter has tail bound . This gives normal-like concentration without assuming a normal distribution. For an uncentered variable, the convention is to apply the condition to .
New to topics? Read the docs here!