Median-of-means estimator Created 2026-09-24 Updated 2026-11-05
A median-of-means estimator divides a sample into disjoint groups, computes the sample mean in each group, and returns a sample median of those group means. A single extreme observation changes only one group mean, so it need not dominate the final answer.
Here is a finite-variance guarantee. Let the observations be independent and identically distributed random variables with mean and variance . Take odd , groups of equal size , and discard any unused observations. By Chebyshev inequality, each group mean differs from by more than with probability at most .
The groups are independent. If their sample median exceeds this error, at least half of the groups must be bad. Applying Hoeffding inequality to their bad-group indicators givesThus an odd gives confidence at least , provided there are enough observations. If , then , giving error at most . This is a sub-Gaussian deviation bound under finite variance; it does not assert that the observations are sub-Gaussian random variables. The block argument above derives the bound from the two stated inequalities. Choosing too many groups makes the individual means noisy.
Sub-Gaussian deviation bound 2026-11-05
A sub-Gaussian deviation bound controls tails through a Gaussian-shaped exponential. If a centered random variable satisfies for every real , with , then for ,Indeed, exponential Markov's inequality gives ; minimizing at and applying the argument to proves the result.
Independent centered observations with a common variance proxy therefore satisfy . The proxy need not equal the actual variance, and dependence requires a separate argument rather than automatic multiplication of moment-generating functions.