For the statistical functional , assuming , the contaminated mean is exactly
Thus the influence function of the mean is , and its gross-error sensitivity is infinite on an unbounded sample space. The linear approximation is exact here: any fixed positive contamination fraction allows an arbitrarily large change by moving far enough. No finite second moment is needed for this derivative, although a finite variance is needed for the usual central limit theorem for the sample mean.
For comparison, the influence function of the sample median is
when the median is unique and the probability density function is positive and continuous at . The sign function records which side of receives the contaminating mass. The influence function of a quantile supplies the short derivation. With the generalized-inverse quantile convention, contamination exactly at leaves the median at , giving derivative zero there. If is very small, this bounded influence function can still be large; if , the displayed formula is unavailable.
For , put . The influence function of the mean, influence function of the sample median, and influence function of a Huber location estimator with fixed are respectively
The first grows without bound, the second jumps at the median, and the third clips continuously. For , and the normalized Huber tail is about . This illustrates the optimal bounded influence function for normal location without asserting that this cutoff is optimal for every contamination model.
Figure 1.
Mean, median, and normalized Huber influence curves for two normal location-scale models
. Details.
Both panels are theoretical normal distributions, with no sampled or observed data. Doubling doubles the vertical influence function scale and the horizontal clipping distance. Changing translates the curves. The isolated dot marks the actual median derivative at the center; connecting its two tails by a vertical segment would misrepresent that value. Bounded influence does not mean every small residual has less effect than on the mean: the central Huber slope is , a price paid for reducing sensitivity in the tails.
For standard normal distribution location estimation, an influence function obeys . Under , minimize by projecting onto , choosing to meet that identity. For this gives the displayed Huber score normalized by , with . Pointwise minimality of proves global optimality after integration. At the only feasible normalized function is almost everywhere, the influence function of the sample median. The endpoint is a limit of rescaled clipped scores, not the identically zero score obtained by substituting literally.
An M-estimator based on an estimating equation chooses a consistent root of
Its population target solves . For a scalar parameter, suppose the root is locally unique and
For the contaminated distribution , differentiate its population equation at zero contamination. The influence function satisfies
Consequently
The constant of proportionality is independent of . A local expansion of the sample estimating equation similarly gives
The central limit theorem yields asymptotic normality with the sandwich variance of an M-estimator
Thus the first-order variance of the unscaled estimator is . For a vector parameter the same differentiation gives and , with and .
For the location problem, take the target location to be zero and let have the standard normal distribution, with density and distribution function . An odd score has . For a differentiable score, integration by parts gives
The last expression also gives the appropriate derivative of the population equation for bounded monotone scores with jumps, by differentiating the shifted normal density. Assume and put . Then
Multiplying a score by a positive constant changes neither its estimator nor this normalized influence function.
First establish feasibility. The bound implies
so necessarily . For , let solve
This solution is unique: the ratio tends to as , tends to infinity as , and has positive derivative because
Take the Huber score . Its derivative is one on and zero outside, so . Hence
It is odd, nondecreasing, meets the bound, and satisfies .
To prove optimality, put . For each fixed , the minimum of over is attained by projecting onto , which is exactly . Therefore every competing normalized influence function satisfies
Taking expectations, the right-hand side vanishes because both functions satisfy . Thus . This proves the optimal bounded influence function for normal location, even over the larger class of all bounded normalized functions, and hence over the required odd nondecreasing class. Its minimum asymptotic variance is
The numerator is .
At the included boundary , equality in the feasibility bound forces almost everywhere. This is the influence function of the sample median, with . It is obtained from the rescaled scores as . The boundary solution is the sign score, or equivalently the median estimator. Literal substitution of in the clipped score gives the identically zero function and no identifiable estimating equation; the printed clipped formula therefore requires this limiting interpretation at equality.
Let be the unique median. The influence function of the sample median is
away from . Its second moment, equivalently the asymptotic distribution of a sample median, gives
No symmetry assumption is used: the density is evaluated at the actual median of .
The gross-error sensitivity is . At , the influence function of the sample median has magnitude , so
For the Huber location estimator, and , giving
For the symmetric normal law, the trimmed population mean is . Writing in the supplied influence function gives