Influence function of the mean 2026-10-14
For the statistical functional , assuming , the contaminated mean is exactlyThus the influence function of the mean is , and its gross-error sensitivity is infinite on an unbounded sample space. The linear approximation is exact here: any fixed positive contamination fraction allows an arbitrarily large change by moving far enough. No finite second moment is needed for this derivative, although a finite variance is needed for the usual central limit theorem for the sample mean.
For comparison, the influence function of the sample median iswhen the median is unique and the probability density function is positive and continuous at . The sign function records which side of receives the contaminating mass. The influence function of a quantile supplies the short derivation. With the generalized-inverse quantile convention, contamination exactly at leaves the median at , giving derivative zero there. If is very small, this bounded influence function can still be large; if , the displayed formula is unavailable.
Normal-location influence curves 2026-10-14
For , put . The influence function of the mean, influence function of the sample median, and influence function of a Huber location estimator with fixed are respectivelyThe first grows without bound, the second jumps at the median, and the third clips continuously. For , and the normalized Huber tail is about . This illustrates the optimal bounded influence function for normal location without asserting that this cutoff is optimal for every contamination model.
Both panels are theoretical normal distributions, with no sampled or observed data. Doubling doubles the vertical influence function scale and the horizontal clipping distance. Changing translates the curves. The isolated dot marks the actual median derivative at the center; connecting its two tails by a vertical segment would misrepresent that value. Bounded influence does not mean every small residual has less effect than on the mean: the central Huber slope is , a price paid for reducing sensitivity in the tails.
