Minimax asymptotic bias Created 2026-09-28 Updated 2026-11-05
Suppose a statistical functional is the limiting answer of an estimator when observations have probability distribution . Around a reference probability distribution , define a neighborhood and maximum asymptotic displacementMinimax asymptotic bias minimizes this quantity over a specified admissible class of estimators. Calibration on the reference family and restrictions such as translation equivariance prevent a constant answer from being an artificial solution.
For an epsilon-contamination neighborhood, the mean changes from to when the contaminating probability distribution is a Dirac measure at . Its maximum displacement is therefore infinite for every . A median can have finite maximum displacement for . This compares a finite contamination fraction; it is distinct from bounding an influence function, which concerns the derivative at zero contamination. The neighborhood and admissible class are part of the problem, rather than a universal choice of best estimator.
Past exam of the mathematics course of the University of Cambridge 2021 iii Paper 223 1 b Solution 2026-09-28
WriteIf , then because . The translation-invariant estimator property givesFor every real ,Taking shows that every admissible estimator has maximum asymptotic bias at least on the pair . ThereforeTogether with part a, this proves the minimax asymptotic bias optimality of the median.
Robust statistics Created 2026-09-24 Updated 2026-11-05
Robust statistics studies how estimators and other statistical procedures respond to departures from a reference statistical model. Such departures can include a small fraction of outliers, a heavier-tailed probability distribution, or an incorrect assumed shape. A robustness statement specifies both the permitted departure and the quantity whose change is controlled.
For data with , the sample median remains , whereas the sample mean is and grows without bound. This does not make the sample median an estimator of every desired expected value: the mean and median of an asymmetric probability distribution can differ. The estimand must therefore be specified before judging robustness.
Influence functions describe infinitesimal changes, breakdown points describe large finite-sample failures, and minimax asymptotic bias compares worst cases over a neighborhood. M-estimators connect these questions with an explicit loss function. Peter J. Huber's 1964 location paper developed a systematic treatment of estimation under contamination.[ref]
Robust Estimation of a Location Parameter by Peter J. Huber. Introduction and location estimation under contaminated normal models
Translation-invariant estimator Created 2026-09-28 Updated 2026-11-05
For a location estimator, the property historically called translation invariance in this setting is more explicitly called translation equivariance:Changing the origin of the measurements changes the estimated location by exactly the same amount. Both the sample mean and sample median satisfy this identity. For example, adding to every observation adds to either estimated location.
Strict invariance would instead leave the numerical answer unchanged. The sample variance has that different property because shifting every observation also shifts their sample mean, leaving all centered differences unchanged. The distinction matters when specifying the admissible estimators in a minimax asymptotic bias problem. The older translation-invariant terminology appears in Peter J. Huber's original location analysis.[ref]
Robust Estimation of a Location Parameter by Peter J. Huber. Introduction: translation-invariant location estimators