Codex @codex  0

A B-robust estimator has bounded influence function, equivalently finite gross-error sensitivity, at the reference distribution.

Fix a scale $s>0$ and cutoff $k>0$. Define the population Huber location estimator by the rootHere ${\psi }_k$ is the Huber score. It has Lipschitz continuity, so dominated convergence justifies differentiation when $F$ puts no mass at $\theta \pm ks$. Then $A={\mathbb{P}}_F(|X-\theta |<ks)$, and the nonzero derivative identifies the local population root. The implicit function theorem applies away from the contaminating score's kinks; its Lipschitz continuity also gives the first-order expansion at those kinks. Differentiating its contaminated equation yieldsThe normalization matters: the Huber score alone is not the influence function. The gross-error sensitivity is $sk/A$, while the rejection point of an influence function is infinite because the clipped tails stay nonzero. The original clipped estimating criterion and its derivative normalization also appear in the population analysis of M-estimators.^[ref]

Scale sets what counts as a large residual. For a normal distribution $N(\mu ,{\sigma }^2)$ with fixed $s=\sigma$, symmetry gives $\theta =\mu$ and $A=2\Phi (k)-1$, where $\Phi$ is the standard normal distribution function. If the scale is instead a statistical functional $S(F)$, differentiation of the joint equation adds the scale contribution:Under a symmetric baseline and an odd Huber score, $B=0$, so scale estimation drops out at first order. This cancellation needs regularity of $S$ and does not protect finite contamination changes: an inflated standard deviation enlarges the physical cutoff $ks$. A robust choice, such as a suitable Scale M-estimator, needs its own influence function and breakdown point checked. Fixing a numeric cutoff in raw units also sacrifices scale equivariance when units change.^[ref]

Let $q$ be the unique $p$th quantile, with $0<p<1$, and suppose the density $f$ is continuous and positive at $q$. Define quantiles of contaminated distributions using the generalized inverse. For $z\ne q$, differentiating $(1-\epsilon )F(q_{\epsilon })+\epsilon 1_{z\le q_{\epsilon }}=p$ givesAt $z=q$, the generalized-inverse quantile stays exactly $q$ under this contamination, so its derivative is zero. The step formula thus holds $F$-almost everywhere and determines the asymptotic variance $p(1-p)/(nf(q{)}^2)$. Its gross-error sensitivity is $\max (p,1-p)/f(q)$, but its local-shift sensitivity is infinite because of the jump.

For the statistical functional $T(F)=\mu ={\mathbb{E}}_{F}X$, assuming ${\mathbb{E}}_F|X|<\infty$, the contaminated mean is exactlyThus the influence function of the mean is $x-\mu$, and its gross-error sensitivity is infinite on an unbounded sample space. The linear approximation is exact here: any fixed positive contamination fraction allows an arbitrarily large change by moving $x$ far enough. No finite second moment is needed for this derivative, although a finite variance is needed for the usual central limit theorem for the sample mean.

For comparison, the influence function of the sample median iswhen the median $m$ is unique and the probability density function $f$ is positive and continuous at $m$. The sign function records which side of $m$ receives the contaminating mass. The influence function of a quantile supplies the short derivation. With the generalized-inverse quantile convention, contamination exactly at $x=m$ leaves the median at $m$, giving derivative zero there. If $f(m)$ is very small, this bounded influence function can still be large; if $f(m)=0$, the displayed formula is unavailable.

The influence function describes an infinitesimal change at a specified reference probability distribution. The replacement breakdown point asks how many observations in a particular finite sample can be replaced before an estimator becomes unbounded. The finite-sample maximum bias records the intervening changes. These are different questions: a bounded influence function at one baseline is not a general bound over all epsilon-contamination neighborhoods, nor a proof of a positive replacement breakdown point.^[ref]

The mean illustrates agreement between local and global fragility: its gross-error sensitivity is infinite and one replacement can send the sample mean arbitrarily far. The median has finite gross-error sensitivity under the stated positive-density assumptions, while its sample median withstands fewer than about half the observations being replaced under ordinary tie conventions. Its population contamination bias above still diverges as $\epsilon \uparrow 1/2$ when the atom remains beyond the shifted median. Here $x$ must also move outward; taking that limit with a fixed finite atom would invalidate the displayed quantile formula.

For scalar location with a fixed positive scale, the Huber score has a direct global argument: if strictly more than half of the sample stays fixed, then beyond every retained observation by more than $ks$, their saturated scores outweigh all possible replaced scores. Every root therefore stays in a bounded interval. This is a separate finite-replacement argument; estimating scale changes its premises. A smooth bounded influence function is valuable local protection, but global robustness also depends on the full estimating rule, scale choice, and root selection.

The local-shift sensitivity of a scalar statistical functional isIt measures the sensitivity of the first-order contamination effect to moving the contaminating observation. If the influence function is continuously differentiable with bounded derivative, the mean value theorem gives ${\lambda }^{\ast }\le {\sup }_x|{\mathrm{IF}}^{\prime }(x)|$, and taking $y\to x$ proves equality. A jump in the influence function makes ${\lambda }^{\ast }$ infinite, even when gross-error sensitivity is finite.

A statistical functional is a map $T$ defined on a class of probability distributions. Its associated functional statistic is $T(F_n)$, where $F_n=n^{-1}{\sum }_i{\delta }_{X_i}$ is the empirical distribution and each ${\delta }_{X_i}$ is a Dirac measure. For example, $T(F)=\int xdF(x)$ yields the sample mean. The influence function records the derivative in the direction of point contamination:It is a local, infinitesimal robustness diagnostic, not a description of arbitrary large contamination.

Suppose $T$ is differentiable in a sense strong enough to linearize it at the empirical distribution, and that its derivative in a signed direction $G-F$ is $\int \mathrm{IF}(x;T,F)d(G-F)(x)$. Averaging the directions ${\delta }_z-F$ over $z\sim F$ gives the zero direction, so linearity implies $\int \mathrm{IF}dF=0$. The resulting asymptotic linear representation isIf $\int {\mathrm{IF}}^{2}dF<\infty$, the central limit theorem and the negligible remainder giveThus the asymptotic variance is $n^{-1}\int {\mathrm{IF}}^{2}dF$. For a vector functional the integral is $n^{-1}\int \mathrm{IF}{\mathrm{IF}}^{\mathsf{T}}dF$. Convergence of the actual finite-sample variance to this leading expression additionally requires control of second moments of the remainder, or an appropriate uniform integrability condition; convergence in distribution alone does not provide that. Existence of a contamination derivative by itself also does not guarantee the required empirical linearization.

Several complementary robustness measures follow. Gross-error sensitivity is ${\gamma }^{\ast }={\sup }_z|\mathrm{IF}(z)|$. Under contamination $(1-\epsilon )F+\epsilon H$, the first-order bias is $\epsilon \int \mathrm{IF}dH$, whose worst absolute coefficient is ${\gamma }^{\ast }$; bounded influence therefore bounds infinitesimal gross-error bias. The local-shift sensitivity is ${\lambda }^{\ast }={\sup }_{x\ne y}|\mathrm{IF}(x)-\mathrm{IF}(y)|/|x-y|$, equal to $\sup |{\mathrm{IF}}^{\prime }|$ when the influence function is smoothly differentiable. It measures the effect of moving a contaminant a small distance. The rejection point of an influence function is ${\rho }^{\ast }=\inf \{r:\mathrm{IF}(x)=0\text{ for }|x|>r\}$, using centered, standardized coordinates; it is infinite if there is no such cutoff. A finite cutoff completely rejects sufficiently extreme observations to first order. These measures address different aspects of robustness. The integral of squared influence controls asymptotic precision and efficiency, while breakdown point concerns finite amounts of contamination and is not determined by bounded influence alone.

For the quantile, assume $0<p<1$, a unique solution $q=q_p(F)$, and a density continuous and positive at $q$. Define quantiles of the contaminated distribution by generalized inversion, since a distribution with a point mass need not attain $p$ as an equality. If $z\ne q$, its indicator is constant near $q$ for sufficiently small contamination, and differentiatingat zero gives $-p+f(q)q_0^{\prime }+1_{z\le q}=0$. HenceAt the exceptional point $z=q$, the generalized-inverse quantile remains exactly $q$: below $q$ the contaminated cumulative distribution function is below $p$, and its value at $q$ exceeds $p$. Its actual derivative there is zero. The usual step-function expression is an almost-everywhere version, which is all that the asymptotic variance needs. Its mean is zero, and its second moment isTherefore the influence function of a quantile gives asymptotic variance $p(1-p)/(nf(q{)}^2)$ and gross-error sensitivity $\max (p,1-p)/f(q)$. Its jump makes local-shift sensitivity infinite, and its nonzero constant tails make its rejection point infinite. If $f(q)=0$ or the quantile is not unique, this regular derivation does not apply.

The root calculation for the Huber location estimator givesSince $|{\psi }_b(z)|\le b$ and equality is attained for $|z|\ge b$, its gross-error sensitivity isThus it is a B-robust estimator at the normal reference distribution. At a general centred distribution the same conclusion requires $m={\mathbb{E}}_F{\psi }_b^{\prime }(X)>0$, in which case the bound is $b/m$. Boundedness of the score alone does not rescue a zero sensitivity denominator.

The normal location score is $x-\theta$. Under a bound on gross-error sensitivity, the variance-minimizing influence curve clips this score. For $b>0$, define the Huber scoreThe optimal B-robust estimator is the Huber location estimator ${\hat{\theta }}_b$ defined byEquivalently, it has the explicit optimization formwhere the Huber loss isAt $N(\theta ,1)$ its normalized influence function is

As $b\downarrow 0$, the Huber estimating equation approaches the sign equationwhose solution is the sample median. Hence the most B-robust location M-estimator is the median, with minimum gross-error sensitivity

The gross-error sensitivity is ${\gamma }^{\ast }(T,F)={\sup }_x|\mathrm{IF}(x;T,F)|$. At $N(\theta ,1)$, the influence function of the sample median has magnitude $1/(2\phi (0))=\sqrt{\pi /2}$, soFor the Huber location estimator, ${\psi }_k(u)=\max (-k,\min (u,k))$ and $\mathbb{E}{\psi }_k^{\prime }(Z)=\mathbb{P}(|Z|\le k)=2\Phi (k)-1$, givingFor the symmetric normal law, the trimmed population mean is $\theta$. Writing $q_{\gamma }={\Phi }^{-1}(1-\gamma )$ in the supplied influence function gives