Canonical gradient 2026-10-07
The canonical gradient is the influence-function representer in the statistical tangent space . It equals the orthogonal projection onto of any representer. Every other representer differs from it by an element of , so the Pythagorean theorem in an inner-product space gives it minimum variance. For in an unrestricted density model with bounded , it is .
For a pathwise differentiable statistical functional, an influence-function representer is a mean-zero function such that every admissible score function satisfies . The efficient influence function, also called the canonical gradient, is the unique such representer in the statistical tangent space. Equivalently, it is the orthogonal projection of any representer onto that statistical tangent space. The Pythagorean theorem in an inner-product space shows that it has the smallest squared L2 norm among all representers.
Here the statistical tangent space is all of . To verify the closure explicitly, take , truncate it to , and set . Then is bounded and centered, and in , by dominated convergence and the Cauchy-Schwarz inequality. Part (c) supplies a representer already in this space. Hence
Its variance is .
The closure must be taken in the density-weighted space . An unweighted reading of in the printed hint is false. For example, when , the function has and , so bounded centered truncations converge to it in ; nevertheless . This illustrates density of bounded centered scores and fixes the measure in the closure statement.
Statistical functional 2026-10-07
A statistical functional assigns a target value to each probability measure in a statistical model. Examples include an expected value, a quantile, and an integral of a power of a probability density function. Its behavior along statistical paths determines whether first-order influence-function representers are available.