Canonical gradient 2026-10-07
The canonical gradient is the influence-function representer in the statistical tangent space . It equals the orthogonal projection onto of any representer. Every other representer differs from it by an element of , so the Pythagorean theorem in an inner-product space gives it minimum variance. For in an unrestricted density model with bounded , it is .
Influence-function representer 2026-10-07
An influence-function representer is a centered square-integrable function representing derivatives of a statistical functional along all admissible score functions. Representers may differ by a function orthogonal to the statistical tangent space. This pathwise definition is distinct from defining an influence function solely by point-mass contamination paths.
Past exam of the mathematics course of the University of Cambridge 2012 iii Paper 36 2 a Solution Created 2026-10-03 Updated 2026-10-07
Choose a collection of statistical paths through that are differentiable in quadratic mean. A statistical tangent set at is the set of their score functions. In particular each member belongs to , by the mean-zero score identity under quadratic-mean differentiability.
A statistical tangent set records which first-order directions the chosen statistical paths can realize. Its closed linear span in L2 space is the statistical tangent space. The tangent set consists of attainable scores; the tangent space also includes their linear combinations and limits.
Past exam of the mathematics course of the University of Cambridge 2012 iii Paper 36 2 d Solution Created 2026-10-03 Updated 2026-10-07
For a pathwise differentiable statistical functional, an influence-function representer is a mean-zero function such that every admissible score function satisfies . The efficient influence function, also called the canonical gradient, is the unique such representer in the statistical tangent space. Equivalently, it is the orthogonal projection of any representer onto that statistical tangent space. The Pythagorean theorem in an inner-product space shows that it has the smallest squared L2 norm among all representers.
Here the statistical tangent space is all of . To verify the closure explicitly, take , truncate it to , and set . Then is bounded and centered, and in , by dominated convergence and the Cauchy-Schwarz inequality. Part (c) supplies a representer already in this space. HenceIts variance is .
The closure must be taken in the density-weighted space . An unweighted reading of in the printed hint is false. For example, when , the function has and , so bounded centered truncations converge to it in ; nevertheless . This illustrates density of bounded centered scores and fixes the measure in the closure statement.
A statistical functional is pathwise differentiable relative to chosen statistical paths if its derivative along every path depends only on that path's score function and defines a bounded linear functional on their statistical tangent space. The Riesz representation theorem expresses this derivative as an L2 inner product with a unique element of the statistical tangent space, the canonical gradient. A path family and the associated derivative remainder conditions must both be specified; a formal derivative along one convenient family does not establish differentiability along all paths.