Density fourth-power functional 2026-10-07
Along bounded density tilts, this functional has derivative . At a bounded baseline density its canonical gradient, relative to these regular paths, is . A common local bound on nearby densities suffices to obtain the same derivative along arbitrary differentiable-in-quadratic-mean paths in that bounded neighborhood. A bounded baseline alone is insufficient, because of the spike obstruction to density-power differentiability.
Mean-zero L2 space 2026-10-07
The mean-zero L2 space is the kernel of the bounded linear functional on L2 space for a probability measure . It is a closed subspace of a Hilbert space, with inner product , and is the natural ambient space for score functions and canonical gradients.
Past exam of the mathematics course of the University of Cambridge 2012 iii Paper 36 2 d Solution Created 2026-10-03 Updated 2026-10-07
For a pathwise differentiable statistical functional, an influence-function representer is a mean-zero function such that every admissible score function satisfies . The efficient influence function, also called the canonical gradient, is the unique such representer in the statistical tangent space. Equivalently, it is the orthogonal projection of any representer onto that statistical tangent space. The Pythagorean theorem in an inner-product space shows that it has the smallest squared L2 norm among all representers.
Here the statistical tangent space is all of . To verify the closure explicitly, take , truncate it to , and set . Then is bounded and centered, and in , by dominated convergence and the Cauchy-Schwarz inequality. Part (c) supplies a representer already in this space. HenceIts variance is .
The closure must be taken in the density-weighted space . An unweighted reading of in the printed hint is false. For example, when , the function has and , so bounded centered truncations converge to it in ; nevertheless . This illustrates density of bounded centered scores and fixes the measure in the closure statement.
Past exam of the mathematics course of the University of Cambridge 2012 iii Paper 36 2 e Solution Created 2026-10-03 Updated 2026-10-07
For the bounded density tilt , differentiate the polynomial in :Since every score function is centered, the centered representer isA bounded baseline makes this a bounded mean-zero function, hence an element of . Thus it is the efficient influence function for the density fourth-power functional relative to the regular bounded density tilts. Its squared L2 norm is .
A bounded baseline alone does not make this functional differentiable along every quadratic-mean differentiable path. The derivative above is the intended regular-path answer. To see the need for the qualification, let and put on , extended by zero outside. For , defineEach is a nonnegative continuous probability density function, because its narrow bump has mass . Moreover,It is therefore a differentiable-in-quadratic-mean path with zero score function. YetThe density fourth-power functional is not even continuous along this statistical path, although every is individually bounded. Consequently no efficient influence function represents derivatives over the unrestricted class of all such paths.
One sufficient additional condition is a common bound for all small . Taylor expansion then bounds the fourth-power remainder by , whileTogether with the quadratic-mean to L1 density derivative, this gives . Under this local bound, or when the chosen statistical paths are the bounded density tilts, the boxed canonical gradient is fully justified. The counterexample is a spike obstruction to density-power differentiability.
A statistical functional is pathwise differentiable relative to chosen statistical paths if its derivative along every path depends only on that path's score function and defines a bounded linear functional on their statistical tangent space. The Riesz representation theorem expresses this derivative as an L2 inner product with a unique element of the statistical tangent space, the canonical gradient. A path family and the associated derivative remainder conditions must both be specified; a formal derivative along one convenient family does not establish differentiability along all paths.