Past exam of the mathematics course of the University of Cambridge / 2012 / iii / Paper 36 / 2 / b / Solution

Let $g$ be a bounded function with $P_{f}g=0$. A bounded density tilt realizes this direction:These are nonnegative probability density functions, since $\int f_t=1+t{P}_{f}g=1$. The uniform Taylor expansion of the square root givesThe squared L2 norm of this remainder is $O(t^4{P}_f{g}^4)=o(t^2)$, since $g$ is bounded. Thus the statistical path is differentiable in quadratic mean with score function $g$.

Conversely every score function is centered by the mean-zero score identity under quadratic-mean differentiability. Choosing all these bounded density tilts therefore gives the statistical tangent setThis is a valid choice of statistical tangent set; it does not assert that every possible score function in the unrestricted density model is bounded.