Choose a collection of statistical paths through that are differentiable in quadratic mean. A statistical tangent set at is the set of their score functions. In particular each member belongs to , by the mean-zero score identity under quadratic-mean differentiability.
A statistical tangent set records which first-order directions the chosen statistical paths can realize. Its closed linear span in L2 space is the statistical tangent space. The tangent set consists of attainable scores; the tangent space also includes their linear combinations and limits.
Let be a bounded function with . A bounded density tilt realizes this direction:
These are nonnegative probability density functions, since . The uniform Taylor expansion of the square root gives
The squared L2 norm of this remainder is , since is bounded. Thus the statistical path is differentiable in quadratic mean with score function .
Conversely every score function is centered by the mean-zero score identity under quadratic-mean differentiability. Choosing all these bounded density tilts therefore gives the statistical tangent set
This is a valid choice of statistical tangent set; it does not assert that every possible score function in the unrestricted density model is bounded.