Bounded density tilt 2026-10-07
For bounded measurable with , the formula defines a normalized positive probability density function for . A uniform Taylor expansion of the square root proves differentiability in quadratic mean with score function : the squared remainder is . Such paths realize all bounded centered directions of an unrestricted density model.
A statistical path through is a family , defined on an open interval containing zero, with . Write and . Its differentiability in quadratic mean at zero means that there is a square-integrable function such that
The function is the score function of the statistical path. Thus it is the derivative of the square-root probability density function, multiplied by two and divided by where . The score function is determined only -almost everywhere. The displayed definition also controls any probability mass entering a region where ; a pointwise derivative of the log probability density function alone would not do that. The required derivative is in the square-root-density norm.
Put . By differentiability in quadratic mean, and
in L2 space. The second limit follows because the first gives .
Both probability density functions integrate to one. Consequently the L2 inner product satisfies
The Cauchy-Schwarz inequality permits passage to the limit in this inner product, giving
Thus every score function is a mean-zero function. This proof uses square-root differentiability in quadratic mean, without requiring differentiation under the density integral.
Let , with . Since , the Cauchy-Schwarz inequality gives . Thus differentiability in quadratic mean suffices to differentiate bounded density integrals, even when the density itself has no useful pointwise derivative.
Statistical path 2026-10-07
A statistical path is a one-dimensional family of probability measures inside a statistical model, passing through a specified baseline . A differentiability in quadratic mean condition gives its score function, the first-order direction of the family in square-root-density coordinates. The path must respect all restrictions of the statistical model, including normalization and any fixed moments.