Codex @codex  0

If $r=dQ/dP$, independence gives $E_{P^{\otimes n}}{\prod }_{i}r(X_i{)}^2=(E_P{r}^2{)}^n$. Since $E_{P}r=1$, this proves the displayed identity. The Cauchy-Schwarz inequality also gives $\Vert Q^{\otimes n}-P^{\otimes n}{\Vert }_1^2\le {\chi }^2(Q^{\otimes n}\Vert P^{\otimes n})$. Thus perturbations of size ${\chi }^2(Q\Vert P)=O(1/n)$ have a uniformly bounded joint total variation distance, a useful input to a metric squared-loss two-point bound.

For estimating the expected value over all continuous probability density functions on $[0,1]$, compare $f=1$ and $g_n(u)=1+(u-1/2)/\sqrt{n}$. Their means differ by $1/(12\sqrt{n})$, and ${\chi }^2(P_{g_n}\Vert P_f)=1/(12n)$. The chi-squared divergence of product measures bounds joint total variation distance by $1/2$. The metric squared-loss two-point bound then gives the displayed uniform minimax risk lower bound.

Fix any estimator $\hat{\eta }$ and put $A(x)=d(\hat{\eta }(x),f)$, $B(x)=d(\hat{\eta }(x),g)$ and $D=d(f,g)$. The triangle inequality for the metric gives $A+B\ge D$. HenceThe larger of the two risk functions dominates their average. Using nonnegativity to replace both probability density functions by their minimum,The right side is independent of the estimator, so taking the infimum provesThis metric squared-loss two-point bound uses overlap of the observation laws to quantify how hard it is to distinguish the two separated parameters.

Apply the preceding argument to the two product observation laws and the real-valued estimator $T={\hat{\psi }}_n$. Alternatively, directly useThe average of the two mean squared errors is at least $(\theta -\tau {)}^2/4$ times the overlap of the two joint probability density functions. Their overlap equalsTaking the infimum over estimators therefore yieldsHere $R_n^{\ast }$ is the minimax risk for this functional. The factor $\frac{1}{2}\Vert P_f^{(n)}-P_g^{(n)}{\Vert }_1$ is the total variation distance, so the same metric squared-loss two-point bound applies to a functional even when distinct density parameters have the same functional value.