Consider fixed-design nonparametric regression , with independent errors , and estimation at a fixed interior point . In the class of functions with Lipschitz continuity constant at most , compare with , with small enough to stay inside the design interval.
The target values differ by . At most equally spaced design points meet the bump, and its height is at most , so the joint Kullback-Leibler divergence is bounded by
Taking a sufficiently small constant times keeps this bounded away from a perfectly distinguishable experiment. Pinsker's inequality and the Le Cam two-point lemma give squared-error risk at least a constant times . The design-spacing assumption is essential to the count of observations inside the bump; it is not valid for arbitrary fixed designs.

Articles by others on the same topic (0)

There are currently no matching articles.