For a density with finitely many jumps at separated points and the unit-width box kernel, take smaller than all consecutive jump spacings. The smoothing bias is supported in disjoint length- neighbourhoods of the jumps. At each jump its two sides form triangles of height , and exact integration givesCombined with the integrated variance of a kernel density estimator, this gives expected error at .
For an equally spaced design with independent errors of variance at most and a regression function with Lipschitz constant , the unit-width box kernel estimator averages the observations in the window. Its bias is at most , and its variance is at most . The window occupancy for an equally spaced regression design gives, whenever ,In the usual range , this is uniformly up to the boundary. For arbitrarily large bandwidth, the stochastic error cannot continue to decrease as : once all observations are included the estimator is simply their mean.
Past exam of the mathematics course of the University of Cambridge 2013 iii Paper 33 2 Solution Created 2026-10-03 Updated 2026-10-07
For the unit-width box kernel, the convolution and kernel density estimator areandIn particular . The scaling gives . Even if is not square-integrable, Young's convolution inequality gives because and .
Using independence to eliminate the cross terms in the centred estimator, and Tonelli theorem to integrate the nonnegative variance, gives the exact integrated variance of a kernel density estimator:The Cauchy-Schwarz inequality now yieldsThis constant comes from the unit norm of the unscaled unit-width box kernel.
For the piecewise constant probability density function, integrability forces the constants on both unbounded outer intervals to be zero. Thus is bounded, has compact support, and has finitely many jumps. Let denote the jump at . For smaller than the least gap between consecutive breakpoints, the smoothing regions do not overlap. Outside these regions the convolution equals .
Within a region, put . For , the bias is ; for , it is . Endpoint values do not affect an norm. Integrating these two triangular errors givesThis is the box-kernel bias of a piecewise constant density. By the triangle inequality, with ,Balancing this bias-variance tradeoff with gives, for all sufficiently large ,
Past exam of the mathematics course of the University of Cambridge 2013 iii Paper 33 4 Solution Created 2026-10-03 Updated 2026-10-07
For the unit-width box kernel, the order-zero local polynomial estimator minimizes, over constants ,A common factor such as in these weights does not change the minimizer. Put and . If , differentiating the quadratic gives its unique minimizer:The last expression is the Nadaraya–Watson estimator. Every is within of some design point . Since gives , that point is in the closed kernel window. Thus and the equality holds throughout the domain, including and .
For the error bound, first take the usual bandwidth range . The clipped window has length at least . Any closed interval of length in contains at least points of the design . Consequentlywhere the last inequality uses . This is a window occupancy for an equally spaced regression design bound that remains valid at the boundary.
Let , the Lipschitz constant supplied by the bounded-derivative assumption. The bias is bounded byIndependence and the variance bound giveBy the Cauchy-Schwarz inequality and the triangle inequality,Thus works uniformly in and the design size in this bandwidth range. The same clipped-length proof in fact works for .
There is a genuine omission in the unrestricted formulation: an upper restriction on bandwidth is necessary for the displayed variance scale. Take , , and . The window contains the sole observation for every , and holds. Its mean absolute error is , whereas the proposed variance term is . No fixed can satisfy this for unbounded .
A valid statement for every satisfying uses . The clipped window has length at least , so , while the preceding coverage argument gives . If , the first bound gives ; if , the second does. Therefore the same bias and variance calculation proves the unrestricted correctionThis mean absolute error of local constant regression bound reduces to the requested rate for ordinary small bandwidths and saturates its stochastic term when the window covers the whole design.