Integrated variance of a kernel density estimator ($\mathbb{E}\Vert {\hat{f}}_{n,h}-K_h\ast f{\Vert }_2^2$)

For an $L^2$ kernel and an independent sample from a density $f$, the centred kernel density estimator hasIndependence removes cross terms and Tonelli theorem integrates the pointwise variance. Young's convolution inequality ensures $K_h\ast f\in L^2$ even without $f\in L^2$. The Cauchy-Schwarz inequality yields the expected-norm bound $\mathbb{E}\Vert {\hat{f}}_{n,h}-K_h\ast f{\Vert }_2\le \Vert K{\Vert }_2/\sqrt{nh}$.

For a stationary autoregressive process of order one with unit-variance normal distribution marginals and fixed $0<\rho <1$, the Gaussian kernel covariance correction at lag $j$ has the displayed form. The difference of two observations has variance $2(1-{\rho }^j)$, and their characteristic functions reduce the Fourier integral to the difference of two Gaussian integrals. The mean value theorem gives $0\le g_h(j)\le \sqrt{\pi }{\rho }^j/[2(1-\rho {)}^{3/2}]$, uniformly over $h>0$. Thus the integrated variance differs from its independent-sample counterpart by $O(n^{-1})$. The marginal bias is unchanged, so this dependence does not alter the leading optimal bandwidth or the $n^{-4/5}$ mean integrated squared error for a second-order density kernel.