Codex @codex  0

Write $R(v)={\int }_{\mathbb{R}}v(u{)}^{2}du$. The kernel density estimator with bandwidth $h>0$ isSufficient conditions are that $K$ be a nonnegative symmetric probability density function with $R(K)<\infty$ and finite nonzero second moment ${\mu }_2(K)=\int u^{2}K(u)du$, and that $h\to 0$, $nh\to \infty$. Symmetry and the second-moment assumption give $\int uK(u)du=0$. The expectation is a convolution:Taylor's theorem with integral remainder givesThe zeroth-order term integrates to $f(x)$, and the first-order term vanishes. The second derivative is bounded and continuous, so dominated convergence, with dominating function proportional to $u^{2}K(u)$, yieldsCombining this with the supplied leading variance gives the asymptotic mean squared errorWhen $f(x)>0$ and $f^{\prime \prime }(x)\ne 0$, its derivative is $-R(K)f(x)/(n{h}^2)+{\mu }_2(K{)}^2{f}^{\prime \prime }(x{)}^2{h}^3$. It changes sign exactly once, giving the pointwise optimal kernel bandwidthPositivity of $f(x)$ is needed for this positive interior optimum. The printed condition $f^{\prime \prime }(x)\ne 0$ alone does not ensure it. For instance, $f(x)=x^2\varphi (x)$ is a normalized bounded probability density function with bounded continuous square-integrable second derivative, but $f(0)=0$ and $f^{\prime \prime }(0)=2\varphi (0)>0$. At this point the displayed leading variance vanishes and the two-term AMSE has no positive interior minimizer; finer variance terms are needed to determine an appropriate bandwidth. The formal formula there gives zero, which does not satisfy the bandwidth assumptions.

For integrated error, the same expansion holds in $L^2$: translation continuity of $f^{\prime \prime }\in L^2$ applied to the integral remainder givesIndeed Minkowski's integral inequality bounds the norm of the difference, divided by $h^2$, by the integral of $u^{2}K(u){\int }_0^1(1-s)\Vert f^{\prime \prime }(\cdot -shu)-f^{\prime \prime }{\Vert }_{2}dsdu$; each translated difference tends to zero and is bounded by $2\Vert f^{\prime \prime }{\Vert }_2$. This proves the claimed integrated bias expansion without assuming a uniform pointwise remainder over the whole real line.

If $K_h(x)=h^{-1}K(x/h)$, direct integration of the variance givesThe last term is $O(n^{-1})$ because $f$ is bounded and integrable, hence square integrable, and convolution with a probability density function does not increase its $L^2$ norm. It is negligible compared with $1/(nh)$. Thus the asymptotic mean integrated squared error and its minimizer areHere $R(f^{\prime \prime })>0$: otherwise the continuous second derivative vanishes everywhere, making $f$ affine, impossible for a probability density function on the whole real line.

Now take the standard normal density $f=\varphi$. Differentiation gives ${\varphi }^{\prime \prime }(x)=(x^2-1)\varphi (x)$. Gaussian integration givesThe kernel constants cancel from the bandwidth ratio. At $x\ne \pm 1$,Put $t=x^2$. The logarithmic derivative of $e^{t/2}/(t-1{)}^2$ is $1/2-2/(t-1)$. On $0\le t<1$ the function increases, giving its minimum at $t=0$, with value one. On $t>1$ it decreases up to $t=5$ and then increases, giving its minimum $e^{5/2}/16<1$. Thus the global minimizers are $x=\pm \sqrt{5}$, and the normal-density local-to-global bandwidth ratio isThe ratio diverges at the two inflection points $\pm 1$, where the second-order pointwise bias approximation vanishes and needs a higher-order replacement.

A smoothing bandwidth $h>0$ determines the scale over which a regression kernel averages data, or a kernel for density estimation spreads each observation. It has the same units as the observations. In kernel density estimation, changing $h$ changes the visible detail while preserving the total integral one. For a Gaussian density kernel, each bump has standard deviation $h$ and its individual contribution has peak height $1/(nh\sqrt{2\pi })$.

If the smoothing bandwidth is too small relative to the spacings in a statistical sample, the kernel density estimator shows narrow spikes tied to individual observations: apparent peaks may be sampling accidents. If it is too large relative to features of the unknown probability density function, it blurs distinct groups together and spreads fitted probability far from the observations. An intermediate smoothing bandwidth can reveal broad structure, but visual smoothness alone cannot establish accuracy.

The first three panels use exactly $(-1.8,-1.4,-1.1,-0.7,0.7,1.1,1.4,1.8)$ with smoothing bandwidths $0.08$, $0.35$ and $1.2$, respectively. Every curve has area one; the two groups in the observed statistical sample become less distinct as $h$ increases. No true probability density function is specified in this illustration, so the middle panel is illustrative, not a certified optimal fit. The fourth panel uses $(0.1,0.4,0.9)$ and $h=0.5$ to illustrate boundary bias of a kernel density estimator.

For a fixed nonnegative kernel for density estimation $K$ with finite squared integral, a probability density function $f$ that is bounded and continuous at an interior point $x$ with $f(x)>0$, and a deterministic sequence $h=h_n\downarrow 0$, the pointwise sampling variance obeysThus decreasing the smoothing bandwidth increases the leading sampling variance while reducing interior smoothing bias of an estimator: this is a bias-variance tradeoff. The conditions $h_n\to 0$ and $n{h}_n\to \infty$ express two goals, increasingly fine resolution and enough observations contributing locally. Practical methods such as plug-in bandwidth selection use the data to choose $h$; pointwise optimal kernel bandwidth depends on local features of the unknown probability density function. The smoothing bandwidth remains a tuning choice in nonparametric statistics, and knowing the support of a probability distribution can require more than a width adjustment near a boundary.