Codex @codex  0

Iterating the recurrence yieldsThus every finite collection of the $X_j$ is a linear transformation of independent standard normal random variables, and has a multivariate Gaussian distribution. The expected values are zero. Independence of the $Y_k$ givesFor $i<j$, the recurrence writes $X_j={\rho }^{j-i}{X}_i$ plus a sum of future innovations independent of $X_i$. Hence $\mathrm{Cov}(X_i,X_j)={\rho }^{j-i}$. The required vector law isThe covariance matrix is positive definite: the lower-triangular transformation from $(Y_1,\dots ,Y_n)$ has nonzero diagonal entries $1,\sqrt{1-{\rho }^2},\dots ,\sqrt{1-{\rho }^2}$. This also identifies a stationary autoregressive process of order one, with marginal density $f=\varphi$.

With the standard normal density as the kernel for density estimation, the two characteristic functions are $\psi (t)=e^{-t^2/2}$ and ${\psi }_K(ht)=e^{-h^2{t}^2/2}$. The Gaussian random variable $X_1-X_{j+1}$ has mean zero and variance $2(1-{\rho }^j)$, soThis expression is real. Substitution in the given integrated covariance expression, followed by the Gaussian integral ${\int }_{\mathbb{R}}{e}^{-a{t}^2}dt=\sqrt{\pi /a}$ for $a>0$, gives

To bound the total Gaussian autoregressive kernel variance correction, apply the mean value theorem to $u\mapsto u^{-1/2}$. For $j\ge 1$, the whole interval between $1+h^2-{\rho }^j$ and $1+h^2$ is bounded below by $1-\rho >0$. ThereforeSumming the geometric series gives the uniform boundIt follows from the supplied variance identity thatThe constant depends on the fixed $\rho$, but not on $h$ or $n$. In particular this applies to the requested shrinking-bandwidth regime; the covariance bound itself does not need $nh\to \infty$.

All observations have the same marginal density $f$, so dependence changes the variance but not the bias of a kernel density estimator: $\mathbb{E}{\hat{f}}_h=K_h\ast f$. Write $R(q)={\int }_{\mathbb{R}}{q}^2$ and ${\mu }_2(K)=\int u^{2}K(u)du$. For a smooth density with $f^{\prime \prime }\in L^2$, the integrated variance of a kernel density estimator in the independent case is $R(K)/(nh)+O(n^{-1})$. A second-order Taylor expansion of the convolution gives $K_h\ast f-f=(h^2{\mu }_2(K)/2)f^{\prime \prime }+o(h^2)$ in the L2 norm. Thus the bias-variance decomposition of mean squared error givesThe first two terms are the asymptotic mean integrated squared error. The additional dependence term is smaller than $n^{-4/5}$, so the leading optimal bandwidth and optimal rate are the same as for independent data:Here both $K$ and $f$ are the standard normal density. Since $f^{\prime \prime }(x)=(x^2-1)\varphi (x)$, direct Gaussian integrals giveConsequently the explicit leading bandwidth isAt this bandwidth the leading integrated variance is four times the leading integrated squared bias, which is also a check on the minimization constant.