For , Cauchy-Schwarz inequality gives
Thus every is bounded and
. The truncations
have finite rank and satisfy
Hence every such Hilbert-Schmidt operator is compact.
Define
This is an inner product inducing . If is Cauchy in this norm, then each converges to some , and the usual Fatou/tail argument gives
and
. Defining
produces a bounded operator by the preceding estimate and gives
in . Thus is a Hilbert space.
The norms are not equivalent in infinite dimension. The rank- orthogonal projection has
Although , no uniform reverse inequality can hold.
Write for the rank-one operator . The estimator is the kernel representation of the empirical covariance operator
Since ,
Thus the estimator has the fixed bias of an estimator for .
The fourth-moment assumption makes square-integrable in the Hilbert space of Hilbert-Schmidt operators. The weak law of large numbers therefore gives
Consequently consistency for holds exactly when . More precisely, if , then
The Hilbert-space central limit theorem also yields
where is a centered Gaussian random element in the Hilbert-Schmidt operator space with covariance determined by . Relative to , the same fluctuation is displaced by and hence does not have a finite centered limit when .
Let be the Hilbert-Schmidt operator with kernel , so the function-on-function linear model is . Independence and centering give . Let
and define the functional principal component scores
The cross-covariance operator identity gives, for every ,
Since is centered, the requested integrated variance is . Applying the Karhunen–Loève expansion to and the Parseval identity in the basis yields
Equivalently, if , the expression is .
Let with Hilbert--Schmidt, and write . Since , part iii and the Cauchy-Schwarz inequality for series give
Thus is trace class with the required bound.
The kernel is real and symmetric. For , Fubini's theorem gives
so is self-adjoint. It is linear, and because it is a Hilbert-Schmidt operator, hence bounded, with
The Schatten norm Hölder inequality gives when . In particular, the product of two Hilbert-Schmidt operators is trace class and
For , the outgoing Green function for the three-dimensional Helmholtz equation yields the far-field pattern
The sign corresponds to the Green function satisfying . This Hilbert-Schmidt operator samples the source Fourier transform on the sphere ; for a ball of radius , its squared Hilbert-Schmidt norm is .