For a complete orthonormal basis of , the Parseval identity for a Hilbertian basis identifies the sum of the feature products with . The Cauchy-Schwarz inequality gives absolute convergence.
Integration by parts gives the Fourier sine series coefficients
Hence
The odd periodic extension is a sawtooth, equal to on and repeated every ; its jumps at odd multiples of have midpoint value zero in the Fourier series. In particular the sine series equals zero, rather than the specified endpoint value , at . The even periodic extension is the continuous triangular wave equal to on . Their sketches are below.
The Parseval identity for a Hilbertian basis for this sine expansion gives
Figure 1.
Odd sawtooth and even triangular periodic extensions on minus two pi to two pi
.
Choose an orthonormal basis of the separable Hilbert space and independent standard normal random variables on a common probability space. In finite dimension the sums below are finite; in dimension zero take . In infinite dimension define
Independence, centring and unit variance give
By the Parseval identity for a Hilbertian basis, the coefficient sequence is square-summable. Completeness of therefore supplies a limit, and we define
Every partial-sum map is linear, and passage to the limit preserves this identity. Thus for each fixed , as an identity, hence an almost sure equality. This constructs an isonormal Gaussian process.
The usual meaning is almost-sure linearity for each fixed choice of arguments. A version linear simultaneously for every argument can also be chosen: select a Hamel basis of , choose a measurable representative of on each basis vector, and extend each sample algebraically by finite sums. For every fixed , this extension equals the constructed variable almost surely, so all its required distributions are unchanged.
For the construction above, independence of the normal random variables makes normal with mean zero and variance . Its characteristic function is . The convergence gives convergence, and
Since by the Parseval identity for a Hilbertian basis, the limiting characteristic function identifies
This includes , where the normal distribution is degenerate at zero.
Put . The deterministic derivative is , and , while . The Itô product rule with a deterministic smooth function gives
Almost every Brownian path is continuous, hence belongs to . Its Fourier coefficient in the given orthonormal basis is therefore . The Parseval identity for a Hilbertian basis gives, pathwise on a probability-one event,
This is the squared-norm consequence of the Brownian half-integer sine expansion; completeness, rather than pointwise convergence of a Fourier series, is all that is needed.
In the real Hilbert space , let . Then . The Parseval identity for a Hilbertian basis gives
The series is absolutely convergent by the Cauchy-Schwarz inequality, since and . Thus
the Brownian covariance kernel. This is the Brownian covariance from an integrated orthonormal basis.
Assume (iii), and let . Choose such that
for every . Coordinate convergence implies, for every finite ,
Letting shows that the corresponding tail of is also at most .
By the Parseval identity for a Hilbertian basis,
The finite first sum tends to zero by weak coordinate convergence, while the second is at most
Since is arbitrary, . Thus (iii) implies (i), completing the equivalence and proving the uniform basis-tail criterion for strong convergence.
Suppose first that . The reverse triangle inequality gives
so (i) implies (ii).
It also implies (iii). Given , choose so that
By the Parseval identity for a Hilbertian basis, choose so that the basis tail of beyond is less than . For and ,
There are only finitely many , so increasing makes each of their tails less than . Thus one works for every , proving (iii).
Twice applying Parseval identity for a Hilbertian basis to the matrix coefficients gives
Thus .
Factor as in part b(v). Then Parseval identity for a Hilbertian basis and Cauchy-Schwarz inequality give
The defining series for the operator trace is therefore absolutely convergent and satisfies .
For unit vectors , the adjoint operator of is , and
Hence and part b(iii), followed by Parseval, gives
Scaling proves . A second use of Parseval yields
which proves the asserted rank-one operator formulas.