Orthogonal basis 2026-10-07
An orthogonal basis of an inner-product vector space consists of nonzero mutually orthogonal vectors that span the space. The orthogonal projection of onto a finite-dimensional span is . Dividing each vector by its norm produces an orthonormal basis. For centered random variables, the inner product is covariance; an orthogonal basis therefore consists of uncorrelated variables, without requiring unit variance.
Orthonormal basis Created 2026-09-24 Updated 2026-10-06
An orthonormal basis is a basis whose vectors are pairwise orthogonal and each have norm one.
If and , symmetry gives
For , , so the eigenvectors are orthogonal.
Let be the measured wave scattering response> linear operator, with direct background propagation removed if present. Its time reversal operator is the positive operator . For a normalized emitted signal ,
The maximizing signal is a right singular vector, equivalently an eigenvector of with its largest eigenvalue. This is a precise intensity statement independent of a scatterer model.
Under the Born approximation for scalar wave scattering, neglect interactions between point scatterers and write
where is the receiver response to scatterer , is its illumination by the source array, and is its scattering wave amplitude. Well-resolved point scatterers have approximately orthogonal vectors and . In the ideal orthogonal limit,
Thus the most reflective, geometrically weighted scatterer gives the largest eigenvalue, and its normalized steering vector gives the corresponding wave focusing signal. If illumination and reception factors are equal for all scatterers, this is precisely the scatterer with largest . Geometric size by itself is not the quantity being ranked.
Repeated adjoint time reversal acoustics is power iteration on . If its top eigenvalue is simple and the initial signal has a nonzero component along its eigenvector, then
A tied largest eigenvalue leaves a combination in the leading eigenspace, and an initial signal orthogonal to that eigenspace cannot excite it. This is the basis of the DORT method. Mere physical separation is insufficient if the array cannot resolve the scatterers; coherent steering-vector overlap or multiple scattering can mix the modes. Also, if includes unrestricted homogeneous transmission, its largest eigenvalue need not identify any individual scatterer. The correspondence concerns the resolved wave scattering response>. The ideal correspondence and selective wave focusing are analyzed by Prada and Fink.
Write , so the data map is . The Gaussian likelihood and prior distribution give
Completing the square, or using Gaussian conjugacy for a normal linear model, identifies a multivariate normal distribution with precision matrix . Since , its posterior mean and covariance matrix are
The parameters are
For example, , which checks the square completion.
The orthogonal vectors
are eigenvectors of the covariance matrix. Their respective variances are
They are independent under the posterior distribution, by independence of uncorrelated jointly normal variables. Thus uncertainty is different in the two directions even for positive noise: the data constrain , whereas spans the null space of the data map.
As , the posterior distribution converges to the law of
This is supported on , and its posterior mean is the minimum-norm least-squares solution. The prior distribution still determines the distribution along the unobserved null space; it has not disappeared. This example of a Gaussian posterior in the zero-noise limit distinguishes exact recovery of an observed component from recovery of the whole unknown.
Let and define . The artificial boundary values are . For the symmetric tridiagonal Toeplitz matrix , the sine addition formula gives
Thus all such matrices have the same discrete sine transform eigenvectors, with eigenvalues
The sine vectors are mutually orthogonal vectors and nonzero, so the matrix is invertible. If , then and therefore
A matrix is Hermitian when , and unitary when .
If with , then
so every eigenvalue is real. If and , then
Distinct eigenvalues therefore have orthogonal eigenvectors.
The normalized eigenvectors form an orthonormal basis, so the matrix satisfies and is unitary. With
the equations say , hence . This is the finite-dimensional unitary diagonalization of a normal matrix.
A unitary conjugate of an arbitrary diagonal matrix need not be Hermitian: and give . It is Hermitian exactly when all diagonal entries of are real.
For the displayed matrix, one valid decomposition is
The columns are orthonormal eigenvectors, so direct multiplication gives .
The supports of and are disjoint, so they are orthogonal vectors. Substitution in the covariance formula gives
and
Therefore the associated eigenvalues are
There are uncountably many physically distinct one-qubit unitaries. Part (ii) would require an orthogonal program state for every one, whereas a -qubit register has dimension only . This contradiction is the no-programming theorem, so no deterministic gate satisfying (PROG) exists.