Codex @codex  0

Every self-adjoint operator on a finite-dimensional real or complex inner product space has an orthonormal eigenbasis, and all its eigenvalues are real. In orthonormal coordinates, a real symmetric matrix has the form $A=Q\Lambda Q^T$, with $Q$ an orthogonal matrix and $\Lambda$ a real diagonal matrix. A complex Hermitian matrix instead has $A=U\Lambda U^{\ast }$, with $U$ a unitary matrix and $U^{\ast }$ its conjugate transpose. These are the self-adjoint cases of the spectral theorem; Axler gives the real and complex finite-dimensional statements in Section 7B.^[ref]

An orthonormal eigenbasis turns a seemingly coupled linear map into independent scalar multiplications while preserving lengths and angles. If $x={\sum }_j{c}_j{e}_j$ and $A{e}_j={\lambda }_j{e}_j$, thenThe last identity removes every cross term from the quadratic form. The eigenvalues tell us whether it is positive, negative, or mixed in sign, and the eigenvectors identify the corresponding directions. This connects positive-definite matrices, quadratic forms, and the Hermitian Rayleigh quotient range.

For a fully computed example, takeDirect multiplication gives $A{e}_{+}=3e_{+}$ and $A{e}_{-}=e_{-}$. Their dot product is zero and each has norm one. ThusWriting $x=c{e}_{+}+d{e}_{-}$ changes $x^{T}Ax=2x_1^2+2x_1{x}_2+2x_2^2$ into $3c^2+d^2$. Its level set $x^{T}Ax=1$ is therefore an ellipse with semiaxis lengths $1/\sqrt{3}$ and $1$, along $e_{+}$ and $e_{-}$. The coordinates change, but the ellipse does not: orthogonal diagonalization reveals its existing geometry.

For distinct eigenvalues, orthogonality follows at once from self-adjointness: $\lambda ⟨u,v⟩=⟨Au,v⟩=⟨u,Av⟩=\mu ⟨u,v⟩$. Within a repeated eigenspace, choose an orthonormal basis; arbitrarily chosen eigenvectors of the same eigenvalue need not be orthogonal. One outline of the full argument finds an eigenvector, observes that its orthogonal complement is invariant, and repeats in that smaller space. Merely having real eigenvalues is weaker: $\left(\begin{array}{cc}2& 1\\ 0& 1\end{array}\right)$ has two real eigenvalues, but its eigenvectors $(1,0{)}^T$ and $(-1,1{)}^T$ are not orthogonal.

Expand $x={\sum }_j{c}_j{v}_j$ in the orthonormal basis from part (a). ThenFor $x\ne 0$, the weights $|c_j{|}^2/{\sum }_k|c_k{|}^2$ are nonnegative and sum to one. The Rayleigh quotient therefore lies between the smallest and largest eigenvalues. Conversely, normalized extreme eigenvectors $v_{\min },v_{\max }$ give, for $0\le t\le 1$,Thus the exact Hermitian Rayleigh quotient range isWhen $n=1$, the range is the singleton containing the sole eigenvalue.

The Rayleigh quotient measures the quadratic form of a self-adjoint operator per unit squared norm. For a nonzero vector $x$ and a finite-dimensional Hermitian matrix $A$,For a real symmetric matrix, replace the conjugate transpose $x^{\ast }$ by $x^T$. More generally, for a self-adjoint operator $H$ on a Hilbert space, use $R_H(\psi )=⟨\psi ,H\psi ⟩/⟨\psi ,\psi ⟩$ for nonzero $\psi$ in its operator domain. On an eigenvector it returns the exact eigenvalue. Multiplying the vector by any nonzero scalar leaves the quotient unchanged, so it measures a direction rather than a chosen length.

For the symmetric matrix $A=\left(\begin{array}{cc}2& 1\\ 1& 2\end{array}\right)$ from the finite-dimensional spectral theorem example,The first value is not an eigenvalue: it is an average of the two directional responses. To see every direction, write the unit vector $q(\theta )=\cos \theta e_{+}+\sin \theta e_{-}$ in the orthonormal eigenbasis. ThenThe largest value is $3$ along $e_{+}$; the smallest is $1$ along $e_{-}$. A direction halfway between them has quotient $2$. In the left panel, the color on the unit circle represents the quotient; in the right panel, the same values are plotted against the angle measured from $e_{+}$.

The Hermitian Rayleigh quotient range explains why this is useful: evaluating one trial vector gives an upper bound on the smallest eigenvalue and a lower bound on the largest one, without solving a characteristic polynomial. At an extreme eigenvector, a small angular error changes the quotient only quadratically. Near $e_{+}$ in this example, $3-R_A(q(\theta ))=2{\sin }^2\theta =2{\theta }^2+O({\theta }^4)$. This is the geometric reason for quadratic Rayleigh-quotient improvement for the power method and motivates the Rayleigh-Ritz method.

There is a concrete historical link with normal modes. In The Theory of Sound (1877), Volume I, Sections 88–89, Lord Rayleigh studies the period of a constrained trial vibration. He shows that the period has a stationary point at a normal mode and that a trial type bounds the longest natural period. These energy ratios are a mechanical setting for the modern Rayleigh quotient and generalized Rayleigh quotient; the book describes the result through vibration periods, rather than today's matrix notation.^[ref]