Hermitian operator Created 2026-09-24 Updated 2026-10-14
A bounded operator on a real or complex Hilbert space is Hermitian, or self-adjoint, when . Equivalently,
Its directional values are real, since this identity makes equal its complex conjugate. Reality allows either sign; a positive operator additionally requires nonnegative values in every direction.
Figure 1.
Self-adjoint directional values may change sign, touch zero, or stay strictly positive
. Details.
The diagram compares Hermitian quadratic forms along paths of unit vectors. The Hermitian matrix takes the values and on the standard basis vectors; takes the values and ; and
satisfies and . These eigenvectors form an orthonormal basis, and every has . Thus is a positive operator, with eigenvalues and operator norm .
Three conditions describe different geometry. A Hermitian operator satisfies ; a normal operator satisfies ; a unitary operator satisfies , where is the identity operator. Every Hermitian operator and every unitary operator is a normal operator. Concrete matrices separate the conditions:
The spectrum of a bounded Hermitian operator is real. In finite dimension, the spectral theorem supplies an orthonormal basis of eigenvectors, turning its action into independent real scalings. This makes the geometry easy to interpret: each eigenvalue records a signed response along an orthogonal direction. An arbitrary bounded Hermitian operator in infinite dimension need not have any eigenvectors; the general spectral theorem uses a projection-valued measure. MIT's lecture 21 develops the real spectrum and the orthogonality of eigenspaces.[ref]
A historical connection is the study of forms with conjugate variables. In his 1901 account of Charles Hermite's work, Camille Jordan describes these forms and emphasizes their role in reducing forms with real or complex coefficients. In today's notation, is the diagonal value of a Hermitian form; the conjugate variables make a real-valued expression possible even with complex coefficients.[ref]
For a densely defined operator outside this bounded setting, the displayed pairing identity alone defines a symmetric operator. A self-adjoint operator must also have the same operator domain as its adjoint operator.
The Hermitian part of a square matrix is half its sum with its conjugate transpose. It is a Hermitian matrix and satisfies . Its largest eigenvalue is the numerical abscissa, controlling instantaneous growth of the Euclidean norm under .
Hermitian quadratic form 2026-10-14
A bounded Hermitian operator determines a Hermitian form and its real-valued diagonal expression . On a complex Hilbert space,
Thus it is a quadratic form on the underlying real vector space; it is generally not a quadratic form over the complex field, whose scaling rule would involve . This distinction explains why replacing by loses the geometry of a complex inner product.
For a finite-dimensional Hermitian operator with an orthonormal basis of eigenvectors and corresponding eigenvalues , the spectral theorem gives
For a unit vector, this is an average of the eigenvalues with nonnegative weights summing to one. It is also the Rayleigh quotient, so its minimum and maximum are the smallest and largest eigenvalues.
In the Hermitian operator diagram, take for , and for . The computed curves are
These paths illustrate the extremal values; the spectral theorem supplies the bounds for every complex unit vector, including those outside the plotted paths.
For a finite-dimensional Hermitian matrix , the Rayleigh quotient has precisely the range , where the endpoints are its extreme eigenvalues. The finite-dimensional spectral theorem writes a nonzero vector as in an orthonormal eigenbasis, giving
Thus the quotient is a convex combination of eigenvalues. The bounds follow immediately, and equality at either endpoint means that lies in the corresponding extreme eigenspace, including any repeated eigenvalue. Every intermediate value occurs: for orthonormal extreme eigenvectors, gives for . If all eigenvalues are equal, the quotient is constant.
The Hermitian hypothesis matters. The real matrix has only the eigenvalue , but . Its quotient is governed by the symmetric part of a matrix , not by a real orthonormal eigenbasis of . A nonsymmetric matrix therefore need not obey the displayed eigenvalue bounds.
Hessian matrix Created 2026-09-24 Updated 2026-10-14
The Hessian matrix describes how the slope of a function changes in different directions. For a real-valued function with continuous second partial derivatives on an open subset of , it is
The symmetry of second derivatives makes a symmetric matrix under these hypotheses. It is also the Jacobian matrix of the gradient: near , a small displacement changes by . Thus the gradient measures the current slope, while the Hessian measures its local variation. [ref]
For example, take the quadratic form
Its gradient and Hessian matrix are
The only critical point is the origin. Completing the square gives , so the origin is a strict global minimum. The eigenvalues and are both positive, recovering the same conclusion from the positive definiteness of the Hessian. Its eigenvectors identify the rotated directions in which the quadratic form has its smallest and largest bending.
Figure 1.
Positive, negative and mixed Hessian eigenvalues produce different critical-point geometry
. Contour plots of , , and . All three have a critical point at the origin; the first two have elliptical contours, while the last has positive and negative sectors meeting along its zero contours. Details.
For a fixed vector , restriction to a straight line gives the directional interpretation
This is the quadratic form associated with the Hessian matrix. For a unit eigenvector , it equals the corresponding eigenvalue. Opposite signs therefore mean that some directions bend upwards and others downwards. The second-derivative test turns this information into a classification when the gradient vanishes.
The same object is useful for computation. Newton's method in optimization chooses a displacement by solving when the Hessian matrix is an invertible matrix; this makes the gradient of the local quadratic model vanish. For the displayed , the equation gives , so one exact step reaches the minimum from any starting point. For a general function, a Hessian with opposite-sign eigenvalues or a large condition number need not give a useful minimizing step, and the local minimum need not be a global minimum.
The name honors Otto Hesse. [ref] An older geometric use is the Hessian criterion for flexes of a plane cubic, connecting a determinant of second partial derivatives with inflection points of an algebraic curve. Hesse's 1844 paper Über die Wendepuncte der Curven dritter Ordnung is an early source on that geometric problem. [ref]
On a positive eigenvalue label and a clean quantum ancilla, the HHL algorithm applies a quantum variable rotation with angle , where :
Uncomputation of the eigenvalue register followed by conditioning on flag one multiplies each input eigenvector amplitude by . If is normalized, the success probability is . Choosing from a valid condition number bound gives success probability at least .
For a differentiable radial factor and integer , the coordinate polynomial obeys and . The identity gives the displayed angular eigenvalue. Lowering gives , a nonzero eigenfunction with the same angular eigenvalue when and the original state is nonzero. At lowering gives the zero function, which is not an eigenfunction. Negative powers satisfy local differential identities off the axis but are not regular angular states.
If and , induction using the defining commutator gives the displayed identity. When is not a root of unity, a finite string of length in a simple module has , . Its distinct eigenvalues make the string vectors independent, and the nonzero raising coefficients prove simplicity.
Use the complex-linear Hodge star operator on the direct sum of all form degrees. Its square on degree is . In positive odd dimension this is always one; in positive even dimension its sign is positive on even-degree forms and negative on odd-degree forms. Complementary basis wedges provide both roots of each sign, so the displayed eigenvalues all occur. On a single degree the Hodge star operator is an endomorphism only in middle degree; on middle degree in dimension its possible eigenvalues are for even and for odd .
Hoffman–Wielandt inequality Created 2026-10-07 Updated 2026-10-14
For two normal matrices of the same size, a pairing of their eigenvalues has squared Euclidean discrepancy at most the squared Frobenius norm of their difference. For Hermitian matrices, the increasing real eigenvalue order gives such a pairing, because it minimizes squared discrepancy. For real symmetric matrices, the norm square is .