A scalar is an eigenvalue of a linear operator when
for some nonzero vector , called an eigenvector. The scalar must belong to the field over which is a vector space. Geometrically, a real eigenvalue tells us what does along a special line: every vector on that line is multiplied by the same number. The eigenvector gives the line and the eigenvalue gives its scaling.
For a real eigenvalue, preserves the orientation along the line, reverses it, and collapses the line to zero. The length is multiplied by the modulus , so stretches and contracts. For example, the diagonal matrix doubles one coordinate direction, reverses and halves another, and annihilates the third. Its eigenvalues are ; the last direction lies in its kernel.
For a finite square matrix, the eigenvalues are the roots of a polynomial , its characteristic polynomial:
Here is the identity matrix. The reason is that means with : the shifted matrix must have a nontrivial kernel, equivalently a zero determinant. The worked symmetric matrix example in eigenvector shows both stages: find the eigenvalues, then find their eigenspaces.
Eigenvalues are especially useful for repeated application of a linear map. If , then
One multiplication proves the next step, so a matrix power becomes an ordinary power on each eigenvector. This explains growth, decay, and alternating signs along these directions. Gilbert Strang develops this connection, and its extension to the matrix exponential, in his lecture "Eigenvalues and Eigenvectors" (MIT 18.065, 2018).[ref]
A documented historical connection is C. G. J. Jacobi's "Über ein leichtes Verfahren die in der Theorie der Säcularstörungen vorkommenden Gleichungen numerisch aufzulösen" (1846, Journal für die reine und angewandte Mathematik 30, pp. 51–94). Its opening discusses symmetric matrices arising from small oscillations, with a common unknown subtracted from every diagonal entry. In modern notation this is ; Jacobi seeks the parameter and the ratios of the components of . This is evidence of an early physical and computational setting for the eigenvalue problem, without assigning its discovery to a single person.[ref][ref]
An eigenvalue collision occurs when distinct branches of eigenvalues coincide in a parameter-dependent family of matrices or linear operators. The resulting repeated eigenvalue need not retain a full eigenbasis; its geometric and algebraic multiplicities must be compared to decide diagonalizability.
The spectral abscissa is the largest real part of a matrix's eigenvalues. It describes asymptotic exponential rates of its matrix exponential, but a non-normal matrix can also have transient amplification. It is generally distinct from the Euclidean logarithmic norm, which gives an immediate Euclidean energy-growth bound.
Geometric multiplicity is the dimension of an eigenspace; algebraic multiplicity is its multiplicity as a root of the characteristic polynomial. For a real symmetric matrix they coincide because it has an orthonormal eigenbasis.
Zero is an eigenvalue of a linear operator exactly when the operator has a nontrivial kernel. Its eigenvectors are precisely the nonzero vectors in that kernel.
Consider
Its row sums vanish, so is an eigenvector for the zero eigenvalue. Its characteristic polynomial is
with sum of principal minors of order two
The other eigenvalues are . No symmetry is required for this formula; positive diagonal symmetrization of a matrix is a sufficient condition for real roots.
An eigenvalue problem asks for the eigenvalues and corresponding eigenvectors or eigenfunctions of a linear operator. It is commonly written as the eigenvalue equation .
An eigenfunction is a nonzero function satisfying for a linear operator and scalar eigenvalue .
A nodeless real eigenfunction has no zero in the interior of the domain. For a one-dimensional confining Schrödinger operator, the nodeless theorem for a one-dimensional ground state identifies the ground state as the eigenfunction that can be chosen strictly positive. Normalizable excited states have nodes.
A Dirichlet eigenfunction is an eigenfunction of a differential operator satisfying a homogeneous Dirichlet boundary condition. The term applies to more general boundary-value operators as well as the Dirichlet Laplacian.
An adjoint eigenfunction is a nonzero eigenfunction of the adjoint operator on its adjoint domain. For an inner product conjugate-linear in its first argument, implies for every in the domain of . Consequently a necessary solvability condition for is . If is a Fredholm operator, orthogonality to every element of its adjoint kernel is also sufficient. Boundary conditions and weights in a coupled system enter the adjoint domain and must be derived by integration by parts; copying the original eigenfunction without checking them can give a wrong projection.
A generalized eigenfunction solves the eigenvalue equation for a linear operator in an enlarged space, often a space of distributions, although it may fail to belong to the underlying Hilbert space. A plane wave on the whole real line is a generalized momentum eigenstate, with momentum , and is not square-integrable. This usage differs from a generalized eigenvector in a Jordan chain, where a higher power of vanishes rather than itself.
A nonzero vector is an eigenvector of a linear operator when for some eigenvalue . For a real vector space and , the line through is preserved: the image can point forward or backward, but cannot turn away from that line. When , the image is zero and has no direction. The zero vector is excluded because it satisfies the equation for every scalar and identifies no special direction.
Every nonzero scalar multiple of an eigenvector is an eigenvector for the same eigenvalue, since . Thus there is usually no preferred length or sign; choosing a unit vector is a convenient normalization. Eigenvectors for a fixed eigenvalue, together with zero, form its eigenspace.
For a fully computed example, consider the real symmetric matrix
Its characteristic polynomial is
For , gives , so is an eigenvector. For , gives , so is an eigenvector. Direct multiplication checks both:
The map stretches the line threefold and fixes the line pointwise. These eigenvectors are orthogonal because ; dividing each by gives an orthonormal basis. A general vector turns because its components along these two lines receive different scalings. For example, maps to and is not an eigenvector.
Figure 1.
Eigenvector geometry: symmetric stretch, quarter-turn rotation, and shear
. Details.
A contrasting example is the planar rotation through degrees:
Every nonzero real vector turns to a perpendicular direction, so there are no real eigenvectors. Its characteristic polynomial is , which has no real roots. Over the complex numbers, however, and . The same matrix therefore has an eigenbasis in even though it has none in : the choice of field matters.
A zero mode is a nonzero eigenvector of an operator with eigenvalue zero. For a differential fluctuation operator it must also satisfy the specified boundary conditions. A zero mode prevents ordinary inversion of the operator and makes its unmodified functional determinant vanish. Gauge directions can produce zero modes of a kinetic operator, while stationary-path focusing can produce them in a semiclassical boundary-value problem. Removing, separately integrating or otherwise treating these directions is necessary before using a Gaussian determinant formula.
Applying the product of the other eigenvalue factors to a linear relation isolates each coefficient. Distinct eigenvalues therefore give linearly independent eigenvectors. A complete eigenvector basis diagonalizes the associated linear system of ordinary differential equations.
The eigenvalue equation asks for a nonzero eigenvector and its eigenvalue .
A right eigenvector satisfies .
A left eigenvector satisfies , equivalently over the real numbers.
For an eigenvalue of a linear operator , its eigenspace is
It contains all eigenvectors for and the zero vector. Including zero makes this a linear subspace: if , then for any scalars . Every nonzero vector in this linear subspace has the same scaling under . Its dimension is the geometric multiplicity of the eigenvalue. If is not an eigenvalue, the shifted kernel is only .
For the symmetric matrix from eigenvector,
Each eigenspace is a line. An eigenspace can also be a plane or the whole vector space: for , is a plane of dimension two, while for every vector belongs to . A repeated eigenvalue therefore need not prevent diagonalizability.
The useful unit of information is the whole eigenspace, rather than a particular choice of eigenvectors inside it. On , is simply multiplication by . Distinct eigenspaces fit together as a direct sum, and a finite-dimensional linear operator is diagonalizable exactly when they fill the whole vector space. For the example above, every vector splits uniquely as
This decomposition makes the independent scalings visible without multiplying out the original matrix again.
An eigenline is a one-dimensional vector subspace spanned by an eigenvector. If with , then for every scalar , so the line is an invariant subspace. It can be contained in an eigenspace of larger dimension; an eigenline need not be the whole eigenspace.
If a real linear operator on an -dimensional vector space has distinct real eigenvalues, any real square root commutes with and preserves each one-dimensional eigenspace. There is multiplication by a real , hence . Conversely, if all the eigenvalues are nonnegative, choosing on an eigenbasis supplies a real square root. Without simple spectrum the necessity fails: a real quarter-turn squares to .
The vector space of functions satisfying for a specified Laplace-Beltrami operator. On a closed manifold its dimension is finite and is the spectral multiplicity of . A finite isometric group action preserves this space; invariant elements are the Laplacian eigenfunctions on the corresponding smooth quotient.
An eigenbasis is a basis consisting of eigenvectors of one operator.
An eigenvalue is simple when it has algebraic multiplicity one.
For unit left eigenvector and right eigenvector of a real matrix at a simple eigenvalue , its normwise sensitivity is
It measures the first-order amplification of a matrix perturbation into an eigenvalue perturbation.
If and is a differentiable function defining a simple eigenvalue, then
The Cauchy-Schwarz inequality and the operator norm give
A finite-dimensional linear operator is diagonalizable over a specified field when it has an eigenbasis. Equivalently, its matrix admits
where is an invertible matrix whose columns are eigenvectors, and is a diagonal matrix of the corresponding eigenvalues. This change of basis reveals a linear map as independent one-dimensional scalings. The matrix may look coupled in the original coordinates, but each coordinate in the eigenbasis evolves on its own.
For the symmetric matrix computed in eigenvector, take
Then , hence . The orthonormal basis version is , an orthogonal matrix satisfying . Every real symmetric matrix has an orthonormal eigenbasis by the spectral theorem; a general diagonalizable matrix need not have orthogonal eigenvectors.
The immediate payoff is repeated application: adjacent factors cancel, giving . In this example,
The component in grows while the component in stays fixed. After division by its Euclidean norm, this particular sequence approaches . This is the mechanism behind the power method; an initial vector entirely in would stay there and never find the dominant eigenvalue .
Figure 1.
Repeated maps: eigenvalue growth, alignment, and the exceptional starting direction
. Details.
Two different obstructions deserve comparison. The planar rotation in eigenvector is diagonalizable over but not over , because its eigenvalues are and . By contrast, the shear mapping
has only , of algebraic multiplicity two, and , of geometric multiplicity one. There is no second independent eigenvector, even over . This is a defective matrix, already a two-dimensional Jordan block. Its powers are
Thus even though both eigenvalues are one, repeated application can produce growth. Eigenvalues alone miss the coupling recorded by a Jordan block. A repeated eigenvalue is harmless when it has enough independent eigenvectors, as demonstrates. More generally, a matrix is diagonalizable exactly when its characteristic polynomial splits over the chosen field and every eigenvalue has equal geometric multiplicity and algebraic multiplicity. The proof outline is to join bases of the distinct eigenspaces; their direct sum fills the space exactly under these conditions.
A physical motivation is the separation of normal modes. Consider two equal masses between three identical springs of stiffness , with the outer ends fixed. By Hooke's law and Newton's second law, the displacement vector obeys
The eigenvectors and have eigenvalues and : the masses move together in the first normal mode and oppositely in the second. Writing separates the coupled equations into two harmonic oscillators,
Their angular frequencies are and ; the eigenvalues give squared angular frequencies after multiplication by . This is the beauty of diagonalization: finding the right directions turns interacting motions into independent patterns. For a physical treatment, see Yen-Jie Lee's "Coupled Oscillators, Normal Modes" (MIT 8.03SC, 2016), and the local article normal modes of two equal masses between three springs.[ref]
A diagonalization is a factorization in which is diagonal and the columns of form an eigenvector basis.
Let be invertible over an algebraically closed field. If is diagonalizable for some , then is diagonalizable. Indeed, a nontrivial Jordan block has and
The first nonzero nilpotent term prevents this power from being diagonalizable.
Suppose real matrices satisfy for an invertible complex matrix . Then and . The real polynomial is not identically zero because its value at is nonzero, so some real makes invertible. This real matrix intertwines and .
Eigenvectors belonging to distinct eigenvalues are linearly independent. Consequently, an -dimensional operator with distinct eigenvalues is diagonalizable.
A spectral decomposition expresses a linear operator through its eigenvalues and projections onto its eigenspaces.
An eigenvalue is dominant when its modulus is greater than or equal to that of every other eigenvalue. It is uniquely dominant when the inequality is strict.
A spectral gap is a positive separation between designated parts of the spectrum of a linear operator. For the power method, the relevant gap separates the modulus of the dominant eigenvalue from the other eigenvalue moduli.
Suppose has ground energy zero and positive spectral gap at least , and . Let be the minimum of restricted to the ground space. Splitting a normalized vector into ground and excited components bounds its energy below by , with the excited norm. Completing the square yields the displayed bound for . The error is controlled by the gap and cannot be treated as a uniform when closes.
The Davis-Kahan theorem bounds the change of an invariant eigenspace of a symmetric matrix in terms of a matrix perturbation and an appropriate spectral gap. The rank-one eigenprojector perturbation bound below depends only on the unperturbed gap. Yu, Wang and Samworth's formulation gives population-gap bounds in greater generality.
If a symmetric matrix has largest eigenvalue separated from by , and is its leading rank-one orthogonal projection matrix, then every unit vector , with , satisfies the displayed inequality. Expanding in an orthonormal eigenbasis gives , while . The analogous statement for a smallest eigenvalue follows by replacing by .
Let project onto a leading unit eigenvector of , with as in the Davis-Kahan curvature lemma. Its maximizing Rayleigh quotient gives . Duality of the operator norm and trace norm, together with the rank-two bound , proves the estimate. No gap condition on the perturbed matrix is needed.

Ancestors (6)

  1. Operator theory
  2. Linear algebra
  3. Algebra
  4. Area of mathematics
  5. Mathematics
  6. Home

Discussion (0)

New discussion

There are no discussions about this article yet.

Articles by others on the same topic (1)