The adjoint operator is defined by
Since is a nonzero finite-dimensional complex vector space, has an eigenvector with eigenvalue . Normality gives
for every , by expanding both sides and using . Taking yields
Use the convention
Changing the summation variable from to gives
Thus the Fourier-basis states are eigenvectors of the cyclic shift, with respective eigenvalues , and the cyclic shift diagonalization by the quantum Fourier transform is
For , write with . Then
so
Hence the required quantum circuit applies, from input to output,
The first phase gate acts on the most significant qubit and the second on the least significant qubit .
The Gershgorin circle theorem states that every eigenvalue of a complex matrix lies in at least one disk
To prove it, choose a nonzero eigenvector for and an index such that . The th component of gives
Taking absolute values and using yields
Division by proves the theorem.
Apply part (b) to the normal matrix . Since , one has
Thus is an eigenvector of with eigenvalue .
A real matrix is orthogonal when . If , norm preservation gives . If and , preservation of the Hermitian inner product gives ; distinct unit-modulus eigenvalues therefore have orthogonal eigenvectors.
The nonreal eigenvalues of a real matrix occur in conjugate pairs. Since their product is one and , the remaining real eigenvalue is . If , then , and , so : the plane is invariant.
The restriction to is a planar orthogonal map whose determinant is , hence a rotation through some . In an orthonormal basis adapted to ,
Therefore and
A linear operator on a real inner-product space is self-adjoint when
for all .
To prove the finite-dimensional spectral theorem, first note that the continuous quadratic function has a maximum on the unit sphere. The Lagrange multiplier equation at a maximizing vector gives , so has a real unit eigenvector. Its orthogonal complement is invariant because
Induction on the dimension supplies an orthonormal eigenbasis of that complement and hence of .
For ,
while symmetry and bilinearity are immediate, so the displayed formula defines an inner product on . Since
integration by parts gives
The boundary term vanishes for polynomials, proving that is self-adjoint.
On the monomial ,
Thus the matrix of in the monomial basis is triangular with diagonal
These are therefore its eigenvalues. For , corresponding eigenvectors are
for eigenvalues , respectively. They are the first Laguerre polynomials up to normalization, as described by the Laguerre differential operator on polynomials.
The coefficient matrix has eigenvector with eigenvalue and eigenvector with eigenvalue . Write
Since
and , the system diagonalises to
Using an integrating factor gives
The unique fastest term is therefore
Consequently diverges for , tends to zero for , and for tends to the finite nonzero vector
Thus the only requested integer is
This is an instance of dominant eigenmode in a forced linear system.
For a decision in the unit ball, conditional expectation under the posterior gives
The symmetric positive semidefinite matrix has a Rayleigh quotient maximized over by any unit eigenvector corresponding to its largest eigenvalue. Bayes decision rule therefore chooses any such eigenvector for the stated utility.
For and centered data, the objective is the Rayleigh quotient
This is the first-direction optimization in principal component analysis. Therefore is any unit eigenvector of the sample covariance matrix corresponding to its largest eigenvalue.
The Karhunen–Loève expansion has the following Hilbert-space form. Let be a square-integrable Random element of a Hilbert space , with mean and covariance operator . There are nonnegative eigenvalues and orthonormal eigenvectors spanning the closure of the range of such that
in . The functional principal component scores
satisfy
If is a Gaussian random element, the scores are independent normal random variables.
For the proof, is positive, self-adjoint, and trace-class, with
It is therefore compact, so the spectral theorem for compact Hermitian operators supplies the eigenpairs. Their score covariance is
For the residual , Parseval identity and the trace formula give
The centered variable's projection onto has zero second moment and is therefore zero almost surely, which completes the mean-square expansion. When has a continuous covariance kernel, Mercer's theorem additionally expands that kernel as .
Because is a real symmetric positive-definite matrix, the finite-dimensional spectral theorem supplies an orthonormal eigenbasis with
Its eigendecomposition is also its singular value decomposition. If , then
so
The operator norms satisfy and . Therefore the worst-case relative perturbation bound is
The ratio is the spectral condition number of a positive-definite matrix. A large ratio means that data noise aligned with an eigenvector for the smallest eigenvalue is strongly amplified, so the inverse problem is ill conditioned.
A complex representation of a finite group is a homomorphism
for a finite-dimensional complex vector space . It is an irreducible representation when its only invariant subspaces are and , and its degree is . Two representations are isomorphic when there is an invertible linear map intertwining their -actions.
Write the dihedral group as
In an irreducible representation choose an eigenvector of , which is possible because . If its eigenvalue is , then
Thus is invariant under both and . Irreducibility forces , proving as in irreducible complex representations of a finite dihedral group.
Let . Besides the one-dimensional representations described below, define for each indicated
These matrices satisfy the defining relations. Since , the only one-dimensional -invariant subspaces are the two coordinate axes, and interchanges them. Hence is irreducible. Their characters satisfy
whose values are distinct in the ranges below, so the are pairwise nonisomorphic. This is the family of two-dimensional representations of a finite dihedral group.
If is odd, a one-dimensional character must send to a scalar satisfying and . Thus , while may independently map to or . These give two one-dimensional irreducibles. Taking
gives two-dimensional irreducibles, for a total of
If is even, may map to either or , and again may map independently to either sign. This gives four pairwise nonisomorphic one-dimensional irreducibles. Taking
gives two-dimensional irreducibles, for a total of
Different dimensions distinguish the one- and two-dimensional families, completing the required construction and justification.
The characteristic polynomial of is
A scalar is an eigenvalue when there is a nonzero vector such that
Such a is an eigenvector belonging to . Equivalently, is a root of and the corresponding eigenvectors are the nonzero elements of .
The characteristic polynomial has degree . By the fundamental theorem of algebra, it has a complex root . Hence
so has a nonzero kernel. Any nonzero in that kernel satisfies
Thus is an eigenvalue and is a corresponding eigenvector.
First note that if is normal, then
for every . Hence an eigenvector with also satisfies
Normalize and extend it to an orthonormal basis. Let have these basis vectors as columns. The first column of is . For every ,
so the first row also has no off-diagonal entries. Therefore
Comparing the two block products in the normality identity shows that , so is normal.
The result is trivial in dimension one. Applying the induction hypothesis to and adjoining the eigenvector gives an orthonormal eigenbasis for . This proves the unitary diagonalization of a normal matrix.
The proof is by induction on . Choose a unit eigenvector of , which exists by part (a), and extend it to an orthonormal basis. In that basis,
By induction, a unitary change of basis on the last coordinates makes upper triangular. Extending that change by the identity on the first coordinate leaves the displayed zero block intact. Their product is unitary and makes all of upper triangular. This proves Schur triangularization.
The characteristic polynomial is
To prove triangularizability, use induction on . The result is immediate for . Over , has a root , so has an eigenvector . Extend it to a basis. In this basis,
By induction, a change among the remaining basis vectors makes upper triangular. Thus the triangularization over an algebraically closed field gives
The minimal polynomial is the monic polynomial of least degree satisfying . To establish existence without quoting the Cayley-Hamilton theorem, let be an upper-triangular matrix similar to , with diagonal entries , and put
Then
The factors commute, so applying all of them successively lowers the invariant flag to zero:
Similarity gives the same polynomial identity for . Hence a nonzero monic annihilating polynomial of degree exists, and a least-degree one exists.
If and were two monic annihilating polynomials of the same least degree, then would be an annihilating polynomial of smaller degree unless it were zero. Thus the minimal polynomial is unique, and the minimal polynomial bound from a triangular invariant flag gives
Proceed by induction on . Over , has an eigenvector , say . The normal operator satisfies the norm equality from part (c), so
Thus . Part (a) now shows that is invariant under both and . The restriction of to is normal. By induction it has an orthonormal eigenbasis, and adjoining the normalized vector proves the finite-dimensional spectral theorem for normal operators.
Hence
A shift-invariant basis is a common eigenbasis of all cyclic shift operators . For the displayed Fourier states, orthonormality follows from the root-of-unity filter:
There are vectors in this orthonormal set in the -dimensional Hilbert space, so they form a basis. Reindexing the finite sum gives
Thus every is simultaneously an eigenvector of every shift, with eigenvalue for .