If , every has the decomposition
whose first term belongs to and second to . Their intersection is zero by ii, so is a direct sum. Choosing bases of the two eigenspaces gives a diagonal matrix with entries and .
Since while , we have . Thus is , , or . Reordering the basis gives exactly
For , is point inversion through the origin. For , it fixes the plane pointwise and reverses the complementary line : if in this direct sum, then . For , it fixes the line pointwise and reverses the complementary plane .
These are instances of oblique symmetry of complementary subspaces, allowing oblique eigenspaces. They are a Euclidean reflection in a hyperplane and a rotation in three dimensions through about a line, respectively, when the two eigenspaces are perpendicular. The hypotheses do not require an orthogonal transformation or an orthonormal basis, so that additional metric property cannot be inferred just from the displayed diagonal forms.
Write . The linear map represented by has the form
The image of a linear map here is contained in the one-dimensional linear span of , so its matrix rank is at most one. The rank-nullity theorem yields
Thus the solution space of , namely the zero eigenspace when zero is an eigenvalue, contains at least linearly independent vectors. If its dimension is ; otherwise it is . When the asserted lower bound is zero, even if zero is not an eigenvalue.
Let be the column-centered data matrix. Its sample covariance matrix is . The loadings matrix has orthonormal eigenvectors of as columns, ordered by nonincreasing eigenvalues:
Each principal component loading specifies the coefficients of a principal direction in the original variables. Signs are arbitrary, and equal eigenvalues permit orthogonal changes of basis within their eigenspaces.
If , then . Alternatively, direct matrix multiplication gives
Thus the normalized eigenvectors from part (b) have respective eigenvalues
If , then , and the whole two-dimensional space is its eigenspace. This degeneracy includes cases where the two eigenvalues of were distinct but opposite.
The characteristic polynomial is . Solving the three eigenvector equations gives
Each eigenspace consists of the scalar multiples of its displayed nonzero vector. Their pairwise dot products vanish: and . This also agrees with the orthogonal diagonalization of a real symmetric matrix.
Compute the characteristic polynomial using :
Its three distinct real roots are and . For , the first row of gives and the second then gives , so take .
For either root of , take and solve the row equations to get . Substitution makes the first two row residuals opposite multiples of the quadratic equation and the third zero. Thus a complete choice is
Every nonzero scalar multiple is another valid eigenvector in the corresponding one-dimensional eigenspace.
The characteristic polynomial is
For , the eigenvector equation reduces to ; for , it reduces to . Choose the following unit vectors consistently for the remaining parts:
Each eigenspace consists of all scalar multiples of its displayed vector, including zero; an eigenvector itself must be nonzero.
For , the eigenvalue equation reduces to a one-dimensional eigenspace spanned by . For , the rows of are multiples of , so its eigenspace is the plane . One possible set of three independent eigenvectors is
Every eigenvector for is a nonzero linear combination of the last two. Their two-dimensional eigenspace shows that the repeated root is not defective: the matrix is diagonalizable.
For the particular eigenvectors chosen in (iii), the dot products are
Thus only and are orthogonal for this choice. The matrix is not symmetric, so distinct eigenvalues alone do not imply orthogonality. Another basis within the repeated eigenspace may change which chosen vectors are perpendicular; the dot products above specify the convention completely.
A vector perpendicular to has the form . Direct matrix multiplication gives
Thus every nonzero such vector is an eigenvector with . The zero vector must be excluded from the literal claim about “any” perpendicular vector, since an eigenvector is nonzero. The eigenspace is two-dimensional. Equivalently, exhibits the spectrum of a scalar matrix plus a rank-one projector.
Choose two perpendicular unit directions in the eigenspace:
Their pairwise dot products vanish and their Euclidean norms are one. They form an orthonormal basis of eigenvectors, with eigenvalues , as guaranteed for a real symmetric matrix by the spectral theorem for real symmetric matrices.
Using the ordered orthonormal basis chosen in (c), the column matrix is
Other signs or another orthonormal choice within the repeated eigenspace are equally valid, provided the same choice is retained in the remaining parts.
Use the common eigenvectors of and . For each ,
Thus, without constructing explicitly, its eigenvalues are
The eigenvalue has direction . The repeated eigenvalue has a real eigenspace consisting of vectors whose coordinates sum to zero. This is the general rule for the symmetric part of an orthogonal matrix. Adding unrelated lists of eigenvalues would not suffice; here the shared eigenvectors justify the pairing.
By the spectral theorem for real symmetric matrices, choose the normalized eigenvectors to form an orthonormal basis. With , orthonormality gives and . For every vector , expand and apply :
Since this equality holds for every , the spectral decomposition is
Each is the rank-one orthogonal projection onto its eigenvector direction. In a degenerate eigenspace, normalized eigenvectors must be chosen mutually orthogonal; normalization alone does not guarantee this resolution of the identity.
A left eigenvector satisfies . Here is a symmetric matrix, so its left and right eigenspaces have the same components. The characteristic polynomial factors as
The eigenvalues and all corresponding nonzero row eigenvectors are
For example, in the block, equal components give the eigenvalue and opposite components give , while the coordinate is unaffected.
The two orthogonal directions and are preserved by this symmetric matrix. Direct multiplication, using the hyperbolic function identities , gives the eigenvalue–eigenvector pairs
Each eigenvector can be multiplied by any nonzero scalar. For these give the two one-dimensional eigenspaces. When , the matrix is the identity: the only eigenvalue is , with multiplicity two, and every nonzero vector is an eigenvector.
Induction on gives , including . The absolutely convergent matrix exponential series may therefore be applied term by term to each eigenvector:
Thus
For a repeated eigenvalue, every nonzero vector in its eigenspace remains an eigenvector. Because the real exponential function is injective, distinct real eigenvalues of do not merge under this transformation.
If for a nonzero eigenvector, then . Since , : every eigenvalue is zero or one. Let be the number of ones, counted with algebraic multiplicity. The trace is and the determinant is the product of these eigenvalues. Therefore
Every output is fixed by a second application:
The image of a linear map is thus the eigenspace for the eigenvalue one. To establish its dimension without assuming diagonalizability, decompose every input as
The first term lies in the image of a linear map and the second in its kernel. Their intersection is zero, because a vector in the image is fixed by whereas a vector in the kernel is killed by . Thus the space is their direct sum, and an adapted basis puts into the form , where . Comparing traces gives :
This is an idempotent linear map, and trace of an idempotent equals its rank. If , no nonzero output exists. The dimension in the question refers to the image subspace, including its zero vector.
Suppose and . Then
Because the eigenvalues of are distinct, the eigenspace for is one-dimensional. It follows that , including the possibility . Thus an orthonormal eigenbasis of is also an eigenbasis of . The simplicity of both spectra means their eigenvectors coincide as directions, up to ordering, phases and nonzero scalar multiples.
Conversely, if they share a complete eigenbasis, choose the unitary matrix whose columns are these common normalized eigenvectors. Then and are diagonal, so and . Hence
This is simultaneous diagonalization of the two Hermitian matrices.
The spectral theorem gives a real orthonormal eigenbasis for a real symmetric matrix . Distinct eigenspaces are orthogonal; within a repeated eigenspace, choose an orthonormal basis, for example by Gram-Schmidt orthogonalization. Put these eigenvectors in the columns of . Then and
For a change of variables , choose . Since , the quadratic form becomes ; the are precisely the eigenvalues of .
In the numerical case, the off-diagonal entries are half the cross-term coefficients, so
A direct eigenvector calculation gives the unit eigenvectors , , , with eigenvalues two, three and minus six. They are pairwise orthogonal. Therefore the required orthogonal diagonalization is
and the transformed quadratic form is .