A linear map is a nilpotent endomorphism if for some positive integer , and a semisimple endomorphism if it is diagonalizable over . Decompose into its generalized eigenspaces , where . Define on to be , and set . Then is diagonalizable, is nilpotent, and both preserve these vector subspaces and commute. Thus
For uniqueness, suppose with semisimple, nilpotent and . Both commute with , so preserve each . On an eigenspace of of eigenvalue inside , the map is and has only the eigenvalue . Since the same subspace lies in , . Hence on , proving and . This is the additive Jordan–Chevalley decomposition.
We need a polynomial consequence of this decomposition. Hermite interpolation supplies a polynomial with , by prescribing for each eigenvalue. For any endomorphism , its semisimple part can likewise be expressed as a polynomial in with zero constant term: if zero is an eigenvalue, its interpolation condition already forces this; if not, add the independent condition .
On , the maps and commute. The first is diagonalizable, with eigenvalues on . The second is nilpotent, since
which vanishes for when . Uniqueness therefore proves adjoint compatibility of additive Jordan decomposition: .
Now assume . The condition implies that both and are invariant under , and every polynomial in with zero constant term maps into . Define to be multiplication by on . It commutes with . On , acts by . Polynomial interpolation on the finite set of differences gives with . The preceding paragraph then expresses as a polynomial in with zero constant term. Consequently , so .
The assumed trace orthogonality nilpotence lemma now follows directly. On , and , while the matrix trace of the nilpotent restriction of is zero. Hence
Every summand is nonnegative, so every eigenvalue of is zero. Its Jordan–Chevalley decomposition therefore has , and is nilpotent. Notice that neither nor was required to be a Lie subalgebra.
A Riemannian metric is a smooth field of positive-definite symmetric bilinear forms on the tangent spaces, equivalently a smooth section of with that positivity. Its musical isomorphism is
Nondegeneracy makes every fiber map an isomorphism. In coordinates the map has matrix , and its inverse has matrix . Smoothness of the inverse follows from the inverse-matrix formula and the nonvanishing determinant. Both maps cover the identity on , giving a smooth vector bundle isomorphism.
For local flattening of a Riemannian metric, choose a manifold chart neighborhood around with closure contained in , and let on . Choose a smooth bump function , with compact support in and equal to one on a smaller neighborhood of . Set
The formulas glue smoothly because the modification is supported strictly inside . A convex combination of positive-definite forms is positive definite. On the metric is exactly , so gives an isometry to a Euclidean open subset. Outside the original metric remains unchanged.
Geodesic completeness means that every geodesic with arbitrary initial point and tangent vector extends for every real affine parameter. On each connected component, the Hopf-Rinow theorem equates this with completeness of the Riemannian distance.
The Euclidean-end claim needs a compact-core interpretation that is absent from its literal hypotheses. Indeed, with , and satisfy those hypotheses. The geodesic reaches the missing unit sphere at and cannot continue within . Thus the printed assumptions alone do not prove completeness.
Here is the intended compact-core completeness for a Euclidean end. Write for the end coordinates and assume additionally that
is compact for every sufficiently large . Choose such an beyond the metric transition and large enough to include the initial point of a geodesic. Its speed is constant. On every segment outside , the Euclidean radius changes at a rate at most , so over a finite parameter interval it cannot exceed . The full segment therefore stays in the compact set . Its velocities also stay in a compact subset of , since their metric norm is fixed and the base set is compact. The smooth geodesic ordinary differential equation consequently extends past any supposed finite endpoint. The reversed-time argument is identical. This proves completeness under the compact-core condition, and explains exactly what the exterior-of-a-ball counterexample lacks.
For upward stability of Riemannian completeness, lengths of all curves satisfy , hence . A -Cauchy sequence is therefore -Cauchy and has a limit because is complete. Smooth positive-definite metrics induce the manifold topology. More explicitly, on a small coordinate ball around , has a bounded largest matrix eigenvalue, so the coordinate straight segment gives . Thus convergence to is also in . That distance is complete, and Hopf-Rinow yields
For disconnected , apply this argument on each component.
Choose a positive system of a root system and the corresponding triangular decomposition of a Lie algebra . A primitive element of a Lie algebra representation of weight is a nonzero vector with for every and . Thus it is a highest-weight vector; the choice of positive roots is part of this definition. A highest-weight representation is generated by such a vector.
Let be the corresponding Borel subalgebra. Define its one-dimensional Lie algebra representation by the scalar on and zero on . This respects the Lie bracket, since . The induced Verma module
is nonzero: the Poincaré-Birkhoff-Witt theorem identifies its underlying vector space with , and is a primitive element of weight . Its weight spaces are finite dimensional, its top weight space is the line , and all other weights are with and at least one positive coefficient.
A proper submodule cannot contain , because generates . More strongly it has no component of weight : any finite sum of distinct weight vectors can be projected onto its individual components by a polynomial in a generic element of . Therefore the sum of all proper submodules still misses the top weight line and is proper. It contains every proper submodule, so the irreducible quotient of a Verma module
is irreducible and retains the nonzero primitive element . This constructs the requested representation for every . It is not asserted to be finite dimensional for arbitrary .
For the sl2 Lie algebra, use , and , with , , . The classification of finite-dimensional sl2 representations gives one irreducible for every integer . In a basis its action is
where . These formulas satisfy the three Lie brackets. Any nonzero invariant subspace contains a weight vector by polynomial projection using ; repeated application of gives , and applications of then give the entire basis. Thus is irreducible.
Conversely, in any finite-dimensional irreducible module, start with an eigenvector of and apply until reaching a nonzero vector with . This process terminates because increases the eigenvalue by two and only finitely many eigenvalues occur. Write . The sl2 highest-weight lowering formula gives
Let and , which again follows from the finite set of weights. Applying to the latter identity yields , so . The resulting distinct weight vectors span an invariant subspace, hence the entire irreducible module. Therefore and its primitive weight is , with ; its weights are .
Use the positive Laplace-Beltrami operator . A Riemannian submersion is a surjective smooth submersion for which, at every , the restriction of to is a linear isometry onto . The spaces and are its vertical and horizontal spaces. Its fibres are totally geodesic submanifolds precisely when is vertical for vertical vector fields : their second fundamental form vanishes. Equivalently, a geodesic initially tangent to a fibre remains in that fibre while defined.
For a smooth , its basic function is constant along each fibre. The Riemannian gradient of is the horizontal lift of a vector field through a submersion of , since
for horizontal , and for vertical . In particular no derivative of in a vertical direction occurs.
Here is the needed connection fact, which also follows directly from the Koszul formula: for horizontal lifts of vector fields on , the horizontal component of projects to . To see this, pair the Koszul formula with a third horizontal lift . The horizontal inner products are pulled back from , and the horizontal components of their Lie brackets of vector fields project to the brackets on . Thus all six terms are the pullbacks of the corresponding terms on .
Choose an adapted Riemannian orthonormal frame , with the horizontal lifts. Using , the connection fact gives
For a vertical , both and , the latter because the fibres are totally geodesic submanifolds. Taking the negative metric trace of the Riemannian Hessian therefore proves the basic-function Laplacian identity
This identity is local and does not require compactness. Vanishing mean curvature of the fibres would already suffice; total geodesicity makes each vertical summand vanish separately.
For the discrete eigenspace assertion, assume the two Riemannian manifolds are closed manifolds. Without a discrete spectral realization, an unrestricted noncompact version need not have an eigenbasis. The projections of the Riemannian product are Riemannian submersions with totally geodesic submanifolds as fibres. Its Levi-Civita connection splits into the two factor connections. Consequently its positive Laplace-Beltrami operator is
The cross term in the product rule for the positive Laplace-Beltrami operator is zero because the two factor Riemannian gradients are orthogonal.
We use the standard compact elliptic compact elliptic spectral theorem: the positive Laplace-Beltrami operator on a closed manifold is self-adjoint, has compact resolvent, and has a complete orthonormal eigenbasis of smooth eigenfunctions, with finite-dimensional eigenspaces and eigenvalues tending to infinity. Let and . Fubini's theorem and completeness on each factor show that form a complete orthonormal basis of . For example, a function orthogonal to all these products has, for each , zero -coefficient as an function, hence is zero.
The displayed operator identity makes an eigenfunction with eigenvalue . Conversely, if , self-adjointness of the positive Laplace-Beltrami operator gives
All other coefficients vanish. Only finitely many pairs can have , since both spectra are nonnegative and have finitely many eigenvalues below any fixed bound. Thus the product Laplacian eigenspace decomposition is
The tensor product summands are mutually orthogonal; their elements are actual smooth eigenfunctions, so this is an equality of eigenspaces, not just a formal expansion.
Let be a closed manifold with a Riemannian metric and use , the positive Laplace-Beltrami operator. This is the setting in which the final discrete eigenfunction expansion applies without additional boundary or noncompact spectral hypotheses. A Riemannian heat kernel is a smooth for such that
for every smooth initial function . Here solves the heat equation. The limit is the statement that the initial kernel is the Dirac delta distribution on the diagonal. In the closed setting this uniquely determines the heat kernel; it is symmetric, preserves constants, is nonnegative, and satisfies the semigroup property.
A heat parametrix is an approximate version with the same delta initial limit and with error
regular enough at to correct by a convergent integral series. One may construct it by the local Gaussian ansatz
where near the diagonal and is supported in a convex normal neighborhood, and the smooth coefficients solve the usual radial transport equations. The leading coefficient accounts for the Riemannian volume form. Taking sufficiently large makes the residual extend continuously, with any prescribed finite number of derivatives, to . Alternatively a smooth asymptotic summation of all transport coefficients gives a residual vanishing to every order. These local construction, extension and differentiability facts are used here as subsidiary results, as permitted.
For the correction proof take a heat parametrix whose residual is smooth up to on a short interval . We also use its uniform integral bound , its approximate-identity limit, and the following standard differentiability property: convolution with a smooth time-dependent kernel gives a smooth kernel for , and differentiating it yields the identity below. These properties follow from the Gaussian estimates and the delta initial limit; no conclusion about the final exact heat kernel is assumed.
Define the Volterra convolution of kernels by
It is associative wherever these integrals converge. The delta term at the upper endpoint gives
Seek . Then its error vanishes exactly when . The solution is the Volterra parametrix correction
The signs matter: the first correction is .
To prove convergence, let and . The time variables in range over a simplex of volume , so
The series for therefore converges uniformly on . Derivatives obey analogous bounds, with polynomial factors in , by the quoted residual extension and differentiation properties. Thus the series can be convolved and differentiated as above. Associativity and absolute convergence give , proving . The correction has integral norm by the integral bound on and boundedness of . It has zero initial limit, so has precisely the required delta initial data.
For uniqueness, a smooth solution with zero initial data satisfies the heat equation energy identity
Its initial norm is zero, hence . Applying uniqueness to consecutive evolutions proves the semigroup property. Choose and, for arbitrary , compose enough kernels that . The resulting kernel is independent of the subdivision by uniqueness, is smooth for positive time by the quoted differentiability property, and extends the construction to every . This proves a parametrix determines the global heat kernel in the closed setting. The heat equation maximum principle gives nonnegativity and applying uniqueness to the constant initial function gives conservation of total mass. Self-adjointness of the positive Laplace-Beltrami operator gives symmetry.
Finally let be a complete complex orthonormal eigenbasis of , with eigenvalues , repeated by multiplicity. As subsidiary analytic facts we use the compact elliptic compact elliptic spectral theorem, elliptic regularity bounds making each fixed derivative of grow at most polynomially in , and a polynomial eigenvalue-counting bound. The spectral expansion of the Riemannian heat kernel converges because exponential decay makes the following series converge with every derivative when :
Indeed, evolving initial data gives by direct substitution into the heat equation and uniqueness. For general , completeness and the heat equation energy identity give
The smoothly convergent kernel series represents this same operator, and equality for all smooth identifies it pointwise with the constructed heat kernel. The complex conjugate is required by the inner product; for a real eigenbasis it may be omitted. A noncompact Riemannian manifold may instead require a spectral integral, and the unqualified discrete formula should not be asserted there.
The complexification of a Lie algebra is , with the Lie bracket extended complex-bilinearly. Equivalently write , where
Complex conjugation is an antilinear map and a Lie algebra automorphism whose fixed subalgebra is .
If the solvable radical of is nonzero, its complexification is a nonzero solvable ideal of . Conversely the solvable radical of is preserved by complex conjugation, because it is the unique largest solvable ideal. Consequently
for , both and belong to . If , is a solvable ideal of . This proves is semisimple if and only if is semisimple. Consistently, the complex Killing form is just the complex-bilinear extension of the real one; its determinant in a real basis is unchanged by extending scalars.
Take the sl2R Lie algebra and the special unitary Lie algebra . Both complexify to . This is immediate for the former; for the latter, the real basis consists of traceless matrices that are skew-Hermitian matrices and is also a complex basis of .
They are not isomorphic as real Lie algebras. Their Killing forms are , but on this is negative definite. On the basis has a diagonal Gram matrix with entries , so the signature of a quadratic form is . A Lie algebra isomorphism preserves the Killing form and therefore its signature.
A real split semisimple Lie algebra has a Cartan subalgebra whose Adjoint representation of a Lie algebra is simultaneously diagonalizable over , so its root-space decomposition is defined over . The example is split: the diagonal Cartan subalgebra has eigenvalues and real root spaces . The example is not split. Invariance makes every skew-adjoint for the positive definite inner product , so its eigenvalues are purely imaginary. If it were diagonalizable over , all these eigenvalues would be zero and . The center is zero, so only has this property; no nonzero split Cartan subalgebra exists. Thus is split and is not.
Use the normalization in which a Hodge metric is a Kähler metric whose Kähler form represents the image of an integral cohomology class in real de Rham cohomology. Equivalently, all its periods on integral two-cycles are integers. A convention using only rescales the metric and does not change existence. An invariant metric on a complex torus is one preserved by every translation; its pullback to has constant coefficients.
Let carry a Hodge metric. Average its Kähler form over translations using normalized Haar measure:
This averaging Kähler forms over a complex torus preserves reality, type , closedness and positivity. Indeed, for any nonzero tangent vector, the quantity being averaged in is strictly positive. Every translation is homotopic to the identity, since a path from to supplies such a homotopy. Thus , as is seen either on de Rham cohomology or by integrating over two-cycles. The average is translation invariant by invariance of Haar measure and determines a Kähler metric . Its class is still integral. The reverse implication is immediate. Therefore a Hodge metric exists exactly when an invariant one does.
Here is the Riemann bilinear criterion for a period matrix, with the signs kept explicit. For the period matrix of a complex torus, use real coordinates along the lattice basis, so . An invariant real two-form is
Its period on the coordinate two-torus is ; these tori generate integral second homology. Thus integrality of the class is exactly . Positivity of a Kähler form makes nonsingular. Because the lattice basis is a real basis of , the complex matrix
is invertible: its rows recover the real and imaginary parts of the coordinates. In the coordinates , the matrix of the two-form is , whose inverse is .
The differential form of type (p, q) condition says that the two diagonal blocks of the form matrix vanish. Since the form is nonsingular, this is equivalent to the diagonal blocks of its inverse vanishing. Because is real, these inverse blocks vanish exactly when
Set . Skew-symmetry and reality of give , and the full inverse matrix is
Inverting these blocks identifies the two-form explicitly:
For a vector with complex coordinate column , evaluation yields . Hence this two-form is positive exactly when is a Hermitian positive-definite matrix. This proves both directions: an invariant Hodge metric gives such an integral , and any such produces a constant positive real closed -form of integral periods. In particular,
As a sign check, for and the last matrix is , and the associated form is .
For the specified two-dimensional complex torus, put
The real and imaginary period vectors are independent because , so they do form a full lattice. Suppose a polarization matrix existed. Its inverse is a rational skew-symmetric matrix, and hence has the block expression
The first condition of the Riemann bilinear criterion for a period matrix becomes
Separating real and imaginary parts gives and
The matrices on both sides have rational entries except for the factor . Irrationality of therefore implies and . For a symmetric two-by-two matrix the latter expression is , so . The candidate Hermitian matrix is now
Since , is symmetric and traceless, and is skew-symmetric, and . Thus . A Hermitian positive-definite matrix has strictly positive eigenvalues, hence strictly positive trace. This contradiction proves
With the same squared-error normalization as in Question 2, the ridge estimator solves
The unpenalized intercept in ridge regression is because the columns of are centered. Differentiating the remaining quadratic objective gives . Since , the left matrix is positive definite even when is rank-deficient. Thus the closed-form ridge regression estimator is
The second equality again uses centering. If the penalty convention is with an unnormalized squared-error term , replace by throughout; the limiting assertion is unchanged.
For the full-column-rank case, take a singular value decomposition with positive singular values . The ordinary least squares estimator, which is the slope maximum-likelihood estimator in this normal linear model, and the ridge regression estimator are respectively
Consequently principal-component shrinkage by ridge regression multiplies the least-squares coordinate in direction by . Ridge shrinks most strongly in directions with the smallest singular values. These are combinations of predictors that the data distinguish least well.
Near multicollinearity creates small singular values, and the factor in ordinary least squares greatly amplifies noise in those directions. Its coefficient variance there is , while the ridge variance is
which is smaller. The price is bias: the expectation of the ridge coordinate is times the corresponding true coefficient. This bias-variance tradeoff can substantially reduce estimation and prediction error when the poorly identified directions do not contain an excessively large signal. It is not a guarantee of improvement for every coefficient vector. Adding to every eigenvalue also improves the condition number of the normal matrix and makes numerical inversion more stable.
To handle every rank and every relation between and , put and use its spectral theorem for real symmetric matrices. Choose an orthonormal eigenbasis with eigenvalues , and put . Then
If , then , so and . Thus these terms are exactly zero for every positive ; there is no divergent component in the null space. Each remaining term converges to . By the definition of the Moore-Penrose pseudoinverse,
and therefore
This proves the vanishing-penalty ridge limit without an invertibility assumption. The limit is the minimum-norm least-squares solution: every other least-squares solution differs by a vector in , orthogonal to the displayed solution, and therefore has at least as large a Euclidean norm.
Write , let be the identity matrix, let be the -by- all-ones matrix, and put , with one diagonal block per experimental block. The variance-covariance matrix is
Its orthogonal decomposition is obtained by first subtracting each block's sample mean, then subtracting the grand sample mean from the block means. More explicitly, writing for coordinate in block , the three invariant subspaces are
They are pairwise orthogonal, with dimensions , and , and their direct sum is . On , both and vanish. On , and . On , and . Thus the eigenvalues and corresponding invariant subspaces are
If some eigenvalues coincide, their eigenspace is the direct sum of the listed subspaces with that value. Zero-dimensional rows are omitted when or . For an admissible covariance matrix the eigenvalues on nonzero subspaces must be nonnegative; these conditions are also sufficient for positive semidefiniteness. The expectation parameters do not affect this calculation.
Work in , the domain of the matrix ; the printed in the introduction is a dimension typo. For a fixed nonempty support of a vector , write for the coordinates of in . Then
The Gram matrix is a Hermitian matrix, so its difference from the identity matrix is also a Hermitian matrix. By the finite-dimensional spectral theorem, its matrix 2-norm is the largest absolute eigenvalue, equivalently
Indeed, an expansion in an orthonormal eigenbasis bounds every Rayleigh quotient by the largest absolute eigenvalue, and an appropriate eigenvector attains that bound. The restricted isometry constant must bound this quantity for every of size at most , and the maximum of these quantities suffices for all sparse vectors of order . There are finitely many sets, so the maximum exists. The empty set contributes zero. Therefore
Use the natural empty-sum convention for cumulative coherence. This is needed for the printed case . For the conclusion is immediate. Otherwise let be its support of a vector, with . The Gram matrix has diagonal entries one because the columns have unit Euclidean norm. Each off-diagonal row sum is bounded by
The last inequality uses monotonicity of cumulative coherence: enlarging an index set only adds nonnegative summands. There are enough indices to enlarge it because .
The Gershgorin circle theorem places every eigenvalue of within distance of one. Since is a Hermitian matrix, its eigenvalues are real, and the finite-dimensional spectral theorem gives
This is the cumulative coherence bound for restricted isometry. The lower bound remains valid when , although it is then nonpositive. No assumption that the matrix is already a near isometry is required. The distortion is bounded by on every order- sparse vector.