Write . If is a best approximation, then for every and real , the competitor satisfies
The linear coefficient must be zero, since otherwise choosing sufficiently small of the appropriate sign makes this expression negative. Hence . In a real inner product space this is the desired orthogonality; in a complex inner product space, apply the same argument to to show that the imaginary part also vanishes. Thus for all .
Conversely, suppose this orthogonality holds. Every competitor has . The Pythagorean identity then gives
Equality forces . We have proved the characterization, as well as uniqueness:
This is the orthogonal projection onto a finite-dimensional subspace. Completeness of the ambient space is not needed. Existence follows, for example, by solving the invertible Gram matrix system in a basis of the finite-dimensional linear subspace.
Let be a finite-dimensional real or complex inner product space, and let be a unital subalgebra stable under the adjoint operator. Define its commutant of an operator algebra by . The double commutant theorem for star-algebras asserts . The inclusion follows immediately from the definition; we prove the reverse.
Write , fix a basis , and act diagonally on . The linear subspace
is invariant under every diagonal . Since is closed under adjoints, its orthogonal complement is invariant too: for , . Hence the orthogonal projection onto commutes with every diagonal .
Writing as an by block matrix , this says , so each . If , it commutes with every , and its diagonal action therefore commutes with and preserves . Because , . Therefore there is one such that
Equality on the basis gives , proving the theorem over either scalar field.
The identity hypothesis is necessary. For a possibly nonunital adjoint-stable subalgebra, adjoining the ambient identity does not change its commutant of an operator algebra, so the exact statement is . For example has on a nonzero . Thus the usual exam formulation takes the algebra to contain the identity.
Here a reduced root system is crystallographic, as appropriate to a semisimple Lie algebra. It is a finite spanning set in a real inner product space of dimension , invariant under each Weyl reflection
with for every pair of roots and . A base of a root system is a basis such that the coefficients of every root are integers that are either all nonnegative or all nonpositive. These define the positive system of a root system. We use the existing Cartan matrix convention
Using the alternative denominator transposes all the matrices below.
The classification of rank-two root systems gives , , , and . In orthonormal coordinates we may choose the following simple roots and Cartan matrices:
  • For , take , and . The positive roots are .
  • For , take , and . The positive roots are .
  • For , take the long root and short root , giving . The positive roots are . Interchanging the long and short convention gives type , which is the same rank-two classification up to the usual identification.
  • For , take the short root and long root , giving . The positive roots are .
Each complete root system consists of these positive roots and their negatives. To see why the list is exhaustive, the off-diagonal Cartan matrix entries of two distinct simple roots are nonpositive integers, and their product is . Thus the product is or , corresponding to simple-root angles or . These determine the four systems and their length ratios.
The Weyl group of a rank-two root system is generated by the two simple Weyl reflections. Their product is a rotation of order , respectively, so the groups are the dihedral groups of order . The first is also the Klein four-group and the second the symmetric group . The root-orthogonal lines cut the plane into Weyl chambers, each of angle . A chosen fundamental chamber of a root system is , ; its walls are the two root-orthogonal lines. The Weyl group acts simply transitively on these open chambers.
Figure 1.
Roots, reflecting lines and a fundamental chamber for the four crystallographic rank-two root systems
. Details.
The crystallographic hypothesis matters: if the integer-pairing condition is dropped, reduced noncrystallographic systems of type also occur. They are not additional Lie-algebra root systems.
The appropriate abstract object is a finite reduced crystallographic root system in a real inner product space . Its axioms are: is finite, spans , and does not contain zero; for , ; each root reflection
permutes ; and every Cartan integer is an integer. The restriction to a reduced root system and crystallographic integrality distinguishes roots of complex semisimple Lie algebras from more general reflection configurations.
For any two roots of a root system, the Cauchy-Schwarz inequality gives
If the inner product is zero, both Cartan integers vanish. Otherwise their signs agree, and the absolute value of each is a positive integer. Dividing their product by an integer of absolute value at least one proves
For nonproportional roots the product is strictly less than four. In a reduced root system, proportional roots are just and have Cartan integers , so the printed bound is intentionally looser than the resulting bound of three.
A fundamental system of a root system is a basis of made of roots, such that each root is an integer combination of with either all coefficients nonnegative or all nonpositive. Its members are the simple roots. Suppose distinct had . Then
has a positive coefficient of and a negative coefficient of , contradicting the defining sign condition. Thus . Distinct simple roots are linearly independent, so their Cartan-integer product is strictly less than four. Combining integrality and the sign condition gives
Here nonpositive is the intended sense of the printed convention that includes zero among “negative” numbers; orthogonal simple roots really do give zero.
To form a Dynkin diagram, place a vertex at each simple root. Join two vertices by bonds, hence zero, one, two or three. A multiple bond has an arrow toward the short root. Indeed determines the squared length ratio, and the diagram with the Cartan matrix reconstructs the angles and relative lengths. A single bond joins equal-length roots.
The connected finite Dynkin diagrams are the following. The descriptions include bond multiplicities and arrow directions, so distinguish dual diagrams:
There are no other connected finite Dynkin diagrams. Low-rank conventions also identify and ; is disconnected, so introduces no further connected type. Affine diagrams are outside this finite classification.
Finally suppose the underlying graph contained a cycle on distinct simple roots . Put . Any bonded pair has
and all other distinct pairs have nonpositive inner products. The cycle contributes at least bonded pairs, so
But the simple roots, and hence these normalized vectors, are linearly independent, making the displayed sum nonzero. Positive definiteness gives a contradiction. Thus the underlying graph of a finite Dynkin diagram has no cycle. This acyclicity of a finite Dynkin diagram argument also excludes cycles with extra chords or multiple bonds; multiple bonds themselves are not treated as two-edge cycles.
For a complex semisimple Lie algebra , a Cartan subalgebra is a maximal abelian subalgebra consisting of elements whose Adjoint representation matrices are diagonalizable. Equivalently it is a nilpotent self-normalizing Lie subalgebra. The root-space decomposition is
where the roots are the nonzero weights of that Adjoint representation.
We use these properties of the Killing form : it is nondegenerate on and on , it is invariant, distinct root spaces are orthogonal unless their roots sum to zero, and pairs nondegenerately with . Define by , and choose , with . Since weights add, , and invariance gives
The nonisotropic root lemma shows . Here is its short proof: if this number were zero, the span of would be a solvable Lie algebra with central. Apply the Lie theorem to its action on . The commutator would be strictly upper triangular and hence nilpotent. But makes it diagonalizable. It would therefore be zero, putting in the zero center of a Lie algebra of , contrary to its definition. Set
Then
so their span is the sl2 subalgebra associated with a root.
The abstract reduced crystallographic root system axioms are as follows. In a finite-dimensional real inner product space , the set is finite, consists of nonzero vectors and spans ; for every , one has ; the root reflection preserves ; and is an integer for every pair of roots. We verify the positive-definite real form as well as these axioms, rather than assuming the complex Killing form is already positive.
First is finite and has no zero element by its definition. The roots span over : any annihilated by all roots commutes with the whole root-space decomposition and is central, hence zero. Therefore the , and also the , span over . For every root , the classification of finite-dimensional sl2 representations applied to the Adjoint representation of the root subalgebra gives . Put . Every root takes real values on this space, and
The strict inequality follows because the roots span . This also shows that the complexification of injects into : an equality with real would contradict positivity of and . Since its complex span is all of , it is a real form. Moreover , so is a real scalar multiple of . The dual inner product thus makes a Euclidean space, as in the Euclidean subspace of a Cartan subalgebra.
To prove reducedness without assuming it, consider the root-subalgebra module
with absent root spaces understood to be zero. Its weights are even, so every nontrivial Irreducible Lie algebra representation in it has even positive highest weight and one-dimensional weight-zero space. The action of on its weight-zero space has image exactly , of dimension one. Therefore there is precisely one nontrivial irreducible summand, the already embedded adjoint module of highest weight . Thus and . If is any root on the same real line, the integral numbers and have product . Hence is one of ; the half and double cases are excluded by applying the preceding argument to the appropriate root. This proves the root-space reducedness lemma and .
For a root not parallel to , the sum of root spaces is stable under the root . Its integer weights are symmetric under sign in each irreducible summand. Therefore the weight also occurs, at the root . The Killing form normalization gives
so this root is exactly . For the reflection just swaps the two roots. This proves reflection invariance and the Cartan integer condition. All axioms of the reduced crystallographic root system have now been verified.
A normalization is important here. I use the covolume-one theta function of a fractional ideal, for which the requested limit is , and also give the formula for the unnormalized Gaussian theta sum.
Let , let , and choose one field embedding for each Archimedean place. The Minkowski embedding of a number field identifies
with a real inner product space having
Its Euclidean Lebesgue measure is . With this convention, the covolume of a fractional ideal lattice is
where is the field discriminant and is the positive absolute norm of a fractional ideal. Thus the Euclidean lattice has covolume . Define
This Gaussian theta sum converges absolutely whenever every .
The trace dual of a fractional ideal is
Here is the inverse different. Since , we have . There is a subtle distinction between the trace pairing and the positive inner product: the dual lattice of is , where the bar conjugates the complex coordinates and fixes the real ones. Indeed,
Consequently . Coordinatewise complex conjugation preserves the weighted squared lengths in the Gaussian theta sum.
Here are the precise analytic formulas used in the proof. For a Schwartz function on , take the Fourier transform to be
For a full Euclidean lattice of covolume , the Poisson summation formula for a Euclidean lattice is
For , the Gaussian Fourier transform, applied in orthonormal real coordinates, gives
More generally, for a real positive-definite matrix that is symmetric. Each complex coordinate contributes two real coordinates, which explains its exponent .
Apply the Poisson summation formula for a Euclidean lattice to , whose covolume is , and use the preceding description of its dual lattice. The anisotropic theta functional equation is
For comparison, the unnormalized Gaussian theta sum
has the functional equation
and its corresponding limit is rather than . Explicitly, our normalization is .
For the small-parameter asymptotic of a lattice theta sum, means that every coordinate tends to zero. In , the zero lattice vector contributes . Every nonzero vector contributes a term tending to zero. Once every , all these terms are bounded by the summable Gaussian theta sum . The dominated convergence theorem therefore gives . Using the anisotropic theta functional equation,
The condition that every coordinate tends to zero matters; alone would not justify this argument.
Put . If minimizes distance, then for every and every real ,
Both signs of arbitrarily small force . In a complex inner product space, apply the same argument to to obtain the imaginary part too. Conversely, if is orthogonal to the subspace, the Pythagorean theorem for inner product spaces gives
Thus orthogonality characterizes the unique best approximation:
Finite dimension also guarantees existence by solving the invertible Gram matrix normal equations; completeness of the ambient inner product space is unnecessary.
Use the nonnegative sign convention for the Laplace-Beltrami operator; the ambient Laplacian has the same sign convention. Changing both signs changes the signs of the eigenvalues below. Let be an orthonormal basis of , and let be the unit-speed geodesic with and . The geodesic Hessian formula gives
Indeed, the second derivative along a geodesic is , because its covariant acceleration is zero. Taking the trace of the Hessian matrix in this orthonormal basis gives the displayed Laplace-Beltrami operator.
For the sphere, put , where , and write for a smooth ambient function. The Euclidean metric becomes and its volume form is . The coordinate formula for the Laplace-Beltrami operator therefore gives the polar-coordinate Laplacian identity
For , restriction to yields
This relation also has a direct geodesic proof. At a point , complete an orthonormal basis of the tangent space by the radial vector . Each great-circle geodesic satisfies . The chain rule gives . Summing and comparing with the ambient trace gives precisely the radial correction above.
Let be the space of homogeneous polynomials of degree on , and let be its subspace of harmonic polynomials. For , homogeneity gives . Substituting in the polar-coordinate Laplacian identity proves that its restriction is a spherical harmonic with
Restriction is injective on : if , homogeneity makes zero away from the origin, hence everywhere.
To count and exhaust these eigenfunctions, use the harmonic decomposition of homogeneous polynomials
Here is an algebraic proof rather than an assumption about the spectrum. On polynomials put the Fischer inner product . Multiplication by is adjoint to , so multiplication by is adjoint to . In finite-dimensional inner product spaces, the orthogonal complement of the image of multiplication by is . This proves the decomposition. Multiplication by is injective, so
where the second term is zero for .
Iterating the harmonic decomposition of homogeneous polynomials and restricting to expresses every polynomial restriction as a finite sum of spherical harmonics. Polynomial restrictions contain constants and separate points of the sphere, so the Stone-Weierstrass theorem makes them uniformly dense in the continuous functions, and hence dense in . The Laplace-Beltrami operator is self-adjoint, and eigenfunctions with different eigenvalues are orthogonal. If a smooth eigenfunction had an eigenvalue not in the list, it would be orthogonal to a dense subspace and would vanish. If it had a listed eigenvalue, subtracting its orthogonal projection onto the corresponding finite-dimensional gives the same contradiction. Thus, for , the spectrum of the Laplacian on a sphere is
In particular, the zero eigenvalue has multiplicity one; on each positive eigenvalue has multiplicity two; on the multiplicity is .
Hecke operators give a commuting family of arithmetic symmetries of modular forms. They preserve the weight and cusp forms, and diagonalizing them turns the Fourier coefficients of a modular form into multiplicative arithmetic data. Odd weight spaces are zero by the action of ; in weight zero the operators act on constants by . For the substantive theory, fix an even positive weight and , and use the following normalization consistently.
Extend the slash operator for modular forms to by
It is a right action and positive scalar matrices act trivially. Let be the integral matrices of determinant . The determinant-n matrix representatives for Hecke operators for are
Integer row operations reduce the first column to , after which a row shear reduces modulo ; uniqueness follows from these same conditions. The Hecke operator is
Right multiplication by permutes the left cosets, so is again invariant under the weight- slash operator for modular forms. Each summand is a holomorphic function on the complex upper half-plane, and the coefficient formula below proves holomorphy at a cusp. Thus acts on and preserves . Geometrically, these operators sum over index- sublattices, or equivalently the associated finite-degree correspondences between complex tori; the factors above compensate for the weight's response to lattice scaling.
Write . The sum over is zero unless , in which case it is . Substituting into the displayed definition proves the Fourier coefficients of a composite-index Hecke operator formula
with . In particular, and . At a prime this becomes
where if .
The Hecke multiplication relations are
They can be checked by applying the coefficient formula twice and regrouping the divisors. More explicitly, coprime indices factor independently, so if . At a prime, separating the terms in the divisor sum according to whether one more factor is available gives
Iteration gives ; combining the prime factors gives the full relation. Hence all Hecke operators commute, , and the Hecke algebra of modular forms is generated by the together with scalars.
The Petersson inner product on the finite-dimensional cusp form space is
The integrand is invariant and the integral converges because cusp forms decay exponentially at the cusp. The Hecke operators are self-adjoint for the Petersson inner product at level one. To see the underlying adjoint calculation, unfold the finite correspondence for a determinant- matrix and change variable . The invariant hyperbolic measure and the determinant-normalized slash factors transfer from one side of the inner product to . Scalar matrices act trivially, so one can replace by the integral adjugate , which again has determinant . This reverses the correspondence and permutes the same collection of terms, with the same real prefactor . Summing gives
Commuting self-adjoint operators on a finite-dimensional inner product space admit a common orthonormal basis of eigenvectors. Thus has a basis of simultaneous Hecke eigenforms, with real eigenvalues.
A nonzero simultaneous cuspidal Hecke eigenform has : if and , comparison of the first coefficients gives for every , so . Normalize . Then
Consequently the full Fourier series is determined by the eigenvalues, and a simultaneous eigenvalue system has a one-dimensional eigenspace. The Hecke multiplication relations translate into
In particular the coefficients are multiplicative at coprime indices and are determined by the prime coefficients. This is the elementary multiplicity-one statement for normalized level-one Hecke eigenforms.
The Hecke eigenvalues are algebraic integers. One way to explain the arithmetic input is to use the rational structure supplied by the graded ring . The rational cusp form space has a basis with integral Fourier coefficients, for example from appropriate monomials in . Its subgroup of forms whose entire expansions are integral is a full lattice: a finite initial coefficient map is injective by the valence formula for the modular group, so it embeds this subgroup into a finite-rank integer module. The coefficient formula shows that every preserves this lattice, and therefore has a monic integral characteristic polynomial. Its eigenvalues are algebraic integers. Simultaneous diagonalization also makes their number field finite over ; conjugating the rational coefficient data gives another eigenform, whose eigenvalues are again real by self-adjointness. Thus the coefficient field is totally real.
For a normalized cuspidal Hecke eigenform, define its L-function of a cusp form by . The coefficient relations yield the Euler product of a Hecke eigenform
Indeed the prime-power recurrence gives , and multiplicativity assembles these factors. These identities hold analytically in an initial right half-plane, as well as formally. For instance boundedness of on the full complex upper half-plane gives , so suffices for absolute convergence.
The Mellin transform of a cusp-form L-function relates this arithmetic to the modular transformation:
Splitting at one and using gives
Exponential cusp decay makes the last integral entire in . This proves the analytic continuation and functional equation of the L-function of a cusp form, complementing its Euler product. The root number is .
Two examples show the scope of the theory. For even , the Eisenstein series is an eigenform with . This follows from its divisor-sum expansion and the same multiplicativity relations; its associated positive-index Dirichlet series is proportional to . The constant coefficient gives , so an eigenbasis of the cusp space together with gives an eigenbasis of the whole modular-form space. The ordinary Petersson inner product above is only used on the cusp space, where it converges. In weight twelve the valence formula for the modular group gives : cancellation of the first coefficients of two independent cusp forms would give a nonzero form with order at infinity at least two, exceeding . Thus the normalized modular discriminant is a Hecke eigenform; writing gives the Ramanujan tau function relations for coprime and .
Use the normalization
This is ridge regression; the penalty is the squared Euclidean norm. The centering removes the need for an intercept. Differentiating gives the normal equation
For every nonzero , . The coefficient matrix is therefore a positive-definite matrix, even if the design matrix has deficient matrix rank. The objective is a strictly convex function, so the unique minimizer is the closed-form ridge regression estimator, with fitted values
For the primal-dual identity for ridge regression, put and observe
Both parenthesized matrices are positive-definite matrices. Multiplying by their inverses gives
Thus the same fitted vector has the dual expression
No inverse of or alone was needed. This is also the kernel-ridge hat matrix for the linear kernel.
Here a positive-definite kernel means a symmetric real-valued function whose every finite kernel matrix is positive semidefinite: for all , and ,
This is the usual positive-semidefinite kernel convention; strict positivity for distinct points is not required. In particular . Write , and . Positivity of the two-point kernel matrix implies
If , substitute to obtain . If , the affine expression can be nonnegative for every only if . Both cases give the Cauchy-Schwarz inequality for positive-semidefinite kernels:
The zero-diagonal case is essential when the positive-definite kernel is not strictly positive.
To construct a feature map, let be the real vector space of finite formal linear combinations of symbols , one for each . Define a symmetric bilinear form by
The positive-definite kernel property makes this a positive semidefinite bilinear form. It need not yet be an inner product: distinct formal vectors can have zero squared length. The same quadratic-polynomial argument, now applied to , proves
Therefore implies for every . The set
is the radical of a bilinear form, hence a linear subspace. Set
The quotient vector space has a well-defined inner product: changing representatives by elements of changes no pairing, and a zero-length class is exactly the zero class. It is therefore an inner product space.
Define . By construction,
Every positive-definite kernel thus has a feature representation, including degenerate kernels and the zero kernel. This is its canonical feature space of a positive-semidefinite kernel. The construction already gives the requested inner product space.
A positive-semidefinite kernel on is a symmetric function such that, for every and ,
If for a feature map into an inner product space, then
Thus every feature-map inner product is a kernel. If , then each finite quadratic form for is the corresponding nonnegative linear combination, so nonnegative linear combinations of kernels are kernels.
A real linear operator on an inner product space is a positive-definite operator when it is self-adjoint and
for every nonzero in its domain. In the variational setting one normally requires the stronger uniform estimate for some , which is coercivity.
Use the standard Hermitian inner product . Since is invariant under every , it is in particular invariant under
Let and . Then
because and is orthogonal to . Thus is orthogonal to every , proving
Therefore is an invariant subspace for . If is irreducible, is either or . In finite-dimensional inner product space, , so these alternatives force or . Hence
No unitarity of was assumed; the inverse-adjoint representation is exactly what makes this orthogonal complement argument work.
For real vectors in a Euclidean inner product space, their Gram matrix satisfies the displayed identity by expanding the squared norm. Thus every Gram matrix is a positive semidefinite matrix, and it is a positive-definite matrix exactly when the vector family is linearly independent. The complex version replaces transposes by conjugate transposes and uses .
Positive-definite operator Created 2026-09-28 Updated 2026-10-14
A self-adjoint operator is positive definite when for every nonzero vector in its domain. In finite dimension it is invertible and has positive eigenvalues. In infinite dimension, strict positivity of individual quadratic-form values need not give a bounded inverse; the stronger uniform bound with supplies coercivity.
For maps and between finite-dimensional inner product spaces, with , the operator is positive definite. Its quadratic form is , whose zero set is . This uses the adjoint operator relation .
Pythagorean theorem Created 2026-09-28 Updated 2026-10-14
For a right triangle in Euclidean geometry with perpendicular side lengths and hypotenuse , the Pythagorean theorem states
Geometrically, the area of the square on the hypotenuse equals the sum of the areas of the squares on the other two sides. Euclid's Elements, Book I, Proposition 47 states this area equality; Proposition 48 states its converse: a triangle satisfying the equality has a right angle opposite side .[ref][ref]
For and , we compute . The triangle has area , and its side lengths form a Pythagorean triple. Conversely, a triangle measured to have sides must have a right angle between the sides and . This makes the equality both a calculation tool and a test for perpendicularity.
The three squares in the next figure have areas , and in squared length units. These are different from the central right triangle's area . The Pythagorean theorem adds the areas of the attached squares, not their side lengths and not the area of the triangle. The square on the hypotenuse is tilted, but a rotation preserves its area. This makes the formula visible without suggesting that the hypotenuse has to align with an axis.
Figure 1.
Squares on a 3-4-5 right triangle have areas ; the triangle itself has area
. Details.
Historically, Euclid's Elements records an organized proof of the Pythagorean theorem as an equality of areas, rather than the modern equation between numbers representing lengths. Its placement in Book I makes it available before the treatment of similar triangles in Book VI. This is evidence of how the result was established within that text; the name Pythagorean theorem alone does not establish who first discovered or proved it. The precise historical anchor here is the surviving proposition, rather than an unsupported story of a single inventor.[ref]
The dissection below makes the general identity tangible. Both outer squares have side and contain the same four congruent right triangles. In the first arrangement, their hypotenuses bound a square of side : adjacent acute angles together make a right angle. In the second, the uncovered regions are squares of sides and . Subtracting the same total triangle area from equal outer areas gives
For the pictured dimensions, the shared uncovered area is .
Figure 2.
Rearranging four congruent 3-4-5 right triangles proves that the uncovered square areas satisfy
. Details.
The same mechanism survives in inner product spaces: for orthogonal vectors , expanding the inner product gives . This is why orthogonal projection separates a squared distance into independent contributions. The familiar right triangle is the simplest picture of a much more reusable principle.
Real spectral theorem Created 2026-09-24 Updated 2026-10-14
The real case of the finite-dimensional spectral theorem says that a self-adjoint operator on a finite-dimensional real inner product space has a real orthonormal eigenbasis. In orthonormal coordinates this is the spectral theorem for real symmetric matrices, . The worked ellipse under finite-dimensional spectral theorem shows why both orthogonal diagonalization and orthogonality matter: the new coordinates separate the quadratic form into squares without distorting lengths or angles.
A real normal matrix need not have real eigenvalues. For example, the quarter-turn is an orthogonal matrix, but its characteristic polynomial is and its eigenvalues are . Over the complex numbers it has an orthonormal eigenbasis; over the real numbers it has no eigenvector. Self-adjointness supplies the reality conclusion in the real spectral theorem.