Two isospectral manifolds remain isospectral after taking a Riemannian product with the same closed factor: eigenvalues add, with multiplicities given by the product Laplacian eigenspace decomposition. For nonisometric closed connected factors , choose . Every closed product geodesic of length less than has constant projection to , since a nonconstant closed geodesic shorter than the injectivity radius is impossible. The short coordinate geodesics of the small flat torus span exactly its tangent factor at every point. Any product Riemannian isometry must preserve that intrinsically defined smooth distribution and its orthogonal complement, hence restrict to an isometry of the original factors. Thus these products are still nonisometric. Taking to be four-dimensional tori proves the higher-dimensional stabilization statement without assuming a cancellation theorem for arbitrary products.
Lax-Milgram theorem Created 2026-09-24 Updated 2026-10-14
The theorem supplies solvability for a coercive weak formulation.
A bounded bilinear form on a real Hilbert space that is a coercive bilinear form represents every bounded linear functional uniquely: for each , there is a unique with for every .
For a proof, the Riesz representation theorem gives a bounded linear operator and a vector with and . Coercivity and the Cauchy-Schwarz inequality give , so is injective and its image is closed: convergence of makes a Cauchy sequence, whose limit supplies the image limit. If belongs to the orthogonal complement of the image, then for every ; setting and using coercivity forces . Thus the image is also dense and equals . There is consequently a unique with , and . The complex version uses a bounded sesquilinear form with .
Multiresolution analysis Created 2026-09-24 Updated 2026-10-14
A multiresolution analysis organizes a function into successively finer approximation spaces. In the usual orthonormal construction on , these are closed linear subspaces with
Rescaling relates the levels: if and only if . Integer translates of a scaling function form an orthonormal basis of . The detail space is the orthogonal complement of inside , giving . Coarse information and new details therefore fit together without overlap in squared L2 norm.
For the Haar wavelet, consists of square-integrable functions constant on cells of length . Splitting every cell into two halves creates one new contrast per old cell, the Haar refinement identity. On the bounded example , the first three spaces have dimensions : a whole-interval mean, two half-interval means, and four quarter-interval means. The Haar projection diagram displays those three resolutions. This bounded construction starts at level zero; the displayed intersection condition refers to the full family on the real line.
The usefulness is a controlled way to increase resolution. Earlier coarse information remains available while new wavelet coefficients identify what the finer description adds. The wavelet approximation complexity connects this extra resolution to both approximation error and the number of coefficients being estimated. [ref]
The new subspace is the orthogonal complement of the old subspace of cusp forms for the Petersson inner product. A form belongs to it precisely when the adjoints of all lower-level oldform by argument dilation maps annihilate it.
The old subspace is spanned by for cusp forms of level , where and . It is stable under the Hecke operators, but need not have a basis of eigenvectors for every bad-prime operator. Its Petersson inner product orthogonal complement is the new subspace of cusp forms.
Orthogonal direct sum Created 2026-10-07 Updated 2026-10-14
An orthogonal direct sum is a direct sum whose distinct summands are mutually orthogonal. For and , the Pythagorean identity gives . In a Hilbert space, a closed subspace of a Hilbert space and its orthogonal complement give an orthogonal direct sum of the entire space. The component maps are orthogonal projections and have operator norm one when their ranges are nonzero.
For a real matrix and a fixed vector , every vector in the image of a linear map defined by is orthogonal to exactly when . Indeed, . If this vanishes for every , choose to obtain . Equivalently each column of is orthogonal to . Requiring the statement only for nonzero changes nothing, since the zero input already has zero dot product. This is the orthogonal complement relation between the image of a linear map and the kernel of a linear map defined by its transpose.
Orthogonal projection matrix Created 2026-09-24 Updated 2026-10-14
A matrix represents a linear projection when applying it twice has the same effect as applying it once. For an orthogonal projection with the standard Hermitian inner product on , the additional condition is that the conjugate transpose equals the original matrix:
Thus is both idempotent and a Hermitian matrix. Over the real numbers this says . Its image of a linear map is the retained linear subspace, while its kernel of a linear map is the orthogonal complement: vectors in the image are unchanged, and vectors in the kernel become zero.
For a matrix with full column rank, projecting onto its column space gives
The invertibility of follows from linear independence of the columns. If those columns are an orthonormal set, and . These formulas and the conditions in the real case are developed in MIT 18.06SC, Projections onto Subspaces, pp. 1–3.
For the line spanned by ,
In particular, and . The eigenvalues are on the retained direction and on the removed direction. This exposes the meaning of an orthogonal projection as retaining selected components, rather than stretching them.
Symmetry refers to the specified inner product. In the real weighted setting, the formula becomes and satisfies and . For the preceding weighted line example,
It is not symmetric under the ordinary transpose, but it is an orthogonal projection for the weighted Euclidean inner product. The matrix criterion should therefore be used with the standard Hermitian inner product, not silently transferred to a different geometry.
For a real skew-symmetric matrix , is symmetric and . On an eigenspace with eigenvalue , every unit vector has unit partner , orthogonal to , with and . Its plane and its orthogonal complement are invariant under . Repeating gives real orthogonal two-dimensional blocks and a zero block. Thus every nonzero eigenvalue of has even multiplicity, the zero multiplicity has the parity of , and the number of distinct eigenvalues is at most for even and for odd . Distinct positive block parameters attain the bound, with one zero direction added when is odd.
Let and choose an auxiliary vector with . Its component perpendicular to is . Then all solutions of the Cartesian equation of a plane are
The two free directions are nonzero, perpendicular to each other and perpendicular to , so they span its two-dimensional orthogonal complement. This proves completeness as well as direct substitution. If , then . If the dot product is nonzero, another complete form is .
The eigenvector has eigenvalue . On its orthogonal complement, write vectors as . The eigenvalue equation becomes
Hence the ordered eigenvalues of the covariance matrix are , , and . The first two principal components explain
of the total variance. The denominator is the sum of all eigenvalues, which equals the trace.
First work over a field of characteristic different from two. If a nonzero symmetric bilinear form had for every vector, polarization would give
a contradiction. Hence choose with . Every decomposes uniquely as
with the second summand orthogonal to . Induct on the orthogonal complement to obtain a diagonal basis. If the restricted form becomes zero, any basis of that remaining space completes the diagonalization. In this basis the rank of a quadratic form is exactly the number of nonzero diagonal coefficients; the remaining basis vectors span its radical of a bilinear form.
Over the reals, rescale the nonzero basis vectors so the diagonal entries are copies of , copies of and zeros. Define the signature of a quadratic form by , so . To prove it is basis independent, note that is the largest dimension of a linear subspace on which the form is positive-definite. The positive coordinate linear subspace attains dimension ; on any other positive linear subspace, projection to those positive coordinates is injective, since its kernel has nonpositive quadratic value. Thus its dimension is at most . The same argument for the negative form characterizes . This proves Sylvester's law of inertia and that the signature is well-defined.
Let and be positive and negative normalized basis vectors, and let be the radical of a bilinear form. The span of and for is a totally isotropic subspace: all mutual bilinear pairings vanish. Its dimension is . Conversely, project any totally isotropic subspace to the nondegenerate positive-plus-negative quotient. The projected linear subspace is still null, and its projections to both the positive and negative coordinate spaces are injective: a vector with one component zero would have strictly signed quadratic value unless it vanished. Its dimension is therefore at most , while the kernel of the quotient map on has dimension at most . Hence
This proves both construction and sharpness of the maximum dimension of a totally isotropic subspace.
For the five-variable example, the symmetric coefficient matrix is
Its cyclic structure makes the vectors , , eigenvectors with eigenvalues . Thus the eigenvalues are
Their product is , and three are positive and two negative. Therefore
The real and imaginary parts of each conjugate pair of eigenvectors give the corresponding real two-dimensional eigenspaces, consistent with the real inertia calculation.
For a compact Lie group , the complex representation ring of a compact group is the Grothendieck group of finite-dimensional continuous complex group representations, with the relations . Multiplication is , and the unit is the trivial one-dimensional representation. The ring of class functions is
with pointwise addition and multiplication. The character of is . The trace identities for direct sums and tensor products make
a well-defined ring homomorphism .
Normalize Haar measure by . Averaging a positive definite Hermitian inner product gives
which is positive definite and -invariant. This proves unitarization of a compact-group representation. In a unitary representation the orthogonal complement of an invariant subspace is invariant. Induction on dimension therefore gives complete reducibility of compact-group representations. Hence every element of is a finite integral linear combination of irreducible classes.
We establish the needed character orthogonality for compact groups carefully. For irreducible unitary representations , let act on by
Its average is a projection onto : averaging makes every image invariant, and it fixes every intertwiner. The trace of this action is , since the inverse of a unitary matrix has conjugate trace. Taking the trace of the projection gives
For completeness, Schur's lemma follows here from invariance of the kernel and image of an intertwiner. A nonzero intertwiner between irreducibles is an isomorphism. An endomorphism of an irreducible complex representation has an eigenvalue ; the noninvertible intertwiner must vanish. Thus the last dimension is one for isomorphic irreducibles and zero for inequivalent ones.
If a virtual character vanishes, integrating it against gives for every irreducible . The irreducible multiplicities therefore distinguish the classes, and
This also proves that two finite-dimensional representations with the same character are isomorphic.
For SU(2), the irreducibles are , , of dimension . One can see this classification through the usual operators : a highest-weight vector has , , and the relations , , give, by induction,
The torus weights are integers. If but , the identity at forces . The vectors span an invariant irreducible module, which in an irreducible representation is the whole space. This is the symmetric-power module. Conversely its successive monomial weight vectors are linked by with nonzero coefficients, proving its irreducibility. Thus the classification of finite-dimensional representations of SU2 gives every irreducible, rather than just a list of examples.
On the maximal torus , their characters are
With , multiplication gives , starting with . Hence each is a monic integral polynomial of degree in . For example and . They form a basis over , so
The character map realizes this ring as the finite integral polynomials in , interpreted as continuous class functions. Its image is not the whole infinite-dimensional ring of continuous class functions; injectivity is the assertion being proved.
Proceed by induction on . The zero-dimensional case has the empty orthonormal basis. In positive dimension, the fundamental theorem of algebra gives a root of the characteristic polynomial, hence a unit eigenvector of , say with eigenvalue . Part (ii) makes it an eigenvector of as well. Thus the line spanned by and its orthogonal complement are invariant under both operators by the introductory adjoint argument.
On , the restriction of is the adjoint of the restriction of , and the restrictions still commute. The restricted linear operator is therefore normal. By induction it has an orthonormal basis of eigenvectors. Adjoining proves an orthonormal eigenbasis exists for , establishing the finite-dimensional spectral theorem by construction.
For the final deduction, use this orthonormal basis and write . Define
The real nonnegative diagonal entries make a Hermitian operator, and the modulus-one diagonal entries make a unitary operator. Both are diagonal in the same orthonormal basis, so they commute and even when . This proves the required factorization without assuming invertibility.
Conversely, if with , , and , then and
Thus is normal. Normality is equivalent to a commuting Hermitian–unitary factorization, with the Hermitian factor even selectable nonnegative. This is the polar decomposition with a unitary extension on the kernel.
Normalize the riskless financial asset to , , and write for the risky asset prices. Their discounted gain random vector is . A zero-cost portfolio holding in the risky assets and in the riskless asset has terminal value . Thus an arbitrage means
An equivalent martingale measure is a probability measure with the same null sets as , under which is integrable and . The discounted risky prices are then martingales over the single trading period.
If such exists, a nonnegative terminal gain has expectation zero under . A nonnegative random variable with zero expectation vanishes almost surely: on its expectation is at least , and the union of these events is . Equivalence transfers this conclusion to , excluding arbitrage.
For the converse we prove the needed positive-density separation proof of the one-period asset-pricing theorem. First make the gain integrable without changing its null sets. Define an equivalent probability measure by
Let and let be its orthogonal complement. Taking a finite basis of shows almost surely. If , the gain is zero and already gives the required measure. Otherwise consider the positive-weight expectation cone
Positive combinations of weights show that is a convex cone. It is open relative to . Indeed, for any admissible weight , perturb it to
These weights remain bounded and strictly positive, while
For every nonzero , is nonzero on an event of positive probability; otherwise . Consequently
The matrix is finite because . The kernel of on is zero, so it defines an invertible matrix on the finite-dimensional vector space . For any sufficiently small , every with is the image of a vector in the radius- ball, since . Hence the perturbations give a neighborhood of zero, proving relative openness of .
If , the hyperplane separation theorem gives a nonzero with for every . The separating constant can be taken to be zero because is a cone. Put and use the strictly positive weights . Taking the limit as yields , forcing . But , so . This is an arbitrage, a contradiction. Hence : some bounded strictly positive satisfies . Normalize it by . This gives an equivalent martingale measure with integrable gains, establishing the fundamental theorem of asset pricing here without any further existence theorem.
Now retain only the positive-probability states of the finite probability space. Let be the linear span of the discounted terminal asset payoffs; it contains the constant vector . A complete market means . An equivalent martingale measure is a vector of strictly positive state probabilities whose pairing with each asset payoff gives its initial price. By linearity it prices every attainable payoff. If , the indicator functions of individual states are attainable, so these prices determine every uniquely.
If is proper, choose . Since , . For sufficiently small , both and have strictly positive entries, sum to one, and give the same pairings with every asset payoff. They are distinct equivalent martingale measures. Therefore market completeness is equivalent to uniqueness of the equivalent martingale measure.
Put and use the continuous functional calculus . It is a unital star-homomorphism taking the coordinate function to . This follows from the commutative C-star theorem applied to , together with spectral permanence for C-star subalgebras, which is among the permitted C-star results.
Take the Hilbert space inner product linear in its first variable. For a vector , let . This cyclic subspace is invariant under every and its adjoint, so it is reducing. The functional is positive because implies . It has, by the Riesz-Markov-Kakutani representation theorem, a finite regular positive Borel measure on . The identity
makes an isometry on its quotient by the functions of zero norm. Density of continuous functions in extends it to a unitary . Multiplication by a continuous function intertwines with on this subspace.
Choose a maximal family of mutually orthogonal nonzero cyclic reducing subspaces. Their orthogonal sum is all of : otherwise its reducing orthogonal complement contains a nonzero vector generating another such subspace. This argument does not require separability. For a bounded Borel measurable function on , multiplication on every is bounded with norm at most . Define on that orthogonal sum
Multiplication operators satisfy , and . The same identities hold for their direct sums, and the norm bound is uniform in . Thus is a norm-decreasing unital star-homomorphism on the algebra of actual bounded Borel measurable functions, and because it extends . No quotient by a single unspecified measure is being substituted for that Borel algebra.
Choose the bounded Borel measurable square root and for , taking . Let . Then
Thus every bounded normal operator has a normal square root. The Borel branch is essential in general: on a circle winding about zero a continuous square-root branch need not exist.
Since and , is an orthogonal matrix in the special orthogonal group. It also satisfies and thus preserves the dot product. Normalize the fixed eigenvector to . For ,
so the orthogonal complement of the fixed axis is invariant. Choose an oriented orthonormal basis . In this basis the matrix has form , where is a real orthogonal matrix of determinant one.
Write the first column of as . Its unit second column must be perpendicular to the first; positivity of the determinant selects . Thus , and fixes the axis through while rotating its perpendicular plane by . Since trace is invariant under change of basis,
This proves that is the required axial rotation. The trace determines the unsigned angle; the action in the oriented perpendicular plane determines its sign. The identity case has angle zero and any axis.
Let be the isometry. Since , it preserves norms, and the polarization identity applied to distances gives . For an orthonormal basis , the vectors are again an orthonormal basis, and
Expanding in that basis proves . Hence is a linear map represented by an orthogonal matrix .
A reflection in a hyperplane with nonzero normal is . If , choose . Because , substitution shows . If they agree, no reflection is needed. The resulting orthogonal transformation fixes and preserves its orthogonal complement. Apply the same construction there to fix ; the second normal is perpendicular to , so the first vector remains fixed. Finally the restriction to the remaining line is either the identity or negation; in the latter case a third reflection, normal to , fixes it. Reversing these steps writes as a product of at most three reflections, each in a plane through the origin. This proves the three-dimensional case of the Cartan–Dieudonné theorem.
Three reflections are sometimes necessary. The map is the product of the three coordinate-plane reflections. Its determinant is , excluding zero or two reflections. A single plane reflection fixes a two-dimensional vector subspace, whereas fixes only zero, excluding one. Thus the bound is sharp.
Under the unrestricted model, insert the maximum-likelihood estimates . Under the diagonal-covariance restriction, the quadratic form is minimized over the mean at , and the remaining objective separates over the diagonal entries:
Differentiating in gives ; the derivative changes from negative to positive there. Put . The fitted trace term is under either model, since . Consequently the likelihood-ratio test statistic is determined by
This is the Gaussian diagonal-covariance likelihood-ratio test. Reject for sufficiently small , equivalently for large . Under the regular large-sample calibration, Wilks theorem gives , since diagonality removes that many free covariance parameters. The exact critical constant can instead be obtained from the null distribution at the actual sample size.
For , write the sample correlation coefficient as . Then , so the likelihood-ratio test rejects for large , not merely for large positive . Under the null, the two variables have a bivariate normal distribution and are independent, and the exact test is
Indeed, condition on the centered first-variable observation vector. Decompose the second centered Gaussian vector into its component along that direction and the -dimensional orthogonal complement. Their squared lengths give independent and variables. Their ratio shows that has Student's t-distribution with statistical degrees of freedom.
With the divisor- sample covariance matrix defined above, the maximum-likelihood estimators are
Their joint sampling distribution is specified by
Here uses the Wishart distribution convention . Thus the covariance maximum-likelihood estimator has expected value ; the unbiased estimator of the covariance matrix is . These distributions follow from orthogonal projections of the jointly multivariate normal observations onto the constant-observation direction and its orthogonal complement, though no proof is required here. The covariance maximum in the positive-definite parameter space requires nonsingular, which holds almost surely when and is positive definite. Otherwise the rank of a centered sample covariance matrix shows why the usual unrestricted finite maximum does not exist.