Cholesky decomposition as a sum of squares Created 2026-10-18 Updated 2026-10-31
For any real vector , a Cholesky decomposition gives the quadratic form identitySince is an invertible matrix, this squared Euclidean norm is positive whenever . The factorization thus certifies positive definiteness and gives coordinates in which the quadratic form is a sum of ordinary squares. For the matrix above,The level set is an ellipse; the linear map sends it to the unit circle. The points and go to and , respectively.
The same factor works in the reverse direction for Gaussian random vectors. If has independent unit-variance, zero-mean Gaussian random variables as coordinates, has covariance matrix . In this example and : their variances are and , while their covariance is . This is a concrete way to generate specified correlations from independent draws.
A triangular factor is not generally a square root of a matrix in the sense . Here . The Cholesky decomposition uses the product with the transpose, which is also what makes the quadratic form a squared Euclidean norm.
Coercive bilinear form Created 2026-09-24 Updated 2026-10-14
A real bilinear form on a normed vector space is coercive when there is one constant such thatThe lower bound uniformly controls every direction in the chosen norm. Unlike the upper bound defining a bounded bilinear form, it forces positive diagonal values at every nonzero vector. No symmetry is assumed. For complex Hilbert spaces, the usual analogue uses a sesquilinear form and ; it is not the same assertion for a complex bilinear form.
A concrete bounded and coercive example on , with the Euclidean norm, isIts quadratic form isThe best lower constant is , attained at . Nevertheless, and , so coercivity does not imply a symmetric bilinear form. The symmetric part of a matrix determines , while the skew-symmetric matrix part changes mixed pairings without changing . This is the symmetric and alternating parts of a bilinear form decomposition.[ref]
For the upper constant, direct multiplication gives . Its eigenvalues are , so the optimal upper constant, the spectral norm, is . The two constants answer different questions: how large a mixed pairing can be, and how small a self-pairing can be relative to squared norm.
Bounded saddle and flat-direction quadratic forms contrasted with a uniformly coercive bowl
. Details. The plotted quadratic forms show the mechanism: descends in one direction, leaves one direction uncontrolled, and controls both. These are self-pairings; their level sets cannot reveal the skew-symmetric matrix part. Calling a quadratic energy here refers to this diagnostic quantity, not to a claim that a nonsymmetric equation comes from minimizing an energy functional.
On a real finite-dimensional vector space with any norm, strict positivity for every nonzero does imply coercivity. Indeed the quadratic form is continuous, and its positive minimum on the compact unit sphere supplies . If is also a symmetric bilinear form, this is positive definiteness. For general , it is the symmetric and alternating parts of a bilinear form decomposition that isolates the positive part. Switching between equivalent norms preserves coercivity, but usually changes its constant.
The infinite-dimensional vector space distinction is explicit on the real l2 sequence space:The Cauchy-Schwarz inequality gives boundedness with , and for every nonzero vector. But with , so no positive works. On the span of , the best lower constant is : each finite restriction is coercive, but the control disappears as grows. Strict positivity is therefore weaker than a uniform lower bound.
The practical payoff is a stability estimate for a weak formulation. Assume is a real Hilbert space, is both a bounded bilinear form and a coercive bilinear form, and the load is a bounded linear functional. The Lax-Milgram theorem gives a unique satisfying for all , including nonsymmetric .[ref]
Introduction to Finite Element Methods by Christian Clason. §2.2, Theorem 2.7, pp. 20–21, equation (2.9): hypotheses, unique solvability and load bound
The dual norm measures load size. Testing with gives the short energy estimateFor the bound holds directly; otherwise divide by . Subtracting the equations for two loads and using the same argument gives . Thus a positive lower constant limits the response to load errors. The upper bound and completeness of the Hilbert space enter the existence theorem; the estimate itself uses the lower bound and the load's dual norm.For the displayed matrix , take . Then for every means , not , with this ordering of the bilinear form. Since ,For , the exact response is and . For , it is , with norm . The actual maximal amplification is the operator norm : the coercivity estimate is valid but need not be sharp for a nonsymmetric bilinear form.
Solutions for unit loads lie inside the coercivity bound, and response grows at most linearly with load norm
. Details. Determinant pairing is not an inner product Created 2026-10-25 Updated 2026-10-31
On real symmetric matrices of size , the displayed pairing is symmetric because . It is not bilinear: , whereas linearity would require . Its self-pairing is always nonnegative, but a nonzero singular matrix has , so positive definiteness fails as well. For it reduces to the ordinary real inner product. The Frobenius inner product supplies the appropriate bilinear, positive-definite geometry in every size.
Let be the vector space of real polynomials of degree of a polynomial at most . Choose distinct real sample points and positive real weights . Thenis an inner product. Symmetry and bilinearity follow from linearity of polynomial evaluation. Its value at is nonnegative, and equality forces all . By the root bound for a polynomial, a nonzero polynomial of degree of a polynomial at most cannot vanish at distinct points. Thus the form has positive definiteness.
Equivalently, the polynomial evaluation map on a finite point set identifies with , equipped with a weighted Euclidean inner product. Too few sample points destroy positive definiteness: if the distinct points number at most , the nonzero polynomial lies in and has zero sampled squared norm.
For three equally weighted samples at , an orthonormal basis isThis construction gives a finite sampling version of orthogonal polynomials and permits exact Gram-Schmidt orthogonalization using only finitely many evaluations.
Hermitian form Created 2026-09-24 Updated 2026-10-14
A Hermitian form is a sesquilinear form on a complex vector space satisfying conjugate symmetry,Hence is a real number for every vector. In a basis, the matrix of a Hermitian form has and obeys , equivalently : it is a Hermitian matrix. The coordinate rule remains . Conjugate symmetry does not imply positivity.[ref]
https://sites.math.washington.edu/~burke/crs/554/lectures/b-lecture4.pdf. Burke, Linear Analysis, Lecture 4, Hermitian symmetry
The diagonal contains more information than might be expected. For any complex sesquilinear form , put . Expanding four expressions gives the complex polarization identity in the linear-first convention:This is an algebraic identity, with no positivity assumption. If every is real, interchanging preserves the first difference and negates the second: use for . The identity then gives . Thus a complex sesquilinear form is a Hermitian form if and only if all its diagonal values are real. Testing only the basis vectors is insufficient: the off-diagonal example in sesquilinear form has zero diagonal entries in its matrix but a nonreal value at .
Consider the indefinite Hermitian formIts values at are . Moreover and are nonzero isotropic vectors: , yet . These vectors do not belong to the radical of a Hermitian form, and the usual Cauchy-Schwarz inequality would incorrectly require . An indefinite Hermitian form records signed geometry rather than defining a norm by .
There is a separate boundary case: is a positive semidefinite Hermitian form, since , but . Its radical of a Hermitian form is the entire second coordinate line. Positive definiteness is exactly the additional condition in a Hermitian inner product. The three examples below show why these distinctions matter: on the real slice , has an ellipse as its unit level, has hyperbolas, and has two parallel lines. These are slices of the complex examples, not drawings of their full four-dimensional domains.
Analytical illustration: real slices of positive definite, indefinite, and positive semidefinite Hermitian forms
. Details. Hermitian inner product Created 2026-10-14 Updated 2026-10-20
A Hermitian inner product is a Hermitian form on a complex vector space which has positive definiteness: for every nonzero vector . It is precisely a complex inner product. Only with this definiteness condition doesdefine a norm rather than a seminorm or an expression that may not be real. The standard Hermitian inner product on is ; positive weights give , with squared norm .[ref]
https://linear.axler.net/InnerProduct.pdf. Sheldon Axler, Linear Algebra Done Right, third edition, §6.A, definitions 6.3 and 6.9 and examples 6.4
A Hermitian inner product need not have a real matrix. For instance, with the linear-first coordinate convention,The last expression proves positive definiteness without a lengthy calculation of eigenvalues. For it gives , while for it gives . These unequal values expose why a silent switch to would change this particular Hermitian inner product: with these same entries it gives at . All entries must keep their roles from the matrix of a Hermitian form.
The Cauchy-Schwarz inequality for a Hermitian inner product statesEquality holds exactly when are linearly dependent, including when either is zero. For a nonzero , outline the proof by setting and . Then , and the Pythagorean theorem givesNonnegativity proves the inequality, while positive definiteness makes equality equivalent to . The scalar has no extra conjugate because the first argument is linear.[ref]
https://linear.axler.net/InnerProduct.pdf. Axler, Linear Algebra Done Right, third edition, orthogonal decomposition 6.14 and Cauchy-Schwarz inequality 6.15
The Cauchy-Schwarz inequality also holds for a positive semidefinite Hermitian form, but equality need not imply linear dependence: for , the independent vectors and give . Equality then describes dependence after passing to the quotient vector space by the radical of a Hermitian form. The indefinite Hermitian form in Hermitian form shows that conjugate symmetry alone does not even guarantee the inequality.
For a worked orthogonal projection, take , and . Then , and , with and for the squared norms. The residual is perpendicular in this Hermitian inner product even though its ordinary real dot product with is . For complex , the same orthogonal projection uses ; rotating multiplies by , while rotating multiplies by . This combines geometric decomposition with sensitivity to the relative complex arguments of the multipliers.
Analytical illustration: weighted orthogonal projection on a real slice and opposite changes of complex argument of its projection coefficient
. Details. A Hermitian inner product therefore supplies more than a positive diagonal: orthogonality, orthogonal projection onto a span, and the triangle inequality for its norm make approximation and distance meaningful. For the function space of complex continuous functions on , has positive definiteness, because a nonzero continuous function has positive modulus on a small interval. The same construction turns overlap under integration into lengths and best approximation in finite-dimensional vector subspaces.
Hessian matrix Created 2026-09-24 Updated 2026-10-14
The Hessian matrix describes how the slope of a function changes in different directions. For a real-valued function with continuous second partial derivatives on an open subset of , it isThe symmetry of second derivatives makes a symmetric matrix under these hypotheses. It is also the Jacobian matrix of the gradient: near , a small displacement changes by . Thus the gradient measures the current slope, while the Hessian measures its local variation. [ref]
For example, take the quadratic formIts gradient and Hessian matrix areThe only critical point is the origin. Completing the square gives , so the origin is a strict global minimum. The eigenvalues and are both positive, recovering the same conclusion from the positive definiteness of the Hessian. Its eigenvectors identify the rotated directions in which the quadratic form has its smallest and largest bending.
For a fixed vector , restriction to a straight line gives the directional interpretationThis is the quadratic form associated with the Hessian matrix. For a unit eigenvector , it equals the corresponding eigenvalue. Opposite signs therefore mean that some directions bend upwards and others downwards. The second-derivative test turns this information into a classification when the gradient vanishes.
The same object is useful for computation. Newton's method in optimization chooses a displacement by solving when the Hessian matrix is an invertible matrix; this makes the gradient of the local quadratic model vanish. For the displayed , the equation gives , so one exact step reaches the minimum from any starting point. For a general function, a Hessian with opposite-sign eigenvalues or a large condition number need not give a useful minimizing step, and the local minimum need not be a global minimum.
The name honors Otto Hesse. [ref]
https://web.mit.edu/course/other/wwmath/vectorc/minmax/hessian.html. MIT World Web Math: the Hessian and its namesake
An older geometric use is the Hessian criterion for flexes of a plane cubic, connecting a determinant of second partial derivatives with inflection points of an algebraic curve. Hesse's 1844 paper Über die Wendepuncte der Curven dritter Ordnung is an early source on that geometric problem. [ref]https://www.degruyterbrill.com/document/doi/10.1515/crll.1844.28.97/html. Hesse (1844), Journal für die reine und angewandte Mathematik 28, pp. 97–107: publisher's bibliographic record
Matrix decomposition 2026-10-14
A matrix decomposition expresses a matrix as a matrix product of factors with simpler structure. An LU decomposition uses triangular factors, a QR decomposition uses an orthogonal matrix and a triangular factor, and a singular value decomposition separates input directions, stretching factors and output directions. The factorization is an identity; the chosen structure determines what it helps compute.
For an original two-by-two example,The outer factors are a lower triangular matrix and an upper triangular matrix, each with unit diagonal as in a unit triangular matrix; the middle factor is a diagonal matrix. Their matrix product is , and the final diagonal entry is the Schur complement of the first entry . This is the scalar version of the factorization under block elimination.
To solve , solve with the three factors in their displayed order from left to right: first the lower triangular factor, then the diagonal factor, then the upper triangular factor. The intermediate vectors are and , giving the concise answer . A new right-hand side uses the same factors. This is why Reusing LU factors for multiple right-hand sides is useful: factorization records work that otherwise would be repeated, while forward substitution and back substitution apply it cheaply.[ref]
Convex Optimization by Stephen Boyd and Lieven Vandenberghe. §C.4.1, printed pp. 673–674: block factor-solve interpretation
Different decompositions reveal different features. A Cholesky decomposition uses positive definiteness of a symmetric matrix, while a singular value decomposition also applies to rectangular matrices and exposes matrix rank. The existence and numerical behaviour of the factors depend on their own hypotheses; for example, an unpivoted LU decomposition can fail when a chosen pivot element is zero even though the matrix is an invertible matrix.
In a homogeneous overlapping two-component Bose-Einstein condensate, the long-wavelength energy change at fixed species numbers is one half the integral of the density perturbation quadratic form with matrix . Strict positive definiteness gives the displayed criterion. Strong positive cross-repulsion favors separation; sufficiently strong cross-attraction instead produces an unstable joint density mode. Equality is marginal at this order, not strict stability.
Nondegenerate bilinear form Created 2026-09-24 Updated 2026-10-14
A bilinear form is nondegenerate when its left radical and right radical are both zero: every nonzero vector can be detected by some pairing, whichever input slot it occupies. On a finite-dimensional vector space, either condition implies the other, and the following tests are equivalent:Here is the matrix of a bilinear form, and is the dual space. The linear map has matrix in the chosen basis and its dual basis, so its kernel is the right radical. The map has matrix . An invertible matrix has zero kernel on both sides, proving the finite-dimensional equivalence. In infinite dimensions, zero left radical and right radical imply these maps are injective, but do not generally make them surjective.[ref]
For the real symmetric bilinear form , the determinant is . Its isotropic vector has zero self-pairing but pairs to with , so it is detected. The alternating bilinear form with matrix has determinant and detects every nonzero vector even though all self-pairings vanish. Neither zero self-pairings nor the absence of positive definiteness implies degeneracy.
Nondegeneracy is useful because it turns a linear functional into a unique vector. For , the linear functional is ; solving for that representing vector amounts to solving an invertible system of linear equations. The analogous identification underlies bilinear orthogonal complements and the dual isomorphisms induced by a nondegenerate pairing.
For the inner product obtained by integrating with weight on , odd moments vanish and the moment of is . The first monic orthogonal polynomials are , and . Positive definiteness follows because the weight is positive almost everywhere and a nonzero polynomial cannot vanish almost everywhere.
The restriction of a positive definite form to each is positive definite. By the spectral theorem for real symmetric matrices, choose an orthogonal matrix such that .
Each , since a basis vector is nonzero. Taking determinants in part (i) givesbecause an orthogonal matrix has determinant . ConsequentlyThese determinants are the leading principal minors in Sylvester's criterion.
Writing and , evaluation against the dual basis givesThis has codomain , not the printed . For a nonzero vector space, take and to obtain . Only the diagonal values must be real. The displayed formula defines the intended complex inner product.
It is linear in the first argument and conjugate-linear in the second:It has conjugate symmetry, since . Finally,with equality exactly when every coordinate vanishes, equivalently . This proves positive definiteness. Since , the original basis is orthonormal. This is the inner product determined by a basis.
Use the convention of part (a): the inner product is linear in its first argument. If with , the adjoint operator identity and givePositive definiteness makes , soThus every eigenvalue of a skew-adjoint operator is purely imaginary, including zero.
For , take the matrix whose leading block is and whose other entries are zero. Its square has leading block , soThis contradicts the positive definiteness required of an inner product. Even the nonzero matrix unit has .
The printed assertion has an exception: when , is an inner product on . Thus the requested failure requires , a restriction absent from the printed question.
A real inner product must be symmetric. Here and , forcing . For this value,This is strictly positive for every nonzero vector. Bilinearity is already given, so symmetry and positive definiteness prove
The adjoint operator is characterized byThis identity works with either convention for which argument of the complex inner product is linear, provided the convention is used consistently.
For uniqueness, subtract the two given identities to get for every . Fix and choose . Then positive definiteness givesso . As was arbitrary, . The decisive fact is that a vector orthogonal to every vector, including itself, must be zero.
The adjoint on an inner product space is characterized byHere is a finite-dimensional construction that supplies every required basis fact. If is any basis, its coordinate linear functionals form a basis of : a linear functional is uniquely specified by its values on these vectors. Hence . The linear mapis injective, because implies , and positive definiteness implies . Equal dimensions make an linear isomorphism. If is the dual map, thenThis establishes existence and linearity. If two possible vectors represent the same linear functional through the inner product, then , so . Applied to every argument, this proves uniqueness of the adjoint on an inner product space.
For linear maps , two applications of the defining inner product identity giveUniqueness therefore gives . Likewise , for real , and . An induction gives , and applying additivity to a polynomial with real coefficients givesSymmetry of the real inner product also gives . If is the minimal polynomial of , the displayed identity gives , so the minimal polynomial of divides . Applying the same argument to gives reverse divisibility. Both polynomials are monic, hence their minimal polynomials are equal.
The distinct eigenvalues are exactly the roots of the minimal polynomial in the chosen field. An eigenvector with eigenvalue satisfies , so . Conversely, if and were a linear isomorphism, then would imply , contradicting minimal degree. Thus is not injective, giving an eigenvector. It follows that and have the same distinct eigenvalues. This includes the complex eigenvalues after complexification of a real vector space; over the real field it states equality of their real eigenvalues.
The adjoint operator is characterized byThis identity works with either convention for which argument of the complex inner product is linear, provided the convention is used consistently.
For uniqueness, subtract the two given identities to get for every . Fix and choose . Then positive definiteness givesso . As was arbitrary, . The decisive fact is that a vector orthogonal to every vector, including itself, must be zero.
Past exam of the calculus of variations course of the University of Oxford 2009 2 a Solution 2026-10-31
For fixed-endpoint variations, the second variation iswith , , evaluated along . The Jacobi equation, written without differentiating separately, isWhen is differentiable this is .
Positive definiteness means for every nonzero admissible variation. Uniform or coercive positivity of a second variation is the stronger assertion that for some fixed . On a fixed-endpoint interval this is equivalent to a positive lower bound in the norm.
The strict Legendre implication uses the uniform interpretation of positivity. If , localized rapidly oscillating variations show : otherwise support them in an interval where , so the derivative term of is negative of order frequency squared, overwhelming its mixed and zero-order terms. Continuity extends the bound to the endpoints, giving on . Under mere positive definiteness this strict conclusion is false: at gives but . In that weaker convention only the ordinary Legendre necessary condition follows. This distinction makes the implication precise.
Under the stated regular condition , a conjugate point to is an endpoint admitting a nonzero Jacobi solution with . The disconjugacy form of the Jacobi positivity criterion says that no such point in exists if and only if there is a Jacobi solution strictly positive on all of .
For the required identity, let that positive solution be and write . Set . The Jacobi equation givesExpanding the second-variation integrand therefore yieldsFor compactly supported , the boundary term vanishes, provingThis is the Jacobi identity for the second variation. The divergence form is also appropriate under the original regularity; with , the Euler-Lagrange equation gives the usual further regularity along the extremal.





