The real Lax-Milgram theorem applies to a Hilbert space and a bounded bilinear form satisfying
For every bounded linear functional there is a unique with
Symmetry of the bilinear form is not required.
By the Riesz representation theorem, write and . The operator is linear and bounded, with . The coercive bilinear form bound and the Cauchy-Schwarz inequality imply
Hence is injective. Its range is closed: if converges, this last inequality applied to differences makes a Cauchy sequence, and its limit maps to the proposed range limit. If is in the orthogonal complement of the range, then for all ; taking and using coercivity gives . The range is thus dense as well as closed, so it is all of . Solve uniquely; the displayed lower bound gives the asserted estimate.
For complex Hilbert spaces the same proof works for a bounded sesquilinear form, linear in the first argument, with . In the convention , must then be a bounded conjugate-linear functional represented as .
The finite element method replaces an infinite-dimensional variational problem by a finite-dimensional one, usually using functions that are polynomial on small mesh elements. Ritz method and Galerkin method describe how the discrete equations are selected; neither intrinsically requires piecewise polynomials, though those spaces make assembly local and sparse.
For a concrete realization of the two-point problem, choose homogeneous Dirichlet boundary conditions at both endpoints of . The differential expression alone is not a complete boundary value problem, so this boundary choice is an explicit assumption. Let with , with , and . Use the zero-boundary Sobolev space with norm . By the Poincaré inequality this is equivalent to its full first-order Sobolev norm. Multiplying by a test function and applying integration by parts gives
The endpoint terms vanish by the essential boundary condition. The form is a symmetric bilinear form, bounded by
and it is a coercive bilinear form:
The load is a bounded linear functional. The Lax-Milgram theorem gives a unique weak solution and a bound . Under the stated coefficient regularity it solves the differential equation in the usual weak sense.
The Ritz method minimizes the energy
over , or over a conforming finite-dimensional subspace . Its first variation is ; symmetry and coercivity make the functional strictly convex. In fact, if is the weak solution,
Thus the energy minimizer is exactly the weak solution. The Galerkin method instead directly asks for with for all . For this symmetric coercive problem, Ritz-Galerkin equivalence for a symmetric coercive form shows that the discrete minimizer and Galerkin solution coincide. For a nonsymmetric problem, a Galerkin formulation can still apply but the same quadratic minimization generally cannot represent its full bilinear form; appropriate coercivity or inf-sup conditions must then justify the chosen spaces.
Subtract the continuous and discrete weak equations to obtain Galerkin orthogonality . Since defines the energy norm , the Pythagorean identity gives
In a general reference norm, the Céa lemma yields
The proof uses together with coercivity and continuity. Dense approximation spaces therefore imply convergence; the estimate reduces a numerical error problem to an approximation problem.
For implementation, partition the interval by nodes . Choose continuous piecewise-linear functions and the interior piecewise-linear hat functions as a basis, with the two boundary coefficients prescribed. Write . The coefficients satisfy
The stiffness matrix is symmetric positive definite: for nonzero interior coefficients. The local supports make it tridiagonal in this one-dimensional linear-element case.
On an element of length , for constant element coefficients , the two-node matrix and constant-load vector are
For variable coefficients, integrate against the same shape functions rather than silently replacing them by constants. Element contributions are added at shared nodes, and boundary values are eliminated or lifted into the right side. A sparse direct solve or a suitable iterative method gives the nodal coefficients. Numerical quadrature should preserve the required accuracy and, with positive coefficients and weights, the positive energy structure.
A finite element interpolation estimate gives for these elements, where is the largest element size and the solution has the stated regularity. The Céa lemma then gives first-order energy error. If the dual elliptic problem has regularity, the Aubin–Nitsche duality argument gives second-order error: for , solve , then use to gain one further factor of . Higher-order elements improve rates when the solution is sufficiently smooth.
Nonzero Dirichlet data are handled by a boundary lifting and an affine trial space. Neumann boundary conditions enter naturally through the integrated boundary term; Robin terms modify both the form and the load. With pure Neumann conditions and , constants lie in the kernel: existence needs the load/flux compatibility condition, uniqueness needs a mean constraint, and the preceding Dirichlet coercivity argument cannot simply be reused. Conforming approximation, boundary conditions and coercivity are the ingredients connecting the finite-element construction to a justified Ritz or Galerkin solution.
Use the real Hilbert space , the zero-boundary Sobolev space, with norm . The Poincaré inequality makes this equivalent to its usual Sobolev space norm. Define the symmetric bilinear form and continuous linear functional
The Cauchy-Schwarz inequality and the sharp interval Poincaré inequality imply
Thus is a bounded bilinear form and a coercive bilinear form, and is bounded because is square-integrable. The Lax-Milgram theorem supplies a unique weak solution:
This is obtained from the differential equation by integration by parts; the test functions have zero boundary trace. Conversely, the weak solution satisfies in the sense of distributions. Since , it belongs to and solves the equation almost everywhere.
Equivalently, the Ritz method minimizes
over . Indeed , since the mixed term is . This proves existence and uniqueness of the minimizer directly from the weak solution, as well as its equivalence to the variational problem.
The Lax-Milgram theorem assumes that is a real Hilbert space and is a bounded bilinear form and a coercive bilinear form: there are such that
Then for every continuous linear functional there is a unique satisfying
Symmetry of is not required.
For the proof, the Riesz representation theorem provides a bounded linear operator and with and . Coercivity and the Cauchy-Schwarz inequality imply
Thus is injective and its range is closed: if converges, the displayed inequality makes a Cauchy sequence; completeness gives and . If lies in the orthogonal complement of the range, then for all . Taking gives , so . A closed subspace with zero orthogonal complement is all of , hence is surjective. The unique solution is , and the same inequality gives the asserted norm bound.
Work in the real zero-boundary Sobolev space , whose members have square-integrable weak derivatives and zero endpoint trace. Define the bounded bilinear form and linear functional
The weak formulation is to find with for every . Integration by parts recovers the differential equation for a smooth solution; conversely, this identity is the definition of its weak solution.
Use the full norm. The Cauchy-Schwarz inequality gives and . Also , so is a coercive bilinear form with constant one. The Lax-Milgram theorem states that a bounded, coercive bilinear form on a real Hilbert space determines a unique weak solution for every bounded linear functional. It therefore applies here.
The equivalent minimization problem is
If is the weak solution, symmetry and give
This is positive unless , proving a unique global minimizer. Conversely, differentiating at gives the weak identity. Thus the unique energy minimizer is exactly the unique weak solution. As a check, the classical representative is
It satisfies both endpoint conditions and .
The starting point of a conforming finite element method is a weak formulation in a Hilbert space . For example, a homogeneous Dirichlet boundary condition on a bounded Lipschitz domain gives . One seeks
where is a bounded bilinear form, , and is a bounded linear functional. A conforming finite element space is finite dimensional and is typically built from functions that are polynomial on each element of a finite element mesh. With a basis , the Galerkin method imposes the same identity only for , giving
The stiffness matrix is sparse when basis supports overlap only locally. Local element integrals assemble its entries; the mass matrix represents an term. This separates the choice of trial functions from the variational principle determining their coefficients.
The fundamental well-posedness theorem is the Lax-Milgram theorem: if for some , there is a unique solution for each , with . The same theorem on gives a unique discrete solution. The constants must be independent of the mesh for uniform stability of a numerical method. Boundary conditions are built into the trial space when they are essential constraints; flux conditions arise through boundary terms in integration by parts and are natural constraints in the weak formulation.
When is symmetric and a coercive bilinear form, the Ritz method minimizes
over . Its first variation is exactly the Galerkin method, so Ritz minimization and Galerkin testing coincide for symmetric coercive problems. The energy norm turns the approximation into an orthogonal projection. Indeed, subtracting the exact and discrete weak equations gives Galerkin orthogonality, . For every the Pythagorean identity becomes
so
This exact best-approximation property is the central advantage of the Ritz method.
Symmetry is unnecessary for the Galerkin method. For any bounded, coercive form, the Céa lemma gives
To prove it, put . Galerkin orthogonality yields , so coercivity and boundedness give . Divide when and take the infimum. Thus approximation capability plus uniform coercivity gives convergence. In contrast, minimizing for a nonsymmetric form differentiates its symmetric part and generally does not solve the original weak equation.
A concrete symmetric example is the one-dimensional reaction-diffusion problem from Question 5. Continuous piecewise-linear hat functions give the diffusion stiffness matrix with diagonal and neighbouring entries , and the mass matrix with diagonal and neighbouring entries . Therefore and . Its positive-definite matrix is the coordinate form of the continuous energy. The exact smooth solution makes this an explicit test of the method, not just an abstract existence result.
For a nonsymmetric example, take positive , constant real , and
Its form is . Since , it has coercivity constant in the full norm, although it is not symmetric when . The Galerkin method remains well posed. On the uniform hat basis, , where , and . The skew-symmetric matrix cancels from , proving nonsingularity. A Ritz energy would omit precisely this advection contribution. Small may nevertheless make the approximation constant large and produce poorly resolved layers; algebraic solvability is not an accuracy guarantee.
Quantitative convergence uses a finite element interpolation estimate. On a shape-regular mesh, for piecewise-linear conforming elements and in the usual low-dimensional setting,
The Céa lemma therefore gives an energy error. The Aubin–Nitsche duality argument improves the L2 norm error when the dual elliptic problem has regularity: solve and use
Consequently
with constants depending on the solution and regularity bounds. The second estimate is conditional on dual regularity; corners or insufficient data regularity can reduce the rate.
The same Galerkin method handles evolution equations. For the homogeneous heat equation, the semidiscrete finite element heat equation is . Because is a positive-definite matrix and is a positive semidefinite matrix,
The decreasing quadratic form is exactly the L2 norm squared of the finite-element function. This separates spatial stability of a numerical method from the subsequent time integrator, just as in the Schrödinger equation example. Conformity, coercivity and approximation estimates together explain convergence.
Consider a bounded Lipschitz domain and homogeneous Dirichlet boundary conditions for
Assume is a bounded real symmetric matrix field with uniformly, is bounded, and defines a bounded linear functional on , the zero-boundary Sobolev space. The weak formulation is
The Cauchy-Schwarz inequality gives continuity . Uniform ellipticity and the Poincaré inequality give a coercive bilinear form, . The Lax-Milgram theorem therefore supplies a unique weak solution, with . Its proof represents by a bounded linear operator using the Riesz representation theorem; coercivity gives an injective operator with closed image, and a zero orthogonal complement makes that image all of . This yields existence, uniqueness and the displayed estimate.
For a conforming finite element space , the Galerkin method finds such that for every . With a basis , this is the linear system , where the stiffness matrix is and . Its positive-definite matrix property proves unique discrete solvability. Local support gives a sparse matrix through elementwise assembly.
For the symmetric problem, the Ritz method minimizes over . Differentiating in every direction gives precisely the Galerkin method equations. Conversely, if solves them, , proving it is the unique minimum. The same argument over gives , where is the energy norm. Thus the Ritz method chooses the best trial function in that norm.
Subtracting the continuous and discrete equations gives Galerkin orthogonality, . For arbitrary and , it follows that . Coercivity and continuity prove the Céa lemma:
In the symmetric energy norm, the Cauchy-Schwarz inequality improves the constant to one. Equivalently, Galerkin orthogonality gives the Pythagorean identity . These estimates establish stability and show that approximation properties of the trial space determine convergence.
For continuous piecewise-linear elements on a shape-regular mesh in dimensions at most three, a finite element interpolation estimate gives when . Combining it with the Céa lemma yields energy norm error. More generally, degree- elements give error in under the corresponding regularity and approximation assumptions. Mere mesh refinement cannot supply an order whose required solution regularity is absent.
An additional order in the L2 norm follows under a dual elliptic regularity assumption. Solve and assume . The Aubin–Nitsche duality argument uses Galerkin orthogonality to obtain
Therefore , giving for the piecewise-linear case with . This improvement explicitly requires regularity of the dual problem.
As a concrete example, solve on with zero endpoint values. On a uniform mesh of spacing , the piecewise-linear hat functions give , and . The discrete equations are , whose solution is . The exact solution is , so is its piecewise-linear nodal interpolant. On each interval ,
Integrating the squared error and squared derivative error gives the explicit rates
where the norm here is .
For nonsymmetric coercive problems, the Galerkin method, Galerkin orthogonality and the Céa lemma still apply, but the symmetric quadratic minimization interpretation of the Ritz method generally does not. Nonconforming trial spaces, inexact integration and noncoercive equations need additional arguments beyond the conforming coercive theory proved here.
By part (a), is a bounded bilinear form: . For each fixed , the map is consequently a bounded linear functional. The Riesz representation theorem supplies a unique vector such that
Uniqueness of the representing vector makes linear, and makes it a bounded linear operator.
The coercivity assumption implies
hence . Moreover, using the adjoint operator,
so the same argument gives . The invertibility from lower bounds on an operator and its adjoint therefore shows that is invertible and is bounded.
Set . Then for every . If another has this property, then , and the injectivity of gives . Thus the unique vector is .
Put with its usual Hilbert space inner product, and define
The Cauchy-Schwarz inequality shows that this is a bounded bilinear form. For , Young inequality gives
and therefore
Because , this is a coercive bilinear form.
The map is a bounded linear functional on . By the Riesz representation theorem, it equals for some . Applying part (b) produces one and only one such that
This is precisely the weak formulation of the stated Dirichlet problem, obtained by integration by parts in the Laplace operator term. Thus is its unique weak solution; this is the constant-drift massive-Laplacian Dirichlet problem.
Define on the bilinear form
and the linear functional
The Hardy inequality on an interval, Cauchy-Schwarz inequality, and the one-sided Poincaré inequality show that is a bounded bilinear form and that
For , , so Cauchy--Schwarz and Fubini's theorem give
Hence
Thus is a coercive bilinear form. The Lax-Milgram theorem supplies a unique satisfying for every . This is precisely the unique weak solution described by the weak boundary value problem with an inverse-square potential.
Testing the weak formulation with the constant function proves the necessary compatibility condition
Assume first that is connected and this condition holds. On the mean-zero Sobolev space
use the norm . To prove the needed Poincare-Wirtinger inequality, suppose it failed. There would be with and . The Rellich-Kondrachov compactness theorem gives a subsequence converging strongly in and weakly in to a function . Its weak derivative vanishes, so connectedness makes constant; its zero mean makes it zero. This contradicts . Hence is an equivalent Hilbert space norm on .
Define
Boundedness of makes a bounded bilinear form, while uniform ellipticity gives
so it is a coercive bilinear form. The Cauchy-Schwarz inequality and the Poincare-Wirtinger inequality make a bounded linear functional. The Lax-Milgram theorem supplies a unique satisfying for every mean-zero . For arbitrary , subtract its mean; the omitted constant contributes zero on both sides because and . Thus solves the original problem.
If two solutions exist, their difference satisfies , so uniform ellipticity gives . It is therefore constant on . The solution is unique up to an additive constant, and its mean-zero representative is unique. If is disconnected, the precise condition is on every connected component , and one independent additive constant remains on each component.
On the Hilbert space , the form from part b obeys
so it is a bounded bilinear form and a coercive bilinear form. The Cauchy-Schwarz inequality and the Poincare inequality with a partial Dirichlet boundary give
so is a bounded linear functional. The Lax-Milgram theorem now gives a unique weak solution . Taking in the weak identity yields
and therefore
For a symmetric bounded bilinear form that is strictly positive on nonzero vectors, and a bounded linear functional , set . The first variation is . A weak solution of satisfies , so it is the unique minimizer. Conversely, any minimizer solves the weak equation. A coercive bilinear form gives existence by the Lax-Milgram theorem; strict positivity alone does not.
Ritz-Galerkin equivalence for a symmetric coercive form Created 2026-10-06 Updated 2026-10-14
For a bounded symmetric coercive bilinear form on a Hilbert space, a solution of minimizes . The displayed identity proves strict minimality and uniqueness. Restricting to a conforming finite element space makes the discrete Ritz method equivalent to the Galerkin method. Galerkin orthogonality gives exact best approximation in the energy norm; the Céa lemma translates it into a reference-norm estimate.
Stiffness matrix 2026-10-05
The stiffness matrix represents a variational bilinear form in a finite element basis. A symmetric coercive bilinear form gives a positive-definite matrix. Local support of the piecewise-linear hat functions produces a sparse matrix, allowing efficient numerical solution.
On l2 sequence space , let and . This bounded self-adjoint operator has for nonzero , but the equation requires , which is not in . Taking the first coordinates equal to one makes . Thus strict positivity in isolation does not give existence in that Hilbert space; a coercive bilinear form and a continuous forcing functional in its norm are essential hypotheses for the usual minimization proof.
A continuous symmetric coercive bilinear form on a real Hilbert space and a continuous linear functional give a unique minimum of . The parallelogram identity makes any minimizing sequence Cauchy in the energy norm; coercivity and completeness give its limit. Differentiation gives , and proves uniqueness. A nonsymmetric operator instead differentiates to its symmetric part. Mere pointwise positivity without a lower bound in the chosen norm need not yield a minimizing vector.
Variational problem Created 2026-10-06 Updated 2026-10-07
A variational problem seeks a stationary point or minimizer of a functional on a specified function space. For a symmetric coercive bilinear form and bounded linear functional on a real Hilbert space, minimizing is equivalent to the weak formulation for every test vector. The Lax-Milgram theorem gives a unique solution, and proves unique minimization. Specifying the admissible space and its boundary constraints is part of the problem.