For a fixed-step linear multistep method with a nonzero leading coefficient, applied to an ordinary differential equation with a locally Lipschitz continuous vector field, the Dahlquist equivalence theorem states that
Here convergence is uniform on each fixed finite time interval as the step size tends to zero, for every set of starting values tending to the corresponding exact values. Consistency of a numerical method means that the normalized local defect tends to zero; for the characteristic polynomials of a linear multistep method it gives and . Zero-stability is equivalent to the root condition for a multistep method: every root of a polynomial of satisfies , and roots with are simple. Order , together with zero-stability and starting errors , gives global error under the usual smoothness assumptions.
To prove the necessity of the root condition for multistep convergence, use the test problem , . Its discrete error satisfies , where . Set . If , the exact recurrence solution
has starting errors tending to zero at every fixed starting index, but . Thus convergence fails.
If a unit-modulus root has multiplicity , the recurrence instead admits
Again every fixed starting error tends to zero while . These polynomial-times-exponential solutions follow from the repeated factor . Complex modes can be interpreted as a real two-component system, or their real and imaginary parts can be used. Therefore convergence requires precisely the root condition for a multistep method. Repeated roots strictly inside the unit disk are allowed, since their polynomial factors are dominated by exponential decay.
Factor the first characteristic polynomial as
The other two roots of a polynomial have product one. If , they are : distinct unit-modulus roots, both different from one. At , the root is double; at , the root one is triple. Outside , one of the reciprocal real roots has modulus greater than one. Thus the root condition for a multistep method holds exactly for .
For the order conditions for a linear multistep method, expand the exponential defect:
The constant, linear and quadratic coefficients vanish for every . The cubic coefficient vanishes only at , where the quartic coefficient is . Consequently the formal order is
For all parameters satisfying the root condition for a multistep method, , so this formal calculation gives ordinary second-order consistency of a numerical method. The Dahlquist equivalence theorem therefore yields
The exceptional third-order formula is not zero-stable. At , and : the recurrence contains no vector-field evaluations. It satisfies the displayed Taylor identities only formally and is a degenerate, nonconvergent formula, not a usable second-order ODE solver. This distinction avoids interpreting formal cancellation as convergence.
Only needs consideration. On the Dahlquist test equation, the amplification polynomial of a multistep method is , where . A-stability requires all amplification roots to have modulus at most one for every , with simple unit-modulus roots.
Choose the negative real value . The leading coefficient of is
whereas . Hence as real . The intermediate value theorem supplies a real amplification root , so this negative test value is unstable. Therefore
This is a direct absolute stability obstruction, independent of the Second Dahlquist barrier, which by itself would not rule out the convergent second-order members.
The nodes have Lagrange interpolation polynomials
The coefficients obtained from and reproduce the given Butcher tableau. In particular, the second row's last entry is , which is missing from the TeX transcription. Thus this is the three-stage Lobatto IIIA method.
One applicable collocation theorem is that -stage Lobatto IIIA collocation has order . Alternatively, the fourth-order conditions for a Runge-Kutta method give a direct verification. With , and , the eight required Butcher order conditions are
Powers of here are componentwise. Substitution satisfies all eight. The stability function computed from the stages is
Its expansion satisfies , so even the scalar linear problem fails the fifth-order condition. Hence
The Butcher order condition theorem equates order with all conditions for rooted trees through order ; the displayed conditions are its complete specialization through order four.
Use the stability function . Its denominator vanishes only at , both in the open right half-plane. For ,
This is nonnegative whenever , so throughout the closed left half-plane. The internal stage equations are also solvable there, since . Therefore the method is A-stable.
The inequality is strict in the open left half-plane, while . Moreover as , so the method is not L-stable. These conclusions follow directly from the definitions of A-stability and L-stability, rather than from the order of the method.
For algebraic stability of a Runge-Kutta method, the weights must be nonnegative and
must be a positive semidefinite matrix. Here all weights are positive, but direct calculation gives
In particular ; equivalently, its eigenvalues are . Therefore the method is not algebraically stable. This does not contradict its A-stability: algebraic stability is a stronger condition designed to guarantee nonlinear B-stability through the Runge-Kutta contractivity identity.
The original PDF puts both neighbouring values at time . Thus the actual scheme is Backward Euler method in time with a centered three-point approximation to the second spatial derivative. The old-time neighbours in the TeX transcription describe a different method.
Let and . Insert a sufficiently smooth exact solution and divide by . Expanding at gives
The PDE cancels the term. Therefore the normalized local truncation error is and
For compatible smooth data with exact nodal initialization, the stability of a numerical method established below gives global error on fixed time intervals, by summing the one-step defects with the contraction bound. Thus no relation between and is needed for stability; choosing makes both consistency contributions .
Let be the tridiagonal matrix with diagonal two and adjacent entries minus one, incorporating zero Dirichlet boundary conditions. The actual PDF scheme is
An orthonormal basis of eigenvectors of has components , and substitution gives
They form an orthonormal basis by the spectral theorem for real symmetric matrices. Hence is invertible for every , and the amplification eigenvalues are . For the discrete L2 norm ,
This bound has constant one independent of time step and mesh, which is the required stability of a numerical method. Therefore every positive Courant number is stable. If a forcing or local-defect sequence is added, the discrete variation-of-constants formula gives a bound by the initial norm plus the sum of those perturbation norms; this also justifies the global error conclusion in part (a).
Use distinct periodic grid points , , and . Values at the two ends of the interval represent the same point, so the endpoint must not be stored twice. With indices interpreted modulo , set
This replaces the Dirichlet matrix by the periodic discrete Laplacian. The normalized Fourier modes form an orthonormal basis and have amplification factors
Each satisfies for every . The Parseval identity therefore gives in the discrete L2 norm, uniformly in the grid and time step. Thus all positive Courant numbers remain stable. The constant mode has , expressing preservation of the spatial mean; all nonconstant modes decay. The formula with modulo indices also handles small grids, where two neighbours can coincide.
For a sufficiently regular solution with zero Dirichlet boundary conditions, differentiate its squared L2 norm. Since ,
Integration by parts and the zero boundary trace give . The potential contribution is real because is real. The quantity in parentheses is consequently real, and its product with has zero real part. Hence
This is the energy method for a skew-adjoint evolution. For general L2 space data, the same result follows from the strongly continuous unitary group generated by a self-adjoint realization of . A sufficient assumption is a bounded real potential with the Dirichlet Laplacian; arbitrary real potentials require appropriate domain and self-adjointness assumptions. The differentiated proof presumes the regularity needed for the displayed integrals, rather than asserting it for every pointwise real function .
Arrange the interior values into a vector . Represent the five-point Dirichlet Laplacian as a Kronecker sum , where is the tridiagonal matrix with diagonal and adjacent entries one. This Kronecker sum is real symmetric; the real sampled potential has a real diagonal matrix . Thus
The generator is a skew-Hermitian matrix. Consequently
The matrix exponential is a unitary matrix, either by differentiating its product with its adjoint or by unitary diagonalization of a normal matrix. For the two-dimensional discrete L2 norm , this gives
Applying the same equation to a difference proves stability of a numerical method with a mesh-independent constant one. This is norm conservation of a semidiscrete Schrödinger equation. It concerns continuous time after spatial discretization; an arbitrary subsequent time integrator need not preserve this stability.
The printed coordinates do not discretize the stated square. For with interior points in each direction, use , , , and sample there. The printed and unshifted coordinates instead describe a grid on . The matrix proof is valid for either geometry with its corresponding boundary values, so this transcription-independent statement flaw does not alter the stability conclusion.
Work in the real zero-boundary Sobolev space , whose members have square-integrable weak derivatives and zero endpoint trace. Define the bounded bilinear form and linear functional
The weak formulation is to find with for every . Integration by parts recovers the differential equation for a smooth solution; conversely, this identity is the definition of its weak solution.
Use the full norm. The Cauchy-Schwarz inequality gives and . Also , so is a coercive bilinear form with constant one. The Lax-Milgram theorem states that a bounded, coercive bilinear form on a real Hilbert space determines a unique weak solution for every bounded linear functional. It therefore applies here.
The equivalent minimization problem is
If is the weak solution, symmetry and give
This is positive unless , proving a unique global minimizer. Conversely, differentiating at gives the weak identity. Thus the unique energy minimizer is exactly the unique weak solution. As a check, the classical representative is
It satisfies both endpoint conditions and .
The trial space must be a subspace of , not merely of . The printed assumptions on the basis do not ensure square-integrable weak derivatives, and boundary traces are not defined for arbitrary L2 space functions. For example, is continuous, vanishes at both endpoints and belongs to , but is not integrable at zero. Assume the basis belongs to the zero-boundary Sobolev space, as it does for the hat functions in part (c).
Write . Differentiating the restricted energy with respect to , or imposing the Galerkin method with test function , gives
The derivative term is the usual diffusion stiffness matrix and the second is the mass matrix. The full matrix is real symmetric, and for every nonzero coefficient vector ,
because a basis is linearly independent. Thus it is a positive-definite matrix, so the restricted Ritz method has a unique solution and minimum.
The piecewise-linear hat functions have disjoint supports unless their nodes coincide or are neighbours. Direct integration on the two adjacent intervals gives
Since and the hat is symmetric about , its load is . Thus the reaction-diffusion finite element matrix gives the explicit equations
The coefficient matrix is a tridiagonal matrix and a positive-definite matrix by the energy identity in part (b), hence nonsingular. A separate spectral verification uses the sine basis with and gives
Both terms are positive for the Dirichlet modes. This also identifies precisely how the diffusion stiffness matrix and reaction mass matrix combine.
The starting point of a conforming finite element method is a weak formulation in a Hilbert space . For example, a homogeneous Dirichlet boundary condition on a bounded Lipschitz domain gives . One seeks
where is a bounded bilinear form, , and is a bounded linear functional. A conforming finite element space is finite dimensional and is typically built from functions that are polynomial on each element of a finite element mesh. With a basis , the Galerkin method imposes the same identity only for , giving
The stiffness matrix is sparse when basis supports overlap only locally. Local element integrals assemble its entries; the mass matrix represents an term. This separates the choice of trial functions from the variational principle determining their coefficients.
The fundamental well-posedness theorem is the Lax-Milgram theorem: if for some , there is a unique solution for each , with . The same theorem on gives a unique discrete solution. The constants must be independent of the mesh for uniform stability of a numerical method. Boundary conditions are built into the trial space when they are essential constraints; flux conditions arise through boundary terms in integration by parts and are natural constraints in the weak formulation.
When is symmetric and a coercive bilinear form, the Ritz method minimizes
over . Its first variation is exactly the Galerkin method, so Ritz minimization and Galerkin testing coincide for symmetric coercive problems. The energy norm turns the approximation into an orthogonal projection. Indeed, subtracting the exact and discrete weak equations gives Galerkin orthogonality, . For every the Pythagorean identity becomes
so
This exact best-approximation property is the central advantage of the Ritz method.
Symmetry is unnecessary for the Galerkin method. For any bounded, coercive form, the Céa lemma gives
To prove it, put . Galerkin orthogonality yields , so coercivity and boundedness give . Divide when and take the infimum. Thus approximation capability plus uniform coercivity gives convergence. In contrast, minimizing for a nonsymmetric form differentiates its symmetric part and generally does not solve the original weak equation.
A concrete symmetric example is the one-dimensional reaction-diffusion problem from Question 5. Continuous piecewise-linear hat functions give the diffusion stiffness matrix with diagonal and neighbouring entries , and the mass matrix with diagonal and neighbouring entries . Therefore and . Its positive-definite matrix is the coordinate form of the continuous energy. The exact smooth solution makes this an explicit test of the method, not just an abstract existence result.
For a nonsymmetric example, take positive , constant real , and
Its form is . Since , it has coercivity constant in the full norm, although it is not symmetric when . The Galerkin method remains well posed. On the uniform hat basis, , where , and . The skew-symmetric matrix cancels from , proving nonsingularity. A Ritz energy would omit precisely this advection contribution. Small may nevertheless make the approximation constant large and produce poorly resolved layers; algebraic solvability is not an accuracy guarantee.
Quantitative convergence uses a finite element interpolation estimate. On a shape-regular mesh, for piecewise-linear conforming elements and in the usual low-dimensional setting,
The Céa lemma therefore gives an energy error. The Aubin–Nitsche duality argument improves the L2 norm error when the dual elliptic problem has regularity: solve and use
Consequently
with constants depending on the solution and regularity bounds. The second estimate is conditional on dual regularity; corners or insufficient data regularity can reduce the rate.
The same Galerkin method handles evolution equations. For the homogeneous heat equation, the semidiscrete finite element heat equation is . Because is a positive-definite matrix and is a positive semidefinite matrix,
The decreasing quadratic form is exactly the L2 norm squared of the finite-element function. This separates spatial stability of a numerical method from the subsequent time integrator, just as in the Schrödinger equation example. Conformity, coercivity and approximation estimates together explain convergence.
An -stage Runge-Kutta method for is defined by
The Butcher tableau records , and ; internal consistency usually sets , and first-order consistency requires . A strictly lower triangular gives an explicit method, while other stage dependencies generally require an implicit Runge-Kutta method. The stage solvability of an implicit Runge-Kutta method must be checked separately: if is globally Lipschitz continuous in with constant , the stage fixed-point map is a contraction in the maximum stage norm whenever . This is a sufficient small-step condition, not a restriction intrinsic to the definitions of A-stability or B-stability.
Linear stability begins with the Dahlquist test equation . Solving the stages gives
The linear stability domain consists of test values for which the stage system is well defined and . A-stability means this includes the closed left half-plane. For , this gives stability with no scalar decay-mode step restriction. For a normal matrix in , unitary diagonalization of a normal matrix reduces the norm estimate to these scalar factors. For a non-normal matrix, eigenvalues alone do not establish a uniform norm bound: eigenvector conditioning and transient amplification matter. Mesh-uniform estimates for discretized PDEs must control operator powers, not only their spectra.
Every consistent explicit Runge-Kutta method has a nonconstant polynomial stability function and therefore cannot be A-stable, since that polynomial is unbounded on the negative real axis. For example, forward Euler method has , stability disk , and restriction for . For a pure imaginary mode , , so it is unstable for every positive step. The classical fourth-order Runge-Kutta method instead has
It is stable on the imaginary axis exactly for , an illustrative conditional stability range for oscillatory evolution.
Backward Euler method has and is A-stable. L-stability adds as in the left half-plane; backward Euler satisfies this and strongly damps unresolved rapidly decaying modes in a stiff differential equation. The implicit midpoint rule and the trapezoidal rule both have , so they are A-stable but not L-stable. They preserve the modulus of a pure imaginary test mode, but their stiff-decay limit is , leaving oscillatory numerical remnants. The three-stage Lobatto IIIA method has the fourth-order rational function found in Question 2 and likewise lacks L-stability. Thus high order and A-stability do not themselves imply efficient stiff damping.
Nonlinear stability measures differences between solutions of the same equation. A one-sided Lipschitz condition is
Differentiating the squared difference and applying the Gronwall inequality gives . A dissipative vector field has and is contractive. A B-stable method preserves this property for every positive step size for which the stages are well defined:
This includes time-dependent vector fields when dissipativity holds at each common time argument. Applying it to scalar linear dissipative fields shows that B-stability implies A-stability when the linear stages are well defined; the converse fails.
The standard sufficient theorem is algebraic stability implies B-stability, subject to stage solvability. Define and . Algebraic stability of a Runge-Kutta method means and is a positive semidefinite matrix. To prove the theorem, set , and . Expanding the output difference and using yields the Runge-Kutta contractivity identity
Dissipativity makes the first sum nonpositive, while positive semidefiniteness makes the last quadratic form nonnegative. The latter follows by factoring and writing it as a sum of squared norms of linear combinations of the . This proves the claimed contraction. It is a sufficient theorem; absence of algebraic stability is not, by itself, a proof of failure of B-stability for every representation.
Several examples make the distinctions concrete. For backward Euler, , , so : it is both L-stable and B-stable. For implicit midpoint, , , so : it is B-stable and preserves squared norms for a skew-Hermitian linear equation, but lacks stiff damping. For the two-stage Gauss--Legendre Runge-Kutta method,
the matrix vanishes as well. The collocation theorem gives order four, and its stability function is exactly the same as the three-stage Lobatto IIIA function. Yet the Gauss method is algebraically stable, whereas that Lobatto method is not. Identical scalar linear stability functions need not imply identical nonlinear stability properties.
An example combining stiff damping and nonlinear contraction is the two-stage Radau IIA method, with
Its positive weights and positive semidefinite prove B-stability; its rational function has denominator roots and, for , satisfies
Thus it is A-stable; the limit then proves L-stability. The standard Radau IIA collocation theorem gives order , here three. These properties explain its usefulness for stiff nonlinear equations.
Finally, A-stability alone does not imply B-stability. The trapezoidal rule fails B-stability even for the scalar dissipative equation . With , its step map is uniquely defined by
At , . Implicit differentiation gives
Thus nearby starting values are separated by approximately twice their original distance after one step, although the exact flow is contractive. This example and the contractivity theorem show why scalar linear analysis, stiff damping and genuinely nonlinear norm estimates answer different stability questions.

Articles by others on the same topic (0)

There are currently no matching articles.