The characteristic polynomials of a linear multistep method are
The consistency of a numerical method conditions hold for every real :
Both roots of a polynomial of , namely and , are simple and have modulus one. The root condition for a multistep method therefore gives zero-stability for every . The Dahlquist equivalence theorem now gives convergence for every fixed . As usual, this means convergence of a numerical method on each fixed finite interval for a sufficiently regular ordinary differential equation with a Lipschitz continuous vector field and starting values tending to the exact starting values. When , the implicit time-stepping method update is locally uniquely solvable for sufficiently small , for example by a contraction mapping if . Zero-stability does not assert that a large fixed step is suitable for a stiff differential equation.
Expand the exact solution about . The unscaled local truncation error is
Only odd powers occur in this centered expansion. Unless , the first nonzero coefficient is the coefficient, giving order of a numerical method two. For , that term vanishes but the next coefficient is , giving order of a numerical method four. Thus
These are exact orders for general smooth ordinary differential equations, since the respective first surviving derivatives need not vanish. With starting errors , the zero-stability established in part (a) makes the global error .
Apply the Dahlquist test equation and put . Every recurrence mode must satisfy
The amplification polynomial of a multistep method, rather than just its root near one, determines absolute stability. Put and use the Cayley transform between the half-plane and disk
For , the characteristic equation becomes
If , the denominator cannot vanish at a root of the characteristic equation: would force , a contradiction. Hence forces , so all amplification roots have modulus less than one. On the imaginary axis the roots have modulus one and are simple: the transformed quadratic has discriminant for imaginary . At they are the two simple roots . Also cannot be a root when and , and the leading coefficient cannot vanish in the closed left half-plane.
If , the root near is
For small negative real it lies below , violating absolute stability. The endpoint deserves separate treatment:
One root is always ; the other is the trapezoidal rule multiplier . They are distinct for every finite in the left half-plane. Consequently, with absolute stability understood as the bounded root condition for a multistep method,
There is a convention at this reducible endpoint: if A-stability is defined to require every unreduced recurrence mode to decay for , the answer is , since the mode persists at . Canceling the common factor gives the A-stable trapezoidal rule, but cancellation removes an actual starting-error mode of the original two-step recurrence. The fourth-order member is outside either A-stability range.
Use the Dirichlet Laplacian eigenvalues and eigenfunctions on :
An expansion reduces the wave equation to independent ordinary differential equations
When , put ; each coefficient is
For finite-energy data and , a uniform spatial bound follows from the energy method, rather than from unjustified absolute summation of the Fourier series. The conserved quantity is
The Poincaré inequality gives . Hence with for , and with for . Since the Dirichlet boundary condition gives , the Cauchy-Schwarz inequality yields
At , the first coefficient is , which is unbounded for some admissible data. For , that coefficient has an exponentially growing component for some admissible data. Thus all-time boundedness of a wave equation with a reaction term requires
At equality, boundedness for a particular data set requires ; the remaining modes are bounded by their spectral gap. Above the threshold, every unstable mode must have its growing component canceled, and any zero-frequency mode must have zero initial velocity. There is no condition on alone for arbitrary specially chosen data.
The printed reference to a limit needs qualification. Bounded oscillations generally have no limit as . If actual existence of that limit for every admissible initial datum is required, no real works: for every , choose with and nonzero pure oscillatory data in that eigenfunction. The boxed inequality answers the intended long-time boundedness question.
Set and . The Dirichlet discrete Laplacian has the eigenvectors
and its negative has the eigenvalues
The discrete sine transform therefore reduces the method of lines equations to . Each coefficient is an oscillator, a linear function, or a hyperbolic function according to the sign of . A finite collection of oscillators is bounded in every fixed-grid norm. A zero-frequency mode can grow linearly, and a negative-frequency-square mode can grow exponentially. Consequently,
is necessary and sufficient for all-time boundedness of a semidiscrete reaction wave equation on this grid. Equality allows bounded displacement only when the initial velocity has zero projection onto the first eigenvector; above it, the growing components must be absent in every unstable mode. A strictly positive spectral gap also gives a time-independent displacement bound uniform over grids whose gaps are bounded below.
The discrete threshold is strictly smaller than , because for , and tends to as . A coarse grid can therefore introduce long-time growth into a continuum problem with . This is distinct from displacement stability of a symmetric semidiscrete wave equation on fixed finite time intervals. As in part (a), if existence of the printed limit is required for every initial datum, no qualifies: any one mode admits oscillatory, secular, or growing initial data, depending on its coefficient.
For the quadratic variational principle for a symmetric positive operator below, use a symmetric operator on the real Hilbert space . Strict positive definiteness means
A uniformly positive definite symmetric operator satisfies the stronger coercive operator condition
In this variational setting, “positive definite” is often used for a symmetric operator with this uniform bound. We will state explicitly where the coercive operator bound is needed. For a bounded linear operator defined on all of , symmetry means that the operator is self-adjoint. For an unbounded operator, positivity is imposed on its operator domain, and the variational formulation is made on its form domain.
Symmetry is essential in a real Hilbert space: positivity of the quadratic expression alone does not imply symmetry. For example, with nonzero real skew-symmetric matrix satisfies , but its quadratic functional has derivative involving , not . A positive definite symmetric operator supplies both the positivity and symmetry needed in part (b).
First let be a bounded linear operator on satisfying the symmetric positive-definiteness convention in part (a). For any direction , expansion of the quadratic functional gives
Thus vanishing of the first variation in every direction is precisely the weak equation for every . In this whole-space bounded-operator setting it is equivalent to , the Euler-Lagrange equation.
If solves that equation, set . The linear terms cancel:
with equality only when . Hence the weak solution is the unique global minimizer. Conversely, any minimizer has zero first variation, and therefore solves the weak equation. For a symmetric bounded bilinear form on a form space , exactly the same calculation gives and for every ; it does not require an unbounded differential operator to map every into .
Existence for every requires an extra hypothesis if “positive definite” means only strict positivity. The coercive operator bound makes the form coercive, so the Lax-Milgram theorem supplies existence and uniqueness. Without that bound, the diagonal operator on sequence space on is symmetric and strictly positive, but belongs to and its formal inverse does not. Thus strict positivity alone proves uniqueness and the minimizing property of a solution when one exists, not existence for all .
There is a genuine conflict in the printed coefficient assumptions: no uniformly positive coefficient in a zero-boundary Sobolev space exists. A function cannot also obey almost everywhere. Indeed, the Lipschitz truncation has , so Lipschitz truncation preserves zero-boundary Sobolev spaces, giving . But would be the nonzero constant . Its zero gradient contradicts the Poincaré inequality in the zero-boundary Sobolev space. Thus the literal coefficient class is empty.
For the meaningful uniformly elliptic problem, take with , and impose the Dirichlet boundary condition on the unknown and test functions: . Additional regularity of is harmless, but a zero trace for must be removed. The divergence-form elliptic operator is . Integration by parts defines the symmetric bounded bilinear form
In particular,
Here is the first Dirichlet Laplacian eigenvalue on the unit square; the Poincaré inequality follows, for example, by applying the one-dimensional inequality in each coordinate and adding. Thus is coercive in the gradient norm on , and the Dirichlet realization of is a positive definite symmetric operator. On its operator domain, .
The required functional and weak equation are
Because , the right side is a bounded linear functional by the Cauchy-Schwarz inequality and Poincaré inequality. The Lax-Milgram theorem gives a unique weak solution, and part (b) proves that it uniquely minimizes . These formulas prove the intended conclusion under the repaired coefficient hypothesis; under the literal hypothesis there is no coefficient to which the conclusion can be applied.
The tableau is the three-stage Lobatto IIIA method. To check its order of a Runge-Kutta method directly, write , , and . The eight fourth-order conditions for a Runge-Kutta method evaluate to
Powers of here mean componentwise powers. For example, , , and , which make the last three checks immediate. These Butcher order conditions establish order at least four for general nonlinear ordinary differential equations.
It is not order five: part (b)'s stability function has expansion
The fifth coefficient already fails on the Dahlquist test equation. The order is exactly four.
For a Runge-Kutta method, the stability function is . Solving the stage equations on the Dahlquist test equation gives
The denominator has roots of a polynomial , both in the open right half-plane. If , direct expansion gives
Since , the modulus of is at most one exactly when . Thus
The method is A-stable. Its stability function has unit modulus on the imaginary axis and tends to one as , so it is not L-stable.
The criterion for algebraic stability of a Runge-Kutta method is and positive semidefiniteness of
The Runge-Kutta contractivity identity implies that this criterion is sufficient for B-stability, namely contractivity for a dissipative vector field, whenever the stage equations are defined. The implication from algebraic stability to B-stability is the relevant nonlinear theorem; A-stability alone is a linear property.
All weights here are positive, but
A positive semidefinite matrix cannot have this negative quadratic value. Hence the method is not algebraically stable. Failure of this sufficient criterion alone would not be a proof of failure of B-stability; no such converse is needed for the question.
For energy stability for variable-coefficient reaction diffusion, let , let be the Dirichlet discrete Laplacian, and set . Use the mesh-weighted inner product with the corresponding discrete L2 norm. For zero boundary values, summation by parts gives
For a solution, or a difference of two solutions, the energy method gives
The Gronwall inequality therefore proves
The constant is independent of , so this is stability of a numerical method on every fixed finite time interval. The bound allows physical growth if ; stability here does not mean uniform boundedness as .
There is also a uniform maximum-norm bound. At a positive spatial maximum the second difference is nonpositive. Applying this observation to and to its negative gives . With a perturbing source , the Duhamel principle gives the corresponding initial-data bound plus in either norm. Thus the estimate controls accumulated residuals as well as initial perturbations.
The original PDF has on the left of the update; the converted TeX omits its . Use the Forward Euler method with and . The explicit time stepping for bounded reaction diffusion update matrix is
When , the heat update has nonnegative stencil weights and row sums at most one. Hence its induced maximum operator norm is at most one. It is also a symmetric matrix with eigenvalues
all in , so its discrete L2 norm operator bound is at most one too. Let . In either of these norms,
Iteration gives the mesh-uniform stability estimate
The same estimate applies to differences of solutions. Adding a per-step defect gives .
This proof only requires and bounded reaction coefficients. It does not assume the full update is nonnegative: a negative can make its middle stencil weight negative when . Nor does it claim contractivity or an all-time bound for every coefficient. The required stability is a bound uniform in the discretization on fixed finite intervals.
For an evolutionary partial differential equation, stability of a numerical method means that errors in the starting data and forcing stay controlled on each fixed interval , with constants independent of the mesh. Fourier stability analysis is especially effective for a constant-coefficient finite difference method on a uniform infinite or periodic grid: translation invariance makes different Fourier modes evolve independently.
For a scalar one-step scheme on the integer lattice, insert , with . The Fourier symbol of each shift is , and the update reduces to
The amplification factor must be defined for every relevant frequency; for an implicit scheme this includes checking that its denominator is nonzero. The Parseval identity turns a bound into a discrete L2 norm bound. Thus gives contractivity, while the more general bound gives for . Conversely, frequencies with amplification uniformly greater than one produce unstable wave packets or periodic Fourier modes under refinement.
For a system, is an amplification matrix; for a multilevel scheme, a companion matrix evolves the vector of time levels. The actual requirement is a uniform bound on matrix powers, not just their spectral radius. A nontrivial Jordan block at a unit-modulus eigenvalue creates polynomial growth in the time index. Even simple eigenvalues inside the unit disk can fail to give a uniform bound if the eigenvector matrices become ill-conditioned as the mesh changes. Uniformly controlled diagonalization of a matrix, or a suitable quadratic energy estimate, resolves this issue. The power boundedness of a two-level Fourier scheme illustrates why root multiplicities and conditioning matter.
For the heat equation, put . Centered space with the Forward Euler method has
The von Neumann stability analysis condition holds exactly for on the full frequency interval. The Backward Euler diffusion scheme instead has and is stable for every . The Crank-Nicolson diffusion scheme has
It too is unconditionally stable, but poorly resolved high-frequency modes have for large , giving oscillatory numerical transients. A-stability therefore does not guarantee strong damping; L-stability distinguishes the damping of the Backward Euler method.
For the advection equation , let . Forward time and centered space give
For nonzero fixed , repeated steps amplify some modes by a fixed factor greater than one, so the method is unstable under the usual refinement . This calculation also shows the refinement qualification: if , its finite-time growth can be bounded by , though the restrictive scaling defeats the usual hyperbolic time-step choice. For , the upwind finite difference scheme has
so it is stable for . The Lax-Wendroff advection scheme instead has
giving . These examples separate the effects of the spatial stencil, temporal approximation and Courant number; a higher order of a numerical method by itself does not establish stability.
A periodic boundary condition is ideal for this analysis. The discrete Fourier transform diagonalizes the circulant update, with only the discrete frequencies needed on a grid of points. A bound on all is a convenient guarantee over every such grid. On the whole line, the Fourier transform uses a continuous frequency interval and the Parseval identity proves the corresponding square-summable-data estimate.
Homogeneous Dirichlet boundary conditions do not admit arbitrary complex exponential Fourier modes. For the standard centered second difference on interior points, a discrete sine transform diagonalizes the actual boundary-value matrix:
The same heat amplification formulas then apply at these sine frequencies. For example, the exact forward-Euler contractivity limit on that fixed grid is ; the mesh-independent sufficient limit follows by including all frequencies. Homogeneous Neumann boundary conditions can similarly permit a discrete cosine transform, provided the endpoint discretization and its weighted inner product are chosen consistently. The constant mode is then present, reflecting conservation of the heat equation's spatial mean. For inhomogeneous boundary conditions, subtract a suitable lifting of the prescribed boundary data and estimate the induced source using the homogeneous evolution's bound and a Duhamel principle estimate. Bounds for the lifting and source must themselves be uniform in the mesh.
General boundary conditions require separate boundary stability of a finite-difference method. For an advection equation, incoming data are prescribed at the inflow boundary, while an outflow closure must respect the outgoing characteristics. An interior periodic Fourier symbol cannot detect a growing mode confined near a boundary. A normal-mode test on a half-line seeks modes with and that satisfy both the interior recurrence and boundary closure. Their existence proves instability, and uniform control requires more than merely excluding isolated growing roots; the Uniform Kreiss--Lopatinskii condition addresses boundary resolvent bounds. Alternatively, a direct energy method using summation by parts can include the boundary terms and establish the required estimate.
Variable coefficients and nonuniform meshes usually destroy exact Fourier transform diagonalization. Frozen-coefficient Fourier stability analysis is then a useful diagnostic, but it is not automatically a proof for the full variable-coefficient boundary problem. The mesh-uniform energy method in question 5 is an example of a direct proof. Also, an L2 norm proof is not automatically a mesh-uniform maximum-norm proof: finite-dimensional norm-equivalence constants may grow with the number of grid points.
Finally, stability measures error propagation; consistency of a numerical method measures the defect of inserting the exact solution. For a well-posed linear initial-value problem in the chosen norm, the Lax equivalence theorem says that a consistent approximation is convergent exactly when it is stable. Boundary discretization and starting data must be included in that assertion. A Fourier calculation proves convergence only after consistency, well-posedness and the actual boundary treatment have also been checked.
Consider an initial value problem on , with a Lipschitz continuous vector field in the solution variable and enough smoothness for the stated error expansions. Convergence of a numerical method means
with consistent starting values. An order of a numerical method quantifies this approximation: with sufficiently accurate starting data and the required stability, the global error is . Stability of a numerical method controls the amplification and accumulation of perturbations; it is the link between a small local defect and small global error.
For a one-step formula , define the unscaled local truncation error
The method has local order if uniformly along sufficiently smooth solutions. If the defect is divided by , its order is instead ; the convention must be specified. Assume also the perturbation estimate
The global error then satisfies
Iterating, or applying the discrete Gronwall inequality, gives
There are steps on a fixed interval, so stable propagation turns local defects into accumulated error. Starting error is needed to retain order . This explains why matching an exact Taylor expansion is insufficient unless errors are controlled during repeated steps.
For a fixed-coefficient linear multistep method, write
The consistency of a numerical method conditions are and . The higher order conditions for a linear multistep method are
with right side zero for ; exact order means first failure at . They come from inserting the exact solution and comparing its Taylor expansion.
Errors at follow the homogeneous recurrence determined by . Zero-stability is equivalent to the root condition for a multistep method: all roots of a polynomial have modulus at most one, and every unit-modulus root is simple. Roots outside the disk give exponential growth in the number of steps; repeated unit roots give polynomial growth in that number. Repeated interior roots are harmless because their polynomial factors are dominated by decay. Under the usual Lipschitz continuity and initialization assumptions, the Dahlquist equivalence theorem gives
For a zero-stable order- linear multistep method, local defects and starting errors of the stated orders yield global error by a recurrence bound and the discrete Gronwall inequality. Every required starting value matters.
A concrete failure of “consistency implies convergence” is
Here and , so and : the method is consistent, of order one. But its root violates zero-stability. For with exact solution zero and starting values , , the computed solution is . These starting errors vanish, yet at the error diverges. Local accuracy cannot compensate for an unstable recurrence.
A different meaning of stability concerns a fixed step on decaying equations. The Dahlquist test equation introduces . A one-step method gives and is absolutely stable when . For a linear multistep method, the corresponding amplification polynomial of a multistep method is , and every root must satisfy the bounded root condition, not just the root approximating . Strict asymptotic decay requires the roots to have modulus less than one for . This distinction matters at reducible methods with an undamped parasitic mode, as in question 1(c).
The Forward Euler method has order one and , so its linear stability domain is . For , with , it requires . It converges as , yet an excessively large step can produce growing oscillations on an exactly decaying problem. The Backward Euler method has the same order, but makes it A-stable and L-stable. For a stiff differential equation, fast decay can impose a severe explicit time-step restriction even when accuracy of the slow dynamics would permit a much larger step.
The trapezoidal rule has order two and is A-stable, but is not L-stable, since its stability function tends to along the negative real axis. The Second Dahlquist barrier limits an irreducible A-stable linear multistep method to order at most two. This does not limit implicit Runge-Kutta methods: question 4's Lobatto IIIA method is fourth-order and A-stable. Conversely, question 1's fourth-order member is convergent but not A-stable. These examples show that order of a numerical method, zero-stability and A-stability answer different questions.
For nonlinear dissipative problems, B-stability controls distances between numerical solutions; algebraic stability of a Runge-Kutta method is a sufficient coefficient criterion. Question 4 shows that A-stability alone does not imply that coefficient criterion. Variable time steps require additional analysis of step ratios and error propagation, and stiff problems may require uniform-in-stiffness error estimates beyond the fixed-problem convergence result. The useful chain is local accuracy plus the appropriate perturbation bound, giving global accuracy; absolute and nonlinear stability then determine which practical time steps preserve the intended dynamics.

Articles by others on the same topic (0)

There are currently no matching articles.