Let . The chain rule gives along a smooth solution. Expanding every term about , the unscaled exact-solution residual of this multiderivative multistep method is
For example, at derivative degree its coefficient is
the coefficients at degrees zero, one and two vanish. Thus the formal order of a numerical method is two for , and three for , where the fourth-degree coefficient is . This order statement describes the exact-solution defect; convergence also needs zero-stability.
At the characteristic polynomial is
The root condition for a multistep method holds exactly when and . In particular has two distinct unit roots and is admissible, whereas has a repeated unit root. Applying the permitted Dahlquist equivalence theorem for this multiderivative setting, with smooth , the nearby implicit solution branch and convergent starting values, yields
All those methods have global order two, provided the starting errors are . The formally third-order choice is not zero-stable and therefore is not convergent as a method for general initial-value problems.
One can see the failure without any nonlinear difficulty. For , an error mode grows exponentially if . At , ; choosing , gives vanishing starting errors but . This also explains why a small residual alone does not rescue that degenerate choice: at the first-derivative term disappears and the formula has no zero-stable first-order evolution interpretation.
The relevant one of the characteristic polynomials of a linear multistep method is
The coefficients on the right are chosen to give third order, so consistency of a numerical method is already available. By the Dahlquist equivalence theorem, convergence with convergent starting values is equivalent to zero-stability: every root of must satisfy , and every root on the unit circle must be simple.
If , the quadratic is negative at and tends to as , so it has a root less than . If , its root product is , so at least one root has modulus greater than one. For , its real roots lie in . For , its conjugate roots have modulus .
At , the three roots are , with the unit-modulus roots simple. At , they are , again simple. The repeated quadratic root at is , strictly inside the unit circle, which the root condition for a multistep method permits. Therefore
This is the root stability of a cubic multistep polynomial; oscillatory parasitic roots at the endpoints do not invalidate convergence when their starting amplitudes tend to zero.
The Dahlquist equivalence theorem states that a consistent linear multistep method is convergent for suitably consistent starting values exactly when it is zero-stable. The root condition for a multistep method requires every root of to lie in the closed unit disk, with every unit-modulus root simple.
The roots are and . Thus is necessary; is excluded because it gives a double root at one. At , the two unit roots are distinct, so the endpoint is allowed. Combined with part (a), this proves
Assume a locally Lipschitz vector field, a smooth solution on the fixed time interval, a nearby solvable implicit branch and starting errors of the required order. The global order is three at and two at the other convergent parameter values. Outside this interval, zero-step perturbations already grow through either an exterior root or a unit-root polynomial factor.
The characteristic polynomials of a linear multistep method are
The consistency of a numerical method conditions hold for every real :
Both roots of a polynomial of , namely and , are simple and have modulus one. The root condition for a multistep method therefore gives zero-stability for every . The Dahlquist equivalence theorem now gives convergence for every fixed . As usual, this means convergence of a numerical method on each fixed finite interval for a sufficiently regular ordinary differential equation with a Lipschitz continuous vector field and starting values tending to the exact starting values. When , the implicit time-stepping method update is locally uniquely solvable for sufficiently small , for example by a contraction mapping if . Zero-stability does not assert that a large fixed step is suitable for a stiff differential equation.
Apply the Dahlquist test equation and put . Every recurrence mode must satisfy
The amplification polynomial of a multistep method, rather than just its root near one, determines absolute stability. Put and use the Cayley transform between the half-plane and disk
For , the characteristic equation becomes
If , the denominator cannot vanish at a root of the characteristic equation: would force , a contradiction. Hence forces , so all amplification roots have modulus less than one. On the imaginary axis the roots have modulus one and are simple: the transformed quadratic has discriminant for imaginary . At they are the two simple roots . Also cannot be a root when and , and the leading coefficient cannot vanish in the closed left half-plane.
If , the root near is
For small negative real it lies below , violating absolute stability. The endpoint deserves separate treatment:
One root is always ; the other is the trapezoidal rule multiplier . They are distinct for every finite in the left half-plane. Consequently, with absolute stability understood as the bounded root condition for a multistep method,
There is a convention at this reducible endpoint: if A-stability is defined to require every unreduced recurrence mode to decay for , the answer is , since the mode persists at . Canceling the common factor gives the A-stable trapezoidal rule, but cancellation removes an actual starting-error mode of the original two-step recurrence. The fourth-order member is outside either A-stability range.
Consider an initial value problem on , with a Lipschitz continuous vector field in the solution variable and enough smoothness for the stated error expansions. Convergence of a numerical method means
with consistent starting values. An order of a numerical method quantifies this approximation: with sufficiently accurate starting data and the required stability, the global error is . Stability of a numerical method controls the amplification and accumulation of perturbations; it is the link between a small local defect and small global error.
For a one-step formula , define the unscaled local truncation error
The method has local order if uniformly along sufficiently smooth solutions. If the defect is divided by , its order is instead ; the convention must be specified. Assume also the perturbation estimate
The global error then satisfies
Iterating, or applying the discrete Gronwall inequality, gives
There are steps on a fixed interval, so stable propagation turns local defects into accumulated error. Starting error is needed to retain order . This explains why matching an exact Taylor expansion is insufficient unless errors are controlled during repeated steps.
For a fixed-coefficient linear multistep method, write
The consistency of a numerical method conditions are and . The higher order conditions for a linear multistep method are
with right side zero for ; exact order means first failure at . They come from inserting the exact solution and comparing its Taylor expansion.
Errors at follow the homogeneous recurrence determined by . Zero-stability is equivalent to the root condition for a multistep method: all roots of a polynomial have modulus at most one, and every unit-modulus root is simple. Roots outside the disk give exponential growth in the number of steps; repeated unit roots give polynomial growth in that number. Repeated interior roots are harmless because their polynomial factors are dominated by decay. Under the usual Lipschitz continuity and initialization assumptions, the Dahlquist equivalence theorem gives
For a zero-stable order- linear multistep method, local defects and starting errors of the stated orders yield global error by a recurrence bound and the discrete Gronwall inequality. Every required starting value matters.
A concrete failure of “consistency implies convergence” is
Here and , so and : the method is consistent, of order one. But its root violates zero-stability. For with exact solution zero and starting values , , the computed solution is . These starting errors vanish, yet at the error diverges. Local accuracy cannot compensate for an unstable recurrence.
A different meaning of stability concerns a fixed step on decaying equations. The Dahlquist test equation introduces . A one-step method gives and is absolutely stable when . For a linear multistep method, the corresponding amplification polynomial of a multistep method is , and every root must satisfy the bounded root condition, not just the root approximating . Strict asymptotic decay requires the roots to have modulus less than one for . This distinction matters at reducible methods with an undamped parasitic mode, as in question 1(c).
The Forward Euler method has order one and , so its linear stability domain is . For , with , it requires . It converges as , yet an excessively large step can produce growing oscillations on an exactly decaying problem. The Backward Euler method has the same order, but makes it A-stable and L-stable. For a stiff differential equation, fast decay can impose a severe explicit time-step restriction even when accuracy of the slow dynamics would permit a much larger step.
The trapezoidal rule has order two and is A-stable, but is not L-stable, since its stability function tends to along the negative real axis. The Second Dahlquist barrier limits an irreducible A-stable linear multistep method to order at most two. This does not limit implicit Runge-Kutta methods: question 4's Lobatto IIIA method is fourth-order and A-stable. Conversely, question 1's fourth-order member is convergent but not A-stable. These examples show that order of a numerical method, zero-stability and A-stability answer different questions.
For nonlinear dissipative problems, B-stability controls distances between numerical solutions; algebraic stability of a Runge-Kutta method is a sufficient coefficient criterion. Question 4 shows that A-stability alone does not imply that coefficient criterion. Variable time steps require additional analysis of step ratios and error propagation, and stiff problems may require uniform-in-stiffness error estimates beyond the fixed-problem convergence result. The useful chain is local accuracy plus the appropriate perturbation bound, giving global accuracy; absolute and nonlinear stability then determine which practical time steps preserve the intended dynamics.
The Dahlquist equivalence theorem states that a linear multistep method has convergence of a numerical method if and only if it is consistent and zero-stable, under the standard assumptions for the initial value problem and convergent starting values. Consistency of a numerical method means order at least one, or
The root condition for a multistep method expresses zero-stability: every root of has modulus at most one, and every root with modulus one is simple. Usual hypotheses include a well-posed ordinary differential equation with continuous in time and Lipschitz continuous in the solution variable, a valid step equation, and starting approximations converging to the exact values.
With , , , the constant order condition gives . The next three order conditions for a linear multistep method give
Solving this linear system yields the unique coefficients of order at least three:
The characteristic polynomial controlling zero-stability factors as
The other root is . Requiring its modulus to be at most one gives , but produces a repeated root at one and violates the root condition for a multistep method. At , the roots are both simple, so that endpoint is allowed. By the Dahlquist equivalence theorem, the method converges precisely for
The fourth defect coefficient is , so the method has order exactly three for nonzero . At it is the two-step Simpson method, of order four; thus the extra-order endpoint has correctly remained in the answer.
Apply the numerical method to the scalar test equation , with . Its linear stability domain consists of those for which the discrete solution stays bounded as the step count tends to infinity. For a one-step method with stability function , this is
If asymptotic decay is required, use instead; this only changes the boundary conventions in part (b). A method is A-stable if its stability domain contains the left half-plane, so every decaying linear test equation is stable for every positive step size. For a multistep method, the corresponding definition uses the root condition for a multistep method for every characteristic root, including simplicity of unit-modulus roots.
On the Dahlquist test equation, , so the amplification polynomial of a multistep method becomes
Both roots of a polynomial, including the parasitic one, must satisfy the root condition for a multistep method.
For , multiply by seven and set . The polynomial is . The complex quadratic Schur criterion says that its roots of a polynomial are strictly in the unit disk if
Here is a direct verification on the entire left half-plane. Put , , , and . Then
and expansion of the squared inequality gives
Every term is nonnegative, and at least one is positive unless . Since , taking square roots proves the strict complex quadratic Schur criterion for . At , the roots of a polynomial are the simple values and . The leading coefficient cannot vanish because . Thus the method at is A-stable. Its order three is compatible with the Second Dahlquist barrier: that barrier concerns first-derivative linear multistep methods, whereas this method uses a second derivative.
For , choose , strictly in the left half-plane. The amplification polynomial of a multistep method reduces to
One root of a polynomial has modulus . Thus the method at is not A-stable.
The first characteristic polynomials of a linear multistep method is
The root condition for a multistep method requires and excludes , where the root of a polynomial at one is double. At , the two unit-modulus roots of a polynomial are distinct, so zero-stability holds. For , the first-order consistency of a numerical method identity is , equal to the coefficient of .
Using the permitted Dahlquist equivalence theorem in this multiderivative multistep method setting gives
This means convergence on every fixed finite time interval where the smooth exact solution of a differential equation exists, with consistent starting values and the nearby branch of each implicit solve. More specifically, the convergence of a zero-stable multiderivative method gives order when the starting errors are and both and are locally uniformly Lipschitz continuous on the relevant region.
The exclusions are genuine. For and , an arbitrarily small parasitic starting error is amplified as . At , take , , also for . The exact solution is zero, but the numerical recurrence gives , an error of order one at fixed positive time. This proves failure even though the starting values converge.
The spatial shift in the PDF also requires a boundary value beyond the supplied right endpoint: if is the last interior index, the newest value is outside the interval. Thus the printed Dirichlet method has no specified boundary closure, and no unique stability range can be assigned to it as stated.
For completeness, the literal interior formula has an exact Von Neumann stability analysis on an infinite or periodic grid. Substitution of a Fourier mode gives
For the root of a polynomial tending to one as , expansion gives
Consequently is unstable: sufficiently small nonzero frequencies have a root of a polynomial of modulus greater than one, and arbitrarily fine periodic grids contain such frequencies.
Conversely, if and , then
For with ,
Since , the complex quadratic Schur criterion yields both roots of a polynomial in the unit disk, strictly inside except at , where they are and . Uniform stability follows directly from the BDF2 discrete energy identity: the modal recurrence is , whose energy decreases because . Summing the modal energies proves a bound independent of the grid and even of ; no eigenvector-separation assumption is needed. This is the stability of a spatially shifted BDF2 stencil. Thus the literal periodic-grid result is
This cannot establish stability of an unspecified Dirichlet boundary condition closure. It also does not restore consistency of a numerical method.
For the intended unshifted backward differentiation formula, a spatial eigenvalue gives
The Schur stability criterion gives the root condition for a multistep method for every , with strict inequalities for . A useful uniform energy method proof, including the repeated interior roots that a bare separation argument would miss, is the BDF2 discrete energy identity. With and
the corrected Dirichlet discrete Laplacian scheme satisfies
This follows by taking the inner product of with and using summation by parts. It controls both time levels uniformly, regardless of the mesh ratio. Hence the corrected method is stable for
For a fully discrete linear partial differential equation evolution, write in a specified discrete norm. Finite-time stability of a numerical method means
with independent of the allowed meshes. For a multistep method, augment the state with its time-history values and include a stable starter. Bounds may grow as when the continuous problem has growth; demanding decay for all time would be a stronger assertion. The treatment of initial data, forcing, Dirichlet boundary conditions, and the norm is part of the hypothesis, not a detail supplied by an interior calculation.
For constant coefficients on an infinite or periodic uniform grid, Von Neumann stability analysis substitutes the Fourier mode . The discrete Fourier transform and the Parseval identity turn a uniform multiplier estimate into a discrete L2 norm estimate. In a one-step scalar scheme, proves contractivity, while gives finite-time stability. In a multilevel scheme, every root of a polynomial in its amplification polynomial of a multilevel finite difference scheme matters, as does uniform control of the associated companion matrix.
For the Forward Euler diffusion scheme with ,
Thus for all frequencies exactly when
Sufficiency follows since ; necessity follows from the highest-frequency mode on even periodic grids. This gives the usual parabolic mesh restriction . For the Backward Euler diffusion scheme,
so every is stable. The Crank--Nicolson method has
again of modulus at most one for all , but stiff modes approach rather than zero. These are PDE manifestations of the A-stability and L-stability distinctions for time integration.
For advection , assume and set . The upwind finite difference scheme is , with
It is contractive when . This also has a direct maximum-norm proof: each newest value is a convex combination of two old values. The resulting Courant–Friedrichs–Lewy condition expresses that the numerical domain of dependence covers the physical one. For negative , the upwind direction must be reversed. By contrast, Forward Euler method time stepping with the centered first finite difference has and for nonzero . Under fixed nonzero refinement it is unstable, since a fixed nontrivial mode grows geometrically over steps. This is not a claim of instability under every imaginable mesh coupling: instead bounds its spurious finite-time growth, since .
The leapfrog advection scheme illustrates a multilevel subtlety. Its amplification polynomial of a multilevel finite difference scheme is
For , both roots of a polynomial have unit modulus and separation at least . A uniformly conditioned eigenbasis of the companion matrix then proves power boundedness of a two-level Fourier scheme for arbitrary history data. At and a grid admitting , the roots coincide on the unit circle, and a Jordan block produces growth. Thus the endpoint fails the ordinary arbitrary-history root condition for a multistep method; checking only that both moduli equal one misses the instability. Restricting the starter or filtering the parasitic mode is an additional hypothesis.
The energy method handles variable coefficients and finite boundaries for which Fourier stability analysis may be unavailable. For the Backward Euler diffusion scheme with homogeneous Dirichlet boundary conditions, define . The discrete summation by parts identity is
Take the inner product of with . The elementary identity gives
This proves unconditional contractivity including the actual boundary treatment. More generally, a dissipative operator gives of operator norm at most one: with , dissipativity implies , and the Cauchy-Schwarz inequality gives . In finite dimensions this also proves invertibility. For the second-order backward differentiation formula, the BDF2 discrete energy identity used in question 4 controls both time levels and proves unconditional diffusion stability. A repeated root strictly inside the disk is harmless here; the energy argument supplies the uniform bound without a singular eigenvector formula.
A second technique is eigenvalue stability analysis of a finite difference method. Under the method of lines, a time integrator advances by . If is a normal matrix, the scalar linear stability domain criterion on all controls its powers exactly in the corresponding L2 norm. For the centered Dirichlet discrete Laplacian, its eigenvalues lie between and zero; intersecting this interval with a time integrator's stability interval determines its mesh restriction. A uniform bound on the diagonalization of a matrix is needed for nonnormal diagonalizable systems. Eigenvalues alone can be misleading. For example,
has both eigenvalues inside the disk for , but the upper-right entry of is . Taking , , this grows like . Hence stable scalar eigenvalues do not give mesh-uniform stability. Boundary closures can introduce precisely the extra growth that an interior Fourier symbol overlooks, so boundary stability of a finite-difference method must be checked separately.
For nonlinear spatial discretizations, a useful replacement for Fourier stability analysis is a convexity argument. If the Forward Euler method map is nonexpansive in a chosen norm for , the second-order strong stability preserving Runge-Kutta method
is also nonexpansive under the same restriction. Indeed, for two inputs, the triangle inequality gives . Its Taylor expansion is , proving order two. Such strong stability preserving Runge-Kutta methods transfer suitable forward-step bounds without relying on a linear spectral calculation.
Finally, consistency of a numerical method explains what stability buys. For a linear Hadamard well-posed problem, the Lax equivalence theorem equates convergence of a consistent discretization with its stability, under the stated approximation-space and norm hypotheses. Directly, if the error satisfies , iteration gives the discrete Duhamel principle
Thus vanishing normalized local truncation error and initial error yield convergence. With a nonlinear Lipschitz step estimate, the discrete Gronwall inequality plays the same role. A stable but inconsistent stencil, such as the literal defective formulas in questions 3 and 4 under their usual refinement, is not rescued by any amplification bound. The decisive checks are a mesh-uniform evolution bound, a valid boundary closure, and consistency with the actual PDE.
For a fixed-step linear multistep method with a nonzero leading coefficient, applied to an ordinary differential equation with a locally Lipschitz continuous vector field, the Dahlquist equivalence theorem states that
Here convergence is uniform on each fixed finite time interval as the step size tends to zero, for every set of starting values tending to the corresponding exact values. Consistency of a numerical method means that the normalized local defect tends to zero; for the characteristic polynomials of a linear multistep method it gives and . Zero-stability is equivalent to the root condition for a multistep method: every root of a polynomial of satisfies , and roots with are simple. Order , together with zero-stability and starting errors , gives global error under the usual smoothness assumptions.
To prove the necessity of the root condition for multistep convergence, use the test problem , . Its discrete error satisfies , where . Set . If , the exact recurrence solution
has starting errors tending to zero at every fixed starting index, but . Thus convergence fails.
If a unit-modulus root has multiplicity , the recurrence instead admits
Again every fixed starting error tends to zero while . These polynomial-times-exponential solutions follow from the repeated factor . Complex modes can be interpreted as a real two-component system, or their real and imaginary parts can be used. Therefore convergence requires precisely the root condition for a multistep method. Repeated roots strictly inside the unit disk are allowed, since their polynomial factors are dominated by exponential decay.
Factor the first characteristic polynomial as
The other two roots of a polynomial have product one. If , they are : distinct unit-modulus roots, both different from one. At , the root is double; at , the root one is triple. Outside , one of the reciprocal real roots has modulus greater than one. Thus the root condition for a multistep method holds exactly for .
For the order conditions for a linear multistep method, expand the exponential defect:
The constant, linear and quadratic coefficients vanish for every . The cubic coefficient vanishes only at , where the quartic coefficient is . Consequently the formal order is
For all parameters satisfying the root condition for a multistep method, , so this formal calculation gives ordinary second-order consistency of a numerical method. The Dahlquist equivalence theorem therefore yields
The exceptional third-order formula is not zero-stable. At , and : the recurrence contains no vector-field evaluations. It satisfies the displayed Taylor identities only formally and is a degenerate, nonconvergent formula, not a usable second-order ODE solver. This distinction avoids interpreting formal cancellation as convergence.
Expand about and use from the chain rule. The residual of the exact solution is
The coefficients through vanish, and the displayed fourth-order coefficient does not. Thus the multiderivative multistep method has order three.
At , its first characteristic polynomial is
Its roots are and , with the unit-modulus root simple, so it satisfies the root condition for a multistep method and is zero-stable. Combining this with the defect estimate proves convergence of order three, assuming sufficiently smooth , order-three starting values, and the nearby branch of each implicit update.
More explicitly, the right-hand side is , where has a uniform local Lipschitz continuity bound for small . A bounded zero-stable impulse response and the discrete Gronwall inequality therefore control the accumulated defects by over fixed time intervals. This is convergence of a zero-stable multiderivative method, rather than a direct application of the first-derivative-only Dahlquist equivalence theorem.