Multiply by a test function vanishing at the endpoints and apply integration by parts. The positive operator is , so the forcing changes sign. The weak formulation of this forced Airy boundary-value problem is: find such thatHere is the zero-boundary Sobolev space and can be equipped with . The interval Poincaré inequality states , so this norm makes a Hilbert space and is equivalent to its usual Sobolev norm. The form is symmetric and satisfiesThe Lax-Milgram theorem says that a bounded coercive bilinear form on a Hilbert space and a bounded linear functional determine exactly one weak solution. All its hypotheses have just been verified. Moreover, gives on the interval; the right-hand side is then continuous, so this weak solution is the classical solution with the prescribed endpoint values.
Since the form is symmetric, the equivalent Ritz method minimizesIndeed, stationarity gives the weak equation andwith equality only at . This proves the minimization equivalence, including the sign of the linear term.
Restricting to a conforming finite element space gives a unique discrete solution and Galerkin orthogonality, for every . The Céa lemma states that if the continuity and coercivity constants are and , then . For this symmetric problem the exact best-approximation constant in the energy norm is one. The piecewise-linear finite element interpolation estimate on regular finite element meshes therefore gives convergence of a numerical method of the Ritz method, with first-order error in the energy norm.
Take a uniform finite element mesh , , , and interior piecewise-linear hat functions . Write . The Ritz method gives withThe derivative part has diagonal , neighboring entries and zero other entries. For the affine-weighted hat mass matrix, symmetry around givesOn , the product of the two hats is symmetric about the midpoint, integrates to , and therefore has weighted integralConsequently the explicit tridiagonal equations arefor , with . The reaction coefficient has been integrated exactly; replacing it by an unweighted constant mass matrix would give a different system. For a nonzero coefficient vector, the represented function is nonzero and , so the matrix is symmetric positive-definite and the algebraic solution is unique.
Uniform spacing is a choice, not a requirement of the method. On a general finite element mesh with , the corresponding entries arewith symmetric lower entries. These reduce to the displayed uniform-grid system.
For this two-step family with a third-order member, use the exponential-symbol order criterion for a multistep method. Expanding the exact-solution residual symbol givesThe constant, linear and quadratic coefficients vanish for every parameter. ThusAt the exceptional value the fourth-degree coefficient is , so there is no further increase. This means an unscaled exact-solution residual of order , or a residual divided by the step of order .
The first characteristic polynomial factors as . The root condition for a multistep method requires every root to have modulus at most one and each unit-modulus root to be simple. The root is allowed because it is distinct from the simple root one; is not, since it makes one a double root. Hence zero-stability holds exactly forOn this interval, and establish consistency of a numerical method. The Dahlquist equivalence theorem, for a fixed-step consistent linear multistep method applied to an ordinary differential equation with a Lipschitz continuous right-hand side with convergent starting values and well-defined small-step updates, says that convergence of a numerical method is equivalent to zero-stability. Therefore the same interval is exactly the convergence of a numerical method range. With sufficiently accurate starting values the convergent members have the orders just computed.
At the Taylor expansion still gives a formal order-two residual, but and the double root prevents a convergent method. Canceling the common factor produces the common-factor cancellation defect in a multistep recurrence and changes the starting relations and cannot repair convergence of a numerical method of the original recurrence. At , cancellation of a zero root instead reveals the ordinary trapezoidal rule; it is consistent with the order-two result.
Apply the method to the Dahlquist test equation, put , and retain every root of its amplification polynomial of a multistep method:An A-stable convergent method must satisfy the root condition for a multistep method for every .
First take . As negative real tends to minus infinity, one root tends to the nonzero root of ,It follows by root continuity that some sufficiently negative finite is unstable. At , the recurrence has polynomial ; for any negative real , its root is below . Thus all negative convergent parameters are excluded.
For , use the boundary-locus test for multistep A-stability. A unit root with would require . Direct multiplication by the conjugate denominator givesThere is therefore no unit-root crossing in the open left half-plane. The leading coefficient of never vanishes there, since its only zero is the positive real value . For a small negative real , the simple root initially at one moves to , inside the disk, and the other root is close to , also inside. Continuity of polynomial roots and connectedness of the open left half-plane then keep both roots strictly inside throughout that half-plane. Possible zeros of cause no omitted crossing: for its other root lies strictly inside the unit disk, while at its unit-circle zero has .
On the imaginary axis, if the displayed real part vanishes only at , which corresponds to and is simple. Other imaginary-axis parameters retain strictly interior roots. If , the two roots are zero and the stability function , whose modulus is one on that axis; the unit root is simple. Thus the required boundary root condition for a multistep method holds as well.
Combining necessity and sufficiency givesIn particular, the third-order member is convergent but not A-stable, in agreement with the Second Dahlquist barrier.
Let , and . For the exact solution of the advection equation, the three left-hand samples are translations by , and relative to ; the right-hand samples are translations by zero and .
Denote their coefficients by , , , and . Taylor expansion compares momentswhere in the zeroth moment. Direct calculation givesThus the unscaled exact-solution residual isFor fixed nonzero , dividing by the time step yieldsThe scheme is therefore third order under fixed-Courant refinement, with an unscaled one-step defect of order four. Stability then gives third-order accumulated error for smooth data with periodic boundary conditions. Calling the unscaled defect fourth order is a different convention, not fourth-order approximation of the differential equation.
At , the amplification factor in (b) becomes exactly : the numerical step translates the grid data by that integer number of cells and is exact for this constant-speed advection equation. At it is the identity, a zero-time-step limit. These are exact special shifts, rather than merely a cancellation of one term of the Taylor expansion. This is the implicit advection scheme with exact integer shifts.
Choose a spatial interval with periodic boundary conditions and a uniform grid, so no separate inflow boundary closure of a difference scheme is required. The discrete Fourier transform is a unitary operator in the discrete L2 norm. Every circulant stencil is diagonal in that transform, and a one-step Fourier multiplier is a contraction exactly when its modulus is at most one for every grid frequency. For a mesh-uniform statement, use all , the limiting frequency range.
A Fourier mode giveswith the coefficients from (a). Squaring moduli and putting yieldsThis has the required nonnegative sign for every frequency exactly whenOne must also check that the implicit equation is solvable, rather than divide by a vanishing symbol. HereFor , a zero would have to occur at zero or ; the latter occurs only at , both outside the displayed stable intervals. At , . Thus there is no denominator zero in the stable range. For fixed such , continuity on the compact frequency interval gives a uniformly bounded inverse, and proves for all steps.
Outside these intervals the displayed difference is negative at every nonzero frequency where , so . On periodic refining meshes there are frequencies approaching any selected such value. Their amplification is bounded away from one and is repeated times over a fixed physical interval when , violating a mesh-uniform stability bound. At the two singular parameters the implicit operator itself fails on meshes containing the Nyquist mode. These observations prove necessity as well as sufficiency.
For the physical convention , , the result is or , with zero admitted as the identity limit. The negative intervals describe the algebraic contraction result for signed Courant numbers. In particular, the additional large positive interval must not be discarded by imposing the usual explicit-scheme Courant–Friedrichs–Lewy condition: this scheme is implicit. Stability at large fixed Courant number is not a guarantee of a small error constant.
For an -stage Runge-Kutta method with coefficient matrix and weights , put . It is algebraically stable whenEquivalently, defines a positive semidefinite symmetric matrix. The condition concerns the full coefficient tableau and nonlinear contractivity, not merely the scalar stability function. It is normally used with a consistent Runge-Kutta method and stage equations satisfying the necessary stage solvability of an implicit Runge-Kutta method.
The Butcher contractivity theorem states that an algebraically stable Runge-Kutta method is B-stable: for a dissipative vector field and any positive step for which the stage problems are solved, its step does not increase the distance between two numerical solutions. The required condition on the dissipative vector field isfor all compared states at each common time. The inner product can be real Euclidean or complex Hermitian. The stage solvability of an implicit Runge-Kutta method is assumed in this comparison, not a conclusion from a distance estimate alone.
Let be the difference of starting values, the differences of corresponding stages and the differences of their vector-field values. ThenExpanding the squared norm of the update givesSubstitute in the linear term. Symmetrizing the double sum proves the Runge-Kutta contractivity identityEach inner product in the first sum is nonpositive by the defining inequality for a dissipative vector field, and its weight is nonnegative. The final quadratic form is nonnegative: resolve the vectors into components and apply positive semidefiniteness of to each component vector. Hence , which is exactly B-stability. No linearization of the vector field has been used.
For the Dahlquist test equation with , this also bounds the amplification factor by one wherever the stages are well defined. With strictly positive weights, no stage pole can occur in the open left half-plane. Indeed, if for nonzero , thenwhen , contradicting . This proves the usual A-stability corollary for the scalar stability function; boundedness from the open half-plane makes any boundary pole in that rational function removable. Zero-weight redundant stages require their own solvability treatment. The nonlinear B-stability statement is stronger than A-stability, and the two notions should not be conflated.
For the first Butcher tableau, and the off-diagonal entries sum to , while each diagonal entry is . ThusThe positive weights and zero matrix prove that method 1 is algebraically stable. It is the two-stage Gauss collocation method.
The second method is explicit and has . Its first diagonal algebraic-stability entry isA positive semidefinite matrix cannot have a negative diagonal quadratic form, so method 2 is not algebraically stable. The negative value supplies a direct test; its order is irrelevant to this conclusion.
For the third method, and . Direct computation givesBoth weights are positive, so method 3 is algebraically stable.
Interpret the square as , use equal spacing in both directions and retain interior indices . Boundary values contribute to the right-hand side and do not change the interior coefficient matrix. Products of the one-dimensional sine modes used in the discrete sine transformform a basis, and substitution into the five-point Laplacian givesThe interior matrix is , so it is nonsingular exactly whenThese are the discrete Helmholtz resonance values, including their possible multiplicities. A sufficient condition is , so in particular every nonpositive is allowed. That is not a necessary restriction: positive values between, or above, the finitely many discrete eigenvalues are nonsingular as well. With homogeneous Dirichlet boundary conditions a nonresonant system has only the zero solution; at a resonance the corresponding modes of the discrete sine transform give nonzero homogeneous solutions.
For a sufficiently smooth function, Taylor expansion of the four neighboring values givesThe reaction term is sampled exactly at the grid point. On an exact solution, therefore,The method has second-order local accuracy for the partial differential equation. The original printed equations multiply this expression by , so their unscaled residual is ; that scaling does not make the Laplacian approximation fourth order. Resonance and inverse-matrix bounds are separate issues from this local truncation calculation.
Let be the sum of the four axial neighbors and the sum of the four diagonal neighbors. The two PDF stencils defineThe reaction stencil has four axial weights and center weight , so its weights sum to one. Taylor expansion givesFor example, the diagonal neighbors supply the term needed to turn the fourth derivatives into the full squared Laplacian. Adding the reaction contribution producesOn a smooth solution of the constant-coefficient equation, both displayed leading terms vanish. Thus the compact fourth-order Helmholtz stencil hasThe cancellation uses the differential equation and constant ; the nine-point finite-difference stencil alone still has an operator error on an arbitrary smooth function. It also does not establish a uniform global fourth-order error without an appropriate inverse bound and compatible treatment of boundaries and resonances.
The eigenvalue stability analysis of a finite difference method reduces a linear evolution discretization to its modal behavior, but it must retain the norm and the dependence on the mesh. For a homogeneous system obtained by the method of lines, , the solution is . A one-step time discretization gives ; for a Runge-Kutta method, where its stage matrices are invertible, . With a multistep method one instead uses an amplification matrix on the augmented vector of several time levels.
The relevant finite-time stability estimate iswith independent of the refining spatial mesh and allowed time steps. Similarly, semidiscrete stability requires for . The norm should represent the continuum problem, such as the discrete L2 norm in one dimension. A fixed finite matrix having decaying solutions as is not by itself a mesh-uniform result for the partial differential equation.
If , thenThus eigenvalues of modulus at most one give a uniform bound when the diagonalizing bases have uniformly bounded condition numbers. For a normal matrix in the chosen inner product, the spectral theorem for normal operators supplies an orthonormal basis, so the condition number is one and the norm of is exactly . For a self-adjoint or skew-adjoint spatial matrix, applying a scalar stability function preserves this favorable modal structure. This is the setting where eigenvalue calculations provide especially clean, reliable step restrictions.
A precise fixed-matrix statement is also useful: a matrix is power bounded for all nonnegative integers if and only if all its eigenvalues lie in the closed unit disk and every Jordan block at a unit-modulus eigenvalue has size one. Indeed, powers of an interior Jordan block contain a polynomial in times a decaying geometric factor and are bounded; a larger block on the unit circle produces unbounded polynomial growth. For a family of matrices, the resulting bounds must still be uniform. Moreover, finite-time stability versus power boundedness distinguishes this all-time condition from the physical-time estimate above. For example , , has , bounded for despite a nontrivial Jordan block at one. Even the scalar update is stable on fixed intervals, since , although it represents a growing equation rather than a contraction.
For a constant-coefficient periodic difference operator, Fourier modes diagonalize the spatial matrix. The discrete Fourier transform is a unitary operator, so Parseval's identity identifies its modal maximum with the operator norm. The eigenvalue stability analysis of a finite difference method then becomes von Neumann stability analysis. For the Dirichlet discrete Laplacian, a discrete sine transform plays the same role. These facts explain its advantages: a large matrix calculation becomes a scalar symbol or a known spectral interval, and the extremal eigenvalue directly determines a safe time step.
As a first example, centered space discretization of the heat equation has eigenvaluesForward Euler method gives with . Requiring all factors in yields for all periodic meshes. In two dimensions the corresponding uniform bound is . Because these are normal matrices, these scalar bounds prove contraction rather than merely suggest it.
Backward Euler method has , so the centered discretization of the heat equation is contractive for every . The Crank-Nicolson method has and is likewise contractive for these negative real modes. However, its factor tends to for very stiff modes, leaving high-frequency oscillations weakly damped; Backward Euler method tends to zero. The eigenvalues therefore expose the presence of stiff differential equations and damping as well as binary stability. Unconditional stability does not remove accuracy requirements.
For an advection equation example, the upwind finite difference scheme for , , has factor , with . Sinceit is a contraction in the periodic discrete L2 norm exactly for . In contrast, Forward Euler method with centered advection has factor . Its modulus exceeds one at nonzero active frequencies, and repeated amplification makes it unstable under fixed nonzero Courant refinement. A much smaller scaling can bound its finite-time growth, demonstrating again that exact contraction and the most general stability estimate are different claims.
The major limitation is the possible presence of a nonnormal matrix. For example,Both eigenvalues are negative, yet at the second unit vector is amplified by at least . This proves that negative spectra do not imply uniform semidiscrete stability. Ill-conditioned eigenvectors, Jordan normal form and transient amplification can invalidate a spectral-only argument. Direct energy estimates or estimates for the resolvent can supply the missing norm control.
Boundary conditions are another limitation. A periodic symbol proves a periodic or whole-line result, not an arbitrary initial-boundary-value problem. Boundary closure of a difference scheme can introduce growing modes or mesh-dependent amplification. A spatial operator with variable coefficients can still be studied through its assembled matrix, but then whether it is a normal matrix, its condition number and the physical inner product must be checked rather than borrowed from a Fourier stability analysis. For the finite element method the natural mass matrix inner product often turns a generalized eigenvalue problem into a self-adjoint one.
For time-dependent or split updates, separate spectra are insufficient to control products. For instance, and each have only zero eigenvalues, while has eigenvalue . For , alternating the two is unstable. A common contractive norm would control the products, but their individual eigenvalues do not.
Finally, stability and consistency of a numerical method have different roles. The Lax equivalence theorem states that, for a well-posed linear initial-value problem and a consistent finite difference method on compatible grid spaces, stability on every fixed time interval is equivalent to convergence of a numerical method as the admissible meshes refine. Bounded grid representation and the correct initial and boundary setup are part of that framework. An eigenvalue estimate can establish its stability hypothesis in the favorable settings described above; it neither proves consistency of a numerical method nor bypasses its uniformity requirements. The method is therefore a powerful modal tool, provided its spectral calculation is connected to a genuine norm estimate.
A fixed-step linear multistep method for uses several previous solution and derivative values:The coefficients are fixed independently of the step size. It is explicit when and implicit otherwise. Its characteristic polynomials of a linear multistep method are and . The contraction mapping theorem gives a uniquely solvable implicit step under a Lipschitz continuity bound whenever , by contraction of the new-value equation on the appropriate solution region. A suitable starting procedure must supply the first values; the method alone does not determine them.
Order is defined by inserting a smooth exact solution into the recurrence. If the residual is and its first nonzero coefficient occurs at that degree, the method has order ; dividing the residual by gives an local truncation error. Taylor expansion gives the exact order conditions for a linear multistep methodwith the right side interpreted as zero at , and failure at for exact order. Equivalently,The basic consistency of a numerical method conditions are , ; for the ordinary nondegenerate consistent formulation this common value is nonzero. Exactness on constants and linear functions does not control propagation of numerical perturbations.
That propagation is the role of zero-stability. On the homogeneous recurrence is . Its modes are , with powers of determined by root multiplicities. The theorem on the root condition for a multistep method states that zero-stability is equivalent to every root of having modulus at most one, with every unit-modulus root simple. Interior repeated roots are permitted, since geometric decay dominates their polynomial factors. An exterior root amplifies perturbations geometrically; a repeated unit root amplifies them polynomially and violates a step-independent perturbation bound.
The Dahlquist equivalence theorem states that a fixed-step consistent linear multistep method is convergent exactly when it is zero-stable. This concerns ordinary differential equations with a uniformly Lipschitz continuous right-hand side on the solution region over a fixed finite interval, convergent starting values, and the well-defined nearby branch of each small-step implicit solve. For order convergence of a numerical method, the solution must have the required smoothness and the starting errors must be .
The mechanism can be sketched explicitly. The root condition for a multistep method bounds the recurrence's discrete Green function. For an order- exact-solution defect , the Lipschitz continuity error equation then gives an estimate of the formThe current-step term can be absorbed for small . The discrete Gronwall inequality says that a bound implies . There are defects on a fixed interval, so their sum is and this yields the claimed global order. Conversely, testing with vanishing starting perturbations in exterior-root or repeated-unit-root modes proves that convergence of a numerical method fails without the root condition for a multistep method.
For example, the two-step Adams-Bashforth method hasIt is explicit, order two and zero-stable, hence convergent with order-two starting values. By contrast, a recurrence with has solutions on the zero differential equation. Starting differences tend to zero yet become unbounded at a fixed positive time, since is of order . A small local defect or formal high order cannot rescue this mode. Canceling a common factor may remove it only by changing the allowed starting relations, as the parameter endpoint in Question 2 illustrates.
Absolute stability addresses a different limit: apply the method to the Dahlquist test equation and put . The amplification roots satisfyAll roots must satisfy the disk condition, with unit roots simple; one cannot inspect only the root that tends to one as . The degree and solvability of the recurrence must also be preserved. The resulting set of is the domain of absolute stability. A-stability means that it includes the whole closed left half-plane, so the numerical solutions of every Dahlquist test equation with are stable for every positive step size. It is a linear test-equation property, not a proof of arbitrary nonlinear contractivity or high accuracy at large steps.
Forward Euler method has order one and factor , so its stability region is the disk . Backward Euler method has factor and is A-stable. The trapezoidal rule is order two with factor ; its modulus is at most one throughout the left half-plane. These one-step methods are included as the simplest multistep examples. For the two-step Adams-Bashforth method, the negative-real stability interval is : its polynomial is , and the root reaches at . It therefore imposes a step restriction when applied to strongly decaying modes.
The genuinely two-step BDF2 method isIt has order two, roots at zero step and is A-stable. For its normalized polynomials , , the unit-circle boundary locus hasThe leading coefficient has no zero in the left half-plane, and the roots at a small negative are both inside the disk. Root continuity then proves open-half-plane stability; on the imaginary boundary the only possible unit root is the simple root one at . This gives a direct proof of the stated A-stability rather than relying on a boundary plot.
Two sharp order barriers explain the tradeoff. The first Dahlquist barrier states that a consistent zero-stable real linear -step method using only first derivatives has order at most for odd and for even ; an explicit method has order at most . The Second Dahlquist barrier states that an irreducible A-stable real linear multistep method has order at most two. These statements concern fixed constant coefficients and the ordinary first-derivative multistep class, not multiderivative methods or arbitrary variable-step formulations. Thus higher order alone is not a route to unconditional stiff stability. Question 2 provides a concrete illustration: its third-order member is zero-stable but not A-stable.
No nontrivial consistent explicit multistep method is A-stable. Its amplification polynomial of a multistep method has a fixed highest coefficient, while at least one lower coefficient grows without bound as real . Were all roots uniformly in the unit disk, their elementary symmetric polynomials would keep all the monic coefficients bounded, a contradiction. This is the coefficient argument behind explicit multistep methods cannot be A-stable.
In practice, selecting a method therefore involves accuracy, startup, the presence of a stiff differential equation, implicit-solve cost and step-size control. Zero-stability handles propagation as the step tends to zero; consistency of a numerical method supplies a vanishing defect; A-stability handles the numerical solutions of all decaying Dahlquist test equations at finite steps. None substitutes for the others, and variable steps or PDE discretizations require additional uniform stability arguments appropriate to their setting.
Articles by others on the same topic
There are currently no matching articles.