Butcher tableau Created 2026-09-28 Updated 2026-10-14
A Butcher tableau records a Runge-Kutta method's stage matrix , time nodes , and output weights in the block array
Read row above the line as the recipe for Runge-Kutta stage : the left entry gives , and the right entries give the coefficients in . Below the line, weights slope in the final update. Zeros on and above the diagonal identify an Explicit Runge-Kutta method. For the internally consistent convention, row sums of equal ; first-order consistency of a numerical method also requires . An embedded Runge-Kutta pair adds another weight row while retaining .
Consistency of a numerical method Created 2026-09-28 Updated 2026-10-14
For a one-step approximation to an ordinary differential equation, insert the exact solution and define the unscaled local truncation error
Consistency of a numerical method requires uniformly on the finite interval being approximated, under the stated smoothness assumptions. Merely asking is too weak: the useless update has defect , which tends to zero but generally fails the scaled test. Here denotes Big O notation. MIT uses this division-by-step convention.[ref]
For the Euler method, Taylor's theorem gives . A bounded second derivative therefore gives local truncation error and a scaled defect . Under a uniform Lipschitz continuity assumption on in , within a region containing the exact and numerical solutions, numerical stability controls accumulation over about steps. This yields global error with exact starting data. Consistency of a numerical method checks each step; numerical stability controls their combination.
Convergence of a numerical method Created 2026-10-06 Updated 2026-10-14
For an initial value problem, convergence means that the largest global error on each fixed finite time interval tends to zero as the step size tends to zero and the starting errors vanish. For linear multistep methods, the Dahlquist equivalence theorem separates this requirement into consistency of a numerical method and zero-stability.
For , the recurrence has fourth-order normalized consistency of a numerical method at fixed if
To derive this, match moments to the temporal Taylor series: , , . The even conditions force antisymmetry; the two odd conditions then determine the displayed coefficients. The normalized residual begins with . Its amplification polynomial of a multilevel finite difference scheme is , where . At , , giving a uniform power bound. At , , and wave packets on the growing polynomial root prove Cauchy linear instability.
For the square-grid nine-point finite-difference stencil for the Laplacian,
If , both displayed correction terms vanish: the mixed sixth derivatives sum to , and the pure sixth derivatives sum to the negative of that sum. Expanding two orders further yields for a smooth harmonic function. Thus the compact harmonic scheme has sixth-order normalized consistency of a numerical method and, with the discrete maximum principle inverse bound, sixth-order nodal convergence on a square with exact smooth Dirichlet boundary data. For example shows that the sixth-order term need not vanish.
Mehrstellen method 2026-10-14
A Mehrstellen method increases the accuracy of a compact finite difference method discretization by using the differential equation to express its leading truncation terms in terms of the prescribed source. For , the square-grid nine-point finite-difference stencil for the Laplacian satisfies . Replacing by and approximating this source derivative gives , with fourth-order normalized consistency of a numerical method while retaining a compact nine-point matrix. The uncorrected nine-point finite-difference stencil operator is only second-order accurate on general functions.
Numerical flux Created 2026-10-07 Updated 2026-10-14
A numerical flux estimates the rate of transfer across a cell face from nearby states. In the finite volume method update, approximates the conservation law flux averaged over the time step; is the transferred amount. For a two-state numerical flux approximating a scalar conservation law with conservation law flux , consistency of a numerical method requires . Thus equal states recover the physical transfer rate. With constant equal-width cells, this also preserves a constant state because its incoming and outgoing numerical fluxes agree.[ref]
Consistency and shared face flux cancellation answer different questions: matching at equal states approximates the intended equation, while sharing one oriented face value preserves the total. The example periodic upwind finite volume advection uses for , so the arriving state comes from the left. The Godunov numerical flux uses an entropy solution of a local Riemann problem; the Engquist-Osher flux provides a different construction for a scalar conservation law. A monotone conservative scheme uses a numerical flux nondecreasing in its left state and nonincreasing in its right state, together with a time step that makes the complete update monotone. Neither two-state consistency nor conservation by itself supplies that time-step restriction or a general stability or order of a numerical method guarantee.
Use the coefficient in the numerator, as verified in the PDF; the converted TeX lost its . Multiplying the method by gives the characteristic polynomials of a linear multistep method
For every admissible real , and , giving consistency of a numerical method. Factorization gives
The second root is . The root condition for a multistep method requires and forbids a repeated root at one. For real ,
At both roots equal one, violating zero-stability. For the second root lies strictly inside the unit disk. The Dahlquist equivalence theorem therefore gives
To find the order rather than only consistency, expand the exact-solution residual through the generating function:
Thus its unnormalized local truncation error begins with when , and the global method order is exactly two for every convergent parameter. For comparison, has formal order three but is not convergent because of its double unit root:
These orders assume a smooth solution, the usual local Lipschitz condition and starting approximations of the required accuracy.
For one stage, first-order consistency of a numerical method gives . The condition then gives . Hence the scheme is the Backward Euler method:
It is a one-node collocation Runge-Kutta method with . Specifically, choose a linear polynomial on with and impose . Its derivative is constant, so , exactly the Backward Euler method update.
Expanding the symmetric spatial stencil by the Taylor theorem gives
Consistency of a numerical method and cancellation of the term require , , and . Solving this linear system gives
The resulting fourth-order centered second derivative has
The nonzero next coefficient proves that the highest spatial order of a numerical method is four for this three-parameter stencil.
A constant-step linear multistep method has the form
with . The characteristic polynomials of a linear multistep method encode both accuracy and error propagation. The method has order of a numerical method when insertion of a sufficiently smooth exact solution leaves an unnormalized local truncation error . The exponential-symbol order criterion for a multistep method expresses this as . In particular, first-order consistency of a numerical method requires and .
Accuracy alone is insufficient. For , perturbations obey the recurrence . The root condition for a multistep method requires every root of a polynomial to lie in the closed unit disk, with each unit-circle root simple. This is zero-stability. A root outside the unit disk causes geometric amplification as increases; a repeated unit-circle root permits polynomial growth in . Either can destroy convergence even for starting perturbations tending to zero.
The Dahlquist equivalence theorem states that, for a fixed-coefficient method and a well-posed ordinary differential equation with a suitably Lipschitz continuous right-hand side, consistency of a numerical method and zero-stability are equivalent to convergence for all convergent starting data. If the starting errors are and the exact solution is sufficiently smooth, the global error is on a fixed time interval. A stability estimate bounds the propagated sum of local defects over steps; the discrete Gronwall inequality controls the dependence of on the accumulated error. Implicit methods also require the locally consistent, uniquely solvable update branch for sufficiently small .
For example, the explicit Euler method has order one and , satisfying the root condition for a multistep method. The two-step Adams-Bashforth method has order two and , again satisfying it. The trapezoidal rule has order two with one step. The two-step Simpson multistep method, , has order four and the simple roots : it is zero-stable, although its parasitic amplification root can spoil long-time decay. These examples distinguish finite-time numerical convergence from absolute stability.
The first Dahlquist barrier gives the maximum possible order of a convergent ordinary real -step method:
These bounds assume only first-derivative evaluations, fixed coefficients and zero-stability; the sixth-order multiderivative multistep method in solution is outside that class.
To obtain arbitrarily high convergent order within the ordinary class, increase the number of steps. The Adams-Bashforth method integrates a polynomial interpolation of past derivative values and has order . The Adams–Moulton method includes the new endpoint and has order for steps. In both families , so the root condition for a multistep method holds for every fixed . Starting values can be generated by a Runge-Kutta method of sufficient accuracy. The backward differentiation formula instead differentiates an interpolating polynomial; its order- members are zero-stable only for .
Finally, high order and favorable stiff stability are separate design goals. By the Second Dahlquist barrier, an ordinary A-stable linear multistep method has order at most two. One may accept a smaller linear stability domain, use suitable backward differentiation formula members for stiff problems, or switch to high-order implicit Runge-Kutta methods or multiderivative multistep methods. A convergent high-order formula still needs time steps appropriate to its stability properties and the problem's eigenvalues.
A spatial finite difference method and time discretization for a linear evolution problem give a recurrence . To obtain numerical stability on , one needs a bound uniform in the permitted grid sizes and time steps. More generally a growth estimate is sufficient. The finite-time stability versus power boundedness distinction matters: growth per step of can be compatible with the latter finite-time estimate, whereas unrestricted geometric growth at a fixed Courant number is not.
The eigenvalue method diagonalizes into modes. If is a normal matrix, the spectral theorem gives . Thus gives contraction, and gives the preceding growth estimate. A diagonalizable matrix has , so its condition number must remain bounded uniformly as the mesh changes. A stable-looking list of eigenvalues alone is insufficient.
Indeed,
Both eigenvalues are one, but the Jordan block gives growth proportional to , violating uniform finite-time numerical stability. A nonnormal Fourier amplification matrix can similarly exhibit large amplification even with its eigenvalues inside the unit disk. Eigenvector conditioning and the full powers of the amplification operator are essential.
For constant-coefficient schemes on a periodic or infinite grid, a Fourier transform diagonalizes scalar translation-invariant stencils. This yields von Neumann stability analysis using the Fourier amplification symbol . The discrete Parseval identity turns a bound on into a discrete L2 norm estimate. For systems, the symbol is a matrix; a uniform power bound for matrix Fourier symbols is required, rather than a bound on its spectral radius alone.
For the heat equation, a central finite difference in space and the explicit Euler method in time give
The scalar condition for every frequency is exactly . With zero Dirichlet boundary conditions, the spatial matrix is symmetric and diagonalized by sine modes, leading to the same uniform sufficient restriction. By contrast, the Backward Euler diffusion scheme has and is stable for every .
For the advection equation , , centered space with the explicit Euler method gives , , and . At fixed positive Courant number, repeated powers are unbounded as the mesh is refined. The upwind finite difference scheme instead has
which gives contraction precisely for . This comparison shows why the spatial stencil and time method must be analyzed together.
Boundary treatment can destroy the normality or mode decomposition available on a periodic grid, so a finite-interval scheme needs its own uniform operator estimate. Multilevel time schemes likewise require the root condition for a multistep method and uniform bounds for the associated amplification matrices; simple scalar root tests do not establish these bounds for arbitrary systems. Once consistency of a numerical method, a well-posed linear evolution problem and the required numerical stability estimate hold, the Lax equivalence theorem gives numerical convergence. Eigenvalues provide a powerful route to that estimate when the accompanying eigenvector and boundary analysis is justified.
The first characteristic polynomial factors as
Also and , so the order conditions for a linear multistep method hold for every . Convergence of the full linear multistep method recurrence requires, in addition, the root condition for a multistep method: all polynomial roots of lie in the closed unit disk and its polynomial roots on the unit circle are simple.
For , write with . The other polynomial roots are , distinct from each other and from 1, so the root condition for a multistep method holds. For , the two quadratic polynomial roots are real and reciprocal, and one has modulus greater than one. At , ; at , . Both endpoints violate simplicity. Consistency of a numerical method plus zero-stability therefore gives
The conclusion applies to the recurrence as printed, including its starting data. Canceling common factors is not innocuous: at the polynomials contain , and at they contain . The reduced recurrences exclude parasitic solutions of the original one. This is the common-factor cancellation defect in a multistep recurrence, so those parameter values are not added to the interval.
Let , and . Along a smooth solution, . The exact difference contains only odd derivatives. Matching terms through degree four therefore requires
The first two conditions give , which also implies . With , the remaining equations are and . Hence
The fifth spatial moment is . After dividing the exact-minus-scheme residual by , its first possible nonzero term is
This is the fourth-order two-step advection stencil. Thus the normalized local truncation error is at fixed positive Courant number, as required. At or the formula translates the physical advection branch exactly, but consistency of a numerical method alone does not decide stability of all two-level perturbations.
The Engquist-Osher method is an upwind finite volume method. For cell values , mesh width and time step , put and use the conservative update
where the numerical flux is
Consistency of a numerical method follows from . Positive characteristic speeds use the left state, and negative speeds use the right state. The flux difference telescopes when summed over cells, giving a discrete conservation law. The method is first order in space and time for smooth solutions; its conservation law form is also appropriate when shock waves develop.
Let be the unique sonic point of a scalar flux, . Convexity implies to its left and to its right. Put and split
Then , , , and
This is the sonic-point splitting of a convex Engquist-Osher flux. If both states are above , ; if both are below it, . Across a transsonic rarefaction wave, , the flux is the minimum . In the opposite crossing it is , which in general differs from the exact Godunov numerical flux. This distinction does not affect the monotonicity proof.
Here stability requires the usual Courant–Friedrichs–Lewy condition. Let the initial values lie in , and choose
A differentiable convex function has a continuous derivative on this interval, so the maximum is finite. Write the three-input update as . Differentiating gives
Thus the update preserves componentwise order. Constants are fixed, since , so comparison with the constants proves for every time level. In particular the same CFL condition remains applicable. This is a mesh-independent maximum-principle stability bound.
A stronger stability statement is contraction in discrete . Consider two solutions in the same invariant interval, on a periodic mesh or on the infinite lattice with summable differences. Let be their componentwise maximum. Monotonicity gives , hence
The discrete conservation law for the difference gives the equality: on a finite periodic mesh the flux sum cancels exactly, and on the infinite lattice it follows by truncation and the fact that the flux is a Lipschitz function on . Interchanging and adding proves
This is L1 contraction of a monotone conservative scheme. Since commutes with the cell shift, applying this contraction to and its shift gives . The scheme is therefore a total variation diminishing scheme as well.
The same order argument proves a discrete entropy inequality, explaining why this stable discretization selects entropy solutions rather than nonphysical expansion shock waves. For a constant , set
Because and , their componentwise difference is at least . Subtracting their updates gives
For constants outside , the entropy inequality is an equality by the invariant bound and the conservative update. At equal states , the Kruzhkov entropy flux. The flux is a Lipschitz function on the invariant interval: writing , the conservative update gives . This time-translation bound, the invariant bound and the total variation estimate give local space-time compactness for bounded-variation initial conditions as the mesh is refined; the conservative update passes to the weak conservation law, and the displayed inequality passes to its Kruzhkov entropy inequality. This identifies the limit as the entropy solution.
Finally the time-step qualification is essential. For the convex Inviscid Burgers equation flux , whose unique sonic point of a scalar flux is zero, linearize about a positive constant . The perturbation update becomes . At Fourier frequency its multiplier is , with modulus greater than one if . Wave packets near this phase give linear instability even for summable Cauchy perturbations. Thus the assumptions on imply the stability results above under the CFL condition, not for arbitrary . This is CFL necessity for explicit Engquist-Osher stability.
A Mehrstellen method gains accuracy by exploiting the differential equation in the local truncation error of a compact finite difference method stencil. The extra nearby values alone do not guarantee higher order: one must also modify the source term. Consider on a square with prescribed Dirichlet boundary data, using the same spacing in both directions.
For comparison, the five-point Laplacian has expansion
Its leading error is not a multiple of , because the mixed fourth derivative is missing. To obtain an isotropic leading error, consider a symmetric nine-point finite-difference stencil with weight on each axial neighbor, on each diagonal neighbor, and on the center, all divided by . Vanishing on constants and consistency of a numerical method require and . Taylor expansion then gives the fourth-derivative contribution
For this to equal we must choose , hence , . The resulting nine-point finite-difference stencil operator is
Its expansion, retaining the next term for later use, is
Thus by itself is second order on a general function. On a Poisson equation solution, however, . Approximating this known source derivative by gives the fourth-order Mehrstellen method equation
Equivalently, its two stencils are
The normalized local truncation error is , since . If the equation is multiplied by , the row residual is ; this change of normalization does not make the solution sixth order. The fourth-order correction of the nine-point Poisson stencil retains only the closest axial and diagonal unknowns. A fourth-order one-dimensional second derivative instead uses , widening the unknown stencil and introducing negative outer weights. Mehrstellen method accuracy is obtained by correcting known source values rather than widening that unknown stencil.
The compact scheme has useful stability and solvability properties. With homogeneous Dirichlet boundary data, is symmetric, has positive diagonal and nonpositive off-diagonal entries, and is a positive definite symmetric operator. Indeed its quadratic form is a sum of positive edge weights times squared differences, with boundary values set to zero. Vanishing of this sum would force a constant on the connected grid and then zero by connection to the boundary. Consequently the Dirichlet boundary condition linear system has a unique solution. The same weights give a discrete maximum principle: if at every interior node and on the boundary, a positive maximum inside would make every weighted difference to its neighbors nonpositive. Equality forces the maximum to propagate to the boundary, which is impossible. Thus everywhere.
This also turns consistency of a numerical method into a quantitative convergence result, rather than merely suggesting an order. Let , let be the normalized residual of the exact solution, and set . Exact Dirichlet boundary data imply on the boundary and . On the unit square the quadratic barrier
has exactly, is nonnegative on the boundary, and has maximum . If , then and , while both comparison functions are nonpositive on the boundary. The discrete maximum principle proves
This is maximum-norm convergence of the corrected nine-point Poisson scheme. It requires sufficient smoothness of the solution up to the boundary for the uniform truncation bound. On other domains the source and boundary closures must retain the required accuracy; boundary singularities can invalidate a smooth-solution order estimate.
The same expansion reveals how to add still more accuracy. Differentiating gives
Thus the sixth derivatives appearing in the term can also be expressed solely through the source. With exact source derivatives,
is the sixth-order source correction of the nine-point Poisson stencil, with normalized residual . If source derivatives are replaced by differences, must be approximated through fourth order and the fourth derivatives through second order to retain that accuracy. The unknowns still occupy the same nine-point finite-difference stencil; only evaluation of known source data becomes more elaborate. The same inverse bound yields sixth-order convergence when these approximations and the boundary data have matching accuracy.
A particularly instructive case is the Laplace equation, . Both displayed error corrections automatically vanish: and , which also makes the pure sixth derivatives sum to zero. Expanding the stencil two orders further gives, for a sufficiently smooth harmonic function,
For verification, the three eighth-derivative contributions are , and . Because is a harmonic function, their sum is . The example has , so this term is genuinely present. The unmodified harmonic nine-point scheme therefore has sixth-order nodal convergence under the same smoothness and boundary assumptions. This harmonic superconvergence of the nine-point stencil is special to harmonic functions; it should not be confused with the fourth-order source-corrected scheme for general Poisson equation data.
The appeal of Mehrstellenverfahren is this combination of a compact sparse matrix, favorable discrete maximum principle properties, and high accuracy obtained by using the governing equation. The derivation also shows precisely which accuracy belongs to the operator on arbitrary functions, which belongs to its action on solutions, and which survives in the computed boundary-value solution.
For this two-step family with a third-order member, use the exponential-symbol order criterion for a multistep method. Expanding the exact-solution residual symbol gives
The constant, linear and quadratic coefficients vanish for every parameter. Thus
At the exceptional value the fourth-degree coefficient is , so there is no further increase. This means an unscaled exact-solution residual of order , or a residual divided by the step of order .
The first characteristic polynomial factors as . The root condition for a multistep method requires every root to have modulus at most one and each unit-modulus root to be simple. The root is allowed because it is distinct from the simple root one; is not, since it makes one a double root. Hence zero-stability holds exactly for
On this interval, and establish consistency of a numerical method. The Dahlquist equivalence theorem, for a fixed-step consistent linear multistep method applied to an ordinary differential equation with a Lipschitz continuous right-hand side with convergent starting values and well-defined small-step updates, says that convergence of a numerical method is equivalent to zero-stability. Therefore the same interval is exactly the convergence of a numerical method range. With sufficiently accurate starting values the convergent members have the orders just computed.
At the Taylor expansion still gives a formal order-two residual, but and the double root prevents a convergent method. Canceling the common factor produces the common-factor cancellation defect in a multistep recurrence and changes the starting relations and cannot repair convergence of a numerical method of the original recurrence. At , cancellation of a zero root instead reveals the ordinary trapezoidal rule; it is consistent with the order-two result.