An ODE solver must distinguish the error made by one step started from exact data from the error accumulated along the computed trajectory. For an order- one-step map , define the exact-start defect . If the step map is Lipschitz with factor , its global error obeys
Iteration, using , proves the variable-step global ODE error bound
It explains the difference between local defect order and global order , and why local tolerance control alone does not certify a prescribed global error. Strong dynamical amplification can magnify many individually small defects.
A practical solver needs an inexpensive local error estimator. In step-doubling error estimation, compare one full step with two half steps . Smoothness and propagation through the second half step give and . Therefore
The difference estimates the finer local correction with the correct denominator and sign; adding it cancels the leading error by Richardson extrapolation. The common starting value and the smooth error expansion are essential, and the extra evaluations make this estimator relatively expensive.
An embedded Runge-Kutta pair instead shares the stage computations and uses two output weight vectors. For orders and , their difference is generally and estimates the lower-order local defect, even when the higher-order output is accepted. Its controller exponent is therefore , not . For example the explicit Euler and Heun outputs share the first slope; their difference is , while Heun's own defect is . Predictor-corrector differences can also estimate a defect when scaled by the appropriate leading error constants; an uncalibrated raw difference need not be the corrected method's error.
For a vector equation, choose positive component scales
The absolute and relative error tolerances allow meaningful tests both near zero and for large components with different physical scales. The max-norm criterion controls every scaled estimated component. A root-mean-square criterion is another common choice but has a weaker individual-component implication.
If the estimate scales like , an adaptive step-size controller uses
with lower and upper bounds on the change factor. A rejected step leaves the old state and time unchanged and recomputes with a smaller step; an accepted step advances with the chosen output and adjusts the next step. A zero estimate receives capped finite growth rather than division by zero. The safety factor allows for variation in the error constant. Step doubling has , whereas a embedded pair usually has . If a solver instead controls defect per unit time, division by changes the scaling exponent and must be included in the controller design.
Using previous estimates can smooth the sequence of accepted steps. A proportional-integral controller can take with , appropriate scaling by the estimator order and bounded factors. It avoids overreacting to a single noisy estimate, but needs safeguards after rejected steps, changes of order and abrupt coefficient changes. Event locations and discontinuities require locating the event and restarting the error expansion; blindly applying a smooth-step estimator across a jump can be misleading.
For a multistep method, adaptive step sizes change the interpolation history and coefficients. Constant-step coefficients cannot simply be reused with arbitrary step ratios. Variable-step formulas, compatible starting/restarting procedures and bounded ratios preserve the needed stability; local error and sometimes order are selected together to balance evaluation cost against accuracy.
Stiffness imposes an additional requirement. On a rapidly decaying mode , explicit Euler requires for absolute stability. Once is small, a local absolute-tolerance test can propose a large step even though roundoff or a small perturbation would then be amplified. A stiff solver therefore also uses a suitable implicit A-stable or L-stable method and solves its algebraic equations accurately enough for the estimator to be meaningful. A-stability alone does not ensure stiff decay, as the Lobatto stability function in question 4 tends to one for large negative arguments.
Finally, over-tightening tolerance eventually encounters roundoff and algebraic-solve error rather than further truncation-error improvement. Inexact Newton or linear solves must have errors below the local budget; a tiny time step with an inaccurate stage solve does not deliver the formal order. Global error assessment can use controlled refinements, defect propagation or adjoint weighting for a chosen output. Sensible error and step-size control therefore combines asymptotic estimators, tolerance scaling, stability, event handling and implementation error, rather than treating the accepted local estimate as a complete guarantee about the trajectory.
For constant-coefficient evolution on an infinite or periodic grid, spatial Fourier stability analysis reduces a multidimensional recurrence to independent modal problems. This gives exact L2 stability results when the coefficients and geometry admit that reduction; it also exposes high-frequency restrictions which a truncation-error calculation alone misses.
Consider a scalar one-step update on . With , its symbol is and . Parseval identity gives
The upper bound is immediate by integration. For the reverse inequality choose Fourier data supported in a positive-measure neighborhood where approaches its essential supremum, then normalize them. This uses actual square-summable data, unlike an isolated infinite plane wave. On a periodic finite grid the discrete Fourier transform gives the same equality with a maximum over its resolved frequencies.
This proves the scalar Fourier power criterion. Contractivity is equivalent to at every frequency. For mesh-uniform stability on , a sufficient condition is instead , because . Conversely, if the powers at are bounded by a common , then as . Thus finite-time stability may allow mild modal growth; demanding strict contraction is stronger than necessary.
Stability connects numerical consistency to numerical convergence. Let be the exact solution restricted by a suitable projection and let its one-step defect be . If and , the error recurrence gives
This proves numerical convergence for smooth solutions and convergent initial approximations. Density plus stability extends numerical convergence to the natural data space when stable projections and well-posed continuous evolution are available.
For completeness, the converse in the Lax equivalence theorem can be understood with faithful grid transfers. Let be a bounded reconstruction into the continuous data space and a bounded projection with , and suppose the grid and reconstructed norms are uniformly equivalent. numerical convergence for every datum, uniformly on the fixed time interval, makes the operators pointwise bounded. The Uniform boundedness principle makes their operator norms uniformly bounded. Apply this bound to , use and the norm equivalence, and obtain the uniform grid-power bound. With the numerical consistency estimate above, this proves the stability/numerical convergence equivalence under these standard linear assumptions.
Several examples illustrate the test. For forward time and centered space on the one-dimensional heat equation,
Its minimum is , so is the exact contraction range. In dimensions with mesh widths , the symbol is , where . Therefore , or on an equal mesh. This follows by independently maximizing every sine factor, not by applying a one-dimensional bound separately to each direction.
For advection , forward time and centered space give , . At fixed nonzero advective Courant number its modulus exceeds one, so its powers grow without a mesh-uniform bound. Under the much smaller choice , however, , allowing finite-time stability. This illustrates why the specified refinement path matters. For , the upwind update instead has
and is contractive exactly for . Its numerical diffusion explains the stable damping as well as its first-order spatial accuracy.
For the heat equation with the Crank-Nicolson method, the symbol is . It has modulus at most one for every nonnegative , so there is no diffusion time-step restriction. Very stiff modes nevertheless have amplification near minus one, causing weakly damped oscillation; stability alone does not guarantee good stiff smoothing or small error.
For systems the symbol is a matrix, and the exact criterion is the uniform power bound for matrix Fourier symbols, not just a bound on eigenvalue moduli. For example has both eigenvalues one but is unbounded as the number of steps increases. If with uniformly bounded condition numbers, then , so a scalar-type condition does suffice. Multilevel schemes are treated by stacking their time levels into a companion matrix and checking its uniform powers. Simple unit-modulus roots and interior roots are the fixed-mode root condition, but uniformity near colliding roots still needs attention.
The technique is inexpensive, identifies the dangerous wavelengths, gives sharp constant-coefficient restrictions and generalizes directly to several space variables and Fourier-diagonalizable vector problems. Its limitations are equally concrete: boundaries can add unstable modes invisible to an infinite-grid calculation; variable coefficients couple frequencies; nonlinearities invalidate the fixed multiplier; nonuniform grids need another transform or energy estimate; and L2 stability does not by itself imply a maximum principle or positivity. Frozen-coefficient analysis is often useful evidence, while an energy or boundary estimate is needed to turn it into a global conclusion in those settings.

Pinned article: Introduction to the OurBigBook Project

Welcome to the OurBigBook Project! Our goal is to create the perfect publishing platform for STEM subjects, and get university-level students to write the best free STEM tutorials ever.
Everyone is welcome to create an account and play with the site: ourbigbook.com/go/register. We belive that students themselves can write amazing tutorials, but teachers are welcome too. You can write about anything you want, it doesn't have to be STEM or even educational. Silly test content is very welcome and you won't be penalized in any way. Just keep it legal!
We have two killer features:
  1. topics: topics group articles by different users with the same title, e.g. here is the topic for the "Fundamental Theorem of Calculus" ourbigbook.com/go/topic/fundamental-theorem-of-calculus
    Articles of different users are sorted by upvote within each article page. This feature is a bit like:
    • a Wikipedia where each user can have their own version of each article
    • a Q&A website like Stack Overflow, where multiple people can give their views on a given topic, and the best ones are sorted by upvote. Except you don't need to wait for someone to ask first, and any topic goes, no matter how narrow or broad
    This feature makes it possible for readers to find better explanations of any topic created by other writers. And it allows writers to create an explanation in a place that readers might actually find it.
    Figure 1.
    Screenshot of the "Derivative" topic page
    . View it live at: ourbigbook.com/go/topic/derivative
  2. local editing: you can store all your personal knowledge base content locally in a plaintext markup format that can be edited locally and published either:
    This way you can be sure that even if OurBigBook.com were to go down one day (which we have no plans to do as it is quite cheap to host!), your content will still be perfectly readable as a static site.
    Figure 5. . You can also edit articles on the Web editor without installing anything locally.
    Video 3.
    Edit locally and publish demo
    . Source. This shows editing OurBigBook Markup and publishing it using the Visual Studio Code extension.
  3. https://raw.githubusercontent.com/ourbigbook/ourbigbook-media/master/feature/x/hilbert-space-arrow.png
  4. Infinitely deep tables of contents:
    Figure 6.
    Dynamic article tree with infinitely deep table of contents
    .
    Descendant pages can also show up as toplevel e.g.: ourbigbook.com/cirosantilli/chordate-subclade
All our software is open source and hosted at: github.com/ourbigbook/ourbigbook
Further documentation can be found at: docs.ourbigbook.com
Feel free to reach our to us for any help or suggestions: docs.ourbigbook.com/#contact