Domain of dependence 2026-10-06
The domain of dependence of a solution value consists of the initial and boundary locations whose data can influence it. For on the whole line, , so its initial-data domain of dependence is the foot of the characteristic. For a finite-difference scheme, repeated stencil dependencies determine a numerical domain of dependence. The Courant–Friedrichs–Lewy condition requires the numerical domain to cover the physical one for convergence; it is necessary under its usual hyperbolic hypotheses, but not in general sufficient for stability.
Engquist-Osher flux Created 2026-10-07 Updated 2026-10-14
The Engquist-Osher numerical flux is . It sends positive-speed contributions from the left state and negative-speed contributions from the right state. Its consistency and opposite monotonicities in the two arguments yield a monotone conservative scheme under the appropriate Courant–Friedrichs–Lewy condition. For the Inviscid Burgers equation, it is .
Stability of a numerical method controls how perturbations in initial data, roundoff and local residuals propagate. For a linear evolution scheme , a suitable finite-time requirement is
with independent of the refining mesh. The norm should approximate the norm of the continuous problem, such as an area-weighted L2 norm. The bound need not imply decay: is appropriate when the equation itself permits finite-time growth. For a multilevel scheme the state includes all required time levels.
The error recurrence shows why stability matters. If , then
Thus a consistent residual tending to zero and a convergent start produce convergence when the stability constant is uniform. Tiny defects need not remain tiny without that bound. The Lax equivalence theorem makes this precise: for a well-posed linear initial value problem and a consistent linear approximation, stability is equivalent to convergence in the compatible solution norms. It is not a theorem for arbitrary nonlinear schemes, and a high formal order does not substitute for stability.
For constant coefficients on a periodic or infinite grid, von Neumann stability analysis diagonalizes spatial translations using Fourier modes. If , the Parseval identity converts a uniform multiplier-power bound into an L2 norm bound. The contraction condition is sufficient; a more general also yields a finite-time bound. For the centered-space explicit heat method,
so exactly for . Larger fixed Courant numbers amplify high frequencies. The Backward Euler method gives instead and is contractive for every .
For , forward time and centered space give , with . Hence for nonzero frequencies, causing instability at a fixed nonzero Courant number. The directionally correct upwind finite difference scheme uses the neighbor at and has
It is contractive exactly for . This also has a direct maximum-norm proof: the update is a convex combination of two old values. The continuum domain of dependence must fit inside the numerical one for a local explicit hyperbolic method to converge, giving the Courant–Friedrichs–Lewy condition. That necessary geometric restriction is not by itself a sufficient stability proof.
For systems and multilevel methods, each Fourier multiplier becomes a matrix. All amplification roots must obey the appropriate root bound, but their moduli alone are insufficient. A repeated unit root in a companion matrix gives a Jordan block; for instance has . Even distinct roots require control of the diagonalizing matrices uniformly in frequency and mesh. The uniform power bound from separated amplification roots supplies such control for a bounded two-root family with a positive gap. Question5 illustrates both sides: strict gives a uniform gap, whereas the endpoints have a double unit root and are unstable despite unit moduli.
Energy estimates are especially useful when coefficients vary or boundaries prevent Fourier diagonalization. As a simple example, for implicit heat evolution with homogeneous Dirichlet boundary conditions, take the grid inner product of with . Discrete integration by parts gives
The boundary term vanishes because the boundary values are zero, proving contraction. For variable positive diffusion coefficients the corresponding flux-weighted squared differences remain nonnegative, so the argument extends without a constant-coefficient Fourier symbol. With forcing or lower-order terms, a discrete energy inequality and Gronwall inequality yield a mesh-independent finite-time bound.
A related technique is eigenvalue stability analysis of a finite difference method. If the spatial matrix is symmetric with nonpositive eigenvalues and the time update is , an orthonormal eigenbasis gives
This proves stability when all scaled spatial eigenvalues lie in the time method's stability domain. For a nonnormal spatial or amplification matrix, the eigenvalues alone do not control powers: ill-conditioned eigenvectors or Jordan terms can cause transient growth. Direct operator-norm estimates, symmetrizers or energy estimates then provide the missing information. In particular an A-stable scalar time formula does not automatically give mesh-uniform bounds for every ill-conditioned family of spatial matrices.
Boundary conditions and starting procedures are part of the discretization. Interior Fourier analysis may fail to detect a growing boundary mode, and a multilevel method can excite a parasitic mode through a poor start. One must therefore analyze the actual finite-domain operator or include its boundary terms in an energy proof. Stability is a uniform error-propagation bound; Fourier symbols, energy identities, matrix norms and spectral analysis are complementary ways of establishing that bound.
The Engquist-Osher method is an upwind finite volume method. For cell values , mesh width and time step , put and use the conservative update
where the numerical flux is
Consistency of a numerical method follows from . Positive characteristic speeds use the left state, and negative speeds use the right state. The flux difference telescopes when summed over cells, giving a discrete conservation law. The method is first order in space and time for smooth solutions; its conservation law form is also appropriate when shock waves develop.
Let be the unique sonic point of a scalar flux, . Convexity implies to its left and to its right. Put and split
Then , , , and
This is the sonic-point splitting of a convex Engquist-Osher flux. If both states are above , ; if both are below it, . Across a transsonic rarefaction wave, , the flux is the minimum . In the opposite crossing it is , which in general differs from the exact Godunov numerical flux. This distinction does not affect the monotonicity proof.
Here stability requires the usual Courant–Friedrichs–Lewy condition. Let the initial values lie in , and choose
A differentiable convex function has a continuous derivative on this interval, so the maximum is finite. Write the three-input update as . Differentiating gives
Thus the update preserves componentwise order. Constants are fixed, since , so comparison with the constants proves for every time level. In particular the same CFL condition remains applicable. This is a mesh-independent maximum-principle stability bound.
A stronger stability statement is contraction in discrete . Consider two solutions in the same invariant interval, on a periodic mesh or on the infinite lattice with summable differences. Let be their componentwise maximum. Monotonicity gives , hence
The discrete conservation law for the difference gives the equality: on a finite periodic mesh the flux sum cancels exactly, and on the infinite lattice it follows by truncation and the fact that the flux is a Lipschitz function on . Interchanging and adding proves
This is L1 contraction of a monotone conservative scheme. Since commutes with the cell shift, applying this contraction to and its shift gives . The scheme is therefore a total variation diminishing scheme as well.
The same order argument proves a discrete entropy inequality, explaining why this stable discretization selects entropy solutions rather than nonphysical expansion shock waves. For a constant , set
Because and , their componentwise difference is at least . Subtracting their updates gives
For constants outside , the entropy inequality is an equality by the invariant bound and the conservative update. At equal states , the Kruzhkov entropy flux. The flux is a Lipschitz function on the invariant interval: writing , the conservative update gives . This time-translation bound, the invariant bound and the total variation estimate give local space-time compactness for bounded-variation initial conditions as the mesh is refined; the conservative update passes to the weak conservation law, and the displayed inequality passes to its Kruzhkov entropy inequality. This identifies the limit as the entropy solution.
Finally the time-step qualification is essential. For the convex Inviscid Burgers equation flux , whose unique sonic point of a scalar flux is zero, linearize about a positive constant . The perturbation update becomes . At Fourier frequency its multiplier is , with modulus greater than one if . Wave packets near this phase give linear instability even for summable Cauchy perturbations. Thus the assumptions on imply the stability results above under the CFL condition, not for arbitrary . This is CFL necessity for explicit Engquist-Osher stability.
Fourier stability analysis exploits translation invariance of a linear constant-coefficient finite difference method. On an infinite uniform grid of spacing , a spatial shift acts on by multiplication by . Hence a scalar two-level scheme with new- and old-time symbols propagates each Fourier mode by , provided the new-time operator is invertible. An explicit stencil simply has . This converts a spatial evolution into scalar algebra at each frequency.
The Plancherel theorem gives the full norm estimate, rather than just a heuristic about waves. For the discrete Fourier transform , interpreted in the sense if necessary,
Thus a scalar mode bound gives an exact discrete L2 norm bound. Stability on a fixed physical interval requires constants independent of the refining spatial and time meshes:
The contraction condition is sufficient and customary for equations whose exact solutions do not grow. More generally suffices, since . At a fixed Courant number, when is independent of , a mode with modulus strictly greater than one violates the estimate as . One must keep this scaling: physical growth such as does not by itself mean finite-time numerical instability. This is finite-time stability versus power boundedness.
For systems, the symbol is an amplification matrix. The requirement is a uniform bound on all its powers, not merely its eigenvalues. A unit-modulus Jordan block has powers and is unstable under refinement. A uniformly conditioned eigenbasis or an energy estimate can justify a modal conclusion; eigenvalues alone cannot control a general nonnormal matrix. Multilevel schemes likewise produce an amplification polynomial of a multilevel finite difference scheme, with a uniform root condition and control of starting errors. Repeated unit-modulus roots can give polynomial growth, and roots approaching each other require attention to mesh-uniform constants.
Several elementary examples show how the calculation works. For with , forward Euler with centered spatial differences gives , where . Since , it is unstable at every fixed nonzero Courant number. The upwind finite difference scheme instead gives and
so its exact contraction range is . The Lax-Wendroff advection scheme has ; expansion gives , hence . The Courant–Friedrichs–Lewy condition relates these restrictions to the numerical domain of dependence, but is a necessary geometric check rather than a complete stability proof. Implicit schemes can have a global spatial dependence and different Courant ranges, as Question 3 illustrates.
For the heat equation , put . Central spatial differences with forward Euler give , so . With backward Euler the factor is , a contraction for every . For the Crank-Nicolson diffusion scheme it is , again a contraction for all . At large , however, high-frequency factors approach minus one rather than zero: unconditional stability does not imply strong damping or accurate resolution of every mode.
The connection with convergence is the Lax equivalence theorem for a consistent approximation to a well-posed linear evolution problem. Its forward implication follows directly from the error recursion. If and for , then
A convergent initialization and a vanishing normalized local truncation error therefore give convergence. Smooth-data consistency can be extended by density when the approximation and initialization are uniformly bounded. For rough data, cell averages or another L2-compatible initialization of grid data are preferable to undefined point samples. A high formal order does not rescue an unstable amplification operator.
Boundary conditions determine whether Fourier diagonalization is exact. On a periodic grid the update is a circulant matrix, and the finite discrete Fourier transform diagonalizes it at the frequencies . Here an interior symbol controls the entire scheme, including the wrapping boundary. On the whole line, the continuous frequency transform serves the same purpose and there is no boundary closure to check.
For a finite interval with homogeneous Dirichlet boundary conditions, centered diffusion is a symmetric tridiagonal problem diagonalized by discrete sine modes. One tests the same diffusion symbol at the admitted sine frequencies, not at arbitrary periodic modes. For homogeneous Neumann boundary conditions, a suitable reflected closure uses discrete cosine modes; the constant mode is present and is neutral for pure diffusion. With the standard reflected endpoint stencil, the natural norm uses half endpoint weights, in which the matrix is self-adjoint. Consequently stable diffusion need not make every solution tend to zero under Neumann conditions. These special orthogonal bases supply an exact substitute for Fourier modes when the operator and closure have the required symmetry.
For transport, prescribe only the incoming physical boundary data. With , , the inflow is the left endpoint; for it is the right endpoint. Imposing unrelated data at both ends generally overdetermines the first-order PDE. Outflow rows or ghost points must be chosen compatibly with the interior method. A general boundary closure of a difference scheme destroys the circulant structure, so whole-line von Neumann stability analysis is necessary in many settings but not sufficient for the full initial-boundary problem. A defective boundary row that doubles one boundary unknown each step can create growth even beside a stable interior stencil.
A more refined boundary calculation seeks half-line modes with ; these are localized near the boundary. Insert them into both the interior recurrence and boundary equations. A compatible mode with proves boundary instability. Absence of one isolated growing mode is not the whole theorem: weakly controlled limiting modes can still destroy a uniform estimate. The Uniform Kreiss--Lopatinskii condition requires a uniformly bounded inverse boundary system on the incoming/decaying mode space. Direct energy estimates are often a clearer alternative to solving that transformed boundary problem.
For example, suppose a first-derivative matrix obeys the discrete summation by parts identity , with positive norm matrix . The semidiscrete advection equation then gives
With homogeneous inflow and , only a nonpositive outflow term remains; prescribed inflow contributes a controlled forcing term. This is the inflow advection energy estimate from summation by parts, and it tests the boundary as part of the operator. For a dissipative semidiscrete matrix , backward Euler also preserves the estimate, because its update gives
This distinguishes spatial energy stability from stability of an arbitrary chosen time integrator.
Finally, nonhomogeneous boundaries can be homogenized by subtracting a suitable lifting, leaving a forced equation whose solution needs a bound in terms of both initial and boundary data. Variable coefficients and nonuniform grids remove translation invariance, so freezing coefficients gives only local diagnostic information. A full energy method, a mesh-uniform operator estimate, or a dedicated boundary-symbol analysis is then needed. Fourier symbols give complete stability tests when an orthogonal mode decomposition diagonalizes the full operator; otherwise the boundaries, matrix powers and norm estimates must be checked as well.
Choose a spatial interval with periodic boundary conditions and a uniform grid, so no separate inflow boundary closure of a difference scheme is required. The discrete Fourier transform is a unitary operator in the discrete L2 norm. Every circulant stencil is diagonal in that transform, and a one-step Fourier multiplier is a contraction exactly when its modulus is at most one for every grid frequency. For a mesh-uniform statement, use all , the limiting frequency range.
A Fourier mode gives
with the coefficients from (a). Squaring moduli and putting yields
This has the required nonnegative sign for every frequency exactly when
One must also check that the implicit equation is solvable, rather than divide by a vanishing symbol. Here
For , a zero would have to occur at zero or ; the latter occurs only at , both outside the displayed stable intervals. At , . Thus there is no denominator zero in the stable range. For fixed such , continuity on the compact frequency interval gives a uniformly bounded inverse, and proves for all steps.
Outside these intervals the displayed difference is negative at every nonzero frequency where , so . On periodic refining meshes there are frequencies approaching any selected such value. Their amplification is bounded away from one and is repeated times over a fixed physical interval when , violating a mesh-uniform stability bound. At the two singular parameters the implicit operator itself fails on meshes containing the Nyquist mode. These observations prove necessity as well as sufficiency.
For the physical convention , , the result is or , with zero admitted as the identity limit. The negative intervals describe the algebraic contraction result for signed Courant numbers. In particular, the additional large positive interval must not be discarded by imposing the usual explicit-scheme Courant–Friedrichs–Lewy condition: this scheme is implicit. Stability at large fixed Courant number is not a guarantee of a small error constant.
Eigenvalue analysis proves mesh-uniform stability when it is accompanied by control of eigenvectors or an energy norm; the signs of eigenvalues alone are insufficient. For an evolution equation, the method of lines first produces . A time integrator then gives an amplification matrix , for example for a Runge-Kutta method. The useful stability requirement on a fixed physical time interval is
where is independent of the refining spatial and temporal meshes. The semidiscrete analogue is for . These are bounds on propagation of initial errors and residuals, not merely statements that each finite matrix has a bounded solution over its own finite time interval.
If is a normal matrix in the chosen discrete inner product, it has a unitary eigenbasis. Then
For dissipative problems it is sufficient that every lie in the integrator's linear stability domain. A diagonalizable family also suffices if its eigenvector matrices have uniformly bounded condition numbers: the same maximum is multiplied by . Without that uniform bound the argument does not establish mesh stability. For finite-time estimates, an amplification modulus can also be acceptable; strict contraction at every step is a stronger property.
For a constant-coefficient stencil on the full lattice or a periodic grid, von Neumann stability analysis provides the eigenvectors explicitly. A Fourier mode diagonalizes each translation-invariant spatial difference, giving a scalar symbol or a small matrix symbol for a system. The discrete Fourier transform and Parseval identity turn a uniform modal bound into an actual discrete L2 norm bound. The two-dimensional stencil in question 3 has , so its continuous-time amplification is contractive; a later time integrator must still be checked. With boundaries one must analyze the boundary rows as well: a whole-line Fourier symbol cannot detect an unstable boundary closure.
For the heat equation on a unit interval with zero Dirichlet data, the centred second difference has a sine eigenbasis and eigenvalues
Explicit Euler method multiplies mode by . Requiring all factors to have modulus at most one yields on a given grid, and the sharp grid-independent sufficient limit is
These parabolic time-step restrictions express the growth of the largest-magnitude diffusion eigenvalue like . Backward Euler method instead has factor and the Crank-Nicolson method factor , both bounded by one for every . Their unconditional stability follows from A-stability, with much stronger damping of the shortest scales for backward Euler.
For , , explicit time stepping with a backward spatial difference gives
Thus the upwind finite difference scheme is contractive exactly for , a Courant–Friedrichs–Lewy condition matching the direction and speed of information propagation. A centred spatial difference has purely imaginary eigenvalues, and forward Euler gives . Under a fixed positive hyperbolic Courant number, high-frequency data grow by a fixed factor in each of steps, proving instability as the mesh is refined. This is not a claim that no exceptionally small coupled step can ever give a finite-time bound: if , the excess per step is only , but the usual hyperbolic scaling is unstable. Higher-order explicit integrators can possess nontrivial imaginary-axis stability intervals and are then suitable for skew-adjoint advection or the energy-form first-order wave equation.
Variable coefficients usually prevent Fourier diagonalization, but may preserve a self-adjoint spatial operator. The positive-face diffusion discretization in question 5 is an example. Its discrete energy identity makes symmetric negative definite, so a unitary eigenbasis still exists even without a closed eigenvalue formula. More generally, a dissipative operator in a discrete energy inner product obeys
which directly proves a uniform semigroup estimate. The dissipative Cayley-transform contraction also follows without normality: for ,
Taking proves contraction of the Crank–Nicolson factor. The contractivity of split Crank-Nicolson diffusion then follows from multiplying two contraction bounds; simultaneous eigenvectors of the two directional matrices are unnecessary.
The negative spectra do not imply uniform semidiscrete stability example shows what can go wrong. Let
Both eigenvalues are for every mesh, but applying the propagator to the second unit vector at gives norm at least . The evolution is therefore not mesh-uniformly stable. For a discrete matrix, a unit-modulus eigenvalue with a nontrivial Jordan block gives powers growing polynomially in the step number. Even strictly interior eigenvalues can allow large transient growth when eigenvectors are badly conditioned. A pseudospectrum or numerical range of an operator, and especially a direct energy estimate, can reveal behavior missed by eigenvalues.
A resolvent estimate provides another way to see the needed uniformity. If for every , then for ,
This shows directly that a uniform power estimate imposes more than the location of the spectrum. Conversely, resolvent-to-power estimates in varying dimension must themselves be uniform; a bound with constants depending on the number of grid points is not enough.
For a linear multistep method, each spatial eigenvalue gives an amplification polynomial, and all roots must satisfy the root condition for a multistep method, including simplicity of any unit-modulus root. Merely following the root approximating misses parasitic modes. The temporal and spatial analyses must therefore be combined with the appropriate zero-stability and uniform modal bounds.
Finally stability connects to convergence. If the exact grid samples have normalized residual and the error obeys , iteration gives
A residual tending uniformly to zero then gives convergence on . For a well-posed linear initial-value problem and a consistent linear finite-difference approximation, this is the forward implication of the Lax equivalence theorem. The practical conclusion is to analyze the full operator including boundaries, select a time method whose stability region contains the relevant scaled spectrum, and verify that eigenvectors or an energy estimate make the resulting bounds uniform as the grid is refined.
Fourier stability analysis applies most directly to linear, constant-coefficient evolution schemes on uniform infinite or periodic grids. Translation invariance makes spatial shifts diagonal in discrete Fourier modes. If a one-step scheme has , substituting gives the Fourier amplification symbol
The discrete Parseval identity identifies the discrete L2 norm with the squared norm of Fourier coefficients. Uniform stability on a fixed time interval means a mesh-independent bound on for all frequencies and . In the scalar case yields contraction. More generally gives the bound and is consistent with a continuously growing well-posed equation. A fixed modulus excess independent of the step produces growth exponential in and fails this requirement.
For systems, eigenvalue moduli alone are insufficient. The uniform power bound for matrix Fourier symbols also controls eigenvector conditioning and Jordan growth. For example has only unit eigenvalues but , unbounded as at fixed . In contrast an off-diagonal entry proportional to gives growth at most proportional to , which can be legitimate. A uniformly conditioned diagonalization is a sufficient reduction to scalar modal bounds; nonnormal matrices require direct power or energy estimates. Multilevel schemes similarly require the root condition for their frequency-dependent amplification polynomial and a uniform bound on the associated companion evolution, including limiting repeated-root cases.
The simplest parabolic example is the Forward Euler method with centered spatial diffusion. For ,
is the sharp mesh-uniform contraction range. For the theta method, , giving unconditional contraction at . Implicit stability permits larger steps, but accuracy still constrains them, and the Crank-Nicolson method does not strongly damp high-frequency rough data.
For advection with , the upwind finite difference scheme gives
Thus is its contraction range. The Lax-Friedrichs scheme has and is contractive exactly when . These express a Courant–Friedrichs–Lewy condition: the numerical domain of dependence must encompass the physical one for convergence. That necessary condition is not sufficient by itself. Forward time with centered advection has and at nonzero modes. At a fixed nonzero Courant number it is unstable even if . Under the much stronger refinement , however, its powers remain bounded on fixed time intervals; the centered-advection refinement-dependent stability must not be confused with the usual hyperbolic-step instability.
Symbols also quantify dispersion and dissipation. For a mode , the argument of gives a numerical phase speed and gives damping. Upwind advection has leading artificial diffusion under fixed-Courant refinement; excessive damping smooths genuine structure, while phase error misplaces waves. Stability controls boundedness, not either error by itself. Smooth low-frequency Taylor expansions establish consistency; high-frequency modal bounds establish stability, so analyzing only fixed physical wavenumbers can miss grid-scale instabilities.
For a well-posed linear initial-value problem, the Lax equivalence theorem makes consistency plus a uniform stability estimate equivalent to convergence in the chosen norm. Boundaries and variable coefficients need extra care: Fourier diagonalization no longer handles the full update, and an interior or frozen-coefficient symbol does not prove boundary or global stability. Boundary energy estimates, a suitable matrix analysis or a separate boundary-stability argument must supplement it. Nonlinear schemes also require controls beyond this linear symbol test. These limitations delimit what the method proves rather than reducing its usefulness: in its proper setting, it turns an arbitrarily large grid evolution into exact and interpretable modal algebra.
For fixed finite matrices, the matrix exponential and a Taylor expansion show
This agrees through degree two with , even when and do not commute. On a fixed time interval, and the telescoping identity
turns the one-step defect into global error for . Hence Strang splitting is second order in general; for commuting matrices it is exact.
For the spatial discretization, use , and the interior vector , with . The central finite differences give
Here lists lower diagonal, main diagonal and upper diagonal, in that order. Thus and . Discrete summation by parts gives
The matrix exponential is consequently a contraction in the Euclidean norm, while is an orthogonal matrix for real . Therefore
Repeated split steps are contractive in the mesh-weighted norm , uniformly in the spatial mesh and without a Courant–Friedrichs–Lewy condition. The split semidiscretization is unconditionally stable. No commutativity or shared eigenvectors are needed for this Strang splitting contraction for symmetric diffusion and skew advection. Its time-order proof is for fixed spatial matrices; as , commutators can grow, so this stability result alone is not a uniform-in-mesh second-order error estimate.
The Engquist-Osher method is a conservative finite volume method built by separating positive and negative characteristic speeds. Take , a uniform cell width , a time step , and cell averages . Write and define the numerical flux
The Engquist-Osher flux uses the left state for right-going transport and the right state for left-going transport. Its conservative update is
It is consistent because . The integrals have their ordinary oriented meaning even for negative states. For the Inviscid Burgers equation, gives the useful example
In a region where all characteristic speeds have one sign, the flux reduces to the corresponding upwind flux. In smooth regions, this basic piecewise-constant, forward-time version is first order in space and time; its main virtue is robust nonlinear stability across shocks.
Here is a precise stability proof. Assume the data lie in a bounded interval and choose
Work on a periodic grid, or on the infinite grid with summable differences; on a finite interval the inflow boundary data and boundary fluxes must be treated monotonically as well. Define the three-point update map
Writing and , its three partial derivatives are
Thus it is a monotone conservative scheme. Since , comparison with the constant states proves
The interval is invariant, so the same Courant–Friedrichs–Lewy condition remains valid at every step. This is an bound relative to constant states, not a claim that arbitrary pairs of solutions are contractive in .
For a stronger perturbation estimate, let denote the global update and use componentwise maxima. Monotonicity gives . Therefore
Sum over the grid. The shared interface flux cancels telescopically, so conservation gives
Interchanging and adding yields the L1 contraction of a monotone conservative scheme:
This is a mesh-independent nonlinear stability estimate. On an infinite grid the telescoping argument is justified by summability of the differences and the bounded characteristic-speed range, or by truncation followed by a limit. For unequal prescribed boundary data, additional boundary flux terms enter the estimate.
The method is also a total variation diminishing scheme. Let shift a grid sequence by one cell. Translation invariance gives . Applying the preceding contraction to and shows
Hence initially finite discrete total variation cannot grow.
Finally, monotonicity supplies a discrete entropy inequality, explaining why the stability is compatible with the physically admissible entropy solution. For a constant , define
Comparison of with the clipped triples above and below gives
Indeed and , and subtracting these two update formulas yields exactly the right side. Also , the Kruzhkov entropy flux. Under the displayed CFL condition the method therefore has an invariant state range, contraction, decreasing discrete total variation and entropy dissipation. These estimates remain meaningful at discontinuities, where linearized Fourier analysis alone cannot establish the corresponding nonlinear stability.
A stability analysis asks whether perturbations in an evolution remain bounded on a fixed physical time interval by a constant independent of the mesh. For a linear update , the basic requirement is
This permits physical growth bounded by ; it need not require every step to be a contraction. Consistency of a numerical method measures how well its stencil reproduces the differential equation, whereas stability of a numerical method controls the accumulated defects. For a well-posed linear problem, the Lax equivalence theorem connects stability and convergence for a consistent approximation in the specified norm.
On the whole line or a periodic grid, constant-coefficient stencils commute with translations. The Fourier modes diagonalize such spatial operators, turning a scalar one-step scheme into
The Fourier symbol is found simply by replacing a shift by . The Parseval identity makes this modal calculation a norm estimate: if at every resolvable frequency, then the discrete norm cannot increase. More generally, a uniform gives and a fixed-time stability bound. All frequencies matter, including those near the grid scale; a small-wavenumber expansion establishes consistency but cannot test the entire stability range.
For the heat equation, put and . The Forward Euler diffusion scheme has
The condition for every is exactly . This illustrates a parabolic time-step restriction . The Backward Euler diffusion scheme instead has
which is contractive for every . The Crank-Nicolson diffusion scheme has
and is likewise unconditionally stable. However, its high-frequency amplification approaches for large , so it need not damp rapidly decaying modes effectively and may produce alternating transients from nonsmooth data. An A-stable time integrator can stabilize a diffusion semidiscretization with left-half-plane spectrum, but damping and accuracy remain separate questions.
For transport , define the hyperbolic Courant number . Forward Euler with a centered spatial difference gives and . It is unstable under a fixed nonzero CFL ratio. For , the upwind finite difference scheme has
Thus is the stable range. Upwinding for negative reverses the spatial difference and gives . The Lax-Wendroff advection scheme gives a second-order example:
It is stable for , but that result does not imply monotonicity or exclude oscillations at shocks. The Courant–Friedrichs–Lewy condition has a domain-of-dependence interpretation for explicit hyperbolic schemes; the Fourier calculation supplies the sharper algebraic stability criterion for the particular stencil.
For multilevel methods, each frequency gives an amplification polynomial and a companion matrix. Every amplification root must lie in the closed unit disk, with unit-modulus roots simple. Uniformity across frequencies and meshes is essential: one also needs control of the associated matrix powers, for example through a uniformly bounded diagonalization or the uniform power bound from separated amplification roots. A repeated unit root generates a Jordan block and polynomial growth in the number of steps. The same issue occurs for systems: checking only eigenvalue moduli of a nonnormal Fourier amplification matrix is insufficient. For instance
has unit eigenvalues but no fixed-time mesh-uniform bound as . For a hyperbolic system with a constant coefficient matrix admitting a uniformly bounded characteristic diagonalization, scalar modal estimates for each characteristic speed do give a system estimate. A positive energy symmetrizer provides another route. Frozen-coefficient Fourier tests for variable coefficients are useful local diagnostics, but a global estimate must also account for coefficient variation and boundary terms.
Boundary conditions change the allowable modes and can change the conclusion. A periodic calculation is exact only for a periodic closure. On a finite interval with zero Dirichlet boundary conditions, the centered diffusion matrix is diagonalized instead by the discrete sine transform. On interior points its eigenvalues are before scaling by . Thus the exact fixed-grid Forward Euler restriction is
which tends to the whole-line threshold as the grid is refined. Backward Euler and Crank-Nicolson remain stable for all nonnegative . An appropriate Neumann boundary condition uses cosine-type modes and includes a constant mode with eigenvalue zero. The constant mode must be preserved, rather than forced to decay; depending on the boundary stencil, the natural discrete inner product may have endpoint weights.
For hyperbolic transport, the continuous and discrete boundary closures must respect the direction of propagation. If on , prescribe the left inflow value; prescribing an independent outflow value can overdetermine the problem. The energy method exposes this directly:
Homogeneous inflow is dissipative, while forced inflow contributes data to the estimate. A compatible upwind boundary update has the same one-sided information flow. For diffusion,
The last term vanishes for homogeneous Dirichlet or Neumann conditions. With Robin boundary conditions of dissipative sign it contributes a further nonpositive term. A non-dissipative boundary can produce genuine PDE growth, which a valid stability estimate should represent rather than incorrectly suppress.
Even a perfectly stable interior symbol cannot detect every defective boundary closure of a difference scheme. As a concrete counterexample, leave a stable explicit heat stencil on all grid points away from the left endpoint, but replace its first interior row by , still keeping . The interior Fourier symbol is unchanged, yet makes the finite-interval update unstable. The faulty boundary-adjacent row creates a mode absent from the periodic interior calculation. Thus the entire finite update matrix, or an energy estimate including its boundary rows, must be examined.
A more systematic boundary stability of a finite-difference method analysis transforms time and any tangential spatial variables, then looks for modes with and on a half-line. The interior dispersion relation selects decaying spatial modes; the boundary equations must determine their coefficients without admitting a nonzero growing homogeneous mode. A uniform inverse estimate for the boundary system, expressed by the Uniform Kreiss--Lopatinskii condition, also rules out arbitrarily weak boundary control near limiting frequencies. Merely excluding one obvious unstable mode is weaker than proving a mesh-uniform estimate. Discrete summation by parts and suitable boundary penalties offer an energy-based alternative.
Finally, nonlinear scalar conservation laws can develop discontinuities, so linearized Fourier stability is only one part of the analysis. A monotone conservative scheme, such as the Engquist-Osher method under its CFL restriction, has an invariant state range and L1 contraction of a monotone conservative scheme, with a discrete entropy inequality selecting admissible shocks. These complement the Fourier and boundary estimates. For an evolution problem, the meaningful outcome is a stability bound in a specified norm, uniform over the chosen mesh family and compatible with the actual boundary and initial data.
For a fully discrete linear partial differential equation evolution, write in a specified discrete norm. Finite-time stability of a numerical method means
with independent of the allowed meshes. For a multistep method, augment the state with its time-history values and include a stable starter. Bounds may grow as when the continuous problem has growth; demanding decay for all time would be a stronger assertion. The treatment of initial data, forcing, Dirichlet boundary conditions, and the norm is part of the hypothesis, not a detail supplied by an interior calculation.
For constant coefficients on an infinite or periodic uniform grid, von Neumann stability analysis substitutes the Fourier mode . The discrete Fourier transform and the Parseval identity turn a uniform multiplier estimate into a discrete L2 norm estimate. In a one-step scalar scheme, proves contractivity, while gives finite-time stability. In a multilevel scheme, every root of a polynomial in its amplification polynomial of a multilevel finite difference scheme matters, as does uniform control of the associated companion matrix.
For the Forward Euler diffusion scheme with ,
Thus for all frequencies exactly when
Sufficiency follows since ; necessity follows from the highest-frequency mode on even periodic grids. This gives the usual parabolic mesh restriction . For the Backward Euler diffusion scheme,
so every is stable. The Crank-Nicolson method has
again of modulus at most one for all , but stiff modes approach rather than zero. These are PDE manifestations of the A-stability and L-stability distinctions for time integration.
For advection , assume and set . The upwind finite difference scheme is , with
It is contractive when . This also has a direct maximum-norm proof: each newest value is a convex combination of two old values. The resulting Courant–Friedrichs–Lewy condition expresses that the numerical domain of dependence covers the physical one. For negative , the upwind direction must be reversed. By contrast, Forward Euler method time stepping with the centered first finite difference has and for nonzero . Under fixed nonzero refinement it is unstable, since a fixed nontrivial mode grows geometrically over steps. This is not a claim of instability under every imaginable mesh coupling: instead bounds its spurious finite-time growth, since .
The leapfrog advection scheme illustrates a multilevel subtlety. Its amplification polynomial of a multilevel finite difference scheme is
For , both roots of a polynomial have unit modulus and separation at least . A uniformly conditioned eigenbasis of the companion matrix then proves power boundedness of a two-level Fourier scheme for arbitrary history data. At and a grid admitting , the roots coincide on the unit circle, and a Jordan block produces growth. Thus the endpoint fails the ordinary arbitrary-history root condition for a multistep method; checking only that both moduli equal one misses the instability. Restricting the starter or filtering the parasitic mode is an additional hypothesis.
The energy method handles variable coefficients and finite boundaries for which Fourier stability analysis may be unavailable. For the Backward Euler diffusion scheme with homogeneous Dirichlet boundary conditions, define . The discrete summation by parts identity is
Take the inner product of with . The elementary identity gives
This proves unconditional contractivity including the actual boundary treatment. More generally, a dissipative operator gives of operator norm at most one: with , dissipativity implies , and the Cauchy-Schwarz inequality gives . In finite dimensions this also proves invertibility. For the second-order backward differentiation formula, the BDF2 discrete energy identity used in question 4 controls both time levels and proves unconditional diffusion stability. A repeated root strictly inside the disk is harmless here; the energy argument supplies the uniform bound without a singular eigenvector formula.
A second technique is eigenvalue stability analysis of a finite difference method. Under the method of lines, a time integrator advances by . If is a normal matrix, the scalar linear stability domain criterion on all controls its powers exactly in the corresponding L2 norm. For the centered Dirichlet discrete Laplacian, its eigenvalues lie between and zero; intersecting this interval with a time integrator's stability interval determines its mesh restriction. A uniform bound on the diagonalization of a matrix is needed for nonnormal diagonalizable systems. Eigenvalues alone can be misleading. For example,
has both eigenvalues inside the disk for , but the upper-right entry of is . Taking , , this grows like . Hence stable scalar eigenvalues do not give mesh-uniform stability. Boundary closures can introduce precisely the extra growth that an interior Fourier symbol overlooks, so boundary stability of a finite-difference method must be checked separately.
For nonlinear spatial discretizations, a useful replacement for Fourier stability analysis is a convexity argument. If the Forward Euler method map is nonexpansive in a chosen norm for , the second-order strong stability preserving Runge-Kutta method
is also nonexpansive under the same restriction. Indeed, for two inputs, the triangle inequality gives . Its Taylor expansion is , proving order two. Such strong stability preserving Runge-Kutta methods transfer suitable forward-step bounds without relying on a linear spectral calculation.
Finally, consistency of a numerical method explains what stability buys. For a linear Hadamard well-posed problem, the Lax equivalence theorem equates convergence of a consistent discretization with its stability, under the stated approximation-space and norm hypotheses. Directly, if the error satisfies , iteration gives the discrete Duhamel principle
Thus vanishing normalized local truncation error and initial error yield convergence. With a nonlinear Lipschitz step estimate, the discrete Gronwall inequality plays the same role. A stable but inconsistent stencil, such as the literal defective formulas in questions 3 and 4 under their usual refinement, is not rescued by any amplification bound. The decisive checks are a mesh-uniform evolution bound, a valid boundary closure, and consistency with the actual PDE.
Stability asks whether perturbations already present in data, arithmetic, or an earlier numerical step remain controlled under subsequent evolution. It complements consistency of a numerical method: consistency says that an exact smooth solution nearly satisfies one numerical step, while stability prevents the accumulated local defects from being amplified without bound. For a well-posed differential equation these two properties are what make convergence possible.
For a linear multistep method, zero-stability concerns the limit . The roots of its first characteristic polynomial must lie in the closed unit disk, and every root on the unit circle must be simple. The Dahlquist equivalence theorem states that a consistent linear multistep method converges precisely when it is zero-stable. The parasitic root in Question 1 decays, whereas a repeated root at would turn small defects into secular growth.
Absolute stability instead fixes for the Dahlquist test equation. A one-step method has amplification factor and absolute-stability region
A-stability means that contains the entire closed left half-plane, matching every decaying scalar linear problem. L-stability additionally requires as , which suppresses unresolved fast transients in a stiff differential equation. Backward Euler is L-stable; the trapezoidal rule is A-stable but approaches and can retain stiff oscillations; forward Euler is stable only in the disk .
For nonlinear dissipative systems, scalar absolute stability can be insufficient. B-stability controls distances between numerical solutions of contractive differential equations. For Runge–Kutta methods, algebraic stability—nonnegative weights and positive semidefiniteness of —is a useful sufficient condition for B-stability. Question 2 shows how a single negative diagonal entry disproves it.
After spatial discretization of a partial differential equation, stability can be studied through the semidiscrete matrix. If its Hermitian part is nonpositive, the energy method proves contractivity without diagonalizing it. A skew-Hermitian generator instead conserves norm, as in the discrete Schrodinger problem of Question 3. Eigenvalues alone can be misleading for a non-normal matrix: transient growth may be large even when every eigenvalue lies in the left half-plane, so matrix norms, logarithmic norms, resolvent bounds, or a pseudospectrum may be needed.
For constant-coefficient Cauchy problems, von Neumann stability analysis inserts Fourier modes and bounds their amplification factors. Question 4 gives a typical result: centered diffusion contributes a negative real symbol and centered advection an imaginary symbol. Semidiscrete evolution is stable, yet forward Euler imposes both the parabolic restriction and an advection-diffusion restriction. This illustrates a Courant–Friedrichs–Lewy condition: a stable spatial approximation need not remain stable under an arbitrary time stepper.
For a well-posed linear initial-value problem and a consistent finite-difference approximation, the Lax equivalence theorem identifies stability with convergence. Its hypotheses matter: it does not by itself cover nonlinear equations, inconsistent boundary closures, changing norms, or non-smooth solutions. Boundaries also defeat a naive whole-line Fourier argument; an energy estimate, normal-mode boundary analysis, or a discrete semigroup bound must include the boundary treatment.
Practical stability analysis therefore starts from the structure of the differential equation. Conservation laws favor unitary or symplectic methods, diffusion favors A- or L-stable implicit methods, monotone transport may require strong-stability-preserving time stepping and upwind fluxes, and stiff splitting requires attention to both the factors and their commutators. Stability does not guarantee accuracy: a heavily damped method may be stable while erasing the solution, and a stable computation with near the edge of its stability region may have an unacceptable phase error.