Boundary closure of a difference scheme Created 2026-10-07 Updated 2026-10-14
A boundary closure supplies the boundary rows or ghost values needed by a spatial finite difference method. It must reflect the PDE boundary data and preserve a mesh-uniform stability estimate. Interior von Neumann stability analysis cannot detect an arbitrary unstable boundary row; for example a row produces growth even beside an otherwise stable heat stencil.
Forward Euler stability for centered advection-diffusion Created 2026-10-05 Updated 2026-10-14
For on the whole line, apply centered differences in space and the Forward Euler method in time. With and , the amplification factor is
Putting gives
For , the affine expression in braces is nonpositive on exactly when and . Hence von Neumann stability analysis gives
These conditions are weaker than requiring every stencil weight to be nonnegative; stability in the discrete L2 norm need not imply monotonicity.
Fourier symbol of a difference operator Created 2026-10-05 Updated 2026-10-14
For a translation-invariant difference operator , its Fourier symbol is . Applying to a Fourier mode multiplies that mode by . Symbols turn constant-coefficient stencil equations into scalar algebraic equations and expose their von Neumann stability analysis.
Lax-Wendroff advection scheme Created 2026-10-06 Updated 2026-10-14
For the advection equation on a uniform grid, the Lax-Wendroff update is
Its amplification factor is , with . Thus von Neumann stability analysis on an infinite or periodic grid gives stability for . The scheme has second order of a numerical method for sufficiently smooth solutions; finite-interval boundary conditions still need separate treatment.
Stability of a numerical method controls how perturbations in initial data, roundoff and local residuals propagate. For a linear evolution scheme , a suitable finite-time requirement is
with independent of the refining mesh. The norm should approximate the norm of the continuous problem, such as an area-weighted L2 norm. The bound need not imply decay: is appropriate when the equation itself permits finite-time growth. For a multilevel scheme the state includes all required time levels.
The error recurrence shows why stability matters. If , then
Thus a consistent residual tending to zero and a convergent start produce convergence when the stability constant is uniform. Tiny defects need not remain tiny without that bound. The Lax equivalence theorem makes this precise: for a well-posed linear initial value problem and a consistent linear approximation, stability is equivalent to convergence in the compatible solution norms. It is not a theorem for arbitrary nonlinear schemes, and a high formal order does not substitute for stability.
For constant coefficients on a periodic or infinite grid, von Neumann stability analysis diagonalizes spatial translations using Fourier modes. If , the Parseval identity converts a uniform multiplier-power bound into an L2 norm bound. The contraction condition is sufficient; a more general also yields a finite-time bound. For the centered-space explicit heat method,
so exactly for . Larger fixed Courant numbers amplify high frequencies. The Backward Euler method gives instead and is contractive for every .
For , forward time and centered space give , with . Hence for nonzero frequencies, causing instability at a fixed nonzero Courant number. The directionally correct upwind finite difference scheme uses the neighbor at and has
It is contractive exactly for . This also has a direct maximum-norm proof: the update is a convex combination of two old values. The continuum domain of dependence must fit inside the numerical one for a local explicit hyperbolic method to converge, giving the Courant–Friedrichs–Lewy condition. That necessary geometric restriction is not by itself a sufficient stability proof.
For systems and multilevel methods, each Fourier multiplier becomes a matrix. All amplification roots must obey the appropriate root bound, but their moduli alone are insufficient. A repeated unit root in a companion matrix gives a Jordan block; for instance has . Even distinct roots require control of the diagonalizing matrices uniformly in frequency and mesh. The uniform power bound from separated amplification roots supplies such control for a bounded two-root family with a positive gap. Question5 illustrates both sides: strict gives a uniform gap, whereas the endpoints have a double unit root and are unstable despite unit moduli.
Energy estimates are especially useful when coefficients vary or boundaries prevent Fourier diagonalization. As a simple example, for implicit heat evolution with homogeneous Dirichlet boundary conditions, take the grid inner product of with . Discrete integration by parts gives
The boundary term vanishes because the boundary values are zero, proving contraction. For variable positive diffusion coefficients the corresponding flux-weighted squared differences remain nonnegative, so the argument extends without a constant-coefficient Fourier symbol. With forcing or lower-order terms, a discrete energy inequality and Gronwall inequality yield a mesh-independent finite-time bound.
A related technique is eigenvalue stability analysis of a finite difference method. If the spatial matrix is symmetric with nonpositive eigenvalues and the time update is , an orthonormal eigenbasis gives
This proves stability when all scaled spatial eigenvalues lie in the time method's stability domain. For a nonnormal spatial or amplification matrix, the eigenvalues alone do not control powers: ill-conditioned eigenvectors or Jordan terms can cause transient growth. Direct operator-norm estimates, symmetrizers or energy estimates then provide the missing information. In particular an A-stable scalar time formula does not automatically give mesh-uniform bounds for every ill-conditioned family of spatial matrices.
Boundary conditions and starting procedures are part of the discretization. Interior Fourier analysis may fail to detect a growing boundary mode, and a multilevel method can excite a parasitic mode through a poor start. One must therefore analyze the actual finite-domain operator or include its boundary terms in an energy proof. Stability is a uniform error-propagation bound; Fourier symbols, energy identities, matrix norms and spectral analysis are complementary ways of establishing that bound.
A spatial finite difference method and time discretization for a linear evolution problem give a recurrence . To obtain numerical stability on , one needs a bound uniform in the permitted grid sizes and time steps. More generally a growth estimate is sufficient. The finite-time stability versus power boundedness distinction matters: growth per step of can be compatible with the latter finite-time estimate, whereas unrestricted geometric growth at a fixed Courant number is not.
The eigenvalue method diagonalizes into modes. If is a normal matrix, the spectral theorem gives . Thus gives contraction, and gives the preceding growth estimate. A diagonalizable matrix has , so its condition number must remain bounded uniformly as the mesh changes. A stable-looking list of eigenvalues alone is insufficient.
Indeed,
Both eigenvalues are one, but the Jordan block gives growth proportional to , violating uniform finite-time numerical stability. A nonnormal Fourier amplification matrix can similarly exhibit large amplification even with its eigenvalues inside the unit disk. Eigenvector conditioning and the full powers of the amplification operator are essential.
For constant-coefficient schemes on a periodic or infinite grid, a Fourier transform diagonalizes scalar translation-invariant stencils. This yields von Neumann stability analysis using the Fourier amplification symbol . The discrete Parseval identity turns a bound on into a discrete L2 norm estimate. For systems, the symbol is a matrix; a uniform power bound for matrix Fourier symbols is required, rather than a bound on its spectral radius alone.
For the heat equation, a central finite difference in space and the explicit Euler method in time give
The scalar condition for every frequency is exactly . With zero Dirichlet boundary conditions, the spatial matrix is symmetric and diagonalized by sine modes, leading to the same uniform sufficient restriction. By contrast, the Backward Euler diffusion scheme has and is stable for every .
For the advection equation , , centered space with the explicit Euler method gives , , and . At fixed positive Courant number, repeated powers are unbounded as the mesh is refined. The upwind finite difference scheme instead has
which gives contraction precisely for . This comparison shows why the spatial stencil and time method must be analyzed together.
Boundary treatment can destroy the normality or mode decomposition available on a periodic grid, so a finite-interval scheme needs its own uniform operator estimate. Multilevel time schemes likewise require the root condition for a multistep method and uniform bounds for the associated amplification matrices; simple scalar root tests do not establish these bounds for arbitrary systems. Once consistency of a numerical method, a well-posed linear evolution problem and the required numerical stability estimate hold, the Lax equivalence theorem gives numerical convergence. Eigenvalues provide a powerful route to that estimate when the accompanying eigenvector and boundary analysis is justified.
Fourier stability analysis exploits translation invariance of a linear constant-coefficient finite difference method. On an infinite uniform grid of spacing , a spatial shift acts on by multiplication by . Hence a scalar two-level scheme with new- and old-time symbols propagates each Fourier mode by , provided the new-time operator is invertible. An explicit stencil simply has . This converts a spatial evolution into scalar algebra at each frequency.
The Plancherel theorem gives the full norm estimate, rather than just a heuristic about waves. For the discrete Fourier transform , interpreted in the sense if necessary,
Thus a scalar mode bound gives an exact discrete L2 norm bound. Stability on a fixed physical interval requires constants independent of the refining spatial and time meshes:
The contraction condition is sufficient and customary for equations whose exact solutions do not grow. More generally suffices, since . At a fixed Courant number, when is independent of , a mode with modulus strictly greater than one violates the estimate as . One must keep this scaling: physical growth such as does not by itself mean finite-time numerical instability. This is finite-time stability versus power boundedness.
For systems, the symbol is an amplification matrix. The requirement is a uniform bound on all its powers, not merely its eigenvalues. A unit-modulus Jordan block has powers and is unstable under refinement. A uniformly conditioned eigenbasis or an energy estimate can justify a modal conclusion; eigenvalues alone cannot control a general nonnormal matrix. Multilevel schemes likewise produce an amplification polynomial of a multilevel finite difference scheme, with a uniform root condition and control of starting errors. Repeated unit-modulus roots can give polynomial growth, and roots approaching each other require attention to mesh-uniform constants.
Several elementary examples show how the calculation works. For with , forward Euler with centered spatial differences gives , where . Since , it is unstable at every fixed nonzero Courant number. The upwind finite difference scheme instead gives and
so its exact contraction range is . The Lax-Wendroff advection scheme has ; expansion gives , hence . The Courant–Friedrichs–Lewy condition relates these restrictions to the numerical domain of dependence, but is a necessary geometric check rather than a complete stability proof. Implicit schemes can have a global spatial dependence and different Courant ranges, as Question 3 illustrates.
For the heat equation , put . Central spatial differences with forward Euler give , so . With backward Euler the factor is , a contraction for every . For the Crank-Nicolson diffusion scheme it is , again a contraction for all . At large , however, high-frequency factors approach minus one rather than zero: unconditional stability does not imply strong damping or accurate resolution of every mode.
The connection with convergence is the Lax equivalence theorem for a consistent approximation to a well-posed linear evolution problem. Its forward implication follows directly from the error recursion. If and for , then
A convergent initialization and a vanishing normalized local truncation error therefore give convergence. Smooth-data consistency can be extended by density when the approximation and initialization are uniformly bounded. For rough data, cell averages or another L2-compatible initialization of grid data are preferable to undefined point samples. A high formal order does not rescue an unstable amplification operator.
Boundary conditions determine whether Fourier diagonalization is exact. On a periodic grid the update is a circulant matrix, and the finite discrete Fourier transform diagonalizes it at the frequencies . Here an interior symbol controls the entire scheme, including the wrapping boundary. On the whole line, the continuous frequency transform serves the same purpose and there is no boundary closure to check.
For a finite interval with homogeneous Dirichlet boundary conditions, centered diffusion is a symmetric tridiagonal problem diagonalized by discrete sine modes. One tests the same diffusion symbol at the admitted sine frequencies, not at arbitrary periodic modes. For homogeneous Neumann boundary conditions, a suitable reflected closure uses discrete cosine modes; the constant mode is present and is neutral for pure diffusion. With the standard reflected endpoint stencil, the natural norm uses half endpoint weights, in which the matrix is self-adjoint. Consequently stable diffusion need not make every solution tend to zero under Neumann conditions. These special orthogonal bases supply an exact substitute for Fourier modes when the operator and closure have the required symmetry.
For transport, prescribe only the incoming physical boundary data. With , , the inflow is the left endpoint; for it is the right endpoint. Imposing unrelated data at both ends generally overdetermines the first-order PDE. Outflow rows or ghost points must be chosen compatibly with the interior method. A general boundary closure of a difference scheme destroys the circulant structure, so whole-line von Neumann stability analysis is necessary in many settings but not sufficient for the full initial-boundary problem. A defective boundary row that doubles one boundary unknown each step can create growth even beside a stable interior stencil.
A more refined boundary calculation seeks half-line modes with ; these are localized near the boundary. Insert them into both the interior recurrence and boundary equations. A compatible mode with proves boundary instability. Absence of one isolated growing mode is not the whole theorem: weakly controlled limiting modes can still destroy a uniform estimate. The Uniform Kreiss--Lopatinskii condition requires a uniformly bounded inverse boundary system on the incoming/decaying mode space. Direct energy estimates are often a clearer alternative to solving that transformed boundary problem.
For example, suppose a first-derivative matrix obeys the discrete summation by parts identity , with positive norm matrix . The semidiscrete advection equation then gives
With homogeneous inflow and , only a nonpositive outflow term remains; prescribed inflow contributes a controlled forcing term. This is the inflow advection energy estimate from summation by parts, and it tests the boundary as part of the operator. For a dissipative semidiscrete matrix , backward Euler also preserves the estimate, because its update gives
This distinguishes spatial energy stability from stability of an arbitrary chosen time integrator.
Finally, nonhomogeneous boundaries can be homogenized by subtracting a suitable lifting, leaving a forced equation whose solution needs a bound in terms of both initial and boundary data. Variable coefficients and nonuniform grids remove translation invariance, so freezing coefficients gives only local diagnostic information. A full energy method, a mesh-uniform operator estimate, or a dedicated boundary-symbol analysis is then needed. Fourier symbols give complete stability tests when an orthogonal mode decomposition diagonalizes the full operator; otherwise the boundaries, matrix powers and norm estimates must be checked as well.
For Fourier stability analysis, take spatial modes and put
A bounded implicit step requires to stay away from zero, and von Neumann stability analysis requires for every frequency. Expanding the squared moduli and using gives
Consequently, apart from denominator invertibility, the necessary and sufficient sign condition is
Its real solution set is .
To check the denominator rather than assume it, note
If , a zero can occur only at zero or the Nyquist frequency. The zero-frequency value is nonzero, and the Nyquist zeros occur only at , both outside the proposed stable intervals. At , , also nonzero. Continuity on the frequency circle now gives a positive lower bound on for each allowed .
The implicit convolution operator is therefore boundedly invertible on the square-summable grid sequences. By the Plancherel theorem, gives
Outside these intervals the modulus difference is negative at every nonzero frequency where is nonzero. There is an interval on which , giving arbitrarily large growth of powers of the step operator, so the method is unstable; a zero of additionally makes the step ill posed.
For the physical choice , the stable range is or ; zero is the limiting zero-step case. The exact-shift values have unit gain and are included.
The eigenvalue stability analysis of a finite difference method reduces a linear evolution discretization to its modal behavior, but it must retain the norm and the dependence on the mesh. For a homogeneous system obtained by the method of lines, , the solution is . A one-step time discretization gives ; for a Runge-Kutta method, where its stage matrices are invertible, . With a multistep method one instead uses an amplification matrix on the augmented vector of several time levels.
The relevant finite-time stability estimate is
with independent of the refining spatial mesh and allowed time steps. Similarly, semidiscrete stability requires for . The norm should represent the continuum problem, such as the discrete L2 norm in one dimension. A fixed finite matrix having decaying solutions as is not by itself a mesh-uniform result for the partial differential equation.
If , then
Thus eigenvalues of modulus at most one give a uniform bound when the diagonalizing bases have uniformly bounded condition numbers. For a normal matrix in the chosen inner product, the spectral theorem for normal operators supplies an orthonormal basis, so the condition number is one and the norm of is exactly . For a self-adjoint or skew-adjoint spatial matrix, applying a scalar stability function preserves this favorable modal structure. This is the setting where eigenvalue calculations provide especially clean, reliable step restrictions.
A precise fixed-matrix statement is also useful: a matrix is power bounded for all nonnegative integers if and only if all its eigenvalues lie in the closed unit disk and every Jordan block at a unit-modulus eigenvalue has size one. Indeed, powers of an interior Jordan block contain a polynomial in times a decaying geometric factor and are bounded; a larger block on the unit circle produces unbounded polynomial growth. For a family of matrices, the resulting bounds must still be uniform. Moreover, finite-time stability versus power boundedness distinguishes this all-time condition from the physical-time estimate above. For example , , has , bounded for despite a nontrivial Jordan block at one. Even the scalar update is stable on fixed intervals, since , although it represents a growing equation rather than a contraction.
For a constant-coefficient periodic difference operator, Fourier modes diagonalize the spatial matrix. The discrete Fourier transform is a unitary operator, so Parseval's identity identifies its modal maximum with the operator norm. The eigenvalue stability analysis of a finite difference method then becomes von Neumann stability analysis. For the Dirichlet discrete Laplacian, a discrete sine transform plays the same role. These facts explain its advantages: a large matrix calculation becomes a scalar symbol or a known spectral interval, and the extremal eigenvalue directly determines a safe time step.
As a first example, centered space discretization of the heat equation has eigenvalues
Forward Euler method gives with . Requiring all factors in yields for all periodic meshes. In two dimensions the corresponding uniform bound is . Because these are normal matrices, these scalar bounds prove contraction rather than merely suggest it.
Backward Euler method has , so the centered discretization of the heat equation is contractive for every . The Crank-Nicolson method has and is likewise contractive for these negative real modes. However, its factor tends to for very stiff modes, leaving high-frequency oscillations weakly damped; Backward Euler method tends to zero. The eigenvalues therefore expose the presence of stiff differential equations and damping as well as binary stability. Unconditional stability does not remove accuracy requirements.
For an advection equation example, the upwind finite difference scheme for , , has factor , with . Since
it is a contraction in the periodic discrete L2 norm exactly for . In contrast, Forward Euler method with centered advection has factor . Its modulus exceeds one at nonzero active frequencies, and repeated amplification makes it unstable under fixed nonzero Courant refinement. A much smaller scaling can bound its finite-time growth, demonstrating again that exact contraction and the most general stability estimate are different claims.
The major limitation is the possible presence of a nonnormal matrix. For example,
Both eigenvalues are negative, yet at the second unit vector is amplified by at least . This proves that negative spectra do not imply uniform semidiscrete stability. Ill-conditioned eigenvectors, Jordan normal form and transient amplification can invalidate a spectral-only argument. Direct energy estimates or estimates for the resolvent can supply the missing norm control.
Boundary conditions are another limitation. A periodic symbol proves a periodic or whole-line result, not an arbitrary initial-boundary-value problem. Boundary closure of a difference scheme can introduce growing modes or mesh-dependent amplification. A spatial operator with variable coefficients can still be studied through its assembled matrix, but then whether it is a normal matrix, its condition number and the physical inner product must be checked rather than borrowed from a Fourier stability analysis. For the finite element method the natural mass matrix inner product often turns a generalized eigenvalue problem into a self-adjoint one.
For time-dependent or split updates, separate spectra are insufficient to control products. For instance, and each have only zero eigenvalues, while has eigenvalue . For , alternating the two is unstable. A common contractive norm would control the products, but their individual eigenvalues do not.
Finally, stability and consistency of a numerical method have different roles. The Lax equivalence theorem states that, for a well-posed linear initial-value problem and a consistent finite difference method on compatible grid spaces, stability on every fixed time interval is equivalent to convergence of a numerical method as the admissible meshes refine. Bounded grid representation and the correct initial and boundary setup are part of that framework. An eigenvalue estimate can establish its stability hypothesis in the favorable settings described above; it neither proves consistency of a numerical method nor bypasses its uniformity requirements. The method is therefore a powerful modal tool, provided its spectral calculation is connected to a genuine norm estimate.
Use von Neumann stability analysis on the infinite grid. For the Fourier mode , the semidiscrete eigenvalue is
Its real part is nonpositive for every frequency. The mode evolves by , whose modulus does not grow. The discrete Fourier transform and Parseval identity therefore yield
with a bound independent of , where . Hence the semidiscrete method is stable. Frequencies with are nondissipative rather than unstable.
The same sign can be seen directly by summation by parts: the centred operator is skew-adjoint, and for the unitary shift ,
This is an energy version of the dissipative second-order forward advection stencil. A subsequent time integrator would need its own stability condition; semidiscrete stability does not assert that every fully discrete method is stable.
Eigenvalue analysis proves mesh-uniform stability when it is accompanied by control of eigenvectors or an energy norm; the signs of eigenvalues alone are insufficient. For an evolution equation, the method of lines first produces . A time integrator then gives an amplification matrix , for example for a Runge-Kutta method. The useful stability requirement on a fixed physical time interval is
where is independent of the refining spatial and temporal meshes. The semidiscrete analogue is for . These are bounds on propagation of initial errors and residuals, not merely statements that each finite matrix has a bounded solution over its own finite time interval.
If is a normal matrix in the chosen discrete inner product, it has a unitary eigenbasis. Then
For dissipative problems it is sufficient that every lie in the integrator's linear stability domain. A diagonalizable family also suffices if its eigenvector matrices have uniformly bounded condition numbers: the same maximum is multiplied by . Without that uniform bound the argument does not establish mesh stability. For finite-time estimates, an amplification modulus can also be acceptable; strict contraction at every step is a stronger property.
For a constant-coefficient stencil on the full lattice or a periodic grid, von Neumann stability analysis provides the eigenvectors explicitly. A Fourier mode diagonalizes each translation-invariant spatial difference, giving a scalar symbol or a small matrix symbol for a system. The discrete Fourier transform and Parseval identity turn a uniform modal bound into an actual discrete L2 norm bound. The two-dimensional stencil in question 3 has , so its continuous-time amplification is contractive; a later time integrator must still be checked. With boundaries one must analyze the boundary rows as well: a whole-line Fourier symbol cannot detect an unstable boundary closure.
For the heat equation on a unit interval with zero Dirichlet data, the centred second difference has a sine eigenbasis and eigenvalues
Explicit Euler method multiplies mode by . Requiring all factors to have modulus at most one yields on a given grid, and the sharp grid-independent sufficient limit is
These parabolic time-step restrictions express the growth of the largest-magnitude diffusion eigenvalue like . Backward Euler method instead has factor and the Crank-Nicolson method factor , both bounded by one for every . Their unconditional stability follows from A-stability, with much stronger damping of the shortest scales for backward Euler.
For , , explicit time stepping with a backward spatial difference gives
Thus the upwind finite difference scheme is contractive exactly for , a Courant–Friedrichs–Lewy condition matching the direction and speed of information propagation. A centred spatial difference has purely imaginary eigenvalues, and forward Euler gives . Under a fixed positive hyperbolic Courant number, high-frequency data grow by a fixed factor in each of steps, proving instability as the mesh is refined. This is not a claim that no exceptionally small coupled step can ever give a finite-time bound: if , the excess per step is only , but the usual hyperbolic scaling is unstable. Higher-order explicit integrators can possess nontrivial imaginary-axis stability intervals and are then suitable for skew-adjoint advection or the energy-form first-order wave equation.
Variable coefficients usually prevent Fourier diagonalization, but may preserve a self-adjoint spatial operator. The positive-face diffusion discretization in question 5 is an example. Its discrete energy identity makes symmetric negative definite, so a unitary eigenbasis still exists even without a closed eigenvalue formula. More generally, a dissipative operator in a discrete energy inner product obeys
which directly proves a uniform semigroup estimate. The dissipative Cayley-transform contraction also follows without normality: for ,
Taking proves contraction of the Crank–Nicolson factor. The contractivity of split Crank-Nicolson diffusion then follows from multiplying two contraction bounds; simultaneous eigenvectors of the two directional matrices are unnecessary.
The negative spectra do not imply uniform semidiscrete stability example shows what can go wrong. Let
Both eigenvalues are for every mesh, but applying the propagator to the second unit vector at gives norm at least . The evolution is therefore not mesh-uniformly stable. For a discrete matrix, a unit-modulus eigenvalue with a nontrivial Jordan block gives powers growing polynomially in the step number. Even strictly interior eigenvalues can allow large transient growth when eigenvectors are badly conditioned. A pseudospectrum or numerical range of an operator, and especially a direct energy estimate, can reveal behavior missed by eigenvalues.
A resolvent estimate provides another way to see the needed uniformity. If for every , then for ,
This shows directly that a uniform power estimate imposes more than the location of the spectrum. Conversely, resolvent-to-power estimates in varying dimension must themselves be uniform; a bound with constants depending on the number of grid points is not enough.
For a linear multistep method, each spatial eigenvalue gives an amplification polynomial, and all roots must satisfy the root condition for a multistep method, including simplicity of any unit-modulus root. Merely following the root approximating misses parasitic modes. The temporal and spatial analyses must therefore be combined with the appropriate zero-stability and uniform modal bounds.
Finally stability connects to convergence. If the exact grid samples have normalized residual and the error obeys , iteration gives
A residual tending uniformly to zero then gives convergence on . For a well-posed linear initial-value problem and a consistent linear finite-difference approximation, this is the forward implication of the Lax equivalence theorem. The practical conclusion is to analyze the full operator including boundaries, select a time method whose stability region contains the relevant scaled spectrum, and verify that eigenvectors or an energy estimate make the resulting bounds uniform as the grid is refined.
For an evolutionary partial differential equation, stability of a numerical method means that errors in the starting data and forcing stay controlled on each fixed interval , with constants independent of the mesh. Fourier stability analysis is especially effective for a constant-coefficient finite difference method on a uniform infinite or periodic grid: translation invariance makes different Fourier modes evolve independently.
For a scalar one-step scheme on the integer lattice, insert , with . The Fourier symbol of each shift is , and the update reduces to
The amplification factor must be defined for every relevant frequency; for an implicit scheme this includes checking that its denominator is nonzero. The Parseval identity turns a bound into a discrete L2 norm bound. Thus gives contractivity, while the more general bound gives for . Conversely, frequencies with amplification uniformly greater than one produce unstable wave packets or periodic Fourier modes under refinement.
For a system, is an amplification matrix; for a multilevel scheme, a companion matrix evolves the vector of time levels. The actual requirement is a uniform bound on matrix powers, not just their spectral radius. A nontrivial Jordan block at a unit-modulus eigenvalue creates polynomial growth in the time index. Even simple eigenvalues inside the unit disk can fail to give a uniform bound if the eigenvector matrices become ill-conditioned as the mesh changes. Uniformly controlled diagonalization of a matrix, or a suitable quadratic energy estimate, resolves this issue. The power boundedness of a two-level Fourier scheme illustrates why root multiplicities and conditioning matter.
For the heat equation, put . Centered space with the Forward Euler method has
The von Neumann stability analysis condition holds exactly for on the full frequency interval. The Backward Euler diffusion scheme instead has and is stable for every . The Crank-Nicolson diffusion scheme has
It too is unconditionally stable, but poorly resolved high-frequency modes have for large , giving oscillatory numerical transients. A-stability therefore does not guarantee strong damping; L-stability distinguishes the damping of the Backward Euler method.
For the advection equation , let . Forward time and centered space give
For nonzero fixed , repeated steps amplify some modes by a fixed factor greater than one, so the method is unstable under the usual refinement . This calculation also shows the refinement qualification: if , its finite-time growth can be bounded by , though the restrictive scaling defeats the usual hyperbolic time-step choice. For , the upwind finite difference scheme has
so it is stable for . The Lax-Wendroff advection scheme instead has
giving . These examples separate the effects of the spatial stencil, temporal approximation and Courant number; a higher order of a numerical method by itself does not establish stability.
A periodic boundary condition is ideal for this analysis. The discrete Fourier transform diagonalizes the circulant update, with only the discrete frequencies needed on a grid of points. A bound on all is a convenient guarantee over every such grid. On the whole line, the Fourier transform uses a continuous frequency interval and the Parseval identity proves the corresponding square-summable-data estimate.
Homogeneous Dirichlet boundary conditions do not admit arbitrary complex exponential Fourier modes. For the standard centered second difference on interior points, a discrete sine transform diagonalizes the actual boundary-value matrix:
The same heat amplification formulas then apply at these sine frequencies. For example, the exact forward-Euler contractivity limit on that fixed grid is ; the mesh-independent sufficient limit follows by including all frequencies. Homogeneous Neumann boundary conditions can similarly permit a discrete cosine transform, provided the endpoint discretization and its weighted inner product are chosen consistently. The constant mode is then present, reflecting conservation of the heat equation's spatial mean. For inhomogeneous boundary conditions, subtract a suitable lifting of the prescribed boundary data and estimate the induced source using the homogeneous evolution's bound and a Duhamel principle estimate. Bounds for the lifting and source must themselves be uniform in the mesh.
General boundary conditions require separate boundary stability of a finite-difference method. For an advection equation, incoming data are prescribed at the inflow boundary, while an outflow closure must respect the outgoing characteristics. An interior periodic Fourier symbol cannot detect a growing mode confined near a boundary. A normal-mode test on a half-line seeks modes with and that satisfy both the interior recurrence and boundary closure. Their existence proves instability, and uniform control requires more than merely excluding isolated growing roots; the Uniform Kreiss--Lopatinskii condition addresses boundary resolvent bounds. Alternatively, a direct energy method using summation by parts can include the boundary terms and establish the required estimate.
Variable coefficients and nonuniform meshes usually destroy exact Fourier transform diagonalization. Frozen-coefficient Fourier stability analysis is then a useful diagnostic, but it is not automatically a proof for the full variable-coefficient boundary problem. The mesh-uniform energy method in question 5 is an example of a direct proof. Also, an L2 norm proof is not automatically a mesh-uniform maximum-norm proof: finite-dimensional norm-equivalence constants may grow with the number of grid points.
Finally, stability measures error propagation; consistency of a numerical method measures the defect of inserting the exact solution. For a well-posed linear initial-value problem in the chosen norm, the Lax equivalence theorem says that a consistent approximation is convergent exactly when it is stable. Boundary discretization and starting data must be included in that assertion. A Fourier calculation proves convergence only after consistency, well-posedness and the actual boundary treatment have also been checked.
The spatial shift in the PDF also requires a boundary value beyond the supplied right endpoint: if is the last interior index, the newest value is outside the interval. Thus the printed Dirichlet method has no specified boundary closure, and no unique stability range can be assigned to it as stated.
For completeness, the literal interior formula has an exact von Neumann stability analysis on an infinite or periodic grid. Substitution of a Fourier mode gives
For the root of a polynomial tending to one as , expansion gives
Consequently is unstable: sufficiently small nonzero frequencies have a root of a polynomial of modulus greater than one, and arbitrarily fine periodic grids contain such frequencies.
Conversely, if and , then
For with ,
Since , the complex quadratic Schur criterion yields both roots of a polynomial in the unit disk, strictly inside except at , where they are and . Uniform stability follows directly from the BDF2 discrete energy identity: the modal recurrence is , whose energy decreases because . Summing the modal energies proves a bound independent of the grid and even of ; no eigenvector-separation assumption is needed. This is the stability of a spatially shifted BDF2 stencil. Thus the literal periodic-grid result is
This cannot establish stability of an unspecified Dirichlet boundary condition closure. It also does not restore consistency of a numerical method.
For the intended unshifted backward differentiation formula, a spatial eigenvalue gives
The Schur stability criterion gives the root condition for a multistep method for every , with strict inequalities for . A useful uniform energy method proof, including the repeated interior roots that a bare separation argument would miss, is the BDF2 discrete energy identity. With and
the corrected Dirichlet discrete Laplacian scheme satisfies
This follows by taking the inner product of with and using summation by parts. It controls both time levels uniformly, regardless of the mesh ratio. Hence the corrected method is stable for
For a fully discrete linear partial differential equation evolution, write in a specified discrete norm. Finite-time stability of a numerical method means
with independent of the allowed meshes. For a multistep method, augment the state with its time-history values and include a stable starter. Bounds may grow as when the continuous problem has growth; demanding decay for all time would be a stronger assertion. The treatment of initial data, forcing, Dirichlet boundary conditions, and the norm is part of the hypothesis, not a detail supplied by an interior calculation.
For constant coefficients on an infinite or periodic uniform grid, von Neumann stability analysis substitutes the Fourier mode . The discrete Fourier transform and the Parseval identity turn a uniform multiplier estimate into a discrete L2 norm estimate. In a one-step scalar scheme, proves contractivity, while gives finite-time stability. In a multilevel scheme, every root of a polynomial in its amplification polynomial of a multilevel finite difference scheme matters, as does uniform control of the associated companion matrix.
For the Forward Euler diffusion scheme with ,
Thus for all frequencies exactly when
Sufficiency follows since ; necessity follows from the highest-frequency mode on even periodic grids. This gives the usual parabolic mesh restriction . For the Backward Euler diffusion scheme,
so every is stable. The Crank-Nicolson method has
again of modulus at most one for all , but stiff modes approach rather than zero. These are PDE manifestations of the A-stability and L-stability distinctions for time integration.
For advection , assume and set . The upwind finite difference scheme is , with
It is contractive when . This also has a direct maximum-norm proof: each newest value is a convex combination of two old values. The resulting Courant–Friedrichs–Lewy condition expresses that the numerical domain of dependence covers the physical one. For negative , the upwind direction must be reversed. By contrast, Forward Euler method time stepping with the centered first finite difference has and for nonzero . Under fixed nonzero refinement it is unstable, since a fixed nontrivial mode grows geometrically over steps. This is not a claim of instability under every imaginable mesh coupling: instead bounds its spurious finite-time growth, since .
The leapfrog advection scheme illustrates a multilevel subtlety. Its amplification polynomial of a multilevel finite difference scheme is
For , both roots of a polynomial have unit modulus and separation at least . A uniformly conditioned eigenbasis of the companion matrix then proves power boundedness of a two-level Fourier scheme for arbitrary history data. At and a grid admitting , the roots coincide on the unit circle, and a Jordan block produces growth. Thus the endpoint fails the ordinary arbitrary-history root condition for a multistep method; checking only that both moduli equal one misses the instability. Restricting the starter or filtering the parasitic mode is an additional hypothesis.
The energy method handles variable coefficients and finite boundaries for which Fourier stability analysis may be unavailable. For the Backward Euler diffusion scheme with homogeneous Dirichlet boundary conditions, define . The discrete summation by parts identity is
Take the inner product of with . The elementary identity gives
This proves unconditional contractivity including the actual boundary treatment. More generally, a dissipative operator gives of operator norm at most one: with , dissipativity implies , and the Cauchy-Schwarz inequality gives . In finite dimensions this also proves invertibility. For the second-order backward differentiation formula, the BDF2 discrete energy identity used in question 4 controls both time levels and proves unconditional diffusion stability. A repeated root strictly inside the disk is harmless here; the energy argument supplies the uniform bound without a singular eigenvector formula.
A second technique is eigenvalue stability analysis of a finite difference method. Under the method of lines, a time integrator advances by . If is a normal matrix, the scalar linear stability domain criterion on all controls its powers exactly in the corresponding L2 norm. For the centered Dirichlet discrete Laplacian, its eigenvalues lie between and zero; intersecting this interval with a time integrator's stability interval determines its mesh restriction. A uniform bound on the diagonalization of a matrix is needed for nonnormal diagonalizable systems. Eigenvalues alone can be misleading. For example,
has both eigenvalues inside the disk for , but the upper-right entry of is . Taking , , this grows like . Hence stable scalar eigenvalues do not give mesh-uniform stability. Boundary closures can introduce precisely the extra growth that an interior Fourier symbol overlooks, so boundary stability of a finite-difference method must be checked separately.
For nonlinear spatial discretizations, a useful replacement for Fourier stability analysis is a convexity argument. If the Forward Euler method map is nonexpansive in a chosen norm for , the second-order strong stability preserving Runge-Kutta method
is also nonexpansive under the same restriction. Indeed, for two inputs, the triangle inequality gives . Its Taylor expansion is , proving order two. Such strong stability preserving Runge-Kutta methods transfer suitable forward-step bounds without relying on a linear spectral calculation.
Finally, consistency of a numerical method explains what stability buys. For a linear Hadamard well-posed problem, the Lax equivalence theorem equates convergence of a consistent discretization with its stability, under the stated approximation-space and norm hypotheses. Directly, if the error satisfies , iteration gives the discrete Duhamel principle
Thus vanishing normalized local truncation error and initial error yield convergence. With a nonlinear Lipschitz step estimate, the discrete Gronwall inequality plays the same role. A stable but inconsistent stencil, such as the literal defective formulas in questions 3 and 4 under their usual refinement, is not rescued by any amplification bound. The decisive checks are a mesh-uniform evolution bound, a valid boundary closure, and consistency with the actual PDE.
With , , and , the Forward Euler method gives
For a Fourier mode , the amplification factor is . Set . Then
The expression in braces is an affine function of , so it is nonpositive for all precisely when its two endpoint values are nonpositive. For , these conditions are and . Thus Forward Euler stability for centered advection-diffusion requires exactly
For , only the first condition remains. If either bound fails, a band of Fourier modes has , giving instability under von Neumann stability analysis. At equality the amplification bound still holds, so the endpoints are included. This is discrete L2 norm stability; nonnegative stencil weights would impose the additional spatial restriction .
Stability asks whether perturbations already present in data, arithmetic, or an earlier numerical step remain controlled under subsequent evolution. It complements consistency of a numerical method: consistency says that an exact smooth solution nearly satisfies one numerical step, while stability prevents the accumulated local defects from being amplified without bound. For a well-posed differential equation these two properties are what make convergence possible.
For a linear multistep method, zero-stability concerns the limit . The roots of its first characteristic polynomial must lie in the closed unit disk, and every root on the unit circle must be simple. The Dahlquist equivalence theorem states that a consistent linear multistep method converges precisely when it is zero-stable. The parasitic root in Question 1 decays, whereas a repeated root at would turn small defects into secular growth.
Absolute stability instead fixes for the Dahlquist test equation. A one-step method has amplification factor and absolute-stability region
A-stability means that contains the entire closed left half-plane, matching every decaying scalar linear problem. L-stability additionally requires as , which suppresses unresolved fast transients in a stiff differential equation. Backward Euler is L-stable; the trapezoidal rule is A-stable but approaches and can retain stiff oscillations; forward Euler is stable only in the disk .
For nonlinear dissipative systems, scalar absolute stability can be insufficient. B-stability controls distances between numerical solutions of contractive differential equations. For Runge–Kutta methods, algebraic stability—nonnegative weights and positive semidefiniteness of —is a useful sufficient condition for B-stability. Question 2 shows how a single negative diagonal entry disproves it.
After spatial discretization of a partial differential equation, stability can be studied through the semidiscrete matrix. If its Hermitian part is nonpositive, the energy method proves contractivity without diagonalizing it. A skew-Hermitian generator instead conserves norm, as in the discrete Schrodinger problem of Question 3. Eigenvalues alone can be misleading for a non-normal matrix: transient growth may be large even when every eigenvalue lies in the left half-plane, so matrix norms, logarithmic norms, resolvent bounds, or a pseudospectrum may be needed.
For constant-coefficient Cauchy problems, von Neumann stability analysis inserts Fourier modes and bounds their amplification factors. Question 4 gives a typical result: centered diffusion contributes a negative real symbol and centered advection an imaginary symbol. Semidiscrete evolution is stable, yet forward Euler imposes both the parabolic restriction and an advection-diffusion restriction. This illustrates a Courant–Friedrichs–Lewy condition: a stable spatial approximation need not remain stable under an arbitrary time stepper.
For a well-posed linear initial-value problem and a consistent finite-difference approximation, the Lax equivalence theorem identifies stability with convergence. Its hypotheses matter: it does not by itself cover nonlinear equations, inconsistent boundary closures, changing norms, or non-smooth solutions. Boundaries also defeat a naive whole-line Fourier argument; an energy estimate, normal-mode boundary analysis, or a discrete semigroup bound must include the boundary treatment.
Practical stability analysis therefore starts from the structure of the differential equation. Conservation laws favor unitary or symplectic methods, diffusion favors A- or L-stable implicit methods, monotone transport may require strong-stability-preserving time stepping and upwind fluxes, and stiff splitting requires attention to both the factors and their commutators. Stability does not guarantee accuracy: a heavily damped method may be stable while erasing the solution, and a stable computation with near the edge of its stability region may have an unacceptable phase error.
Consider first a scalar constant-coefficient Cauchy problem for a partial differential equation on the whole line. A translation-invariant spatial discretization is a convolution operator, so the discrete Fourier transform turns it into multiplication by its Fourier symbol. This reduction is exact because Fourier modes are the simultaneous generalized eigenfunctions of every translation-invariant stencil.
For a fully discrete one-step method
write for its amplification factor. The Parseval identity gives
Consequently the exact necessary and sufficient condition for stability on every bounded time interval is
with independent of the mesh. Sufficiency follows directly from Parseval; necessity follows by choosing transformed initial data concentrated where the multiplier is largest. For a contractive scheme one can take , yielding the familiar von Neumann stability analysis condition .
For a semidiscretization with scalar symbol , the corresponding exact criterion is
Indeed, the Fourier multiplier of the solution operator is . For systems, eigenvalues alone cease to be sufficient when the matrix symbol is non-normal; the necessary and sufficient statement is the uniform bound .
On the whole lattice, a finite stencil defines a Laurent operator, whose operator norm is the essential supremum of its symbol. Restricting the same stencil to a half-line gives a Toeplitz operator. The Cauchy symbol condition remains necessary for a stable initial-boundary scheme because data localized far from the boundary behave like the whole-line problem for a finite time. It is not sufficient: the boundary closure can support growing modes or amplify incoming modes even when every interior Fourier mode is stable.
Boundary stability therefore requires a uniform estimate for the forced half-line recurrence. After a Laplace transform in time and a Fourier transform in tangential variables, one solves a normal-direction recurrence. The Uniform Kreiss--Lopatinskii condition requires the boundary equations to determine its decaying roots with a uniformly bounded inverse. In practical terms, one imposes one independent boundary condition for each incoming characteristic or numerical mode and none for outgoing modes. The group velocity identifies the direction in which a narrow wave packet carries energy, so its sign helps determine which boundary is inflow and explains why a numerically generated high-frequency branch can require a boundary condition different from that suggested by its phase velocity.
For a two-step method, the Fourier substitution produces an amplification polynomial of a multilevel finite difference scheme. Every root must lie in the closed unit disk, and unit-modulus roots must be simple, uniformly in the wavenumber. For example, leapfrog differencing of gives
and hence
The roots have unit modulus when , giving the usual Courant restriction . At the endpoint, a wavenumber with produces a repeated unit root and violates the uniform root condition; strict avoids this marginal linear growth. The second root is the familiar oscillatory computational mode, illustrating why a multilevel scheme requires its full amplification polynomial rather than a single multiplier.
Iteration gives
If everywhere, the Parseval identity gives
Conversely, if , continuity supplies a neighbourhood on which . Choose nonzero square-integrable Fourier data supported there. Its norm then grows at least as , contradicting boundedness. Hence
This is the one-step von Neumann stability analysis criterion.
Insert the Fourier mode into the scheme. von Neumann stability analysis gives
For every physical Courant number , one has . Thus the method is unconditionally stable: the range is .
After spatial discretization, a linear time-dependent PDE produces an update
Stability over requires a bound independent of the mesh. If is normal, the spectral theorem for normal operators gives
so eigenvalue analysis is decisive. More generally, if , then
Thus eigenvalues suffice only when the eigenvector condition numbers are uniformly bounded and unit-circle eigenvalues are semisimple. Defective or increasingly nonnormal matrices can have large powers even though every eigenvalue lies in the unit disk.
For a constant-coefficient scheme on the whole line or a periodic grid, the discrete Fourier transform diagonalizes translation-invariant difference operators. This is von Neumann stability analysis: insert and require . Its advantages are simplicity, sharp mesh restrictions, and direct identification of unstable wavelengths. Its limitations are boundaries, variable coefficients, nonlinearities, and nonnormality; frozen-coefficient Fourier analysis then gives at most local evidence.
As a successful implicit example, the Backward Euler diffusion scheme has
where the periodic or homogeneous-Dirichlet discrete Laplacian is symmetric negative semidefinite. Its eigenvalues are , proving unconditional discrete--norm stability.
For a failure, consider explicit upwinding for on a finite inflow grid:
Its lower-triangular nonnormal upwind amplification matrix has only the eigenvalue , so eigenvalues alone incorrectly suggest stability for . For , however, interior alternating data are amplified by before the boundary is felt, and the matrix powers have no mesh-uniform bound. The correct range is . This example isolates the missing hypothesis: spectral radius does not control powers of a nonnormal matrix family.