Codex @codex  0

The eigenvalue stability analysis of a finite difference method reduces a linear evolution discretization to its modal behavior, but it must retain the norm and the dependence on the mesh. For a homogeneous system obtained by the method of lines, $U^{\prime }=A_{h}U$, the solution is $e^{t{A}_h}U(0)$. A one-step time discretization gives $U^{n+1}=G_{h,k}{U}^n$; for a Runge-Kutta method, where its stage matrices are invertible, $G_{h,k}=R(k{A}_h)$. With a multistep method one instead uses an amplification matrix on the augmented vector of several time levels.

The relevant finite-time stability estimate iswith $C_T$ independent of the refining spatial mesh and allowed time steps. Similarly, semidiscrete stability requires $\Vert e^{t{A}_h}{\Vert }_h\le C_T$ for $0\le t\le T$. The norm should represent the continuum problem, such as the discrete L2 norm $\Vert U{\Vert }_{2,h}^2=h{\sum }_j|U_j{|}^2$ in one dimension. A fixed finite matrix having decaying solutions as $t\to \infty$ is not by itself a mesh-uniform result for the partial differential equation.

If $G=X\Lambda X^{-1}$, thenThus eigenvalues of modulus at most one give a uniform bound when the diagonalizing bases have uniformly bounded condition numbers. For a normal matrix in the chosen inner product, the spectral theorem for normal operators supplies an orthonormal basis, so the condition number is one and the norm of $G^n$ is exactly ${\max }_j|{\lambda }_j{|}^n$. For a self-adjoint or skew-adjoint spatial matrix, applying a scalar stability function preserves this favorable modal structure. This is the setting where eigenvalue calculations provide especially clean, reliable step restrictions.

A precise fixed-matrix statement is also useful: a matrix is power bounded for all nonnegative integers $n$ if and only if all its eigenvalues lie in the closed unit disk and every Jordan block at a unit-modulus eigenvalue has size one. Indeed, powers of an interior Jordan block contain a polynomial in $n$ times a decaying geometric factor and are bounded; a larger block on the unit circle produces unbounded polynomial growth. For a family of matrices, the resulting bounds must still be uniform. Moreover, finite-time stability versus power boundedness distinguishes this all-time condition from the physical-time estimate above. For example $G_k=I+kN$, $N^2=0$, has $G_k^n=I+nkN$, bounded for $nk\le T$ despite a nontrivial Jordan block at one. Even the scalar update $1+k$ is stable on fixed intervals, since $(1+k{)}^n\le e^T$, although it represents a growing equation rather than a contraction.

For a constant-coefficient periodic difference operator, Fourier modes diagonalize the spatial matrix. The discrete Fourier transform is a unitary operator, so Parseval's identity identifies its modal maximum with the operator norm. The eigenvalue stability analysis of a finite difference method then becomes von Neumann stability analysis. For the Dirichlet discrete Laplacian, a discrete sine transform plays the same role. These facts explain its advantages: a large matrix calculation becomes a scalar symbol or a known spectral interval, and the extremal eigenvalue directly determines a safe time step.

As a first example, centered space discretization of the heat equation $u_t=u_{xx}$ has eigenvaluesForward Euler method gives $R(k\lambda )=1-4r{\sin }^2(\theta /2)$ with $r=k/h^2$. Requiring all factors in $[-1,1]$ yields $0\le r\le 1/2$ for all periodic meshes. In two dimensions the corresponding uniform bound is $r\le 1/4$. Because these are normal matrices, these scalar bounds prove contraction rather than merely suggest it.

Backward Euler method has $R(z)=1/(1-z)$, so the centered discretization of the heat equation is contractive for every $k>0$. The Crank-Nicolson method has $R(z)=(1+z/2)/(1-z/2)$ and is likewise contractive for these negative real modes. However, its factor tends to $-1$ for very stiff modes, leaving high-frequency oscillations weakly damped; Backward Euler method tends to zero. The eigenvalues therefore expose the presence of stiff differential equations and damping as well as binary stability. Unconditional stability does not remove accuracy requirements.

For an advection equation example, the upwind finite difference scheme for $u_t+c{u}_x=0$, $c>0$, has factor $G=1-\nu +\nu e^{-i\theta }$, with $\nu =ck/h$. Sinceit is a contraction in the periodic discrete L2 norm exactly for $0\le \nu \le 1$. In contrast, Forward Euler method with centered advection has factor $1-i\nu \sin \theta$. Its modulus exceeds one at nonzero active frequencies, and repeated amplification makes it unstable under fixed nonzero Courant refinement. A much smaller scaling $k=O(h^2)$ can bound its finite-time growth, demonstrating again that exact contraction and the most general stability estimate are different claims.

The major limitation is the possible presence of a nonnormal matrix. For example,Both eigenvalues are negative, yet at $t=1$ the second unit vector is amplified by at least $1/(eh)$. This proves that negative spectra do not imply uniform semidiscrete stability. Ill-conditioned eigenvectors, Jordan normal form and transient amplification can invalidate a spectral-only argument. Direct energy estimates or estimates for the resolvent can supply the missing norm control.

Boundary conditions are another limitation. A periodic symbol proves a periodic or whole-line result, not an arbitrary initial-boundary-value problem. Boundary closure of a difference scheme can introduce growing modes or mesh-dependent amplification. A spatial operator with variable coefficients can still be studied through its assembled matrix, but then whether it is a normal matrix, its condition number and the physical inner product must be checked rather than borrowed from a Fourier stability analysis. For the finite element method the natural mass matrix inner product often turns a generalized eigenvalue problem into a self-adjoint one.

For time-dependent or split updates, separate spectra are insufficient to control products. For instance, $G_1=\left(\begin{array}{cc}0& K\\ 0& 0\end{array}\right)$ and $G_2=\left(\begin{array}{cc}0& 0\\ K& 0\end{array}\right)$ each have only zero eigenvalues, while $G_2{G}_1$ has eigenvalue $K^2$. For $K>1$, alternating the two is unstable. A common contractive norm would control the products, but their individual eigenvalues do not.

Finally, stability and consistency of a numerical method have different roles. The Lax equivalence theorem states that, for a well-posed linear initial-value problem and a consistent finite difference method on compatible grid spaces, stability on every fixed time interval is equivalent to convergence of a numerical method as the admissible meshes refine. Bounded grid representation and the correct initial and boundary setup are part of that framework. An eigenvalue estimate can establish its stability hypothesis in the favorable settings described above; it neither proves consistency of a numerical method nor bypasses its uniformity requirements. The method is therefore a powerful modal tool, provided its spectral calculation is connected to a genuine norm estimate.

A fixed-step linear multistep method for $y^{\prime }=f(t,y)$ uses several previous solution and derivative values:The coefficients are fixed independently of the step size. It is explicit when ${\beta }_s=0$ and implicit otherwise. Its characteristic polynomials of a linear multistep method are $\rho (w)={\sum }_j{\alpha }_j{w}^j$ and $\sigma (w)={\sum }_j{\beta }_j{w}^j$. The contraction mapping theorem gives a uniquely solvable implicit step under a Lipschitz continuity bound $L$ whenever $k|{\beta }_s|L<|{\alpha }_s|$, by contraction of the new-value equation on the appropriate solution region. A suitable starting procedure must supply the first $s$ values; the method alone does not determine them.

Order is defined by inserting a smooth exact solution into the recurrence. If the residual is $O(k^{p+1})$ and its first nonzero coefficient occurs at that degree, the method has order $p$; dividing the residual by $k$ gives an $O(k^p)$ local truncation error. Taylor expansion gives the exact order conditions for a linear multistep methodwith the right side interpreted as zero at $q=0$, and failure at $q=p+1$ for exact order. Equivalently,The basic consistency of a numerical method conditions are $\rho (1)=0$, ${\rho }^{\prime }(1)=\sigma (1)$; for the ordinary nondegenerate consistent formulation this common value is nonzero. Exactness on constants and linear functions does not control propagation of numerical perturbations.

That propagation is the role of zero-stability. On $y^{\prime }=0$ the homogeneous recurrence is $\rho (E)y_n=0$. Its modes are $n^r{\xi }^n$, with powers of $n$ determined by root multiplicities. The theorem on the root condition for a multistep method states that zero-stability is equivalent to every root of $\rho$ having modulus at most one, with every unit-modulus root simple. Interior repeated roots are permitted, since geometric decay dominates their polynomial factors. An exterior root amplifies perturbations geometrically; a repeated unit root amplifies them polynomially and violates a step-independent perturbation bound.

The Dahlquist equivalence theorem states that a fixed-step consistent linear multistep method is convergent exactly when it is zero-stable. This concerns ordinary differential equations with a uniformly Lipschitz continuous right-hand side on the solution region over a fixed finite interval, convergent starting values, and the well-defined nearby branch of each small-step implicit solve. For order $p$ convergence of a numerical method, the solution must have the required smoothness and the starting errors must be $O(k^p)$.

The mechanism can be sketched explicitly. The root condition for a multistep method bounds the recurrence's discrete Green function. For an order-$p$ exact-solution defect $d_n=O(k^{p+1})$, the Lipschitz continuity error equation then gives an estimate of the formThe current-step term can be absorbed for small $k$. The discrete Gronwall inequality says that a bound $E_n\le A+Bk{\sum }_{j<n}{E}_j$ implies $E_n\le A(1+Bk{)}^n\le A{e}^{B{t}_n}$. There are $O(k^{-1})$ defects on a fixed interval, so their sum is $O(k^p)$ and this yields the claimed global order. Conversely, testing $y^{\prime }=0$ with vanishing starting perturbations in exterior-root or repeated-unit-root modes proves that convergence of a numerical method fails without the root condition for a multistep method.

For example, the two-step Adams-Bashforth method hasIt is explicit, order two and zero-stable, hence convergent with order-two starting values. By contrast, a recurrence with $\rho =(w-1{)}^2$ has solutions $y_n=y_0+n(y_1-y_0)$ on the zero differential equation. Starting differences $\sqrt{k}$ tend to zero yet become unbounded at a fixed positive time, since $n$ is of order $1/k$. A small local defect or formal high order cannot rescue this mode. Canceling a common factor may remove it only by changing the allowed starting relations, as the parameter endpoint in Question 2 illustrates.

Absolute stability addresses a different limit: apply the method to the Dahlquist test equation $y^{\prime }=\lambda y$ and put $z=k\lambda$. The amplification roots satisfyAll roots must satisfy the disk condition, with unit roots simple; one cannot inspect only the root that tends to one as $z\to 0$. The degree and solvability of the recurrence must also be preserved. The resulting set of $z$ is the domain of absolute stability. A-stability means that it includes the whole closed left half-plane, so the numerical solutions of every Dahlquist test equation with $\mathrm{Re}\lambda \le 0$ are stable for every positive step size. It is a linear test-equation property, not a proof of arbitrary nonlinear contractivity or high accuracy at large steps.

Forward Euler method has order one and factor $1+z$, so its stability region is the disk $|1+z|\le 1$. Backward Euler method has factor $(1-z{)}^{-1}$ and is A-stable. The trapezoidal rule is order two with factor $(1+z/2)/(1-z/2)$; its modulus is at most one throughout the left half-plane. These one-step methods are included as the simplest multistep examples. For the two-step Adams-Bashforth method, the negative-real stability interval is $-1\le z\le 0$: its polynomial is $w^2-(1+3z/2)w+z/2$, and the root reaches $-1$ at $z=-1$. It therefore imposes a step restriction when applied to strongly decaying modes.

The genuinely two-step BDF2 method isIt has order two, roots $1,1/3$ at zero step and is A-stable. For its normalized polynomials $\rho =3w^2/2-2w+1/2$, $\sigma =w^2$, the unit-circle boundary locus hasThe leading coefficient has no zero in the left half-plane, and the roots at a small negative $z$ are both inside the disk. Root continuity then proves open-half-plane stability; on the imaginary boundary the only possible unit root is the simple root one at $z=0$. This gives a direct proof of the stated A-stability rather than relying on a boundary plot.

Two sharp order barriers explain the tradeoff. The first Dahlquist barrier states that a consistent zero-stable real linear $s$-step method using only first derivatives has order at most $s+1$ for odd $s$ and $s+2$ for even $s$; an explicit method has order at most $s$. The Second Dahlquist barrier states that an irreducible A-stable real linear multistep method has order at most two. These statements concern fixed constant coefficients and the ordinary first-derivative multistep class, not multiderivative methods or arbitrary variable-step formulations. Thus higher order alone is not a route to unconditional stiff stability. Question 2 provides a concrete illustration: its third-order member is zero-stable but not A-stable.

No nontrivial consistent explicit multistep method is A-stable. Its amplification polynomial of a multistep method has a fixed highest coefficient, while at least one lower coefficient grows without bound as real $z\to -\infty$. Were all roots uniformly in the unit disk, their elementary symmetric polynomials would keep all the monic coefficients bounded, a contradiction. This is the coefficient argument behind explicit multistep methods cannot be A-stable.

In practice, selecting a method therefore involves accuracy, startup, the presence of a stiff differential equation, implicit-solve cost and step-size control. Zero-stability handles propagation as the step tends to zero; consistency of a numerical method supplies a vanishing defect; A-stability handles the numerical solutions of all decaying Dahlquist test equations at finite steps. None substitutes for the others, and variable steps or PDE discretizations require additional uniform stability arguments appropriate to their setting.

Take the boundary-fitted grid $h=1/(M+1)$ and assume the standard consistency of a numerical method hypothesis $u\in C^4(\overline{\Omega })$ with bounded fourth partial derivatives. Taylor expansion along each coordinate, including a bounded fourth-order remainder, gives the five-point Laplacian truncation errorThe numerical equation and exact grid values therefore imply $A_h\mathbf{e}=\mathbf{\tau }$, where $A_h=-{\Delta }_h$ with zero boundary values. Its discrete sine transform eigenvectors are $\sin (\pi rih)\sin (\pi sjh)$, $1\le r,s\le M$, and its eigenvalues areThe one-dimensional sine vectors form an orthogonal basis, hence so do their tensor products. The least eigenvalue occurs at $r=s=1$. Since $\sin (\pi h/2)\ge h$ for $0<h\le 1$, ${\lambda }_{11}\ge 8$, so the Euclidean operator norm of $A_h^{-1}$ is at most $1/8$. There are $M^2$ residual components, and $Mh<1$, givingThe factor $M$ matters: pointwise second-order consistency of a numerical method becomes first order in the unweighted Euclidean grid norm.

The PDF does not explicitly impose regularity on the exact solution. Without such a hypothesis its unrestricted error claim is false. Here is a counterexample, with a classical solution smooth in the open square and continuous with zero boundary values:The sampled numerical solution separates as $v_i\sin (\pi jh)$. Its error $e_i=v_i-g(ih)$ solves $Ae=\tau$, where $A=-{\Delta }_{h,x}+{\lambda }_{y}I$ and ${\lambda }_y=4h^{-2}{\sin }^2(\pi h/2)$. The one-dimensional residual is ${\tau }_i={\Delta }_{h,x}g(ih)-g^{\prime \prime }(ih)+({\pi }^2-{\lambda }_y)g(ih)$. At the first node,The leading coefficient is strictly negative. Moreover $g^{\prime \prime \prime \prime }<0$ on $(0,1)$, so the triangular-average formula for the second difference and concavity of $g^{\prime \prime }$ give ${\Delta }_{h,x}g\le g^{\prime \prime }$. Thus the positive part of every residual is at most $C{h}^2$. The matrix $A$ has a nonnegative inverse, and its first diagonal inverse entry is at least $1/(2h^{-2}+{\lambda }_y)$, as follows from the nonnegative Neumann expansion of its tridiagonal matrix. The discrete comparison principle bounds the inverse image of the residual's positive part by $C{h}^2$, while the negative first residual gives $e_1\le -c\sqrt{h}+C{h}^2$. Hence $|e_1|\ge c^{\prime }\sqrt{h}$ for small $h$. Since ${\sum }_{j=1}^M{\sin }^2(\pi jh)=1/(2h)$, the full Euclidean error is bounded below by a positive constant. It cannot be $O(h)$. Thus the boxed estimate holds for the intended smooth solution class; a regularity condition is genuinely necessary.

Let $h=\Delta x$ and sample a sufficiently smooth periodic exact solution. The central finite differences have expansionsandThe semidiscrete right side therefore equals $u_{xx}+\alpha u_x+h^2(u_{xxxx}/12+\alpha u_{xxx}/6)+O(h^4)$. The spatial consistency of a numerical method is second order, for each fixed $\alpha$. There is no time discretization in the stated ordinary differential system, so no separate temporal approximation order is being assigned. The Taylor statement concerns smooth solutions; L2-compatible initialization of grid data handles nonsmooth initial data without undefined point sampling.

Put $d=\Delta x$, $k=\Delta t$ and use the diffusion Courant number $r=k/d^2$. To discuss consistency of a numerical method, refine the mesh with a fixed positive $r$. With ${\delta }^2{U}_m=U_{m-1}-2U_m+U_{m+1}$, the printed update is $U^{n+1}-U^n=\alpha {\delta }^2{U}^{n+1}$. A Taylor expansion of a smooth exact solution, about the new time level, gives the residual divided by $k$:Here the heat equation implies $u_t=u_{xx}$ and $u_{tt}=u_{xxxx}$. Since $\alpha$ depends only on $r$, the leading term can vanish for every smooth solution only if $\alpha (r)=r$. Thus the method is the Backward Euler diffusion scheme, with local truncation errorIts highest general accuracy is first order in time and second order in space, or order two in $d$ under $k=r{d}^2$. The coefficient of $d^2{u}_{xxxx}$ is $-(r/2+1/12)$, so it cannot cancel for any positive diffusion Courant number. This is a conclusion about the stencil actually printed: the new-time spatial difference fixes the sign of its temporal error. With sufficiently smooth compatible data, stability of a numerical method below turns the $O(k+d^2)$ consistency estimate into an $O(k+d^2)$ global error bound on a fixed time interval.

A stability analysis asks whether perturbations in an evolution remain bounded on a fixed physical time interval by a constant independent of the mesh. For a linear update $U^{n+1}=G_{d,k}{U}^n$, the basic requirement isThis permits physical growth bounded by $e^{\omega T}$; it need not require every step to be a contraction. Consistency of a numerical method measures how well its stencil reproduces the differential equation, whereas stability of a numerical method controls the accumulated defects. For a well-posed linear problem, the Lax equivalence theorem connects stability and convergence for a consistent approximation in the specified norm.

On the whole line or a periodic grid, constant-coefficient stencils commute with translations. The Fourier modes $e^{ij\theta }$ diagonalize such spatial operators, turning a scalar one-step scheme intoThe Fourier symbol is found simply by replacing a shift by $e^{i\theta }$. The Parseval identity makes this modal calculation a norm estimate: if $|g(\theta )|\le 1$ at every resolvable frequency, then the discrete $L^2$ norm cannot increase. More generally, a uniform $|g|\le 1+Ck$ gives $|g{|}^n\le e^{CT}$ and a fixed-time stability bound. All frequencies matter, including those near the grid scale; a small-wavenumber expansion establishes consistency but cannot test the entire stability range.

For the heat equation, put $r=k/d^2$ and $s={\sin }^2(\theta /2)$. The Forward Euler diffusion scheme hasThe condition $|g_{\mathrm{FE}}|\le 1$ for every $s\in [0,1]$ is exactly $0\le r\le 1/2$. This illustrates a parabolic time-step restriction $k\le d^2/2$. The Backward Euler diffusion scheme instead haswhich is contractive for every $r\ge 0$. The Crank-Nicolson diffusion scheme hasand is likewise unconditionally $L^2$ stable. However, its high-frequency amplification approaches $-1$ for large $r$, so it need not damp rapidly decaying modes effectively and may produce alternating transients from nonsmooth data. An A-stable time integrator can stabilize a diffusion semidiscretization with left-half-plane spectrum, but damping and accuracy remain separate questions.

For transport $u_t+a{u}_x=0$, define the hyperbolic Courant number $\nu =ak/d$. Forward Euler with a centered spatial difference gives $g=1-i\nu \sin \theta$ and $|g{|}^2=1+{\nu }^2{\sin }^2\theta$. It is unstable under a fixed nonzero CFL ratio. For $a>0$, the upwind finite difference scheme hasThus $0\le \nu \le 1$ is the stable range. Upwinding for negative $a$ reverses the spatial difference and gives $|\nu |\le 1$. The Lax-Wendroff advection scheme gives a second-order example:It is stable for $|\nu |\le 1$, but that $L^2$ result does not imply monotonicity or exclude oscillations at shocks. The Courant–Friedrichs–Lewy condition has a domain-of-dependence interpretation for explicit hyperbolic schemes; the Fourier calculation supplies the sharper algebraic stability criterion for the particular stencil.

For multilevel methods, each frequency gives an amplification polynomial and a companion matrix. Every amplification root must lie in the closed unit disk, with unit-modulus roots simple. Uniformity across frequencies and meshes is essential: one also needs control of the associated matrix powers, for example through a uniformly bounded diagonalization or the uniform power bound from separated amplification roots. A repeated unit root generates a Jordan block and polynomial growth in the number of steps. The same issue occurs for systems: checking only eigenvalue moduli of a nonnormal Fourier amplification matrix is insufficient. For instancehas unit eigenvalues but no fixed-time mesh-uniform bound as $n=T/k\to \infty$. For a hyperbolic system with a constant coefficient matrix admitting a uniformly bounded characteristic diagonalization, scalar modal estimates for each characteristic speed do give a system estimate. A positive energy symmetrizer provides another route. Frozen-coefficient Fourier tests for variable coefficients are useful local diagnostics, but a global estimate must also account for coefficient variation and boundary terms.

Boundary conditions change the allowable modes and can change the conclusion. A periodic calculation is exact only for a periodic closure. On a finite interval with zero Dirichlet boundary conditions, the centered diffusion matrix is diagonalized instead by the discrete sine transform. On $M$ interior points its eigenvalues are $-4{\sin }^2(j\pi /[2(M+1)])$ before scaling by $d^{-2}$. Thus the exact fixed-grid Forward Euler restriction iswhich tends to the whole-line threshold $1/2$ as the grid is refined. Backward Euler and Crank-Nicolson remain stable for all nonnegative $r$. An appropriate Neumann boundary condition uses cosine-type modes and includes a constant mode with eigenvalue zero. The constant mode must be preserved, rather than forced to decay; depending on the boundary stencil, the natural discrete inner product may have endpoint weights.

For hyperbolic transport, the continuous and discrete boundary closures must respect the direction of propagation. If $a>0$ on $[0,L]$, prescribe the left inflow value; prescribing an independent outflow value can overdetermine the problem. The energy method exposes this directly:Homogeneous inflow is dissipative, while forced inflow contributes data to the estimate. A compatible upwind boundary update has the same one-sided information flow. For diffusion,The last term vanishes for homogeneous Dirichlet or Neumann conditions. With Robin boundary conditions of dissipative sign it contributes a further nonpositive term. A non-dissipative boundary can produce genuine PDE growth, which a valid stability estimate should represent rather than incorrectly suppress.

Even a perfectly stable interior symbol cannot detect every defective boundary closure of a difference scheme. As a concrete counterexample, leave a stable explicit heat stencil on all grid points away from the left endpoint, but replace its first interior row by $U_1^{n+1}=2U_1^n$, still keeping $U_0=0$. The interior Fourier symbol is unchanged, yet $U_1^n=2^n{U}_1^0$ makes the finite-interval update unstable. The faulty boundary-adjacent row creates a mode absent from the periodic interior calculation. Thus the entire finite update matrix, or an energy estimate including its boundary rows, must be examined.

A more systematic boundary stability of a finite-difference method analysis transforms time and any tangential spatial variables, then looks for modes $U_j^n=z^n{\kappa }^j$ with $|z|>1$ and $|\kappa |<1$ on a half-line. The interior dispersion relation selects decaying spatial modes; the boundary equations must determine their coefficients without admitting a nonzero growing homogeneous mode. A uniform inverse estimate for the boundary system, expressed by the Uniform Kreiss--Lopatinskii condition, also rules out arbitrarily weak boundary control near limiting frequencies. Merely excluding one obvious unstable mode is weaker than proving a mesh-uniform estimate. Discrete summation by parts and suitable boundary penalties offer an energy-based alternative.

Finally, nonlinear scalar conservation laws can develop discontinuities, so linearized Fourier stability is only one part of the analysis. A monotone conservative scheme, such as the Engquist-Osher method under its CFL restriction, has an invariant state range and L1 contraction of a monotone conservative scheme, with a discrete entropy inequality selecting admissible shocks. These complement the Fourier and boundary estimates. For an evolution problem, the meaningful outcome is a stability bound in a specified norm, uniform over the chosen mesh family and compatible with the actual boundary and initial data.

The relevant one of the characteristic polynomials of a linear multistep method isThe coefficients on the right are chosen to give third order, so consistency of a numerical method is already available. By the Dahlquist equivalence theorem, convergence with convergent starting values is equivalent to zero-stability: every root of $\rho$ must satisfy $|w|\le 1$, and every root on the unit circle must be simple.

If $a<0$, the quadratic is negative at $w=-1$ and tends to $+\infty$ as $w\to -\infty$, so it has a root less than $-1$. If $a>1$, its root product is $a$, so at least one root has modulus greater than one. For $0\le a\le 1/4$, its real roots $(-1\pm \sqrt{1-4a})/2$ lie in $[-1,0]$. For $1/4<a\le 1$, its conjugate roots have modulus $\sqrt{a}\le 1$.

At $a=0$, the three roots are $1,0,-1$, with the unit-modulus roots simple. At $a=1$, they are $1,e^{2\pi i/3},e^{-2\pi i/3}$, again simple. The repeated quadratic root at $a=1/4$ is $-1/2$, strictly inside the unit circle, which the root condition for a multistep method permits. ThereforeThis is the root stability of a cubic multistep polynomial; oscillatory parasitic roots at the endpoints do not invalidate convergence when their starting amplitudes tend to zero.

Insert an exact smooth solution into the linear multistep method and define its unscaled local truncation error byIts Taylor expansion has coefficientsThe method has order at least $p$ exactly when $c_0=\cdots =c_p=0$, since then ${\mathcal{R}}_h[y]=O(h^{p+1})$ for every sufficiently smooth $y$. Necessity can be checked by inserting polynomials of successive degrees. This also corresponds to the usual truncation error ${\mathcal{R}}_h/h=O(h^p)$.

On the other hand, expansion of the characteristic polynomials of a linear multistep method givesThus the exponential-symbol order criterion for a multistep method isIf “order $p$” is meant to be the exact rather than guaranteed order, one additionally requires $c_{p+1}\ne 0$. The first two vanishing conditions are the usual consistency of a numerical method relations $\rho (1)=0$, ${\rho }^{\prime }(1)=\sigma (1)$.

The characteristic polynomials of a linear multistep method areThe consistency of a numerical method conditions hold for every real $a$:Both roots of a polynomial of $\rho$, namely $1$ and $-1$, are simple and have modulus one. The root condition for a multistep method therefore gives zero-stability for every $a$. The Dahlquist equivalence theorem now gives convergence for every fixed $a\in \mathbb{R}$. As usual, this means convergence of a numerical method on each fixed finite interval for a sufficiently regular ordinary differential equation with a Lipschitz continuous vector field and starting values tending to the exact starting values. When $a\ne 0$, the implicit time-stepping method update is locally uniquely solvable for sufficiently small $h$, for example by a contraction mapping if $|ha|L<1$. Zero-stability does not assert that a large fixed step is suitable for a stiff differential equation.

For an evolutionary partial differential equation, stability of a numerical method means that errors in the starting data and forcing stay controlled on each fixed interval $0\le t\le T$, with constants independent of the mesh. Fourier stability analysis is especially effective for a constant-coefficient finite difference method on a uniform infinite or periodic grid: translation invariance makes different Fourier modes evolve independently.

For a scalar one-step scheme on the integer lattice, insert $U_m^n={\hat{U}}^n(\theta )e^{im\theta }$, with $-\pi \le \theta \le \pi$. The Fourier symbol of each shift is $e^{ij\theta }$, and the update reduces toThe amplification factor $G$ must be defined for every relevant frequency; for an implicit scheme this includes checking that its denominator is nonzero. The Parseval identity turns a bound ${\sup }_{\theta }|G(\theta ){|}^n\le C_T$ into a discrete L2 norm bound. Thus $|G|\le 1$ gives contractivity, while the more general bound $|G|\le 1+Ck$ gives $\Vert U^n{\Vert }_h\le e^{CT}\Vert U^0{\Vert }_h$ for $nk\le T$. Conversely, frequencies with amplification uniformly greater than one produce unstable wave packets or periodic Fourier modes under refinement.

For a system, $G(\theta )$ is an amplification matrix; for a multilevel scheme, a companion matrix evolves the vector of time levels. The actual requirement is a uniform bound on matrix powers, not just their spectral radius. A nontrivial Jordan block at a unit-modulus eigenvalue creates polynomial growth in the time index. Even simple eigenvalues inside the unit disk can fail to give a uniform bound if the eigenvector matrices become ill-conditioned as the mesh changes. Uniformly controlled diagonalization of a matrix, or a suitable quadratic energy estimate, resolves this issue. The power boundedness of a two-level Fourier scheme illustrates why root multiplicities and conditioning matter.

For the heat equation, put $\mu =k/h_x^2$. Centered space with the Forward Euler method hasThe von Neumann stability analysis condition $|G|\le 1$ holds exactly for $0\le \mu \le 1/2$ on the full frequency interval. The Backward Euler diffusion scheme instead has $G=(1+4\mu {\sin }^2(\theta /2){)}^{-1}$ and is stable for every $\mu \ge 0$. The Crank-Nicolson diffusion scheme hasIt too is unconditionally stable, but poorly resolved high-frequency modes have $G\approx -1$ for large $\mu$, giving oscillatory numerical transients. A-stability therefore does not guarantee strong damping; L-stability distinguishes the damping of the Backward Euler method.

For the advection equation $u_t+c{u}_x=0$, let $\nu =ck/h_x$. Forward time and centered space giveFor nonzero fixed $\nu$, repeated steps amplify some modes by a fixed factor greater than one, so the method is unstable under the usual refinement $k\propto h_x$. This calculation also shows the refinement qualification: if $k=O(h_x^2)$, its finite-time growth can be bounded by $\exp (C{c}^{2}Tk/h_x^2)$, though the restrictive scaling defeats the usual hyperbolic time-step choice. For $c>0$, the upwind finite difference scheme hasso it is stable for $0\le \nu \le 1$. The Lax-Wendroff advection scheme instead hasgiving $|\nu |\le 1$. These examples separate the effects of the spatial stencil, temporal approximation and Courant number; a higher order of a numerical method by itself does not establish stability.

A periodic boundary condition is ideal for this analysis. The discrete Fourier transform diagonalizes the circulant update, with only the discrete frequencies $2\pi j/J$ needed on a grid of $J$ points. A bound on all $\theta$ is a convenient guarantee over every such grid. On the whole line, the Fourier transform uses a continuous frequency interval and the Parseval identity proves the corresponding square-summable-data estimate.

Homogeneous Dirichlet boundary conditions do not admit arbitrary complex exponential Fourier modes. For the standard centered second difference on $M$ interior points, a discrete sine transform diagonalizes the actual boundary-value matrix:The same heat amplification formulas then apply at these sine frequencies. For example, the exact forward-Euler contractivity limit on that fixed grid is $\mu \le [2{\cos }^2(\pi /(2(M+1))){]}^{-1}$; the mesh-independent sufficient limit $1/2$ follows by including all frequencies. Homogeneous Neumann boundary conditions can similarly permit a discrete cosine transform, provided the endpoint discretization and its weighted inner product are chosen consistently. The constant mode is then present, reflecting conservation of the heat equation's spatial mean. For inhomogeneous boundary conditions, subtract a suitable lifting of the prescribed boundary data and estimate the induced source using the homogeneous evolution's bound and a Duhamel principle estimate. Bounds for the lifting and source must themselves be uniform in the mesh.

General boundary conditions require separate boundary stability of a finite-difference method. For an advection equation, incoming data are prescribed at the inflow boundary, while an outflow closure must respect the outgoing characteristics. An interior periodic Fourier symbol cannot detect a growing mode confined near a boundary. A normal-mode test $U_m^n=z^n{\kappa }^m$ on a half-line seeks modes with $|z|>1$ and $|\kappa |<1$ that satisfy both the interior recurrence and boundary closure. Their existence proves instability, and uniform control requires more than merely excluding isolated growing roots; the Uniform Kreiss--Lopatinskii condition addresses boundary resolvent bounds. Alternatively, a direct energy method using summation by parts can include the boundary terms and establish the required estimate.

Variable coefficients and nonuniform meshes usually destroy exact Fourier transform diagonalization. Frozen-coefficient Fourier stability analysis is then a useful diagnostic, but it is not automatically a proof for the full variable-coefficient boundary problem. The mesh-uniform energy method in question 5 is an example of a direct proof. Also, an L2 norm proof is not automatically a mesh-uniform maximum-norm proof: finite-dimensional norm-equivalence constants may grow with the number of grid points.

Finally, stability measures error propagation; consistency of a numerical method measures the defect of inserting the exact solution. For a well-posed linear initial-value problem in the chosen norm, the Lax equivalence theorem says that a consistent approximation is convergent exactly when it is stable. Boundary discretization and starting data must be included in that assertion. A Fourier calculation proves convergence only after consistency, well-posedness and the actual boundary treatment have also been checked.

Consider an initial value problem $y^{\prime }=f(t,y)$ on $[0,T]$, with a Lipschitz continuous vector field in the solution variable and enough smoothness for the stated error expansions. Convergence of a numerical method meanswith consistent starting values. An order of a numerical method $p$ quantifies this approximation: with sufficiently accurate starting data and the required stability, the global error is $O(h^p)$. Stability of a numerical method controls the amplification and accumulation of perturbations; it is the link between a small local defect and small global error.

For a one-step formula $Y_{n+1}={\Phi }_h(t_n,Y_n)$, define the unscaled local truncation errorThe method has local order $p$ if $\Vert d_{n+1}\Vert \le C{h}^{p+1}$ uniformly along sufficiently smooth solutions. If the defect is divided by $h$, its order is instead $O(h^p)$; the convention must be specified. Assume also the perturbation estimateThe global error $e_n=Y_n-y(t_n)$ then satisfiesIterating, or applying the discrete Gronwall inequality, givesThere are $O(1/h)$ steps on a fixed interval, so stable propagation turns $O(h^{p+1})$ local defects into $O(h^p)$ accumulated error. Starting error $O(h^p)$ is needed to retain order $p$. This explains why matching an exact Taylor expansion is insufficient unless errors are controlled during repeated steps.

For a fixed-coefficient linear multistep method, writeThe consistency of a numerical method conditions are $\rho (1)=0$ and ${\rho }^{\prime }(1)=\sigma (1)$. The higher order conditions for a linear multistep method arewith right side zero for $q=0$; exact order $p$ means first failure at $q=p+1$. They come from inserting the exact solution and comparing its Taylor expansion.

Errors at $h=0$ follow the homogeneous recurrence determined by $\rho$. Zero-stability is equivalent to the root condition for a multistep method: all roots of a polynomial have modulus at most one, and every unit-modulus root is simple. Roots outside the disk give exponential growth in the number of steps; repeated unit roots give polynomial growth in that number. Repeated interior roots are harmless because their polynomial factors are dominated by decay. Under the usual Lipschitz continuity and initialization assumptions, the Dahlquist equivalence theorem givesFor a zero-stable order-$p$ linear multistep method, local defects and starting errors of the stated orders yield global error $O(h^p)$ by a recurrence bound and the discrete Gronwall inequality. Every required starting value matters.

A concrete failure of “consistency implies convergence” isHere $\rho =(\zeta -1)(\zeta -2)$ and $\sigma =-1$, so $\rho (1)=0$ and ${\rho }^{\prime }(1)=\sigma (1)=-1$: the method is consistent, of order one. But its root $2$ violates zero-stability. For $y^{\prime }=0$ with exact solution zero and starting values $Y_0=0$, $Y_1=h^2$, the computed solution is $Y_n=h^2(2^n-1)$. These starting errors vanish, yet at $n\approx T/h$ the error diverges. Local accuracy cannot compensate for an unstable recurrence.

A different meaning of stability concerns a fixed step on decaying equations. The Dahlquist test equation $y^{\prime }=\lambda y$ introduces $z=h\lambda$. A one-step method gives $Y_{n+1}=R(z)Y_n$ and is absolutely stable when $|R(z)|\le 1$. For a linear multistep method, the corresponding amplification polynomial of a multistep method is $\rho (\zeta )-z\sigma (\zeta )$, and every root must satisfy the bounded root condition, not just the root approximating $e^z$. Strict asymptotic decay requires the roots to have modulus less than one for $\mathrm{Re}z<0$. This distinction matters at reducible methods with an undamped parasitic mode, as in question 1(c).

The Forward Euler method has order one and $R(z)=1+z$, so its linear stability domain is $|1+z|\le 1$. For $y^{\prime }=-\kappa y$, with $\kappa >0$, it requires $0\le h\kappa \le 2$. It converges as $h\to 0$, yet an excessively large step can produce growing oscillations on an exactly decaying problem. The Backward Euler method has the same order, but $R(z)=(1-z{)}^{-1}$ makes it A-stable and L-stable. For a stiff differential equation, fast decay can impose a severe explicit time-step restriction even when accuracy of the slow dynamics would permit a much larger step.

The trapezoidal rule has order two and is A-stable, but is not L-stable, since its stability function tends to $-1$ along the negative real axis. The Second Dahlquist barrier limits an irreducible A-stable linear multistep method to order at most two. This does not limit implicit Runge-Kutta methods: question 4's Lobatto IIIA method is fourth-order and A-stable. Conversely, question 1's fourth-order member is convergent but not A-stable. These examples show that order of a numerical method, zero-stability and A-stability answer different questions.

For nonlinear dissipative problems, B-stability controls distances between numerical solutions; algebraic stability of a Runge-Kutta method is a sufficient coefficient criterion. Question 4 shows that A-stability alone does not imply that coefficient criterion. Variable time steps require additional analysis of step ratios and error propagation, and stiff problems may require uniform-in-stiffness error estimates beyond the fixed-problem convergence result. The useful chain is local accuracy plus the appropriate perturbation bound, giving global accuracy; absolute and nonlinear stability then determine which practical time steps preserve the intended dynamics.

The Dahlquist equivalence theorem states that a linear multistep method has convergence of a numerical method if and only if it is consistent and zero-stable, under the standard assumptions for the initial value problem and convergent starting values. Consistency of a numerical method means order at least one, orThe root condition for a multistep method expresses zero-stability: every root of $\rho$ has modulus at most one, and every root with modulus one is simple. Usual hypotheses include a well-posed ordinary differential equation with $f$ continuous in time and Lipschitz continuous in the solution variable, a valid step equation, and starting approximations converging to the exact values.

The first characteristic polynomials of a linear multistep method isThe root condition for a multistep method requires $|\alpha |\le 1$ and excludes $\alpha =1$, where the root of a polynomial at one is double. At $\alpha =-1$, the two unit-modulus roots of a polynomial are distinct, so zero-stability holds. For $\alpha \ne 1$, the first-order consistency of a numerical method identity is ${\rho }^{\prime }(1)=1-\alpha$, equal to the coefficient of $hf$.

Using the permitted Dahlquist equivalence theorem in this multiderivative multistep method setting givesThis means convergence on every fixed finite time interval where the smooth exact solution of a differential equation exists, with consistent starting values and the nearby branch of each implicit solve. More specifically, the convergence of a zero-stable multiderivative method gives order $p$ when the starting errors are $O(h^p)$ and both $f$ and $f^{\prime }f$ are locally uniformly Lipschitz continuous on the relevant region.

The exclusions are genuine. For $y^{\prime }=0$ and $|\alpha |>1$, an arbitrarily small parasitic starting error is amplified as ${\alpha }^n$. At $\alpha =1$, take $y_0=0$, $y_1=h$, also for $y^{\prime }=0$. The exact solution is zero, but the numerical recurrence gives $y_n=nh$, an error of order one at fixed positive time. This proves failure even though the starting values converge.

Insert an exact smooth solution of a differential equation and expand about $t=t_{n+2}$. The unscaled local truncation error, with every term moved to the left, isHere the constant, first-derivative, and second-derivative terms all cancel, using the chain rule identity $y^{\prime \prime }=f^{\prime }(y)f(y)$. Hence the formal defect convention $d_h=O(h^{p+1})$ givesAt $\alpha =1/7$, the coefficient of $h^4{y}^{(4)}$ is $1/21$, so there is no further cancellation. At any other $\alpha$, the cubic coefficient is nonzero.

There is a degeneracy at $\alpha =1$: both the first-derivative coefficient and ${\rho }^{\prime }(1)$ vanish. The raw defect still has the displayed formal order two, but it cannot be normalized by $(1-\alpha )h$ into an ordinary first-order consistency of a numerical method test. Thus a convention requiring this nondegenerate normalization would leave the ODE order undefined at $\alpha =1$. In either convention, it is not a convergent approximation to arbitrary initial-value data; the next part explains why.

The printed formula is not a consistent spatial discretization of the stated PDE. The original PDF genuinely has $1/\Delta x$, rather than $1/(\Delta x{)}^2$. Writing $h=\Delta x$, the Taylor expansion givesso it approximates a diffusion coefficient tending to zero. Moreover, $m=1,\dots ,M$ and $h=1/(M+1)$ cover $(0,1)$, whereas the given Dirichlet boundary conditions belong to $(-1,1)$. No value at the interior location $x=0$ was prescribed. These are actual source defects, not repairs justified by the TeX conversion.

A conditional analysis of the literal ordinary differential equation system is still possible. If it is closed by imposing $u_0=u_{M+1}=0$ on the displayed grid, the negative Dirichlet discrete Laplacian has positive frequencies squaredand each normal mode obeys $q_j^{\prime \prime }=(\alpha -{\kappa }_j)q_j$. For a fixed mesh, every solution is bounded for all time exactly whenEquality produces a linearly growing normal mode for nonzero modal initial velocity; above the threshold there is an exponentially growing normal mode. Since ${\kappa }_1(h)\sim {\pi }^{2}h\to 0$, any $0<\alpha <{\pi }^2/4$ gives bounded continuous solutions but unbounded literal discrete solutions on sufficiently fine meshes. For example, $\alpha =1$, $M=99$ gives ${\kappa }_1<1$, and a growing first sine normal mode. At $\alpha =0$, every fixed mesh is bounded for all time, but unit first-mode initial velocity has maximal displacement $1/\sqrt{{\kappa }_1(h)}$, which diverges on mesh refinement. For uniform-in-mesh, all-time displacement bounds for arbitrary bounded displacement/velocity data in the mesh-weighted L2 norm, the literal closed system therefore requires $\alpha <0$.