Let , and define analogously. The Crank-Nicolson diffusion scheme is
Use and zero values on every boundary node for every time level. This is the theta method with applied to the spatial finite difference method for the heat equation.
The first characteristic polynomial factors as
The two quadratic roots have product one. Both can lie in the closed unit disk only if both have modulus one, requiring . At the root one is triple and ; at the root minus one is double. Both fail the root condition for a multistep method. In the intervening open interval the two quadratic roots are distinct conjugate unit-modulus roots, different from one. Thus
Using , the supplied expansion gives
Throughout the zero-stable range, , so every such method has order two. There is a unique higher-order choice:
Here and , giving exactly order four, with normalized leading truncation error . But the extra roots are , one of modulus greater than one. By the Dahlquist equivalence theorem this consistent but non-zero-stable method is not convergent for arbitrary consistent starting values.
Zero-stability means that perturbations of the starting values of the zero-step recurrence remain bounded by a fixed multiple of their initial size, uniformly as the number of steps tends to infinity on a fixed time interval. In particular solutions of obey with independent of .
The equivalent root condition for a multistep method is
A root outside the unit circle gives exponential growth of a recurrence relation mode; a repeated root on it gives polynomial growth. Repeated roots strictly inside it are harmless because their polynomial factor is dominated by decay.
In the normalization used by the supplied coefficient expansion, the local truncation error of the linear multistep method is
The nonzero sum in the denominator is an explicit hypothesis. Consistency of a numerical method requires uniformly on a fixed finite time interval for every sufficiently smooth exact solution as . Equivalently, the two polynomial identities are
These follow by inserting constant and affine functions, or by setting the first two Taylor coefficients to zero.
On the Dahlquist test equation, set . The theta method has stability function
With the decaying-solution convention, its region of absolute stability is . Writing , squaring numerator and denominator gives
For this is the open disk with centre and radius . At it is the open left half-plane. For it is the exterior of the closed disk with centre and radius . The pole , when present, lies outside the stability region.
Every with satisfies the inequality exactly for . If , sufficiently large negative real fails it. Therefore
If absolute stability is instead defined by bounded amplification, the boundary is included; this convention does not change the A-stability conclusion for the open left half-plane.
Figure 1.
Absolute stability regions of the theta method at zero, one half and one; green regions damp the scalar test solution
. Details.
Put . Subtracting the numerical update from the exact update with its local truncation error gives
The Lipschitz condition in the solution variable and the triangle inequality imply
The assumed positive denominator permits division. With and , repeated substitution of this Lipschitz one-step error bound yields
Here because , so the displayed geometric series quotient is well defined. For implicit steps, the same condition makes the scalar update map a contraction mapping, ensuring a unique numerical next value.
Use the normalized local truncation error
The Taylor theorem expansions about are
Substitution gives exactly
Thus the theta method has order two exactly for , and otherwise order one, as a statement about the method on a sufficiently smooth class of problems. The leading term vanishes at one half, and a function with nonzero third derivative shows that the next term does not vanish universally. As usual, a uniform order estimate assumes bounded relevant derivatives; mere existence of on the open interval gives the stated pointwise remainders but not, by itself, a uniform bound. Special exact solutions can of course have zero truncation error even for a first-order method.
The endpoint in the printed nonnegative-parameter hypothesis must be excluded. We first establish the intended result for , then describe that endpoint exactly.
Write for the two directional matrices; they commute because they act on separate tensor-product coordinates. At a limit , the intermediate vector also has a limit . Subtract the two limiting equations in the form that cancels and ; this gives . Hence for . Substitution then gives , precisely the required discrete equation.
Eliminating the intermediate vector gives the alternating direction implicit iteration matrix
The sine-product basis simultaneously diagonalizes , with eigenvalues and , where
Thus
For , each factor has modulus strictly less than one. Hence , proving convergence from every starting vector to the unique discrete solution.
At the two factors are both , so . The forcing terms cancel in the composed iteration as well, and for every starting vector. An incorrect initial vector therefore remains incorrect forever, even though the sequence is constant and has a limit. This disproves both the literal fixed-point implication and the claimed general convergence-to-solution assertion at zero; strict positivity of is the necessary repair.
With zero boundary values eliminated, the diagonal of is . The Jacobi method is therefore
which averages the four neighboring components. The sine addition identity shows that the supplied product vectors are eigenvectors, with
The discrete sine vectors form a basis, so these are all eigenvalues. Their largest modulus is
attained at the lowest and highest sine frequencies. Thus the asymptotic error reduction factor per iteration is . If the convergence rate is expressed logarithmically, as . A fixed error reduction therefore takes Jacobi sweeps. For the special grid , and one sweep solves its single interior equation.
The given stencil has nonnegative neighbor weights, zero row sums and a path from every unknown node to the Dirichlet boundary. Thus the discrete maximum principle applies, including at the reflected Neumann edge. The barrier is positive throughout the square.
At an ordinary interior node, central differences differentiate this quadratic exactly, giving . At , the reflected horizontal part is
and the vertical part is two. Thus there. Part (c) therefore permits
On the Dirichlet boundary, the largest barrier value is . Consequently
The truncation error at the Neumann edge is divided by the barrier response , producing a contribution of order . Thus its lower local order does not reduce this global maximum-norm error bound.
The displayed estimate requires a nonnegative barrier. As printed, a counterexample is obtained with two interior nodes, each having row to one boundary node. Set , , and , . Both interior rows have and . Put one node in each of and take . Then the proposed right-hand side is while .
For the intended use, suppose and the stencil has the maximum principle established in part (a). Set . On either subregion,
At boundary nodes these functions equal . Hence
which proves the intended discrete elliptic barrier estimate
For a normalized stencil with and a sign-changing barrier, shifting it by its minimum gives the valid general replacement . The supplied barrier in part (d) is positive, so the printed estimate applies there without a sign problem.
A diameter-only bound also needs the normalization of a Laplacian stencil, beyond its coefficient signs. For example, a single interior row with allows and on a domain of fixed diameter. Thus arbitrary rescaling of the printed coefficients rules out a universal diameter-only estimate.
For the intended normalized Laplacian stencil, assume and for , with , as holds for the standard two-dimensional central stencil. Let . Then . Use the truncation error convention , so ; reversing the convention does not change the absolute-value argument.
The two functions satisfy . On the prescribed boundary , so their maximum boundary values are at most . Apply the discrete maximum principle from part (a), with its boundary-connectivity assumption. Since ,
This is the standard quadratic-barrier error estimate for a discrete Laplacian. The calculation identifies exactly the additional normalization needed for the bound intended by the question.
The coefficient signs alone do not imply the assertion as printed. Two interior nodes can have rows and , with a separate boundary node. Taking interior values one and boundary value zero satisfies every stated coefficient inequality and , but its maximum is not on the boundary. Connectedness of the geometric domain does not ensure connectedness of this stencil graph.
The usual extra assumption is that every interior node has a path of positive stencil coefficients to a prescribed boundary node. Under this assumption let be the global maximum and suppose an interior node attains it. Then
All summands are nonpositive, so equality forces at every neighbor with . Propagate along a path to the boundary to find a boundary node with value . This proves the discrete maximum principle under boundary-reaching stencil connectivity, and exhibits why the literal hypotheses need that qualification.
Use the fine matrix and right-hand side from part (b), with diagonal . Starting from an iterate , take weighted Jacobi smoothing steps
Form the residual . For coarse interior indices , use full-weighting restriction
The prolongation operator matrix is linear interpolation of a coarse correction: and , with zero endpoint corrections. Thus . Choose the Galerkin coarse-grid operator , solve exactly, and correct . The entries of , and above specify every matrix in the cycle. A rediscretized coarse operator is another standard choice if used consistently.
For a nonsingular coarse operator, the fine-grid iteration matrix of this pre-smoothed two-grid cycle is
The purpose of under-relaxation is to damp fine-grid oscillations, leaving smoother error for coarse-grid correction. For the diffusion-dominated one-dimensional operator, is the usual effective choice; the high-frequency symbol then has modulus at most for . Coefficients and convection can change the best parameter, so this is a motivated choice rather than a universal optimum. Under the diagonal-dominance condition, the unweighted Jacobi matrix already has norm less than one in the maximum norm, and its convex combination with the identity remains convergent for .
At , the central finite difference equations are
with , . For this is a linear system , with row coefficients
The right-hand side starts from and includes in its first entry and in its last entry. Under , both off-diagonal coefficients are negative, so . Omitting nonexistent endpoint columns can only reduce this sum. Therefore is strictly diagonally dominant. In particular the linear discrete system is nonsingular.
Introduce and solve the initial-value system
The unknown initial slope is the shooting method parameter. Integrate to one and solve the scalar residual equation , using a secant iteration or a bracketed root finder when suitable data are available.
For a Newton update, integrate the sensitivity equations along the current shot:
Then and the update is when this derivative is nonzero. After a root has been found, the corresponding shot satisfies both endpoint conditions. This formulation does not presume that a nonlinear boundary-value problem necessarily has a unique solution.
On nonnegative states the characteristic speed is , so upwind finite difference scheme uses the left spatial difference. With , the conservative upwind finite difference scheme is
Explicitly the flux difference is . Preservation of nonnegativity under the given Courant restriction, proved next, justifies the same left-upwind direction at every step.
Transforming the spatial shifts and putting gives the real amplification factor
For the denominator is at least one, so the implicit step is a bounded Fourier multiplier on . Set and use . The numerator is no greater than the denominator, so . The other inequality is
If , the bracket is nonpositive and this always holds. If , the concave quadratic has its maximum at , with value . Therefore precisely under the stated condition
and without a mesh-ratio restriction when . The Parseval identity now gives
Iteration proves stability with constant one. It is conditional for and unconditional for . The sampled initial data have finite support, hence belong to . This is the Fourier stability threshold for a mixed-width heat scheme.
Figure 1.
The exact stable mesh-ratio region for the mixed-width heat scheme
. Details.

Pinned article: Introduction to the OurBigBook Project

Welcome to the OurBigBook Project! Our goal is to create the perfect publishing platform for STEM subjects, and get university-level students to write the best free STEM tutorials ever.
Everyone is welcome to create an account and play with the site: ourbigbook.com/go/register. We belive that students themselves can write amazing tutorials, but teachers are welcome too. You can write about anything you want, it doesn't have to be STEM or even educational. Silly test content is very welcome and you won't be penalized in any way. Just keep it legal!
We have two killer features:
  1. topics: topics group articles by different users with the same title, e.g. here is the topic for the "Fundamental Theorem of Calculus" ourbigbook.com/go/topic/fundamental-theorem-of-calculus
    Articles of different users are sorted by upvote within each article page. This feature is a bit like:
    • a Wikipedia where each user can have their own version of each article
    • a Q&A website like Stack Overflow, where multiple people can give their views on a given topic, and the best ones are sorted by upvote. Except you don't need to wait for someone to ask first, and any topic goes, no matter how narrow or broad
    This feature makes it possible for readers to find better explanations of any topic created by other writers. And it allows writers to create an explanation in a place that readers might actually find it.
    Figure 1.
    Screenshot of the "Derivative" topic page
    . View it live at: ourbigbook.com/go/topic/derivative
  2. local editing: you can store all your personal knowledge base content locally in a plaintext markup format that can be edited locally and published either:
    This way you can be sure that even if OurBigBook.com were to go down one day (which we have no plans to do as it is quite cheap to host!), your content will still be perfectly readable as a static site.
    Figure 5. . You can also edit articles on the Web editor without installing anything locally.
    Video 3.
    Edit locally and publish demo
    . Source. This shows editing OurBigBook Markup and publishing it using the Visual Studio Code extension.
  3. https://raw.githubusercontent.com/ourbigbook/ourbigbook-media/master/feature/x/hilbert-space-arrow.png
  4. Infinitely deep tables of contents:
    Figure 6.
    Dynamic article tree with infinitely deep table of contents
    .
    Descendant pages can also show up as toplevel e.g.: ourbigbook.com/cirosantilli/chordate-subclade
All our software is open source and hosted at: github.com/ourbigbook/ourbigbook
Further documentation can be found at: docs.ourbigbook.com
Feel free to reach our to us for any help or suggestions: docs.ourbigbook.com/#contact