On each finite interval use the Banach space with the supremum norm. The free term belongs to , and the time-integral operator maps to itself with norm at most . The strongly continuous semigroup property and boundedness of justify continuity of the Bochner integral.
Define
The factorial bound for a Volterra iterate gives . The series therefore converges absolutely in . Since is a bounded linear operator on , it can be passed through the convergent sum, giving
Thus , the required integral formulation, and . Each term on a larger interval restricts to the identical term on a smaller interval, so these constructions define a single global solution without having to restart at successive times. This is an integrable Volterra solution for normalized velocity relaxation. It is a mild solution of an abstract Cauchy problem in and hence an weak solution in the paper's integral-formulation sense. No smallness condition such as is needed.
For the standard complex inner product, . Using the conjugate transpose and the defining equality for a normal matrix,
Both norms are nonnegative, so for every .
Throughout this question the Banach spaces and Hilbert spaces are complex. Separability is an additional standing hypothesis, not part of the general definition of a Hilbert space. Here and below unit ball means the closed unit ball. An open unit ball in positive finite dimension is not compact. In finite dimension, equivalence of norms identifies the closed unit ball with a closed bounded subset of Euclidean space, so the Heine-Borel theorem gives compactness in the norm topology.
In an infinite-dimensional Hilbert space, the Gram-Schmidt process constructs an infinite orthonormal sequence . Put . Then and, for , . No subsequence is a Cauchy sequence, contradicting sequential compactness. Thus the closed unit ball is norm compact exactly in finite dimension.
The finite-dimensional implication again follows from equivalence of norms and the Heine-Borel theorem. In an infinite-dimensional Banach space, inductively apply Riesz lemma to the proper closed finite-dimensional linear span to obtain a unit vector with . Therefore for distinct indices, precluding a Cauchy subsequence.
For completeness, Riesz lemma here follows by taking , setting , choosing with , and putting . Its distance from exceeds . This proves the closed unit ball is norm compact if and only if the Banach space is finite-dimensional. The printed hint's equality of all pairwise distances is unnecessary; the separation inequality is what the argument supplies.
For , the real Lp space is the vector space of real measurable functions with , identifying functions equal almost everywhere. Its Lp norm is . For , take the essentially bounded real measurable functions, with the same identification and norm . The identification makes each norm definite; absolute homogeneity follows from the Lebesgue integral, and the triangle inequality follows from Minkowski inequality for finite , or directly from the essential supremum for .
Here is a completeness proof valid on any measure space. For , a Cauchy sequence has a subsequence with . Choose measurable function representatives and put . By Minkowski inequality and the monotone convergence theorem,
Consequently the series converges absolutely almost everywhere. Define there, and define it to be zero on the measurable exceptional null set. Then , and Fatou lemma applied to each tail gives . The original Cauchy sequence also converges in Lp norm, by the triangle inequality. For , choose the same subsequence using the essential supremum norm. Outside one measurable null set, all the bounds hold and is bounded. The series then converges uniformly there, with an essentially bounded measurable function limit and the same tail estimate in essential supremum norm. Thus all these spaces are Banach spaces.
The duality of Lp spaces says that, for and , the map
is an isometric isomorphism of normed spaces. This form of Lp duality on an arbitrary measure space requires no finiteness hypothesis on . At , a standard version assumes a sigma-finite measure and identifies with through the same dual pairing. That endpoint assertion must not be made without a suitable measure-space hypothesis.
We first prove the required duality of Lp spaces for a finite measure. Let and set . For disjoint measurable , the indicator functions of their partial unions converge in Lp norm to that of their union, so is countably additive. It has finite variation measure: for every finite measurable partition , choosing real signs gives
Also implies . The Radon-Nikodym theorem supplies a Radon-Nikodym derivative with . Linearity gives for simple functions. Uniform approximation by simple functions extends this identity to bounded measurable functions: both their Lp norm errors and the errors in integration against tend to zero.
To establish the correct integrability, test with the bounded measurable function . Since , writing gives
The second inequality is also valid when . The monotone convergence theorem gives and . Density of simple functions in the Lp space, together with Hölder's inequality, now gives on all of . Conversely Hölder's inequality gives . If , testing against
gives and , so . This also proves uniqueness of the representing Radon-Nikodym derivative.
For completeness, the passage to an arbitrary measure space can be made without losing a hypothesis in the reflexive Banach space argument below. On a sigma-finite measure space, exhaust by nested finite-measure sets . The representing Radon-Nikodym derivatives on agree on overlaps by uniqueness. Their glued density has Lp norm by the monotone convergence theorem, and represents because in Lp norm. Every on an arbitrary measure space is supported on a sigma-finite measurable set: the sets have finite measure and their union is .
Use support localization of an Lp functional as follows. For a sigma-finite measurable , let be the operator norm of restricted to functions supported in . The support observation gives . Choose approaching this supremum and set ; then . If a sigma-finite had , functions supported on the disjoint sets have the direct-sum Lp norm. Optimizing their two scalar coefficients by Hölder's inequality, and using functions approaching the two restriction operator norms, would give
a contradiction. Thus vanishes on functions supported outside . The density on , extended by zero, represents globally. The case simply uses . This proves the stated Lp duality on an arbitrary measure space.
Finally let and let , where stars denote continuous dual spaces. Compose with to obtain the bounded linear functional on . Applying duality of Lp spaces with the exponents reversed gives with . For the canonical embedding into the bidual , its value on is also . Since is onto, . Its norm is by the same dual pairing norm identity. Therefore , which proves that is a reflexive Banach space through its actual canonical embedding into the bidual.
All vector spaces in this solution are complex, while convex combinations use real coefficients. An extreme point of a convex set is one for which , and , forces . Equivalently, is not the midpoint of two distinct points of .
The Krein-Milman theorem says that every nonempty compact convex set in a Hausdorff locally convex space is the closed convex hull of its extreme points. Here is a proof. A face of a convex set is a convex set such that whenever an interior point of a segment in belongs to , both endpoints belong to . Consider nonempty compact faces, ordered by reverse inclusion. A chain has nonempty intersection by compactness and the finite intersection property; that intersection is again a compact face. The Zorn lemma therefore gives a minimal nonempty compact face .
If contains distinct , a continuous real linear functional on the underlying real locally convex space distinguishes them. Such a linear functional exists because the space is Hausdorff and locally convex, by the Hahn-Banach theorem. The maximizers of on form a nonempty proper compact face of . A face of a face is a face of , contradicting minimality. Therefore is a singleton, yielding an extreme point. The same argument inside any nonempty compact face of supplies an extreme point of lying in that face.
Let be the closed convex hull of the extreme points of . It is a nonempty closed subset of compact , hence compact. If , the Hahn-Banach separation theorem provides a continuous real linear functional with . Its maximizer set on is a nonempty compact face, which contains an extreme point of . But and , a contradiction. Thus , proving Krein-Milman theorem.
For a nonempty compact Hausdorff space , the extreme points of the dual unit ball of C(K) are
This is the permitted description without proof, with denoting the complex space of continuous functions on a compact space equipped with the supremum norm. If is empty, and the closed unit ball of its continuous dual space has the single extreme point instead.
The complex Banach–Stone theorem states that a surjective complex-linear isometric isomorphism of normed spaces has the form
where and is a homeomorphism. Conversely, every such map is a surjective complex-linear isometric isomorphism of normed spaces for the supremum norm.
To prove this, suppose first that are nonempty. The Banach-space adjoint is a bijective isometric isomorphism of normed spaces on the continuous dual spaces, so it bijects their closed unit balls and preserves extreme points. The displayed extreme point description gives uniquely
Uniqueness follows by evaluating at the constant function , and then using that continuous functions separate points of a compact Hausdorff space. Evaluation gives the required formula for , and is continuous. Surjectivity of on extreme points proves surjectivity of : the preimage of any is for some . If , every function in the range of has equal values at these two points after division by ; surjectivity of and separation of points force . Thus is bijective.
For every , is continuous. The evaluation map , , is a continuous injection of a compact Hausdorff space into a Hausdorff product topology, hence a homeomorphism onto its image. Continuity of every coordinate proves continuity of . A continuous bijection between compact Hausdorff spaces is a homeomorphism. Conversely the weighted-composition formula plainly preserves the supremum norm, and its inverse is
If one compact space is empty, a surjective isometric isomorphism of normed spaces forces the other to be empty, and the empty homeomorphism gives the corresponding trivial case. This completes Banach–Stone theorem.
Neither the space of sequences converging to zero nor can be isometrically a continuous dual space of a Banach space. Indeed, every nonzero continuous dual space has a nonempty weak-star compact closed unit ball by Banach-Alaoglu theorem, and Krein-Milman theorem then guarantees an extreme point. A bijective linear isometry preserves extreme points of closed unit balls.
The closed unit ball of has no extreme points. Given with , choose with and . The two distinct elements remain in that closed unit ball and have midpoint .
The closed unit ball of the complex Lp space also has no extreme points. An element of norm less than one can be perturbed by a sufficiently small nonzero Lp space element in both directions. If , the non-atomic measure admits a measurable set of mass ; for example the continuous function attains . Put . For , the distinct functions both have Lp norm
with the two coefficients interchanged for the minus sign. Their midpoint is . Thus neither proposed space is isometrically a Banach dual.
Finally, is a connected space, whereas is disconnected. They cannot be homeomorphic. By Banach–Stone theorem, and are not isometrically isomorphic as complex Banach spaces.
Work over and take a nonzero commutative unital Banach algebra , with . A character of an algebra is a nonzero multiplicative complex linear functional . It satisfies . Moreover : otherwise would be invertible, although its image under is zero. The bound on the spectrum of an element therefore gives , proving automatic continuity of characters and .
Every proper maximal ideal of is closed. Indeed its closure is an ideal; if this closure were all of , would contain an element within distance less than one of . Such an element is invertible by the Neumann series, forcing . Thus the closure is proper and maximality makes it equal to . The quotient Banach space , with its quotient Banach algebra structure, is a complex normed division algebra. By the Gelfand-Mazur theorem, it is , so the quotient map gives a character of an algebra with kernel . Conversely, the kernel of every character of an algebra is a maximal ideal, since the character is onto . The Zorn lemma supplies a maximal ideal containing every proper ideal, so the character space of an algebra is nonempty.
These facts give the exact relation between the character space and the spectrum of an element:
One inclusion was proved above. For the other, if is noninvertible, the principal ideal it generates is proper because is commutative. Contain it in a maximal ideal and use its corresponding character of an algebra to obtain .
Give the Gelfand topology, namely its subspace topology from the weak-star topology on . In the closed unit ball of , it is the intersection of the closed conditions
Consequently Banach-Alaoglu theorem makes a compact Hausdorff space. For every , define the Gelfand transform . This is a continuous function on by definition of the Gelfand topology. The Gelfand representation theorem gives a contractive unital algebra homomorphism over a field
Multiplicativity and linearity follow by evaluating at each character of an algebra; the supremum norm equality follows from the preceding spectrum of an element identity. Its kernel is
the Jacobson radical. Equivalently, its elements have spectrum of an element . Thus is injective precisely when is a semisimple commutative Banach algebra, and it gives a faithful continuous representation of as a function algebra. Its range contains the constants and separates points of , because distinct characters of an algebra differ on some . An arbitrary Banach algebra need not have an isometric or surjective Gelfand transform, nor a uniformly dense range: those conclusions require further hypotheses.
For the Banach algebra on a nonempty compact Hausdorff space , all characters of an algebra are evaluation characters. To see this, let be a maximal ideal. If its elements had no common zero, compactness would supply with no common zero. The continuous function belongs to , is strictly positive on , and has a continuous reciprocal. It is therefore invertible, a contradiction. Hence all elements of vanish at some , so and maximality gives equality. The associated character of an algebra must be : since , its value on is .
The map is a continuous bijection , using separation of points by continuous functions. Compactness and the Hausdorff property make it a homeomorphism. Under this identification the Gelfand transform is , so it is the identity representation of , in particular an isometric onto map. The empty gives the zero algebra, whose empty character space represents the zero function space; it was excluded by the nonzero unital convention above.
Now let be a commutative unital C-star algebra. The stronger conclusion is the Commutative Gelfand--Naimark theorem: the Gelfand transform is an isometric onto C-star homomorphism . We prove the additional assertions without assuming this conclusion.
First every character of an algebra respects the C-star algebra involution. If , the elements , , are unitary elements of a C-star algebra, and their norm is one by the C-star identity. Continuity and multiplicativity give . Thus for every real , forcing to be real. Writing with and self-adjoint gives . Therefore the range of is closed under complex conjugation.
Every element of commutative is a Normal element of a C-star algebra. For a normal , use the C-star identity, and then the same identity for the self-adjoint element , to obtain
Its powers are also normal, so . The spectral radius formula gives , hence . The Gelfand transform is therefore an isometry, and its range is complete and closed in the supremum norm. It contains constants, separates points and is closed under complex conjugation. The complex Stone-Weierstrass theorem makes that range dense, hence all of .
The approximation step in Stone-Weierstrass theorem can also be seen directly here. For a unital conjugation-closed point-separating subalgebra , the real-valued part of its uniform closure is closed under absolute values, by polynomial approximation to on bounded intervals, hence under pointwise maxima and minima. Its real-valued functions separate points. Given real and , for each an affine rescaling of a separating function produces agreeing with at ; take a constant when . For fixed , finitely many neighbourhoods of where cover . Their maximum exceeds everywhere and agrees with at , hence is less than near . Finitely many of these latter neighbourhoods cover ; the minimum of their lies between and everywhere. Approximate real and imaginary parts separately. This proves the density used above and completes the C-star algebra conclusion.
Set and . The Dirichlet discrete Laplacian has the eigenvectors
and its negative has the eigenvalues
The discrete sine transform therefore reduces the method of lines equations to . Each coefficient is an oscillator, a linear function, or a hyperbolic function according to the sign of . A finite collection of oscillators is bounded in every fixed-grid norm. A zero-frequency mode can grow linearly, and a negative-frequency-square mode can grow exponentially. Consequently,
is necessary and sufficient for all-time boundedness of a semidiscrete reaction wave equation on this grid. Equality allows bounded displacement only when the initial velocity has zero projection onto the first eigenvector; above it, the growing components must be absent in every unstable mode. A strictly positive spectral gap also gives a time-independent displacement bound uniform over grids whose gaps are bounded below.
The discrete threshold is strictly smaller than , because for , and tends to as . A coarse grid can therefore introduce long-time growth into a continuum problem with . This is distinct from displacement stability of a symmetric semidiscrete wave equation on fixed finite time intervals. As in part (a), if existence of the printed limit is required for every initial datum, no qualifies: any one mode admits oscillatory, secular, or growing initial data, depending on its coefficient.
There is a genuine conflict in the printed coefficient assumptions: no uniformly positive coefficient in a zero-boundary Sobolev space exists. A function cannot also obey almost everywhere. Indeed, the Lipschitz truncation has , so Lipschitz truncation preserves zero-boundary Sobolev spaces, giving . But would be the nonzero constant . Its zero gradient contradicts the Poincaré inequality in the zero-boundary Sobolev space. Thus the literal coefficient class is empty.
For the meaningful uniformly elliptic problem, take with , and impose the Dirichlet boundary condition on the unknown and test functions: . Additional regularity of is harmless, but a zero trace for must be removed. The divergence-form elliptic operator is . Integration by parts defines the symmetric bounded bilinear form
In particular,
Here is the first Dirichlet Laplacian eigenvalue on the unit square; the Poincaré inequality follows, for example, by applying the one-dimensional inequality in each coordinate and adding. Thus is coercive in the gradient norm on , and the Dirichlet realization of is a positive definite symmetric operator. On its operator domain, .
The required functional and weak equation are
Because , the right side is a bounded linear functional by the Cauchy-Schwarz inequality and Poincaré inequality. The Lax-Milgram theorem gives a unique weak solution, and part (b) proves that it uniquely minimizes . These formulas prove the intended conclusion under the repaired coefficient hypothesis; under the literal hypothesis there is no coefficient to which the conclusion can be applied.
For energy stability for variable-coefficient reaction diffusion, let , let be the Dirichlet discrete Laplacian, and set . Use the mesh-weighted inner product with the corresponding discrete L2 norm. For zero boundary values, summation by parts gives
For a solution, or a difference of two solutions, the energy method gives
The Gronwall inequality therefore proves
The constant is independent of , so this is stability of a numerical method on every fixed finite time interval. The bound allows physical growth if ; stability here does not mean uniform boundedness as .
There is also a uniform maximum-norm bound. At a positive spatial maximum the second difference is nonpositive. Applying this observation to and to its negative gives . With a perturbing source , the Duhamel principle gives the corresponding initial-data bound plus in either norm. Thus the estimate controls accumulated residuals as well as initial perturbations.
The original PDF has on the left of the update; the converted TeX omits its . Use the Forward Euler method with and . The explicit time stepping for bounded reaction diffusion update matrix is
When , the heat update has nonnegative stencil weights and row sums at most one. Hence its induced maximum operator norm is at most one. It is also a symmetric matrix with eigenvalues
all in , so its discrete L2 norm operator bound is at most one too. Let . In either of these norms,
Iteration gives the mesh-uniform stability estimate
The same estimate applies to differences of solutions. Adding a per-step defect gives .
This proof only requires and bounded reaction coefficients. It does not assume the full update is nonnegative: a negative can make its middle stencil weight negative when . Nor does it claim contractivity or an all-time bound for every coefficient. The required stability is a bound uniform in the discretization on fixed finite intervals.
For an evolutionary partial differential equation, stability of a numerical method means that errors in the starting data and forcing stay controlled on each fixed interval , with constants independent of the mesh. Fourier stability analysis is especially effective for a constant-coefficient finite difference method on a uniform infinite or periodic grid: translation invariance makes different Fourier modes evolve independently.
For a scalar one-step scheme on the integer lattice, insert , with . The Fourier symbol of each shift is , and the update reduces to
The amplification factor must be defined for every relevant frequency; for an implicit scheme this includes checking that its denominator is nonzero. The Parseval identity turns a bound into a discrete L2 norm bound. Thus gives contractivity, while the more general bound gives for . Conversely, frequencies with amplification uniformly greater than one produce unstable wave packets or periodic Fourier modes under refinement.
For a system, is an amplification matrix; for a multilevel scheme, a companion matrix evolves the vector of time levels. The actual requirement is a uniform bound on matrix powers, not just their spectral radius. A nontrivial Jordan block at a unit-modulus eigenvalue creates polynomial growth in the time index. Even simple eigenvalues inside the unit disk can fail to give a uniform bound if the eigenvector matrices become ill-conditioned as the mesh changes. Uniformly controlled diagonalization of a matrix, or a suitable quadratic energy estimate, resolves this issue. The power boundedness of a two-level Fourier scheme illustrates why root multiplicities and conditioning matter.
For the heat equation, put . Centered space with the Forward Euler method has
The von Neumann stability analysis condition holds exactly for on the full frequency interval. The Backward Euler diffusion scheme instead has and is stable for every . The Crank-Nicolson diffusion scheme has
It too is unconditionally stable, but poorly resolved high-frequency modes have for large , giving oscillatory numerical transients. A-stability therefore does not guarantee strong damping; L-stability distinguishes the damping of the Backward Euler method.
For the advection equation , let . Forward time and centered space give
For nonzero fixed , repeated steps amplify some modes by a fixed factor greater than one, so the method is unstable under the usual refinement . This calculation also shows the refinement qualification: if , its finite-time growth can be bounded by , though the restrictive scaling defeats the usual hyperbolic time-step choice. For , the upwind finite difference scheme has
so it is stable for . The Lax-Wendroff advection scheme instead has
giving . These examples separate the effects of the spatial stencil, temporal approximation and Courant number; a higher order of a numerical method by itself does not establish stability.
A periodic boundary condition is ideal for this analysis. The discrete Fourier transform diagonalizes the circulant update, with only the discrete frequencies needed on a grid of points. A bound on all is a convenient guarantee over every such grid. On the whole line, the Fourier transform uses a continuous frequency interval and the Parseval identity proves the corresponding square-summable-data estimate.
Homogeneous Dirichlet boundary conditions do not admit arbitrary complex exponential Fourier modes. For the standard centered second difference on interior points, a discrete sine transform diagonalizes the actual boundary-value matrix:
The same heat amplification formulas then apply at these sine frequencies. For example, the exact forward-Euler contractivity limit on that fixed grid is ; the mesh-independent sufficient limit follows by including all frequencies. Homogeneous Neumann boundary conditions can similarly permit a discrete cosine transform, provided the endpoint discretization and its weighted inner product are chosen consistently. The constant mode is then present, reflecting conservation of the heat equation's spatial mean. For inhomogeneous boundary conditions, subtract a suitable lifting of the prescribed boundary data and estimate the induced source using the homogeneous evolution's bound and a Duhamel principle estimate. Bounds for the lifting and source must themselves be uniform in the mesh.
General boundary conditions require separate boundary stability of a finite-difference method. For an advection equation, incoming data are prescribed at the inflow boundary, while an outflow closure must respect the outgoing characteristics. An interior periodic Fourier symbol cannot detect a growing mode confined near a boundary. A normal-mode test on a half-line seeks modes with and that satisfy both the interior recurrence and boundary closure. Their existence proves instability, and uniform control requires more than merely excluding isolated growing roots; the Uniform Kreiss--Lopatinskii condition addresses boundary resolvent bounds. Alternatively, a direct energy method using summation by parts can include the boundary terms and establish the required estimate.
Variable coefficients and nonuniform meshes usually destroy exact Fourier transform diagonalization. Frozen-coefficient Fourier stability analysis is then a useful diagnostic, but it is not automatically a proof for the full variable-coefficient boundary problem. The mesh-uniform energy method in question 5 is an example of a direct proof. Also, an L2 norm proof is not automatically a mesh-uniform maximum-norm proof: finite-dimensional norm-equivalence constants may grow with the number of grid points.
Finally, stability measures error propagation; consistency of a numerical method measures the defect of inserting the exact solution. For a well-posed linear initial-value problem in the chosen norm, the Lax equivalence theorem says that a consistent approximation is convergent exactly when it is stable. Boundary discretization and starting data must be included in that assertion. A Fourier calculation proves convergence only after consistency, well-posedness and the actual boundary treatment have also been checked.
Consider the operators on all of or , extending the displayed positive-function formula linearly. Here is the space of continuous functions vanishing at infinity. The multiplier has modulus at most one, so , and multiplication of exponentials gives and . For strong continuity on , choose a compact outside which is small. On the continuous is bounded, making uniform; outside , . For , use pointwise convergence and the dominated convergence theorem with bound . Thus both are contraction semigroups, even when is unbounded.
The generator of a multiplication semigroup is
Indeed pointwise difference quotients converge to . A norm limit therefore forces the displayed domain condition, using an almost-everywhere convergent subsequence for the case. Conversely , so the dominated convergence theorem proves the limit when . In write the error as times , with the value at supplied by continuity. That second factor tends uniformly to zero where is bounded and has modulus at most one; the compact-set and small-tail argument applied to proves uniform convergence. To prove directly that is a closed operator, take and . Pointwise limits in , or a common almost-everywhere convergent subsequence in , give . Thus is in the appropriate generator domain and . In the domain is dense because ; in compactly supported continuous functions are a dense subspace contained in the domain.
A real multiplication operator on its maximal domain is an unbounded self-adjoint operator. One direct verification is to test the adjoint relation against functions supported on . If is in the adjoint operator domain with representing vector , those tests force on each such set, hence . The converse follows by integration. On the sigma-finite measure spaces used below, the spectrum of a real multiplication operator is its essential range; spectral values are detected by unit vectors supported where the multiplier is arbitrarily close to that value, while outside the essential range its reciprocal is a bounded resolvent multiplier.
For the heat semigroup on , take the normalization . The unitary Fourier transform converts it to multiplication by , and converts the semigroup to multiplication by . Consequently
The Sobolev space domain is exactly . The continuous spectrum comes from the full essential range of , not from square-integrable Fourier eigenvectors.
For the Ornstein-Uhlenbeck semigroup on standard Gaussian measure, the normalized Probabilists' Hermite polynomials form an orthonormal basis. The construction below gives and , so the Hermite coefficient map turns it into a real multiplication operator on . Therefore
Finally, the heat semigroup on the whole real line has no positive spectral gap, whereas the standard Ornstein-Uhlenbeck semigroup has gap one. For the first claim, take a nonzero smooth compactly supported and set . Then , but . This disproves a uniform whole-line Poincaré inequality ; one can also choose . Lebesgue measure here is infinite, so it has no normalized probability mean to subtract. For Gaussian measure, the Hermite expansion instead gives the sharp Gaussian Poincaré inequality
Equality holds for affine functions. The identity on the right is interpreted on the energy-form domain, which is larger than the full operator domain.