Introduce a free scalar . The epigraph reformulation is the linear program
For each fixed , the smallest feasible equals the maximum of the affine expressions, so the reformulation preserves the optimum.
Associate nonnegative multipliers with these inequalities. Its optimization Lagrangian is
Because and are unrestricted, the infimum is finite precisely when the coefficients of both vanish. Therefore the Lagrangian dual problem is
A feasible dual vector is a convex combination of the slopes whose mean slope is zero. It gives a constant lower bound on the maximum of the affine functions. The primal is always feasible, by taking and sufficiently large . If it has a finite optimum, linear programming duality gives attainment and equality with this dual; otherwise the dual is infeasible and the primal is unbounded below.
First, equality of two values forces equality of the corresponding values: neither strict comparison holds for , and the same is then true for in both directions. Thus for a well-defined strictly increasing function on . Since is a convex set and are affine functions, is a real interval and
If contains , let and . The mixture identity gives for . For , express as a convex combination of and and solve the same identity for ; for , express as a mixture of and . Hence the formula holds on all of , not merely between the chosen anchors. We obtain positive affine uniqueness of affine preference representations:
If is constant, the same comparisons force to be constant; choose and the appropriate . If the probability-measure set is empty, the assertion is vacuous. These degenerate cases do not require distinct anchors.
First we prove the Krein-Milman theorem in the required setting. If is empty the conclusion is immediate, so assume it is nonempty. A face of a convex set is a convex subset with the property that an interior point of a segment in belongs to only if both endpoints do. Consider all nonempty weakly compact faces of , ordered by reverse inclusion. A chain has a nonempty intersection by compactness and the finite intersection property; that intersection is again a compact face. The Zorn lemma gives a minimal compact face .
If contained distinct points, a bounded linear functional separating them would be nonconstant on . Its maximizer set is a nonempty proper compact face of , hence a face of , contradicting minimality. Therefore is a singleton and its member is an extreme point of . The same reasoning applies to each nonempty compact face of , so each such face contains an extreme point of .
Let be the norm-closed convex hull of the extreme points of . A weakly compact subset of a Banach space is weakly closed, hence norm closed, so . If , the Hahn-Banach separation theorem gives with . The maximizer face of on contains an extreme point of . Then , contradicting . We conclude
Norm and weak closed convex hulls coincide by the same separation theorem. The printed phrase “closed convex cover” is understood in this standard closed-convex-hull sense.
Now work in the real space of continuous functions on a compact space on the Cantor set. The extreme points of a real continuous-function unit ball are exactly the continuous sign functions:
If , continuity supplies a neighbourhood where . The Cantor cylinder sets form a clopen base, so choose a nonempty cylinder inside that neighbourhood. Its indicator function is continuous, and are distinct members of with midpoint . Hence is not extreme. Conversely, if is pointwise sign-valued and with , equality at the endpoint of the scalar interval forces at every point.
To prove the closed-hull assertion without assuming weak compactness, take and . A sufficiently fine finite partition of into Cantor cylinders has oscillation of less than on each cell, by uniform continuity. Choose a value on each cell and let be the corresponding continuous step function. Then . For each sign vector , let take value on cell , and assign the weight
These weights are nonnegative, sum to one, and satisfy . Thus is a convex combination of extreme points. This is clopen sign approximation in the real Cantor unit ball, proving
Nevertheless is not weakly compact. The suggested functions lie in and converge pointwise to the function equal to zero at and one at every other point of . It is discontinuous at zero, since tends to zero. If were weakly compact, the sequence, viewed as a net, would have a weakly convergent subnet with limit in . Point evaluations are bounded linear functionals, so that subnet would have the same pointwise limit; its indices are cofinal in the original sequence. The limit would therefore be the discontinuous function just described, a contradiction. This discontinuous pointwise limit obstruction to weak compactness gives the required failure of weak compactness, despite the closed-hull equality.
The preceding perfect matching gives a permutation matrix supported on the positive entries of . Let
If , every row's selected entry is one and all other entries vanish, so . Otherwise
is a doubly stochastic matrix with strictly fewer positive entries. Induct on the number of positive entries: the base case has exactly positive entries and is a permutation matrix. By induction, write as a convex combination. Then
is another convex combination, with nonnegative coefficients summing to one. Thus
This constructive proof of the Birkhoff-von Neumann theorem is Birkhoff decomposition by support matchings.
The weak topology on a normed vector space is , the coarsest topology making every bounded linear functional continuous. A neighbourhood base at is given by finitely many inequalities , with . In the complex case, separation uses real parts of bounded linear functionals.
Mazur theorem states that the weak closure of a convex set equals its closure in the norm topology. The weak topology is coarser than the norm topology, so the norm closure is contained in the weak closure. Conversely, if is outside the norm closure of a convex set , the Hahn-Banach separation theorem gives and with . The corresponding weak topology neighbourhood of misses , so is outside its weak closure. This proves Mazur theorem, including the empty-set case. In particular, if converges weakly to , then is in the weak closure of every tail and therefore in the norm closure of its convex hull. Choosing a finite convex combination of the th tail within of proves the usual Mazur lemma formulation as well.
The weak-star topology on the continuous dual space is : convergence means pointwise convergence on , and a neighbourhood base prescribes finitely many evaluation inequalities. The Banach-Alaoglu theorem states that the closed unit ball of is compact in this weak-star topology, even if is incomplete. Embed this closed unit ball into
where or . Each factor is compact, so is compact by the Tychonoff theorem. Inside , the equations and define a closed set. Every such point defines a linear functional satisfying , hence belongs to the closed unit ball of . Thus this image is closed in . The product topology on it is exactly the weak-star topology, proving Banach-Alaoglu theorem. Evaluations also separate its points, so the weak-star topology is Hausdorff.
For the canonical embedding into the bidual , we have . Restricting all evaluations at therefore gives exactly . Thus the induced subspace topology is the weak topology on .
Now identify with . Let be a bounded convex set, write for its norm closure in , and let be its weak-star topology closure in . Boundedness places in a multiple of the closed unit ball of , so is compact by Banach-Alaoglu theorem. The preceding subspace topology identification and Mazur theorem give
If is a weakly compact set, its image in the Hausdorff weak-star topology is compact and therefore closed. It contains , so . Conversely, if , the displayed identity gives , and its compactness is precisely weak compactness in . Hence . This argument also covers .
For a bounded linear operator , its Banach-space adjoint is , defined by . Evaluation at any fixed is thus evaluation at after applying . Each is continuous in the relevant weak-star topology, proving that is weak-star continuous. Applying the same result to shows that is weak-star continuous. Direct evaluation gives
Use for the closed unit ball; using the open ball gives the same norm closure of . Goldstine theorem says that is weak-star dense in . Put . It is compact and closed in the weak-star topology by Banach-Alaoglu theorem and the established continuity. It contains . Conversely, Goldstine theorem gives, for every , a net from converging weak-star to ; its image converges weak-star to . Consequently
Apply the preceding bounded convex set criterion in , and then scale the closed unit ball. We obtain the bidual characterization of weakly compact operators:
The canonical embedding into the bidual on the right specifies exactly which copy of is intended.
All vector spaces in this solution are complex, while convex combinations use real coefficients. An extreme point of a convex set is one for which , and , forces . Equivalently, is not the midpoint of two distinct points of .
The Krein-Milman theorem says that every nonempty compact convex set in a Hausdorff locally convex space is the closed convex hull of its extreme points. Here is a proof. A face of a convex set is a convex set such that whenever an interior point of a segment in belongs to , both endpoints belong to . Consider nonempty compact faces, ordered by reverse inclusion. A chain has nonempty intersection by compactness and the finite intersection property; that intersection is again a compact face. The Zorn lemma therefore gives a minimal nonempty compact face .
If contains distinct , a continuous real linear functional on the underlying real locally convex space distinguishes them. Such a linear functional exists because the space is Hausdorff and locally convex, by the Hahn-Banach theorem. The maximizers of on form a nonempty proper compact face of . A face of a face is a face of , contradicting minimality. Therefore is a singleton, yielding an extreme point. The same argument inside any nonempty compact face of supplies an extreme point of lying in that face.
Let be the closed convex hull of the extreme points of . It is a nonempty closed subset of compact , hence compact. If , the Hahn-Banach separation theorem provides a continuous real linear functional with . Its maximizer set on is a nonempty compact face, which contains an extreme point of . But and , a contradiction. Thus , proving Krein-Milman theorem.
For a nonempty compact Hausdorff space , the extreme points of the dual unit ball of C(K) are
This is the permitted description without proof, with denoting the complex space of continuous functions on a compact space equipped with the supremum norm. If is empty, and the closed unit ball of its continuous dual space has the single extreme point instead.
The complex Banach–Stone theorem states that a surjective complex-linear isometric isomorphism of normed spaces has the form
where and is a homeomorphism. Conversely, every such map is a surjective complex-linear isometric isomorphism of normed spaces for the supremum norm.
To prove this, suppose first that are nonempty. The Banach-space adjoint is a bijective isometric isomorphism of normed spaces on the continuous dual spaces, so it bijects their closed unit balls and preserves extreme points. The displayed extreme point description gives uniquely
Uniqueness follows by evaluating at the constant function , and then using that continuous functions separate points of a compact Hausdorff space. Evaluation gives the required formula for , and is continuous. Surjectivity of on extreme points proves surjectivity of : the preimage of any is for some . If , every function in the range of has equal values at these two points after division by ; surjectivity of and separation of points force . Thus is bijective.
For every , is continuous. The evaluation map , , is a continuous injection of a compact Hausdorff space into a Hausdorff product topology, hence a homeomorphism onto its image. Continuity of every coordinate proves continuity of . A continuous bijection between compact Hausdorff spaces is a homeomorphism. Conversely the weighted-composition formula plainly preserves the supremum norm, and its inverse is
If one compact space is empty, a surjective isometric isomorphism of normed spaces forces the other to be empty, and the empty homeomorphism gives the corresponding trivial case. This completes Banach–Stone theorem.
Neither the space of sequences converging to zero nor can be isometrically a continuous dual space of a Banach space. Indeed, every nonzero continuous dual space has a nonempty weak-star compact closed unit ball by Banach-Alaoglu theorem, and Krein-Milman theorem then guarantees an extreme point. A bijective linear isometry preserves extreme points of closed unit balls.
The closed unit ball of has no extreme points. Given with , choose with and . The two distinct elements remain in that closed unit ball and have midpoint .
The closed unit ball of the complex Lp space also has no extreme points. An element of norm less than one can be perturbed by a sufficiently small nonzero Lp space element in both directions. If , the non-atomic measure admits a measurable set of mass ; for example the continuous function attains . Put . For , the distinct functions both have Lp norm
with the two coefficients interchanged for the minus sign. Their midpoint is . Thus neither proposed space is isometrically a Banach dual.
Finally, is a connected space, whereas is disconnected. They cannot be homeomorphic. By Banach–Stone theorem, and are not isometrically isomorphic as complex Banach spaces.
For a convex subset of a Banach space, weak closure equals norm closure. The Mazur theorem states that for every convex set ,
Since every bounded linear functional is norm-continuous, the weak topology is weaker than the norm topology, giving .
For the reverse inclusion, use this form of the Hahn-Banach separation theorem: if is a nonempty norm-closed convex set in a real normed vector space and , there is a continuous real-linear functional such that
Apply it to . In a complex Banach space, use the underlying real space; every continuous real-linear is the real part of the complex bounded linear functional . The separating strict inequality gives a neighbourhood open for the weak topology of disjoint from , so . The empty set case is immediate. This proves the Mazur theorem.
A weakly null sequence has disjoint convex blocks converging to zero in norm. If , then for every starting index ,
The Mazur theorem places in the norm closure of that tail convex hull. Thus a finite convex combination of vectors from any tail can have norm less than any prescribed .
Choose the convex blocks recursively. After selecting the previous terminal index , let , and choose a finite convex combination from with norm less than . Choose beyond its largest used index, padding the intervening coefficients and the final coefficient with zero. This ensures the printed strict condition as well as . Setting unused coefficients to zero yields
Therefore in norm. The recursive tail selection is what makes these convex blocks, rather than merely unrelated convex combinations.
Next suppose is separable and is bounded. Use the canonical embedding into the bidual , where . If , then . The Banach-Alaoglu theorem makes this ball compact in , and weak-star metrizability of the dual ball makes it metrizable because its predual is separable. A compact space that is a metric space is sequentially compact, so some subsequence satisfies
The limit need not belong to ; it is precisely the use of the bidual space that supplies compactness without assuming reflexivity.
For a convex block , every satisfies
Both and tend to , so
This is the useful convex-block cancellation of a weak-star limit; it does not require the limit to be a vector in .
The quotient sequence has approximate lifts in that are weakly null after passing to a subsequence. Let be the quotient map, with the quotient norm. Since , choose such that
This uses the infimum defining the quotient norm and does not assume that it is attained. By the preceding compactness argument, pass to a subsequence with a common weak-star limit in . Its quotient images form a weakly null sequence.
Apply the convex block construction to in the quotient Banach space. Using the same coefficients on gives convex blocks
Set . The convex-block cancellation of a weak-star limit proves , while
Thus the approximate weakly null lifting through a quotient is achieved with the required bound:
For , an averaged operator has the form
for some nonexpansive mapping , meaning for all . The word averaging refers to a convex combination with the identity. It does not mean averaging function values over a neighborhood.
An equivalent and useful averaged-operator inequality is
To see it, put and and expand
Use and . Conversely, substituting into the same expansion proves its nonexpansiveness from the displayed inequality. The strict range matters for convergence of unrelaxed iterations: a general nonexpansive mapping such as can have nonconvergent alternating iterates.
For a fully discrete linear partial differential equation evolution, write in a specified discrete norm. Finite-time stability of a numerical method means
with independent of the allowed meshes. For a multistep method, augment the state with its time-history values and include a stable starter. Bounds may grow as when the continuous problem has growth; demanding decay for all time would be a stronger assertion. The treatment of initial data, forcing, Dirichlet boundary conditions, and the norm is part of the hypothesis, not a detail supplied by an interior calculation.
For constant coefficients on an infinite or periodic uniform grid, Von Neumann stability analysis substitutes the Fourier mode . The discrete Fourier transform and the Parseval identity turn a uniform multiplier estimate into a discrete L2 norm estimate. In a one-step scalar scheme, proves contractivity, while gives finite-time stability. In a multilevel scheme, every root of a polynomial in its amplification polynomial of a multilevel finite difference scheme matters, as does uniform control of the associated companion matrix.
For the Forward Euler diffusion scheme with ,
Thus for all frequencies exactly when
Sufficiency follows since ; necessity follows from the highest-frequency mode on even periodic grids. This gives the usual parabolic mesh restriction . For the Backward Euler diffusion scheme,
so every is stable. The Crank--Nicolson method has
again of modulus at most one for all , but stiff modes approach rather than zero. These are PDE manifestations of the A-stability and L-stability distinctions for time integration.
For advection , assume and set . The upwind finite difference scheme is , with
It is contractive when . This also has a direct maximum-norm proof: each newest value is a convex combination of two old values. The resulting Courant–Friedrichs–Lewy condition expresses that the numerical domain of dependence covers the physical one. For negative , the upwind direction must be reversed. By contrast, Forward Euler method time stepping with the centered first finite difference has and for nonzero . Under fixed nonzero refinement it is unstable, since a fixed nontrivial mode grows geometrically over steps. This is not a claim of instability under every imaginable mesh coupling: instead bounds its spurious finite-time growth, since .
The leapfrog advection scheme illustrates a multilevel subtlety. Its amplification polynomial of a multilevel finite difference scheme is
For , both roots of a polynomial have unit modulus and separation at least . A uniformly conditioned eigenbasis of the companion matrix then proves power boundedness of a two-level Fourier scheme for arbitrary history data. At and a grid admitting , the roots coincide on the unit circle, and a Jordan block produces growth. Thus the endpoint fails the ordinary arbitrary-history root condition for a multistep method; checking only that both moduli equal one misses the instability. Restricting the starter or filtering the parasitic mode is an additional hypothesis.
The energy method handles variable coefficients and finite boundaries for which Fourier stability analysis may be unavailable. For the Backward Euler diffusion scheme with homogeneous Dirichlet boundary conditions, define . The discrete summation by parts identity is
Take the inner product of with . The elementary identity gives
This proves unconditional contractivity including the actual boundary treatment. More generally, a dissipative operator gives of operator norm at most one: with , dissipativity implies , and the Cauchy-Schwarz inequality gives . In finite dimensions this also proves invertibility. For the second-order backward differentiation formula, the BDF2 discrete energy identity used in question 4 controls both time levels and proves unconditional diffusion stability. A repeated root strictly inside the disk is harmless here; the energy argument supplies the uniform bound without a singular eigenvector formula.
A second technique is eigenvalue stability analysis of a finite difference method. Under the method of lines, a time integrator advances by . If is a normal matrix, the scalar linear stability domain criterion on all controls its powers exactly in the corresponding L2 norm. For the centered Dirichlet discrete Laplacian, its eigenvalues lie between and zero; intersecting this interval with a time integrator's stability interval determines its mesh restriction. A uniform bound on the diagonalization of a matrix is needed for nonnormal diagonalizable systems. Eigenvalues alone can be misleading. For example,
has both eigenvalues inside the disk for , but the upper-right entry of is . Taking , , this grows like . Hence stable scalar eigenvalues do not give mesh-uniform stability. Boundary closures can introduce precisely the extra growth that an interior Fourier symbol overlooks, so boundary stability of a finite-difference method must be checked separately.
For nonlinear spatial discretizations, a useful replacement for Fourier stability analysis is a convexity argument. If the Forward Euler method map is nonexpansive in a chosen norm for , the second-order strong stability preserving Runge-Kutta method
is also nonexpansive under the same restriction. Indeed, for two inputs, the triangle inequality gives . Its Taylor expansion is , proving order two. Such strong stability preserving Runge-Kutta methods transfer suitable forward-step bounds without relying on a linear spectral calculation.
Finally, consistency of a numerical method explains what stability buys. For a linear Hadamard well-posed problem, the Lax equivalence theorem equates convergence of a consistent discretization with its stability, under the stated approximation-space and norm hypotheses. Directly, if the error satisfies , iteration gives the discrete Duhamel principle
Thus vanishing normalized local truncation error and initial error yield convergence. With a nonlinear Lipschitz step estimate, the discrete Gronwall inequality plays the same role. A stable but inconsistent stencil, such as the literal defective formulas in questions 3 and 4 under their usual refinement, is not rescued by any amplification bound. The decisive checks are a mesh-uniform evolution bound, a valid boundary closure, and consistency with the actual PDE.
A function is a convex function when
for every and .
Fix , , and . Since the value function is finite, choose with
For the convex combination , convexity of gives
so is feasible for the intermediate right-hand side. Convexity of then gives
Letting proves
so is convex.
The Hahn-Banach separation theorem for two convex sets states that disjoint nonempty convex sets in a real locally convex space, with open, admit a nonzero continuous linear functional and such that
There need not be a positive uniform gap between the two sets.
For a proof, set . It is open and convex, and . Choose , let , and let be the Minkowski functional of . Because is open, convex and contains zero, is a finite sublinear functional, and . Put . Since , . On define . For this equals ; for it is nonpositive and hence at most . The Hahn-Banach theorem extends it to a linear with . Both and are bounded near zero, so this domination makes continuous; it is nonzero because . For ,
Thus for every . Define , which is finite because any fixed bounds it above. Openness of and nonzeroness of ensure for every , and for every . This proves the stated separation.
For the sequence criterion, suppose and . If each , then
Conversely, the assumed inequality implies that every convex combination of the has norm at least . Hence is disjoint from . Apply the separation theorem with the open set to obtain and
Then has norm one and satisfies for every . Therefore
The PDF confirms the “if and only if” that is garbled in the TeX transcription.
The Mazur theorem states that the weak closure and norm closure of a convex set in a normed vector space coincide:
Norm closure is contained in weak closure because the weak topology is coarser. Conversely, if , the Hahn-Banach separation theorem provides a continuous real linear functional strictly separating from that closed convex set. In a complex space this is the real part of a continuous complex linear functional. A weak neighborhood of then misses , so . This proves the equality. It also gives the usual Mazur lemma: if , then lies in the norm closure of the convex hull of each tail, so one can choose tail convex combinations with .
Now let be a weakly compact set in a normed space . Each is bounded on because it is weakly continuous. The family in , where is the canonical embedding into the bidual, is therefore pointwise bounded. The space is Banach even if is not. Apply the Uniform boundedness principle and use to obtain
This proves that a weakly compact set is norm bounded without assuming completeness of the original space.
For the real-valued dual and integral formulas that follow, take to be real, as in the PDF. In a complex space the norming formula uses real parts, and the integral identities use complex-valued functionals instead.
If the separable Banach space is nonzero, choose a norm-dense sequence in its unit sphere. By the Hahn-Banach theorem, choose with and . For any unit vector , arbitrarily close satisfy
Scaling gives the countable norming family identity
For use the constant sequence of zero functionals. If is norm-Borel measurable, every is measurable, so its countable supremum is measurable. Equivalently, this also follows directly from continuity of the norm.
For any , continuity makes measurable, and
Thus the assumed integrability of the norm implies scalar integrability, and
defines a bounded linear functional on . Use the granted weak-star continuity of . By the continuous dual of a weak-star topology, is evaluation at a vector of . Indeed, continuity gives finitely many and such that whenever for all . Scaling shows that vanishes on the common kernel of these evaluations. It therefore factors through their finite-dimensional coordinate map, so . The Hahn-Banach theorem makes this representing vector unique. Hence
In this separable setting the vector is the Bochner integral.
Return to a weakly compact set and its inclusion . For each fixed , the identity makes weakly Borel measurable. Norm balls are consequently weakly Borel measurable. Separability gives a countable base of such balls, so every norm-open set is weakly Borel measurable. This proves measurability of , and establishes the equality of the weak and norm Borel sigma-algebras in a separable Banach space.
Put . For every finite signed Borel measure on ,
For positive measures this is the integral in the question. For signed measures, the correct integrability condition uses the variation measure; define the integral by taking the difference of the positive and negative integrals. The printed in this clause should be , the domain of the inclusion.
The Riesz-Markov-Kakutani representation theorem now defines the bounded linear map
For each the restriction is in , and
The right side is weak-star continuous in . The defining property of the weak topology therefore proves that is weak-star-to-weak continuous, for arbitrary nets. For a Dirac measure, .
If , let be its regular probability measures. This is a weak-star closed subset of : its conditions are and for every nonnegative . It is compact by Banach-Alaoglu theorem. Thus is weakly compact and convex, and contains because it contains all . It is weakly closed, hence norm closed, so it contains . By Mazur theorem, is weakly closed. Therefore it is a closed subset of the weakly compact set , proving
The empty case is immediate. In fact : a barycenter of a measure on a Banach space outside would be strictly separated by a functional , contradicting .
A feasible point lies in the probability simplex, so is a convex combination of the coordinates of . Hence . Taking a coordinate vector with attains equality. Therefore
More generally, all optimal solutions are exactly the probability vectors supported on the maximizing indices: equality requires for every . Thus ties give an entire optimal face, while a unique maximizing index gives a unique optimizer.
Let . For , express in the Bernstein basis as , where . Its precomputed coefficients are
with the ratio for interpreted as one. The identity follows from , obtained by the binomial theorem.
At this level solve the linear program
There are exactly inequalities. Equivalently, must have nonnegative coefficients in the unnormalized basis; its coefficients are . Since the basis functions are nonnegative and sum to one, every feasible satisfies for all , so .
Degree elevation of Bernstein coefficients gives, for ,
with endpoint coefficients unchanged. These convex combinations imply .
To cover every positive index even when , put . For , use the one-inequality LP , giving . This is a lower bound on ; moreover the explicit coefficient formula has all its factorial ratios in , so . Thus the transition to level is also monotone and every level respects the requested bound of at most inequalities. Constants are handled by the main formula at all positive indices.
Finally, for every , is strictly positive on the interval. Part (c) supplies a nonnegative-coefficient representation at some degree, and degree elevation preserves it at every higher degree. Hence eventually . Combining with the upper bound proves the Bernstein linear programming hierarchy for polynomial minimization: