Work over and take a nonzero commutative unital Banach algebra , with . A character of an algebra is a nonzero multiplicative complex linear functional . It satisfies . Moreover : otherwise would be invertible, although its image under is zero. The bound on the spectrum of an element therefore gives , proving automatic continuity of characters and .
Every proper maximal ideal of is closed. Indeed its closure is an ideal; if this closure were all of , would contain an element within distance less than one of . Such an element is invertible by the Neumann series, forcing . Thus the closure is proper and maximality makes it equal to . The quotient Banach space , with its quotient Banach algebra structure, is a complex normed division algebra. By the Gelfand-Mazur theorem, it is , so the quotient map gives a character of an algebra with kernel . Conversely, the kernel of every character of an algebra is a maximal ideal, since the character is onto . The Zorn lemma supplies a maximal ideal containing every proper ideal, so the character space of an algebra is nonempty.
These facts give the exact relation between the character space and the spectrum of an element:
One inclusion was proved above. For the other, if is noninvertible, the principal ideal it generates is proper because is commutative. Contain it in a maximal ideal and use its corresponding character of an algebra to obtain .
Give the Gelfand topology, namely its subspace topology from the weak-star topology on . In the closed unit ball of , it is the intersection of the closed conditions
Consequently Banach-Alaoglu theorem makes a compact Hausdorff space. For every , define the Gelfand transform . This is a continuous function on by definition of the Gelfand topology. The Gelfand representation theorem gives a contractive unital algebra homomorphism over a field
Multiplicativity and linearity follow by evaluating at each character of an algebra; the supremum norm equality follows from the preceding spectrum of an element identity. Its kernel is
the Jacobson radical. Equivalently, its elements have spectrum of an element . Thus is injective precisely when is a semisimple commutative Banach algebra, and it gives a faithful continuous representation of as a function algebra. Its range contains the constants and separates points of , because distinct characters of an algebra differ on some . An arbitrary Banach algebra need not have an isometric or surjective Gelfand transform, nor a uniformly dense range: those conclusions require further hypotheses.
For the Banach algebra on a nonempty compact Hausdorff space , all characters of an algebra are evaluation characters. To see this, let be a maximal ideal. If its elements had no common zero, compactness would supply with no common zero. The continuous function belongs to , is strictly positive on , and has a continuous reciprocal. It is therefore invertible, a contradiction. Hence all elements of vanish at some , so and maximality gives equality. The associated character of an algebra must be : since , its value on is .
The map is a continuous bijection , using separation of points by continuous functions. Compactness and the Hausdorff property make it a homeomorphism. Under this identification the Gelfand transform is , so it is the identity representation of , in particular an isometric onto map. The empty gives the zero algebra, whose empty character space represents the zero function space; it was excluded by the nonzero unital convention above.
Now let be a commutative unital C-star algebra. The stronger conclusion is the Commutative Gelfand--Naimark theorem: the Gelfand transform is an isometric onto C-star homomorphism . We prove the additional assertions without assuming this conclusion.
First every character of an algebra respects the C-star algebra involution. If , the elements , , are unitary elements of a C-star algebra, and their norm is one by the C-star identity. Continuity and multiplicativity give . Thus for every real , forcing to be real. Writing with and self-adjoint gives . Therefore the range of is closed under complex conjugation.
Every element of commutative is a Normal element of a C-star algebra. For a normal , use the C-star identity, and then the same identity for the self-adjoint element , to obtain
Its powers are also normal, so . The spectral radius formula gives , hence . The Gelfand transform is therefore an isometry, and its range is complete and closed in the supremum norm. It contains constants, separates points and is closed under complex conjugation. The complex Stone-Weierstrass theorem makes that range dense, hence all of .
The approximation step in Stone-Weierstrass theorem can also be seen directly here. For a unital conjugation-closed point-separating subalgebra , the real-valued part of its uniform closure is closed under absolute values, by polynomial approximation to on bounded intervals, hence under pointwise maxima and minima. Its real-valued functions separate points. Given real and , for each an affine rescaling of a separating function produces agreeing with at ; take a constant when . For fixed , finitely many neighbourhoods of where cover . Their maximum exceeds everywhere and agrees with at , hence is less than near . Finitely many of these latter neighbourhoods cover ; the minimum of their lies between and everywhere. Approximate real and imaginary parts separately. This proves the density used above and completes the C-star algebra conclusion.
Every finitely supported sequence lies in : if for , set for and afterwards. Then is a bounded sequence and . Consequently . The finitely supported sequences are dense in the space of sequences converging to zero for the supremum norm, by truncation, so continuity of the bounded linear functional gives . For in the real convergent sequence space, with ordinary limit , we have . Therefore .
We prove compactness of zero-boundary Poisson solutions. Here the printed must mean ; otherwise the boundary condition refers to an unspecified set. Use this intended boundary condition throughout. Let . A maximum-principle barrier gives a uniform bound on : with , we have and on . Since ,
The weak maximum principle gives , so .
Standard elliptic regularity on the smooth ball first gives . The global Schauder estimate then gives
Thus the functions and all their derivatives through order two are uniformly bounded and equicontinuous on the closed ball. The Arzela-Ascoli theorem gives a subsequence converging uniformly along with all these derivatives. Integration along line segments identifies the limiting derivatives, so the convergence is in .
It remains to keep the limit in the set, rather than merely proving relative compactness. If in , then the zero boundary values pass to the limit and uniformly. For each pair of distinct points,
Taking suprema gives , while . Hence . The limit belongs to the set, proving sequential compactness in . The fixed positive Hölder exponent supplies the compactness; a bound on the supremum norm of alone would not supply this argument.
The Baire category theorem in the needed version states that a nonempty complete metric space cannot be a countable union of closed sets with empty interior. To prove it, suppose are such sets and start with a nonempty open set . Inductively choose closed balls of positive radius at most , with and . This is possible because each complement is open and dense. The centres form a Cauchy sequence; completeness supplies a limit in every closed ball. It lies in and outside every , proving the theorem.
Here the sequence spaces are over the real scalars, as required by the Euclidean-plane assertion. Suppose an isometry existed. On the compact complete space , the sets
are closed. They cover that space: for a nonzero sequence in , the supremum norm is attained at a coordinate; for every coordinate works. By the Baire category theorem, one contains a product of open arcs. Shrink the arcs to be disjoint. The real coordinate difference is then continuous and nonzero, so its sign is constant on the product. Thus the chord distance has the separated form
In particular its alternating sum on every four-point rectangle is zero. Parametrize the arcs by angles with . Their chord distance is , whose mixed derivative is
The zero rectangle identity would force this mixed derivative to vanish, a contradiction. Therefore no such isometry exists.
For a real vector , list its signed sums over all choices , followed by infinitely many zero coordinates:
This is linear, has finite support and lies in . Choosing the signs of the components gives . Thus , the required linear isometry.
Use integer graph vertices in the boxes: , and set . Thus , , and for .
If , erase loops from an open graph path to obtain a self-avoiding walk. Let be its first graph vertex on . Split at . The prefix certifies , while a segment of the suffix certifies : the final graph vertex is at supremum norm distance at least from , so the suffix first hits that translated boundary. The two certificates use disjoint edges. Therefore the BK boundary-splitting estimate, the union bound, the van den Berg-Kesten inequality, and translation invariance give
The cases or follow directly from , so this proves the bound including the endpoints.
Here is an explicit way to remove the polynomial boundary factor. For put , . By symmetry in , assume . Then
Consequently is a subadditive sequence. The Fekete lemma states that any real subadditive sequence satisfies , possibly . In this case the direct horizontal open graph path gives , so this limit of a sequence is bounded below by . Since , its upper bound is zero. Finally,
has the same limit of a sequence. Thus the percolation one-arm decay rate exists and
For , every with is zero and . No exponential-decay theorem or assumption that is below the percolation critical probability is needed.
Fix the normalization
The Lasso penalty uses the L1 norm. All arguments below apply to every minimizer; uniqueness of the coefficient vector is not assumed.
The Karush-Kuhn-Tucker conditions are the subgradient optimality condition
These conditions are necessary and sufficient because the objective is a convex function. They use the subgradient of the absolute value, coordinate by coordinate.
Put . Centered columns imply , so the subtraction of in the model contributes nothing to the score. The Karush-Kuhn-Tucker conditions become
Multiply by . Since and , this gives the prediction inequality from Lasso stationarity:
This is the desired version of the Basic inequality for the Lasso. Using stationarity directly preserves the coefficient on the squared prediction norm.
For the Gaussian score event for the Lasso, write for column . The assumed Euclidean norm and the multivariate normal distribution of give
The may be correlated, which does not affect the union bound. Use the following sharp two-sided Gaussian tail bound, valid for with the standard normal distribution and every :
For completeness, the difference satisfies , , and as . It first increases and then decreases to zero, so it is nonnegative. This bound avoids introducing an unnecessary factor two.
Here is the standard normal distribution function. With , the union bound yields
Consequently
The score event uses the supremum norm of ; the centering term still vanishes because .
We next work deterministically on . Let
By Holder inequality, . Since , the triangle inequality gives
Substituting both inequalities into the Basic inequality for the Lasso produces
Because , this also proves the relevant Lasso cone condition, . The assumed Compatibility condition for the Lasso therefore applies to :
Set . Combining these inequalities gives
If , discarding the nonnegative term shows . If , compatibility gives , and the preceding inequality then gives . In either case , so
This is a fast prediction bound and an inactive-coordinate error bound on the same event. It is the fast-rate Lasso prediction bound under compatibility.
Finally, the same argument bounds the active-coordinate L1 norm by
If , then , and . When this implies ; when it implies . Thus the sign function obeys
This is Lasso sign recovery under compatibility. It concerns the sufficiently large nonzero coefficients; it does not assert that every estimated inactive coefficient is zero.
For the constant monomial , the binomial theorem gives . For , the binomial coefficient identity gives
Thus , including by evaluation of the polynomials.
For and , substitute the preceding coefficient identity into the Bernstein polynomial sum and write . This yields the Bernstein monomial recurrence
The coefficients are nonnegative and sum to ; and the others tend to zero. The weights in any Bernstein polynomial sum are nonnegative and sum to , so . Induction on therefore gives : the term has that limit and the other finitely many terms vanish. In fact, the same estimate in the supremum norm proves uniform convergence on .
As an independent quantitative bound, take a binomial distribution variable with parameters . Then . On , factoring the difference of powers gives ; the Cauchy-Schwarz inequality and the variance of give
For the error is exactly zero. Finally the requested sum equals , so
The unheaded preliminary requests are addressed before the first example. A norm is a function satisfying exactly for , , and . Its induced metric is . Translation preserves this distance, and scalar multiplication satisfies , so both are continuous; multiplication by zero is constant.
The open unit ball determines the norm uniquely through its Minkowski functional:
because is equivalent to . This also works for .
Under the given radial and convexity hypotheses, set and for . The finite symmetric segment along each line gives positivity, absolute homogeneity and . If and , then , and the stated convexity condition yields . Hence ; taking and proves the triangle inequality. Thus this is a norm determined by a convex radial unit ball. The case is immediate.
For the coordinate box, the Minkowski functional is the supremum norm:
Indeed exactly when .
Use the paper's classical norm convention: is the derivative supremum norm through order two, not an norm. Write and , where the latter is the full Hölder norm of the forcing.
Fix . If the asserted estimate failed, rescaling the functions by their global Hessian matrix Hölder seminorm would produce with
In particular . Choose for which
The supremum norm of tends to zero, so . Let be the quadratic Taylor polynomial of at , and define
The domains contain , and vanish at zero. Moreover
The right side is bounded by and tends to zero locally uniformly. The normalized Hessian matrix bound controls ; integration along line segments then bounds on every compact Euclidean ball. Arzela-Ascoli theorem and a diagonal subsequence argument give convergence in on compact subsets to an entire harmonic function , with and .
After a further subsequence with . The normalization ensures . But each second derivative of is harmonic and has finite global Hölder seminorm with exponent below one. The supplied Liouville theorem makes each derivative constant; it is the globally Hölder case of the polynomial-growth Liouville theorem for harmonic functions. Its value at zero makes it zero, a contradiction. This blow-up compactness proof of an interior Schauder estimate establishes
To absorb the term on the larger Euclidean ball, rescale this estimate to Euclidean balls contained in . For , pairs separated by less than are controlled in a Euclidean ball centred at their first point; farther pairs are controlled directly by . Thus
This is the covering step in the Simon absorption lemma. Take and fix . Iterating makes the remainder tend to zero, since the global seminorm is finite; the error terms form a convergent geometric series. Consequently
For the requested failure of the weaker estimate, take and . The derivative supremum norm and remain bounded, but comparison at and , both in for large , gives
This proves the necessity of Hölder forcing for Schauder estimates. Every member of the sequence is smooth; failure comes from the increasing frequency, not from any lack of individual regularity.
On continuous functions on the p-adic integers, define the forward difference operator and the Mahler coefficients by
Writing , the explicit iterate follows from . The ultrametric inequality and integral binomial coefficients imply and , where the supremum norm is taken over .
The Mahler theorem states that every such has a unique expansion with uniform convergence
Conversely, every sequence in tending to zero yields a continuous function by this expansion. The binomial polynomials form an orthonormal expansion in the non-Archimedean sense: .
Here is the requested proof under the permitted coefficient-decay assumption. For , the binomial polynomial is a continuous function on . Its values on nonnegative integers are integral, and those integers are dense in the p-adic integers. Since is a closed set in , . Also , so , including .
If , the ultrametric inequality gives the uniform tail bound
Completeness of gives a uniform limit , and the uniform limit theorem makes continuous. At any nonnegative integer , all with vanish. Finite binomial inversion gives
since the inner sum is . Hence on a dense subset and therefore on all of . The values at recover each coefficient recursively because ; this proves uniqueness. The expansion bounds by , and the earlier coefficient inequality proves equality. This also proves the converse statement.
Although the problem allows us to assume decay, it can be established independently. By compactness and uniform continuity, approximate uniformly by constant on residue classes modulo . On this finite-dimensional space, and
The matrix of has entries divisible by , so its operator norm is at most ; consequently for . Thus . Since , arbitrary uniform approximation proves automatic decay of Mahler coefficients.
For the last claim, construct the discrete antidifferentiation on the p-adic integers
Its coefficient sequence is , still tending to zero, so it is continuous. By Pascal's identity, . The boundedness of permits applying it to the uniform limit, giving . For the stated linear map, invariance under translation by one now gives
Thus translation-invariant linear forms on p-adic continuous functions vanish:
No continuity of has been assumed or used. In particular, one must not justify this by applying termwise to an infinite Mahler expansion; it is the existence of a continuous discrete antiderivative that makes the conclusion valid.
Put , the uniform bound on the supremum norm of the gradient. The fundamental theorem of calculus on a line segment, together with the inner product inequality , gives
Thus is Lipschitz continuous with respect to the L1 norm. The Gaussian random variables comprising and have finite exponential moments of their absolute values. More explicitly, for , Hölder's inequality gives . Consequently and every exponential expression below are finite, including when the covariance matrix is singular.
Use the convex function . Since is an independent copy of , Jensen inequality for the conditional expectation gives
For , define the Gaussian rotation of independent copies
Writing , both rotated covariance matrices are and their cross-covariance is zero. The pair has a centered multivariate normal distribution, so its components are independent and has the same probability law as . This calculation uses no inverse of and therefore also proves the assertion for degenerate multivariate normal distributions.
The path runs from to . The chain rule and the fundamental theorem of calculus give the pathwise identity
Apply Jensen inequality to the uniform probability measure on . Then use Tonelli theorem and the Gaussian rotation of independent copies to obtain
This proves the Gaussian rotation interpolation inequality in the required form:
The stated almost-sure domination now gives an exponential moment of an absolute standard normal variable bound. If , completing the square in the standard normal density yields
where is the standard normal distribution function. Hence Markov inequality gives, for every ,
The exponent is minimized at . Therefore the resulting Gaussian tail bound is
No independence of from or is needed: only the given almost-sure domination is used.
The Commutative Gelfand--Naimark theorem states that a complex commutative unital C-star algebra is isometrically star-isomorphic to through its Gelfand transform, with a compact Hausdorff space. The l-infinity sequence space is such an algebra under coordinatewise multiplication and conjugation, with the supremum norm. Therefore
gives the required isometric isomorphism.
Uniqueness as a Banach space representation uses the Banach–Stone theorem, rather than just uniqueness as an algebra representation. To justify the relevant theorem, the Riesz-Markov-Kakutani representation theorem gives
the extreme points of the dual unit ball of C(K). A norm-one measure whose variation measure is not concentrated at one point splits into two normalized restrictions to disjoint sets of positive variation, and so is not extreme. Conversely, equality in the variation bound shows that any decomposition of into the average of two dual-unit-ball elements forces both to be : after removing the phase, the two measures must be positive and their average is concentrated at .
If is a surjective linear isometry, its dual map preserves these extreme points and their scalar orbits. Hence for a bijection and . Evaluating at gives the continuous function , while
shows that is continuous, since continuous functions determine the topology of a compact Hausdorff space. It is consequently a homeomorphism. Thus any other compact space representing is homeomorphic to this . The Banach–Stone theorem is also stated in Leonard Tomczak's notes on András Zsák's functional analysis lectures.
Embed by the evaluation characters . They are distinct because the coordinate indicator functions distinguish them. Moreover, , so every character has . If , then
and hence . It follows that is open in . Thus is a homeomorphism from the discrete natural numbers onto its image.
To prove density, suppose . The Urysohn lemma provides a nonzero vanishing on . Write . Then for all , so and , a contradiction. Every bounded function is an element of , and is its continuous extension to . Density makes this extension unique. Therefore
This identifies with the Stone-Čech compactification of the natural numbers.
For the first norm-one assertion, use the usual unital Banach algebra convention . A character of an algebra is a nonzero complex linear multiplicative functional, initially without any continuity assumption. It satisfies , since otherwise for every . Moreover, cannot be invertible: applying to an inverse identity would give . Thus
This proves automatic continuity of characters and . Evaluation at the normalized identity gives the reverse inequality, so
If a convention permits , only follows in general: on with norm , the identity character has norm . The later completion argument needs only the upper bound.
If is invertible, , so every character is nonzero on . Conversely, if is not invertible, its principal ideal is proper and lies in a maximal ideal by Zorn lemma. The ideal is closed: if its closure were the whole algebra, it would contain with , making invertible by the Neumann series, which is impossible for a proper ideal. Maximality therefore gives . The quotient is a complex Banach division algebra, hence is by the Gelfand-Mazur theorem. The quotient map yields a character vanishing at . Consequently
Now let . Its evaluation characters give the map . Every character has this form. Indeed, its kernel is a proper ideal. If the functions in that kernel had no common zero, compactness would give finitely many in the kernel with no common zero. Then belongs to the kernel and is everywhere positive, hence is invertible in , a contradiction. At a common zero , the fact that belongs to the kernel gives for every . Continuous functions distinguish points of the compact Hausdorff space , so the map is bijective. It is continuous for the Gelfand topology, and the compact-to-Hausdorff continuous bijection theorem gives
For the norm comparison is trivial; assume henceforth that .
Let be the completion for the other algebra norm . It remains commutative and unital, with embedded densely. The restriction of any is a nonzero character of , since it takes to , and is automatically continuous for the original supremum norm. Thus maps into . It is injective because two continuous characters agreeing on the dense subalgebra agree on , and it is continuous because each coordinate is weak-star continuous.
The character space is weak-star compact even if its identity was not normalized: the spectral bound puts all its characters in , and the conditions , define a weak-star closed set. Apply Banach-Alaoglu theorem. Consequently is a homeomorphism onto a closed subset .
Suppose . The compact Hausdorff space is normal, so choose an open with . By the Urysohn lemma, choose with and on , and choose with on and on . Then . Every character of restricts to evaluation at a point of , so . The invertibility criterion proved above makes invertible in . Multiplying by in gives , contradicting . Therefore and is onto .
For each , choose a character extending . Its spectral bound gives
Taking the supremum over proves the minimality of the supremum norm on C(K):
Let with the supremum norm. By equivalence of norms in finite dimensions, there is such that whenever . Hence
so . This upgrades convergence on fixed polynomials to operator norm convergence on the fixed space.
For sufficiently large , , and a Neumann series gives
Thus the inverse Bernstein approximation on a fixed-degree polynomial space satisfies . By the extreme value theorem, strict positivity on the compact interval gives . Eventually , and consequently
Applying pointwise convergence to the varying polynomials without this finite-dimensional operator argument would not justify the conclusion.
A sequence of functions converges uniformly to when, for every , there is an such that
for every . Equivalently, in the supremum norm.
Yes. Fix and . Uniform convergence gives such that for every . Since the continuous function is continuous at , there is a such that implies . The triangle inequality then gives
This proves the uniform limit theorem: is continuous.
For , the triangle inequality and the Cauchy-Schwarz inequality give
Thus is a continuous function. The unit sphere in the finite-dimensional Euclidean normed vector space is compact. Moreover, implies that the polynomial vanishes identically, so every coefficient is zero. Hence is strictly positive on the unit sphere. By the extreme value theorem, it has a positive minimum
The supremum norm is homogeneous. For ,
It follows directly that whenever .
For a function space on a set and a point , the point evaluation functional is . It is bounded on with the supremum norm.
A polyhedral uncertainty set is specified by finitely many linear inequalities. The displayed centered example is the inverse image of a box under a linear map. It is nonempty because it contains , and contains every line with . Consequently it need not be bounded when is rank deficient. Its supremum norm constraint is equivalent to .
For a random walk with centered independent identically distributed increments of variance one, the maximum of its polygonal interpolation is the maximum at its grid vertices. The maximum functional is Lipschitz for the supremum norm, so the continuous mapping theorem applied to the Donsker invariance principle proves the displayed convergence in distribution. The Brownian reflection principle then gives upper-tail limits at all , since the limiting maximum has no atom there.