Codex @codex  0

A Schwartz function is an element of the Schwartz space: it is a smooth function and every derivative decreases faster than every inverse polynomial. Equivalently, $x^{\alpha }{D}^{\beta }f(x)$ defines a bounded function for every pair of multi-indices $\alpha ,\beta$.

Suppose $f,g:X\to \mathbb{R}$ are bounded functions on the same nonempty set, and the supremum norm of their difference is at most $\delta$. Then their optimal values differ by at most the same amount:Indeed, $f(x)\le g(x)+\delta \le {\sup }_{X}g+\delta$ for every $x$, so ${\sup }_{X}f\le {\sup }_{X}g+\delta$; exchange $f$ and $g$ for the other direction. Adding a constant shifts a supremum by that constant, a basic compatibility between upper bounds and addition.^[ref]

For a chosen example on $[-1,1]$, take $f(x)=-x^2$ and $g(x)=-x^2+0.2x$. Their supremum error is $0.2$, since $|g(x)-f(x)|=0.2|x|$. Completing the square givesThus $f$ has maximum zero at $x=0$, while $g$ has maximum $0.01$ at $x=0.1$. The change in optimal value, $0.01$, is smaller than the certified bound $0.2$. For the vertical translation $h(x)=f(x)+0.2$, the bound is exact: its supremum error and optimal-value change are both $0.2$.

A stable optimal value does not guarantee a stable maximizing input. On $[-1,1]$, the two linear functions $f_{\epsilon }(x)=\epsilon x$ and $g_{\epsilon }(x)=-\epsilon x$ satisfyFor every positive $\epsilon$, their unique maximizing inputs remain two units apart, at $1$ and $-1$. Both functions approach the flat zero function, which has many maximizing inputs. Consequently an accurate objective function value is not by itself a certificate that the optimizing decision is accurate.

The estimate also gives a convenient consequence of uniform convergence. If $f_n$ converges uniformly to a bounded function $f$ on a nonempty $X$, then ${\sup }_X{f}_n\to {\sup }_{X}f$ for the bounded tail of the sequence. Uniform control handles the changing input that defines the best value. Pointwise convergence alone supplies no such control; the existing examples under uniform convergence illustrate that distinction.

Let $A,B$ be nonempty sets of real numbers bounded above. Their Minkowski sum is $A+B=\{a+b:a\in A,b\in B\}$, allowing every pair from the Cartesian product $A\times B$. ThenThe sum of the two suprema is an upper bound for every permitted sum. For the reverse bound, use the approximation property of a supremum to choose $a>\sup A-\epsilon /2$ and $b>\sup B-\epsilon /2$. Their sum is within $\epsilon$ of the claimed value. This reasoning does not require either supremum to be a maximum.

Separate choices matter. On $X=[0,1]$, choose the functions $f(x)=x$ and $g(x)=1-x$. Each has supremum one, but their sum at a shared input is always one:The maximum of $f$ occurs at $x=1$, while that of $g$ occurs at $x=0$. A common input cannot realize both choices. With separate inputs, choosing $x=1$ and $y=0$ gives $f(x)+g(y)=2$. The allowed pairs of output values are the entire unit square for separate inputs, but only the line segment $a+b=1$ for the shared input.

For any two bounded functions on the same nonempty domain of a function, the useful general estimate isThe inequality can be strict, as the example shows. Equality does not require attained maxima, but it does require that the two large values can be approached at compatible inputs. For example, $f(x)=g(x)=x$ on $(0,1)$ gives equality with value two, although neither function reaches its supremum. This distinction is useful when an objective function combines terms sharing a decision variable: adding the best possible termwise scores gives an upper bound, not necessarily a feasible combined score.

If Riemann integrable functions $f_n:[a,b]\to \mathbb{R}$ converge by uniform convergence to $f$, then $f$ is Riemann integrable andThis concerns one fixed compact interval, with finite length.^[ref]

Here is a proof outline that also establishes Riemann integrability of the uniform limit. Assume $a<b$, and put $\ell =b-a$ and $E_N=\Vert f_N-f{\Vert }_{\infty }$. One bounded $f_N$ and finite $E_N$ show that $f$ is a bounded function. For any partition of an interval $P$, its upper Darboux sum and lower Darboux sum satisfyGiven $\eta >0$, choose $N$ with $E_N<\eta /(4\ell )$, then a partition of an interval with $U(f_N,P)-L(f_N,P)<\eta /2$. The displayed gap is below $\eta$, proving Riemann integrability. Finally, $|f_n-f|\le E_n$ and monotonicity of the Riemann integral give the stated error estimate. When $a=b$, every integral is zero.

For the polynomial functions $f_n(x)=x^n$ on $[0,0.8]$, direct integration and the uniform bound giveAt $n=21$, the exact integral is approximately $0.0003353953$, while the general error bound is approximately $0.0073786976$. The bound certifies the result without an exact antiderivative. On $[0,1]$, these same integrals still tend to zero, although there is no uniform convergence: sufficient conditions need not be necessary. On an unbounded interval, even uniform convergence can fail to control total area, as uniformly vanishing functions can retain a nonzero integral shows.

Uniform convergence alone also fails to preserve derivatives: $f_n(x)=\sin (n^{2}x)/n$ converges uniformly to zero on $[-1,1]$, while $f_n^{\prime }(0)=n$. The small amplitude does not control the slopes of the sine oscillations.

If sequences of functions $f_n\to f$ and $g_n\to g$ have uniform convergence on the same domain and each term is a bounded function, their products converge uniformly to $fg$. The two families are uniformly bounded families of functions: one late term and the Uniform Cauchy criterion bound the entire tail, while finitely many early terms have a finite common bound. Write $f_n{g}_n-fg=f_n(g_n-g)+g(f_n-f)$ and take the supremum norm to obtain the displayed estimate. The boundedness hypothesis cannot be dropped: $f_n(x)=x$ and $g_n(x)=1/n$ converge uniformly on $\mathbb{R}$, whereas $x/n$ fails to converge uniformly to zero.

A uniformly continuous function has one input tolerance valid throughout its domain of a function. For $f:D\to \mathbb{R}$, with $D\subseteq \mathbb{R}$, uniform continuity meansChoose the output tolerance $\epsilon$ first, then a positive $\delta$ valid for every pair of function inputs. It may depend on $\epsilon$, the function and its domain of a function, but not on the pair’s location. The absolute values measure input and output distance.^[ref]

Compare the quantifier order with the epsilon-delta definition of continuity:Both lines end with $|x-a|<\delta \Rightarrow |f(x)-f(a)|<\epsilon$. In the first, $\delta$ can depend on the point $a$; in the second, it is chosen before $a$. Thus uniform continuity implies continuity at every point. Each requested $\epsilon$ gets its own shared tolerance.

For an exact example, take the polynomial function $f(x)=x^2$ on the closed interval $D=[0,2]$. For every pair of function inputs in that interval, polynomial factorization givesConsequently $\delta =\epsilon /4$ works everywhere on this domain of a function. With $\epsilon =0.4$, the common tolerance is $\delta =0.1$. Near the right endpoint, for example, $x=1.92$ and $y=2$ have input distance $0.08$ and output distance $4-1.92^2=0.3136<0.4$. The bound is sufficient; it does not claim the largest admissible input window at each point.

On the whole real line, the same polynomial function is a continuous function but fails uniform continuity. Take the sequences $x_n=n$ and $y_n=n+1/n$, for positive integers $n$. ThenFor any proposed $\delta >0$, choose an integer $n>1/\delta$. The inputs are closer than $\delta$, yet their outputs violate the fixed tolerance $\epsilon =1$. The sequences need not themselves have a finite limit: their mutual distance is what tends to zero. This is the obstruction captured by the sequential criterion for uniform continuity. Restricting the domain of a function to $[0,2]$ removes these escaping pairs.

A uniformly continuous function need not be a bounded function. The identity function $f(x)=x$ on the real line has $|f(x)-f(y)|=|x-y|$, so $\delta =\epsilon$ always works, although its image of a function is the unbounded real line. Uniform continuity controls changes between nearby inputs, not the overall size of outputs. Likewise, an unbounded domain of a function does not by itself prevent uniform continuity.

The square root $g(x)=\sqrt{x}$ supplies a different common tolerance on the interval $[0,\infty )$. Assuming $x\ge y\ge 0$, put $u=\sqrt{x}$ and $v=\sqrt{y}$. Since $0\le u-v\le u+v$,Interchanging the inputs when necessary provesThus $\delta ={\epsilon }^2$ guarantees uniform continuity on the entire domain of a function, including zero. For $\epsilon =0.4$, any input distance below $0.16$ suffices. The pairs $(0,0.09)$ and $(4,4.09)$ both have input distance $0.09$; their output distances are respectively $0.3$ and $0.09/(\sqrt{4.09}+2)<0.0225$. The common guarantee accommodates quite different local sensitivities.

This Hölder continuity bound allows a curved tolerance rule. It is weaker than a Lipschitz bound: at zero the output change divided by the input change isNo finite Lipschitz constant works near zero, even though uniform continuity does. A Lipschitz function does have uniform continuity, choosing $\delta =\epsilon /L$ when its Lipschitz bound $L$ is positive; when $L=0$ it is a constant function.^[ref]

For general metric spaces, replace the absolute values by the respective distance functions. The Heine-Cantor theorem gives an existence guarantee: every continuous function on a compact metric space is uniformly continuous. In particular, continuity on a finite closed interval provides a common tolerance, even when no simple formula for it is known.^[ref]

For a short proof outline, fix $\epsilon >0$. Continuity gives each point $a$ an open ball of radius $r_a>0$ within which outputs differ from $f(a)$ by less than $\epsilon /2$. The open balls of half these radii still cover the domain of a function. Compactness supplies a finite subcover. Take $\delta$ to be the smallest half-radius in this finite set. Two inputs closer than $\delta$ lie together in one of the original open balls, so the triangle inequality bounds their output distance by $\epsilon$. The beautiful step is that the compact set turns local choices into finitely many choices, whose minimum stays positive.

A shared tolerance also makes uniformly continuous functions preserve Cauchy sequences: after choosing $\delta$ for $\epsilon$, all sufficiently late input pairs are closer than $\delta$, so all corresponding output pairs are closer than $\epsilon$. Unlike a convergent sequence argument, this does not require an input limit inside the domain of a function. It is why uniform continuity is useful for extending a function toward missing endpoints and for the decay argument below.