Supremum ($\sup$)

For a nonempty set $A\subseteq \mathbb{R}$, a real number $s$ is its supremum precisely when it is an upper bound and no smaller real number is an upper bound. It is unique: two least upper bounds must each be no greater than the other.

For $A=(0,1)$, every number at least one is an upper bound, and none smaller than one bounds the whole set. Thus $\sup A=1$, although $1\notin A$. For $A=[0,1]$, that same supremum is also the maximum. The approximation property of a supremum supplies witnesses arbitrarily close to an unattained upper edge.

Let $A,B$ be nonempty sets of real numbers bounded above. Their Minkowski sum is $A+B=\{a+b:a\in A,b\in B\}$, allowing every pair from the Cartesian product $A\times B$. ThenThe sum of the two suprema is an upper bound for every permitted sum. For the reverse bound, use the approximation property of a supremum to choose $a>\sup A-\epsilon /2$ and $b>\sup B-\epsilon /2$. Their sum is within $\epsilon$ of the claimed value. This reasoning does not require either supremum to be a maximum.

Separate choices matter. On $X=[0,1]$, choose the functions $f(x)=x$ and $g(x)=1-x$. Each has supremum one, but their sum at a shared input is always one:The maximum of $f$ occurs at $x=1$, while that of $g$ occurs at $x=0$. A common input cannot realize both choices. With separate inputs, choosing $x=1$ and $y=0$ gives $f(x)+g(y)=2$. The allowed pairs of output values are the entire unit square for separate inputs, but only the line segment $a+b=1$ for the shared input.

For any two bounded functions on the same nonempty domain of a function, the useful general estimate isThe inequality can be strict, as the example shows. Equality does not require attained maxima, but it does require that the two large values can be approached at compatible inputs. For example, $f(x)=g(x)=x$ on $(0,1)$ gives equality with value two, although neither function reaches its supremum. This distinction is useful when an objective function combines terms sharing a decision variable: adding the best possible termwise scores gives an upper bound, not necessarily a feasible combined score.

Suppose $f,g:X\to \mathbb{R}$ are bounded functions on the same nonempty set, and the supremum norm of their difference is at most $\delta$. Then their optimal values differ by at most the same amount:Indeed, $f(x)\le g(x)+\delta \le {\sup }_{X}g+\delta$ for every $x$, so ${\sup }_{X}f\le {\sup }_{X}g+\delta$; exchange $f$ and $g$ for the other direction. Adding a constant shifts a supremum by that constant, a basic compatibility between upper bounds and addition.^[ref]

For a chosen example on $[-1,1]$, take $f(x)=-x^2$ and $g(x)=-x^2+0.2x$. Their supremum error is $0.2$, since $|g(x)-f(x)|=0.2|x|$. Completing the square givesThus $f$ has maximum zero at $x=0$, while $g$ has maximum $0.01$ at $x=0.1$. The change in optimal value, $0.01$, is smaller than the certified bound $0.2$. For the vertical translation $h(x)=f(x)+0.2$, the bound is exact: its supremum error and optimal-value change are both $0.2$.

A stable optimal value does not guarantee a stable maximizing input. On $[-1,1]$, the two linear functions $f_{\epsilon }(x)=\epsilon x$ and $g_{\epsilon }(x)=-\epsilon x$ satisfyFor every positive $\epsilon$, their unique maximizing inputs remain two units apart, at $1$ and $-1$. Both functions approach the flat zero function, which has many maximizing inputs. Consequently an accurate objective function value is not by itself a certificate that the optimizing decision is accurate.

The estimate also gives a convenient consequence of uniform convergence. If $f_n$ converges uniformly to a bounded function $f$ on a nonempty $X$, then ${\sup }_X{f}_n\to {\sup }_{X}f$ for the bounded tail of the sequence. Uniform control handles the changing input that defines the best value. Pointwise convergence alone supplies no such control; the existing examples under uniform convergence illustrate that distinction.

Let $A\subseteq \mathbb{R}$ be nonempty and bounded above. An upper bound $s$ equals $\sup A$ exactly when, for every $\epsilon >0$, some $a\in A$ satisfies $s-\epsilon <a\le s$. If no such member existed, $s-\epsilon$ would be a smaller upper bound. Conversely, the condition defeats every proposed upper bound $u<s$ by taking $\epsilon =s-u$. ^[ref].

For $(0,1)$ and $\epsilon =0.2$, $a=0.9$ is one witness: $0.8<0.9<1$. Choosing $a_n\in A$ with $s-1/n<a_n\le s$ produces a sequence converging to $s$ by the squeeze theorem. The choices need not form a monotone sequence.

If a nonempty real set $A$ has finite supremum $s$ and $s\notin A$, then every interval $(s-\epsilon ,s)$ contains infinitely many elements of $A$. Otherwise its finitely many elements have a largest value $m<s$; all remaining elements are at most $s-\epsilon$, making $\max (m,s-\epsilon )<s$ an upper bound. The interval cannot be empty either, by the defining approximation property of a supremum. Thus failure to attain a finite supremum forces accumulation from below.