Affine minorant Created 2026-10-06 Updated 2026-10-14
An affine minorant of is a function that is everywhere at most . Every proper lower-semicontinuous convex function has such a minorant, by separating a point below its closed epigraph. Adding a positive quadratic then yields a coercive function, which establishes existence in proximal minimization.
Biconjugation as closed convexification 2026-10-07
For a proper extended-real function with an affine minorant, biconjugate gives its greatest lower-semicontinuous convex minorant. Geometric separation of its epigraph turns containing closed half-spaces into affine lower bounds. Vertical half-spaces are recovered by adding multiples of a domain-separating inequality to one fixed affine minorant.
Convex analysis 2026-10-05
Convex analysis studies convex sets and convex functions, including epigraphs, convex conjugates and subdifferentials.
Convex function Created 2026-09-24 Updated 2026-10-14
A function on a convex set is a convex function if, for every and ,Geometrically, a line segment joining two points of its graph of a function lies on or above that graph of a function. The convex set condition ensures that the intermediate input stays in the domain of a function. An affine function satisfies the defining inequality with equality.
For the quadratic function , the inputs and have equally weighted arithmetic mean . Evaluating at the arithmetic mean gives , whereas averaging the outputs gives . Averaging first saves one unit in this example. More generally, direct expansion givesThis identity proves convexity and also shows exactly when its defining inequality is strict.
The graph of a convex quadratic lies below its endpoint interpolation and above its supporting tangent
. For , the line segment through and has height at , while the graph of a function has height . The tangent line is an affine minorant: everywhere. Details.For a differentiable convex function, the tangent line in one dimension, or the corresponding supporting affine function in several dimensions, lies below the entire graph of a function. This is the subgradient inequality. The equivalent geometric statement is that the epigraph, consisting of points on or above the graph of a function, is a convex set. These characterizations are developed in Boyd and Vandenberghe's convex-function slides, sections 3.1–3.4.
Convexity does not require differentiability: the absolute value function is a convex function with a corner at . When a function is twice continuously differentiable on an open interval, it is a convex function exactly when its second derivative is nonnegative throughout that interval. In several dimensions, the corresponding criterion on an open convex set is that its Hessian matrix is positive semidefinite everywhere. The domain of a function matters: is a convex function on , but not on all of . A strictly positive second derivative is sufficient for strict convexity, but is not necessary: is a strictly convex function although its second derivative vanishes at .
The usefulness of convexity is that local information can certify a global conclusion. Every local minimum of a convex function on a convex set is a global minimum: if a lower value existed elsewhere, the defining inequality would produce lower values arbitrarily close to the proposed local minimum. For a differentiable convex function on an open convex set, a zero gradient therefore certifies a global minimum. Strict convexity gives uniqueness when a global minimum exists; it does not supply existence by itself. These facts explain the role of convex functions in convex optimization.
Dual of a maximum of affine functions Created 2026-10-07 Updated 2026-10-14
Minimizing over unrestricted is a linear program after introducing an epigraph variable and inequalities . Its optimization Lagrangian has finite infimum over exactly when the nonnegative multipliers sum to one and their weighted slopes sum to zero. The displayed Lagrangian dual problem maximizes the resulting constant lower bound. It identifies the role of a zero-slope convex combination of the affine functions.
Epigraph Created 2026-10-05 Updated 2026-10-07
The epigraph is . It is a convex set exactly when is a convex function, and is a sequentially closed set in the product topology exactly when is sequentially lower semicontinuous.
Fenchel–Young inequality Created 2026-09-28 Updated 2026-10-14
The Fenchel–Young inequality says that every input and every slope obeywhere is any proper extended-real function and is its convex conjugate. No convexity assumption on is needed for this inequality: the defining supremum is at least the particular value . If either term on the left is , the inequality still holds, but cannot be an equality because the dot product on the right is finite.
For a proper convex function, equality is equivalent to the subgradient conditionTo see this, with finite, equality says that attains the supremum defining , so for every . Rearranging gives the subgradient inequality . Geometrically, the affine minorant touches at .
If the proper convex function is also closed, meaning its epigraph is a closed set, or equivalently it is lower semicontinuous, thenThe forward implication holds without closedness; the reverse one requires the additional hypothesis in general. Applying the equality criterion to relates to , and the Fenchel-Moreau theorem supplies when is closed. See Bertsekas, Convex Optimization Theory: A Summary, §5.4.1, Proposition 5.4.3 for precisely this distinction.
A concrete failure of the reverse implication occurs for the indicator functional of a constraint set of the open interval . Its convex conjugate is : the endpoint gives the supremum, even though it is excluded from the interval. At , , but , so equality fails and is empty. Closing the interval changes the endpoint value and restores equality there.
For the convex quadratic function , the Fenchel–Young inequality is , and equality holds exactly when . For the absolute value , finite equality requires at , where is the sign function; at every gives equality. These are exactly the subgradients of the absolute value, including its entire interval of slopes at the corner.
Half-space representation of a closed convex set Created 2026-10-06 Updated 2026-10-14
A closed convex set in a finite-dimensional Euclidean space is the intersection of all containing closed half-spaces. For a point outside a nonempty set, its Euclidean projection onto a convex set gives a separating normal. Applied to an epigraph, this turns geometric separation into affine lower bounds and is a key step in the Fenchel-Moreau theorem.
At a point where is finite, this is an affine plane supporting the epigraph from below: for every . A nonzero coefficient of the vertical coordinate permits normalization to the displayed graph form. For a constrained value function, the slope is exactly an attained multiplier in the Strong Lagrangian property. When the value function is differentiable at an interior point of its finite domain, a supporting slope equals its gradient: apply the supporting inequality along both positive and negative multiples of each coordinate direction and take limits.
Past exam of the mathematics course of the University of Cambridge 2001 iii Paper 31 2 Solution Created 2026-10-03 Updated 2026-10-14
Choose the sign conventionThis is the optimization Lagrangian; equality-constraint Lagrange multipliers are unrestricted in sign. The Lagrangian sufficiency theorem for minimization says: if satisfies and globally minimizes on for some , then it globally minimizes the constrained objective function. Indeed, for every feasible ,This is a full global certificate, not merely stationarity. No convexity is needed for the implication, although convexity commonly supplies the required global optimization Lagrangian minimum.
Let , setting , and assume is finite. The Strong Lagrangian property at means that a finite multiplier attains the constrained value as an unconstrained lower bound:This includes dual attainment, but need not include primal attainment. A non-vertical supporting hyperplane of a value function at has a finite slope and supports the epigraph from below:If this inequality holds, then for every ,so . Conversely restricting the infimum to gives , even if the primal infimum is approached only by a sequence. Thus equality holds. In the reverse direction, the Strong optimization Lagrangian identity implies for every . Taking the infimum over yields the supporting inequality, with empty fibres causing no problem. This proves both implications without a convexity or attainment assumption beyond finite .
For the advertising calculation, measure the budget in thousands of pounds by . Requiring the full budget to be spent gives , with . Substitute to reduce the maximization problem toIts second derivative is , so the unique constrained maximum is obtained by clipping the stationary point:The upper constraint never clips the interior formula because for . The maximal revenue in thousands of pounds isEquivalently the revenue Hessian is , negative definite since its leading minor is negative and its determinant is seven. Thus the full-budget affine feasible set has a unique global maximum.
At the two requested budgets,The units in the middle columns are minutes; the last column is thousands of pounds. Revenue measured in pounds is , soAn additional advertising pound therefore increases optimized revenue locally by £2.50 at the smaller budget and £0.25 at the larger budget. These are marginal rates, not exact finite-difference increments: on the interior branch .
The maximization multiplier in equals on the interior branch. The sign is consistent with the minimization convention above applied to , whose supporting slope is . If spending is only capped by the budget, rather than required to equal it, these same answers apply at the two budgets. Beyond £11,000 the unconstrained maximum is affordable, so further allowed spending is unused and the capped-budget value is constant; forced full spending would instead lower revenue.
Past exam of the mathematics course of the University of Cambridge 2010 iii Paper 35 1 Solution 2026-10-14
Use the optimization Lagrangian with the sensitivity sign conventionFor equality constraints the Lagrange multipliers have unrestricted signs. The Lagrangian sufficiency theorem says that if and, for some , globally minimizes over , then globally minimizes subject to the constraint. Indeed every feasible satisfiesThis proves the theorem without a convexity or differentiability assumption. Merely finding a stationary point of the optimization Lagrangian would not establish its required global minimum.
Let , with value when the feasible set is empty, and suppose is finite. The problem has the Strong Lagrangian property if a finite multiplier satisfiesThis includes attainment of the dual bound by a multiplier. It does not by itself assert attainment of the primal infimum. For every multiplier, restricting the infimum to feasible gives , the relevant weak duality. A non-vertical supporting hyperplane of a value function is a planewith for every . Its vertical coefficient is nonzero and has been normalized to one; the epigraph lies above it. The two directions of the equivalence are proved in parts (a) and (b).
For the sampling allocation put . Finite variance requires every ; interpret the objective at a zero coordinate as . An optimum uses all the budget, because scaling every positive up would otherwise reduce the objective while remaining feasible. The Cauchy-Schwarz inequality gives the global boundEquality requires to be proportional to . The budget then determines the unique allocation:This is the optimal cost-constrained stratified sampling allocation.
For an inequality , our sign convention uses , so is a lower bound on at feasible points. Its coordinate stationary equations are , and the displayed allocation givesThe function has a strict global minimum at : its second derivative is and its value diverges at both endpoints of . Thus the multiplier also supplies the Lagrangian sufficiency theorem certificate, with the tight inequality giving complementary slackness.
Past exam of the mathematics course of the University of Cambridge 2010 iii Paper 6 1 Solution Created 2026-10-03 Updated 2026-10-14
We first prove the algebraic extension step needed for Hahn-Banach separation theorem. Suppose is a finite sublinear functional on a real vector space and is a linear functional on a vector subspace , with there. For , choose a real number betweenThis interval is nonempty: for any ,Taking or also bounds the endpoints by finite numbers. Define . For , the upper bound for , applied to , proves . For , writing and using the lower bound at proves the same inequality. The case is the original domination. Thus a dominated linear functional extends over one further direction. Order all dominated extensions by extension of their domains. A chain has its union as an upper bound, so Zorn's lemma supplies a maximal extension. The one-direction argument shows its domain is the whole vector space. This proves the required algebraic Hahn-Banach theorem, rather than assuming the separation result.
Choose , and put . This is a radially open convex set containing zero. It is absorbing: along each line through zero, sufficiently small multiples of any vector lie in . Its Minkowski functionalis finite and nonnegative. Positive homogeneity follows by rescaling . If and , convexity gives , proving subadditivity by taking infima. Moreover,Indeed, gives for some , hence by convexity and . Conversely, radial openness at permits for some , giving .
Since , and for every . Define a linear functional on byIt is well defined because . For , write ; then . For , domination follows from . The extension step therefore gives with , and . If , thenso . ConsequentlyBecause , this kernel of a linear map has codimension one and is a hyperplane. This establishes the geometric Hahn-Banach theorem for radially open sets without assuming a norm or a topology on .
For the convex function, use its strict epigraph in . It is nonempty and convex, and does not contain . It is also radially open: on every affine line, a finite convex function is continuous. To justify this last fact, convexity orders secant slopes; on a smaller interval the slopes are bounded above and below by slopes to two fixed exterior endpoints, giving a local Lipschitz bound. Thus is continuous, and a strict negative value persists near .
Apply the separation theorem with the zero subspace. A nonzero separating linear functional has form . Its values on the convex epigraph cannot have both signs, since a line segment would then meet its kernel. Choose the sign so that on the epigraph. At and this gives . Letting decrease to yields . ThereforeThe resulting linear functional need not be nonzero: for example, the zero functional is the only linear minorant of on .
Now suppose the norm and continuity hypotheses hold. Domination at and givesIf and in norm, apply this inequality to . Since and both bounding values tend to , we obtain . The kernel of a linear map is therefore closed.
Finally, a linear functional with closed kernel on a normed vector space is continuous. If , this is immediate. Otherwise choose with and put . Closedness gives . For , , so . The same resulting bound holds when :This proves continuity and explains exactly how closedness of the kernel is used.
Past exam of the mathematics course of the University of Cambridge 2012 iii Paper 42 1 c Solution Created 2026-10-03 Updated 2026-10-07
Introduce a free scalar . The epigraph reformulation is the linear programFor each fixed , the smallest feasible equals the maximum of the affine expressions, so the reformulation preserves the optimum.
Associate nonnegative multipliers with these inequalities. Its optimization Lagrangian isBecause and are unrestricted, the infimum is finite precisely when the coefficients of both vanish. Therefore the Lagrangian dual problem isA feasible dual vector is a convex combination of the slopes whose mean slope is zero. It gives a constant lower bound on the maximum of the affine functions. The primal is always feasible, by taking and sufficiently large . If it has a finite optimum, linear programming duality gives attainment and equality with this dual; otherwise the dual is infeasible and the primal is unbounded below.
Past exam of the mathematics course of the University of Cambridge 2013 iii Paper 62 1 b Solution Created 2026-10-03 Updated 2026-10-07
The Legendre-Fenchel transform and biconjugate areThe Fenchel-Moreau theorem says that every proper convex function which is lower semicontinuous equals its biconjugate. More generally, if a proper extended-real has an affine minorant, thenwhere the right side is the greatest lower semicontinuous convex minorant. This is biconjugation as closed convexification. The affine-minorant hypothesis ensures that the closed convexification is proper; an unqualified statement including arbitrary improper functions would need separate conventions.
Here are the essential proof steps. The Fenchel–Young inequality gives . Every term in the supremum defining is an affine minorant of , and conversely any affine minorant has . Thus is exactly the supremum of all affine minorants, hence is convex and lower semicontinuous.
Put . Its epigraph is the closed convex hull of the epigraph of . Applying the half-space representation of a closed convex set in recovers that epigraph from its containing half-spaces. A containing half-space writtenhas , since epigraphs extend upwards. If , it is precisely the epigraph inequality of an affine minorant, .
Vertical half-spaces with must also be accounted for. Choose one affine minorant of , which exists because is proper and closed: strictly separate from its epigraph for a finite domain point ; the separating coefficient of cannot be zero, since that would not distinguish points with the same . If a vertical containing inequality is , thenis still an affine minorant on the domain of . At a point violating the vertical inequality, these minorants tend to infinity as . Thus vertical domain restrictions are also recovered by the supremum of affine minorants.
Consequently equals that supremum. Every affine minorant of is below , while the epigraph of any affine minorant of contains its closed convex epigraph hull. Therefore and have the same affine minorants, completing . The theorem in the previous solution supplies the geometric separation step behind biconjugation.
Past exam of the mathematics course of the University of Cambridge 2014 iii Paper 65 1 b Solution Created 2026-10-03 Updated 2026-10-06
For an extended-real function define its Fenchel conjugate by and its biconjugate by . The Fenchel-Moreau theorem states, in the standard proper-envelope setting,Here the right side is the largest lower semicontinuous convex function below , equivalently the function whose epigraph is the closed convex hull of . It is enough to assume is proper and has an affine minorant, ensuring this envelope is proper. In particular, for a proper convex function that is lower semicontinuous, .
First, by the definition of the convex conjugate. The biconjugate is a supremum of continuous affine functions, so it is convex, lower semicontinuous and no greater than . Second, the best intercept for an affine minorant with slope is : for all precisely when . Thus is the supremum of all affine minorants.
To prove that no part of the closed convex envelope is missed, set . The half-space representation of a closed convex set from part (a), applied in , separates any from by an inequality . Because is upward closed, . If , division by gives an affine minorant with .
A vertical separator has . Let be an existing affine minorant. Combine with to obtainSince , a sufficiently small positive makes this affine function exceed . Thus vertical half-spaces can be approximated by nonvertical epigraph supports. Every point below the envelope is excluded by an affine minorant, so the supremum of these minorants is exactly the envelope. This is the decisive use of part (a).
Properness and the minorant convention matter for unrestricted extended-real functions. For example, on has no affine minorant; and . With the corresponding improper-envelope convention its closed convex envelope is also . The theorem should not silently describe such an envelope as proper. The identically function is another degenerate case, handled separately by extended-real conventions.
Past exam of the mathematics course of the University of Cambridge 2014 iii Paper 65 3 b Solution Created 2026-10-03 Updated 2026-10-06
Fix and minimize . A proper lower semicontinuous convex function has an affine minorant , as follows by separating a point below its closed epigraph. HenceThe quadratic dominates the linear term, proving coercivity. Properness supplies at least one finite trial value, lower semicontinuity passes to limits, and finite-dimensional compactness makes a bounded minimizing sequence converge along a subsequence to a minimizer. Thus the proximal operator exists at every .
The subdifferential sum rule applies because the quadratic is finite and continuous everywhere. The Fermat rule for convex minimization givesThus the minimizer lies in . The uniqueness proved in part (a), or strict convexity of the quadratic sum, now yieldsThis proof displays the separate roles of properness, lower semicontinuity, convexity and finite dimension. In particular, compactness here is not inferred merely from strict convexity.
Past exam of the mathematics course of the University of Cambridge 2016 iii Paper 325 1 i Solution Created 2026-10-03 Updated 2026-10-06
Use the extended real numbers . A proper convex function never takes and is finite somewhere. Its effective domain isFor a proper extended-real function, convexity meansThe endpoint cases are identities; taking avoids the ambiguous product . Equivalently, its epigraph is a convex set. In particular, the effective domain is a convex set. Properness is an additional condition: it rules out the identically function and all values, rather than requiring finiteness everywhere.
For , the subdifferential is the set of supporting slopesEach element is a subgradient. Define outside . The defining subgradient inequality must hold globally, not merely in a neighborhood of . For a differentiable finite convex function, .
Past exam of the mathematics course of the University of Cambridge 2018 iii Paper 326 1 1 2 c Solution Created 2026-10-03 Updated 2026-10-05
The epigraph isAssume is -sequentially lower semicontinuous. If lies in the epigraph and converges to in the product topology, thenThe limit remains in the epigraph, so it is a sequentially closed set.
Conversely, suppose the epigraph is a sequentially closed set and sequential lower semicontinuity fails along . Choose a finite real number with . There is a subsequence along which . Thus lies in the epigraph and converges to , which does not lie there. This contradiction provesThis is a sequential statement; identifying it with ordinary closedness requires an appropriate assumption on the topology.
