Box theorem 2026-10-14
A Euclidean body has an axis-parallel box of the same volume with every coordinate-projection volume no larger than its own. In logarithmic coordinates the box side lengths solve a linear program with constraints . Its dual uses nonnegative exact fractional covers; the uniform cover inequality bounds every dual objective below by , proving existence by strong duality.
An alternative proof minimizes an array of candidate projection volumes subject to the finitely many inequalities from irreducible uniform covers. Tight constraints force the array to factor into its singleton coordinates, which become the side lengths of the box.
Conic dual problem Created 2026-10-06 Updated 2026-10-14
A conic dual problem searches for a lower bound on a conic optimization problem. A feasible point exhibits an attainable cost; a feasible dual variable explains why every allowed decision costs at least a specified amount. If the two costs agree, the pair certifies a global minimum without relying on how the points were found.
Fix a real matrix , vectors , , and a closed convex cone . With unrestricted , use the conventionwhere the dual cone is . The conic dual problem uses because it must turn every allowed slack variable into a nonnegative dot product. Taking gives componentwise linear inequalities; taking a second-order cone gives a Euclidean norm constraint. A self-dual cone has , but this equality does not guarantee a feasible point or strong duality.
The Lagrangian supplies a short derivation. For ,Its infimum over unrestricted is when , and otherwise. Maximizing the resulting Lagrange dual function gives the stated conic dual problem. The minus sign matches the convention .
Conic primal-dual gap 2026-10-14
For a feasible point and a feasible dual variable , weak duality follows from one identity:The inequality is the defining property of the dual cone. Every feasible pair therefore encloses the optimal objective function value:Both optima are finite when such a pair exists. Consequently,These are absolute cost bounds, rather than bounds on distance to an optimizing vector. Zero gap certifies both optima immediately. A small positive gap bounds the remaining improvement even if no strong duality theorem has been invoked.
For the nonnegative-orthant optimality certificate example, is feasible and costs . Pairing it with gives , so its cost exceeds the optimum by at most . Here the optimum is known to be , and the bound is exact. Pairing the same with the weaker certificate gives : a valid but less informative guarantee.
The identity assumes exact primal and dual feasibility. With a dual linear-system residual , it becomesThe second term has no guaranteed sign. Checking only a small linear-system residual and the cone dot product is insufficient when is large; a separate bound follows from the Cauchy-Schwarz inequality. Approximate cone membership likewise needs a quantified correction before claiming a certificate.
For an exact arithmetic example, minimize subject to . The point is optimal. A proposed multiplier is nonnegative and gives zero cone dot product because the slack is zero, but violates by . Its purported lower bound is , exceeding the optimum. The missing term explains the failure.
Constraint qualification 2026-10-14
A constraint qualification is a regularity hypothesis on optimization constraints that guarantees a specified optimality or duality conclusion. For the necessity of Karush-Kuhn-Tucker conditions, an appropriate constraint qualification ensures that a local minimum admits suitable Lagrange multipliers; linear independence of the gradients of equality optimization constraints and active constraints is one sufficient hypothesis in KKT regularity at a local minimum.[ref]
Lecture 7: Lagrange Multipliers and KKT Conditions. Lecture 7, §L7.1.3, Theorem L7.3, printed p. 4: independent active gradients
Slater's condition provides a different constraint qualification for convex optimization, yielding strong duality and dual attainment.[ref]Convex Optimization by Stephen Boyd and Lieven Vandenberghe. §5.2.3, printed pp. 226–227: Slater's condition, strong duality and dual attainment
Convex KKT optimality certificate 2026-10-14
For differentiable functions that are convex functions on an open convex set and affine functions , the KKT conditions certify a global minimum. Once Lagrange multipliers satisfy them, no extra Slater condition is needed.[ref]
Convex Optimization by Stephen Boyd and Lieven Vandenberghe. §5.5.3, printed p. 244: sufficiency under convexity and affine equalities
The certificate is a short chain of inequalities. Nonnegative Lagrange multipliers and affine equalities make a convex function. Its zero gradient gives a global minimum at by the first-order optimality condition. For every feasible point ,The first equality uses feasibility and complementary slackness; the last inequality uses and . Equivalently, the Lagrange dual function attains the same value as the primal objective function, proving strong duality. A strictly convex function makes the primal optimum unique, although the Lagrange multipliers need not be unique.
Affine equality optimization constraints matter: an arbitrary signed multiple of a nonlinear equality can destroy convexity of the optimization Lagrangian. For example, minimizing subject to the affine equality gives and for . This equality Lagrange multiplier is positive for , zero at , and negative for . Completing the square gives the certificate for every real number .
Outside convex optimization, KKT stationarity alone does not certify an optimum: minimizing with no optimization constraints gives the stationary candidate , which is a global maximum. The Lagrangian sufficiency theorem remains applicable whenever a global minimum of the optimization Lagrangian can be proved directly.
Convex optimization Created 2026-09-24 Updated 2026-10-13
Convex optimization is a minimization problem with a convex function as its objective function and a convex set of feasible points. For a finite-valued , the problem is to find with for every . The displayed infimum describes its value even when no minimizing point exists. The two convexity requirements concern different objects: the allowed decisions and the scores assigned to them.
A convex set contains the whole line segment between any two of its points:A convex function lies below the interpolation of its endpoint values:Thus mixing two allowed decisions preserves feasibility, and the mixed score is no worse than the same mixture of endpoint scores. The objective function may have flat regions or corners. For a strictly convex function, the second inequality is strict when and .
A useful constraint representation iswhere are convex functions on a common convex set , and the equalities are affine functions. Each inequality defines a convex sublevel set; their intersection with and the equality set is a convex set. An equality involving a general convex function need not preserve this geometry: allows and but excludes their midpoint . See Boyd and Vandenberghe, Convex Optimization (2004), §4.2.1 for the standard problem form.
Why local information can certify a global answer. Every local minimum of a convex optimization problem is a global minimum, including minima on the boundary. If a feasible point had , points would remain feasible and have value strictly below for every . Taking arbitrarily small contradicts a local minimum at . This argument explains the special power of convexity: a better distant decision would reveal an improving direction immediately nearby.
If a minimizer exists and the objective function is strictly convex on , it is unique. Two distinct minimizers of value would have a feasible midpoint with value strictly below . Existence is a separate question: the exponential function is strictly convex on , but its infimum is approached only as . Even a bounded convex set need not suffice: on also has unattained infimum . A continuous function on a nonempty compact set attains its minimum by the extreme value theorem.
Nor does strict convexity imply differentiability. For , the squared term gives the strict inequality while the triangle inequality gives the weak inequality for the absolute value. At zero the left and right derivatives are and , so no derivative exists there, although zero is the unique minimizer. Such objectives require subgradients or proximal operators rather than an ordinary gradient at every point.
For a differentiable convex function on an open convex set containing , the constrained first-order condition isIndeed, the subgradient inequality makes this sufficient; taking the one-sided derivative along feasible line segments makes it necessary. At an interior minimizer, both directions are feasible and the gradient must vanish. At a boundary minimizer it can be nonzero: it only needs to make every feasible direction nondecreasing. See Boyd and Vandenberghe, §§3.1.3 and 4.2.3.
A fully computed nearest-point problem. Project onto the half-space by minimizing half the squared Euclidean distance:The Hessian matrix is the identity matrix, so the objective function is strictly convex. The unconstrained minimizer violates the inequality. With the convention , the optimization Lagrangian is , where the Lagrange multiplier satisfies . Its Karush-Kuhn-Tucker conditions areThe last two equations give , . The choice is infeasible, so complementary slackness forces . Consequently , giving , and . The Euclidean distance is , rather than the objective function value . The gradient at the answer balances ; the displacement from to is a normal vector to the boundary.
There is an exact certificate independent of numerical search. Completing squares givesFor every feasible point, implies . Thus every feasible objective is at least , and attains this bound. More generally the Lagrangian dual problem has objective for . Its maximum is also , illustrating strong duality through matching computed bounds. This makes the example a model for Euclidean projection onto a convex set and the projection step in projected gradient descent.
What the multiplier conditions require. For differentiable convex functions on an open convex set and equalities defined by affine functions, the KKT conditions combine feasibility, , complementary slackness , and stationaritywith unrestricted equality Lagrange multipliers . They suffice to certify a global minimum without an additional regularity assumption: the optimization Lagrangian is convex, stationarity minimizes it, and feasibility with complementary slackness gives the same certificate as above. To guarantee their necessity at an attained finite optimum, a regularity hypothesis suffices: Slater's condition requires some with and . The projection example has the strictly feasible point . See Boyd and Vandenberghe, §§5.2.3 and 5.5.3. This hypothesis guarantees suitable multipliers, not existence of a primal minimizer.
Without regularity, necessity can fail even for convex functions: minimize subject to . The sole feasible point is optimal, but stationarity would require . No Lagrange multiplier works. There is no strictly feasible point, and the gradient of the constraint vanishes at the answer.
The nonconvex contrast. The polynomial has derivative and second derivative . Numerically solving the cubic gives stationary points , , and . Their objective values are respectively , , and , with second derivatives , , and . Hence both outer points are local minima, and the middle point is a local maximum. Since at both ends, its global minimum exists and must be one of the stationary minima: it is the left one. A method stopping at the right local minimum misses a better value by approximately .
A strictly convex quadratic has one minimum; a tilted quartic has two local minima with different values
. Details. The practical appeal of convex optimization is the ability to check an answer globally using geometry and matching Lagrangian duality bounds. The projection certificate certifies every feasible alternative at once; the tilted quartic shows why a zero gradient alone cannot do that for general nonlinear optimization.
Historically, an early landmark is Kuhn and Tucker's [ref]
https://digicoll.lib.berkeley.edu/record/112776/files/math_s2_article-35.pdf. Nonlinear Programming, Second Berkeley Symposium (1951), pp. 481–492
. Its §3 explicitly states a regularity hypothesis for inequality-constrained Lagrange multipliers; its discussion of saddle points explains how concave functions support global conclusions for maximization. This documents an early formulation of the multiplier approach; it does not establish sole discovery of today's KKT conditions or of convex optimization as a whole. Convex perturbation duality 2026-10-06
For a convex perturbation function, defineThe primal and dual values are and ; the signed dual marginal is concave. The identity gives . If is proper and finite near zero, subgradients at zero prove strong duality with dual attainment. In finite dimensions the relative-interior condition also suffices, provided is finite. This does not itself prove primal attainment.
Duality gap 2026-10-18
For finite primal and dual optimal values in a minimization problem, the duality gap is . Strong duality means this difference is zero.
Finite-valued infimal convolution Created 2026-10-07 Updated 2026-10-14
If two nonnegative finite-valued convex functions are defined on all of a finite-dimensional space, their infimal convolution is finite, convex and continuous everywhere. Convex perturbation duality then gives strong duality and dual attainment at every argument. It does not require or imply attainment of the primal decomposition infimum.
More precisely, let be finite everywhere and write . Nonnegativity supplies a lower bound, while the two trial splits and giveMixing nearly optimal splits proves convexity, and continuity of a convex function applies because the effective domain is the entire finite-dimensional vector space. These statements concern the optimized value, rather than existence of an optimal split. For the continuity theorem and dual attainment under the equality constraint , see Bertsekas, Convex Optimization Theory: A Summary, Propositions 1.3.11 and 5.3.3(a). The equality has a feasible point in the whole space for every , and the displayed bound makes its optimal value finite.
A finite value without any optimal split. On , take the convex functions and . Both are nonnegative and finite everywhere, butfor every . The splits have costs , yet the exponential function is strictly positive at every finite . No split attains the infimum. The value function is even constant and differentiable; regularity of the value function does not prevent optimizing splits from escaping to infinity. For example, gives costs approximately , and .
A sufficient extra condition for attainment at a fixed is that be a coercive function, meaning it tends to as . Under the finite-valued assumptions it is a continuous function, so a sufficiently large closed ball contains a global minimum by the extreme value theorem. If this cost is also a strictly convex function, the optimal split is unique. The quadratic example above satisfies both conditions; the exponential function example does not satisfy coercivity.
Nonnegativity is sufficient, not necessary: finite lower bounds , would give by the same argument. Removing all lower-bound control can lose finiteness even for finite convex functions: and give , hence . Nor does finiteness alone guarantee differentiability: choosing gives by the triangle inequality and the split .
KKT regularity at a local minimum 2026-10-14
At a local minimum of continuously differentiable functions, a suitable constraint qualification guarantees the existence of Lagrange multipliers satisfying the KKT conditions. One sufficient local regularity assumption is that the gradients of the equality optimization constraints and the active constraints are jointly linearly independent. This assumption concerns the description of the feasible set, not just the smoothness of the objective function.[ref]
Lecture 7: Lagrange Multipliers and KKT Conditions. Lecture 7, §L7.1.3, Theorem L7.3, printed p. 4: continuous differentiability and independent active gradients
To see why a hypothesis is needed, minimize subject to . The feasible set is the singleton , so is a global minimum. Yet for every finite Lagrange multiplier . Thus this convex optimization problem has an attained optimum without a KKT multiplier. The zero gradient of the active constraint has hidden the actual restriction from its first-order equation. Rewriting it as the equality yields the unrestricted Lagrange multiplier .
For convex optimization, Slater's condition requires strict inequalities and affine equalities at a point in the relative interior of the common domain of a function. A finite optimum value then gives strong duality and dual attainment. Primal attainment and differentiability yield KKT multipliers. Affine inequalities may be nonstrict in the refined version.[ref]
Slater's condition is sufficient, and need not hold for an optimum to exist. The singular example above also shows that mere primal attainment is not a substitute for a constraint qualification.
Lagrange dual function 2026-10-06
The Lagrange dual function is the infimum of a Lagrangian over its primal variables. It is concave in the multipliers, even before convexity of the primal problem is assumed. Maximizing it over sign-compatible multipliers gives a lower bound on a minimization problem by weak duality; appropriate convex qualifications give strong duality.
Lagrangian duality Created 2026-10-06 Updated 2026-10-18
A feasible point gives an upper bound on a minimization problem's best value; a suitable Lagrange multiplier gives a lower bound. Lagrangian duality searches for the strongest bound obtainable this way. Matching bounds certify a global minimum.
Let be a nonempty decision domain on which the objective function and the constraint functions are finite. Write the primal problem and its optimization Lagrangian asThe inequality Lagrange multipliers obey ; the equality Lagrange multipliers are unrestricted real numbers. Define the Lagrange dual function and dual optimal value byThe inner infimum keeps , but releases the displayed optimization constraints. It can be , giving an uninformative lower bound. A different domain changes the bound.[ref]
Convex Optimization by Stephen Boyd and Lieven Vandenberghe. §§5.1.1–5.1.3, printed pp. 215–216: domain, Lagrangian, dual function and lower bounds
Here is the entire weak duality argument. For any feasible point and allowable Lagrange multipliers,The first inequality is the definition of an infimum; the second uses and . Taking the infimum over feasible , then the supremum over allowable Lagrange multipliers, gives . No convexity is used.
The Lagrange dual function is a concave function, since each fixed decision makes an affine function of the Lagrange multipliers.[ref]
Convex Optimization by Stephen Boyd and Lieven Vandenberghe. §5.1.2, printed p. 216: pointwise infimum of affine functions
Explicitly, write and choose two points where is finite. For and every ,Taking the infimum over proves the defining concavity inequality. Thus even a difficult primal problem supplies a dual with useful geometry, although evaluating can itself be difficult.For finite optimal values, strong duality means , or zero duality gap. It need not imply dual attainment. For convex optimization, Slater's condition is a sufficient constraint qualification for both when is finite.[ref]
Convex Optimization by Stephen Boyd and Lieven Vandenberghe. §§5.2.2–5.2.3, printed pp. 225–227: gap, strong duality and Slater dual attainment
The Strong Lagrangian property requires an actual finite Lagrange multiplier achieving equality. Convex perturbation duality interprets such a bound as a supporting slope of the perturbed value function.Set for candidate axis-parallel box side lengths. Its coordinate-projection constraints are the displayed linear program. The dual feasible weights are fractional uniform covers. Its optimal extreme point is rational, so the uniform covers theorem forces its objective to be at least . Weight one on the full coordinate set attains that value. Strong duality therefore supplies box side lengths with volume and no larger coordinate projections.
Max-flow min-cut theorem Created 2026-09-24 Updated 2026-10-14
For a finite flow network with finite nonnegative real flow network edge capacities, the greatest strength of a flow of a feasible flow equals the least cut capacity of a source-to-sink cut of a flow network:For a maximum flow, the vertices reachable from the source in the residual network define a minimum cut whose outgoing original edges are saturated and whose incoming original edges carry zero flow.[ref]
https://courses.csail.mit.edu/6.854/21/Notes/n06-flow.html. Karger, MIT 6.854 Notes 6, maximum-flow optimality conditions
Why is a cut of a flow network an upper bound? Sum flow conservation on its source side . Internal edge contributions cancel, leavingOnly directed edges leaving contribute to cut capacity. Directed edges entering are subtracted in net flow, so adding their capacities to the upper bound would lose the intended bottleneck. This inequality is weak duality; the theorem says the bound is attained, an instance of strong duality. Its beauty is that a routing plan and a separating boundary independently witness each other's optimality.
In the running flow network, the two internal vertices give four possible source sides. For , the cut capacity is . For it is . For it is ; the incoming edge contributes nothing to that cut capacity. Finally, gives . Thus the minimum cut has cut capacity , matching the explicitly computed maximum flow.
Maximum flow of value five and two minimum-cut certificates
. Labels show flow/capacity on each directed edge. The shaded source sides give cuts of capacities three plus two and two plus one plus two, both equal to the flow value. Details.Ford and Fulkerson's 1956 paper opens with a railway-capacity question attributed there to T. Harris and proves a minimal-cut theorem as Theorem 1. Its original formulation uses graph paths carrying nonnegative amounts; the residual reachability certificate for maximum flow below gives the finite directed flow network proof used here.[ref]
https://doi.org/10.4153/CJM-1956-045-5. Ford and Fulkerson, Maximal Flow Through a Network, Canadian Journal of Mathematics 8 (1956), pp. 399–404
Past exam of the mathematics course of the University of Cambridge 2001 iii Paper 31 3 ii Solution Created 2026-10-03 Updated 2026-10-14
The objective function is nonnegative. We now construct a feasible zero-objective point, distinguishing the input problem's possible states.
If the primal is feasible and bounded below, strong duality and attainment for a linear program give , and withSet , , , , , andThe first three embedding equations hold. Substituting their equalities into the fourth gives precisely .
If the primal is infeasible, the Farkas alternative supplies with and . Take , , , and . These satisfy the same equations. If the primal is feasible and unbounded below, it has a direction in the recession cone with and . Set , , and . This is again a feasible nonzero embedding vector. Normalize the constructed vector by the sum of its nonnegative coordinates. In every case,The facts about optimal pairs and recession directions follow from the polyhedral alternatives of linear programming duality; they do not require knowing their values or witnesses to write the transformed coefficients.
To recover information from the transformed optimum, multiply the first three original embedding equations by , , and , respectively, and add. Their cross terms cancel; the fourth equation givesAt , nonnegativity forces and . The equations also implyThus any normalized zero-objective point has : if , all these coordinates vanish, and then , contradicting normalization.
If , division by gives a primal-feasible point and dual-feasible point with equal objective function values; hence they are optimal. If , then , , , andTherefore either certifies primal infeasibility, or is an improving recession direction certifying dual infeasibility and unboundedness whenever the primal is feasible. If only the latter certificate is obtained and primal feasibility is unknown, apply the same construction to the feasibility problem with objective function ; it gives either a feasible point or a direct primal infeasibility certificate.
A degenerate optimal point can have and convey neither conclusion. Choose an optimum in the relative interior of the optimal face of a linear program. The explicit existence argument above gives a point of this face with . A nonnegative coordinate which is positive somewhere on a face of a convex set is positive throughout its relative interior, so the chosen point has and can be decoded. The assertion follows because a small relative-interior displacement in the direction opposite a positive-coordinate point would otherwise make that coordinate negative. Equivalently one may obtain a maximum-support optimum; choosing an arbitrary degenerate boundary optimum is insufficient.
This reduction is useful because an interior-point method now has a known strictly feasible start, a compact standard simplex slice, and a known target objective function. Projective rescalings can recenter positive iterates, and the transformed problem supplies optimality or infeasibility information without a separate guessed optimum. Polynomial bit-complexity claims need rational data with a finite encoding length. The printed bound on arbitrary real coefficients by itself does not bound denominators or the size of nonzero determinants; it is not a substitute for that encoding assumption.
Past exam of the mathematics course of the University of Cambridge 2004 iii Paper 33 1 b Solution Created 2026-10-03 Updated 2026-10-14
False: both primal and dual can be infeasible. For example, takeThe primal requires , so is infeasible. Its dual requires the first coordinate of to be at least , namely , and is also infeasible. An infeasible primal therefore does not force an unbounded dual. If the dual is additionally assumed feasible, strong duality rules out a finite dual optimum; a feasible linear program with finite optimal value attains it, so in that qualified case the dual is unbounded below.
Past exam of the mathematics course of the University of Cambridge 2005 ib Paper 1 8D Solution Created 2026-09-24 Updated 2026-10-14
Associate free real dual variables and with the row and column equality constraints. The Lagrangian for the transportation problem isIts infimum over is finite exactly when for every pair. The linear programming duality therefore givesThe dual variables have no sign restrictions because the primal constraints are equalities.
A feasible shipment is optimal if and only if there exist feasible transportation dual potentials satisfying complementary slackness:Thus every occupied route must have . To see sufficiency explicitly, the primal minus dual objective isand complementary slackness makes it zero. This is the weak duality certificate. Necessity follows from strong duality for the feasible, bounded linear program. If the total supply is positive, gives feasibility; if , does. The feasible shipments form a closed bounded set, so the primal optimum is attained. This also covers zero supplies and demands. The one redundant equality merely leaves the dual gauge freedom .
Past exam of the mathematics course of the University of Cambridge 2005 iii Paper 10 4 Solution Created 2026-10-03 Updated 2026-10-14
The uniform covers theorem says that if a multiset of coordinate subsets covers every coordinate exactly times, then a Euclidean body satisfieswhere is its coordinate projection of a Euclidean body. Work with bounded Borel bodies, whose projections are Lebesgue measurable sets; an empty-coordinate projection has measure one.
Prove the theorem by induction on dimension, with the one-dimensional case immediate. Slice at the last coordinate, writing . The subsets still cover each remaining coordinate times, so induction givesFor not containing , the projected slice is contained in , giving a constant bound. For containing , its measure is the slice measure of . Exactly members of contain , counted with multiplicity. Integrate and apply Hölder's inequality to those factors:Fubini's theorem identifies , completing the proof. Exact covering is needed for real volumes, which may be smaller than one.
The Bollobas--Thomason box theorem states that there is an axis-parallel box with and for every nonempty coordinate subset . Use the logarithmic linear program for the box theorem: if its side lengths are , maximize subject toThe linear program is feasible by choosing all sufficiently negative and is bounded above by the full-set constraint. Its dual minimizes subject to and for each : precisely a fractional uniform cover.
The dual feasible polytope is nonempty, bounded and defined by integer coefficients, so an optimal extreme point has rational coordinates. Multiply its weights by a common denominator . The resulting integer uniform cover and the uniform covers theorem giveThus the dual optimum is at least ; weight one on attains equality. Strong duality gives a primal optimum . The corresponding box has the required volume and projected-volume bounds, proving the theorem.
For the Loomis–Whitney theorem, take the box supplied by the Bollobas--Thomason box theorem. Each side length occurs in exactly projections omitting one coordinate, soThis is the Loomis--Whitney inequality.
For the three projection areas of a volume-one body, necessity is . Conversely suppose and setThe box has projected areas and volume . Inside it retain the three slabsFor , each projection is the full corresponding rectangle, since the slab in the omitted coordinate supplies every point of that projection. The volume is . Chooseto make the volume one. This is a compact connected union of three positive-thickness boxes. Hence the complete answer is
Past exam of the mathematics course of the University of Cambridge 2008 iii Paper 15 2 i Solution Created 2026-10-03 Updated 2026-10-14
The uniform cover inequality states that for a positive-volume body and a multiset in which each coordinate occurs exactly times, , where is its coordinate projection and volumes use the corresponding dimensions.
To deduce the box theorem, maximize subject to for every nonempty . This linear program is feasible and bounded above by the full-set constraint. Its dual minimizes over nonnegative weights with . For rational weights, clearing denominators gives an exact uniform cover, so the uniform cover inequality bounds that dual objective below by . The same holds for all feasible weights by density of rational points in the rational constraint polyhedron. Strong duality makes the primal optimum at least , while the full-set constraint makes it at most that value. An optimal solution therefore gives withThe axis-aligned box with these side lengths has the required volume and projection volumes.
Past exam of the mathematics course of the University of Cambridge 2008 iii Paper 38 1 b Solution Created 2026-10-03 Updated 2026-10-14
Let the finite primal supremum be . First it is attained. The setis a finitely generated cone, hence closed by the argument in the root Solution. For a sequence of primal feasible points whose values approach , the pairs belong to . Their limit therefore belongs to . It gives a feasible point with , so necessarily .
Let index the tight primal inequalities at and let index its zero coordinates. Consider the closed convex cone generated by for and for . If were outside this cone, separation from a closed convex cone would give a direction withFor sufficiently small positive , remains a feasible point: the active constraints have the required signs, and every inactive constraint retains its positive slack. Its larger objective contradicts optimality. Therefore there are , supported on , and , supported on , such thatThis makes a dual feasible point. Moreover, the support restrictions giveTogether with weak duality, this proves strong duality and dual attainment:


