Convex combination Created 2026-09-24 Updated 2026-10-14
A convex combination is a finite weighted average of points in a real vector space. For , it has the form
The nonnegative coefficients forbid subtracting a component, and their unit sum keeps the result on the same affine scale as the inputs. With two points it parametrizes their line segment; equal coefficients give their centroid. A convex set contains every finite convex combination of its points. Conversely, the two-point case already gives the defining property of a convex set.[ref]
The distinction from a linear combination is concrete. Combining and with coefficients and gives , outside their line segment, despite the unit coefficient sum. Using two coefficients both equal to one gives here, but their sum is two, so it is not a convex combination with those coefficients. A numerical output may happen to coincide with a point admitting a different convex representation; the definition applies to the specified coefficients.
Consider a stipulated continuous-allocation problem. Amounts of two activities use units of a common resource, with budget six. The feasible region
is a triangle with extreme points , and . It is the intersection of three closed half-spaces, hence a closed convex set. The general intersection argument is short: a line segment between two points in every constraint set belongs to every constraint set, so it belongs to their intersection.[ref]
For an original numerical check, take and . Their resource totals are and . Every convex combination is nonnegative and has resource total
In particular the midpoint is , using units. This verifies the full line segment, rather than just a plotted sample of it.
Figure 1.
Feasible averages and convex weights in a continuous resource budget
. Original continuous-allocation model , , . The orange line segment joins two feasible allocations; the green point is the equal-weight convex combination of the three extreme points. The shaded region is their convex hull, not just the three generating points. Details.
This is useful whenever divisible quantities share linear limits: the feasible choices remain compatible under averaging. A new linear equation also preserves this property, because averaging two identical constraint values gives the same value. The affine subspace and closed half-space viewpoints explain this without requiring a separate argument for every budget.
Convex set Created 2026-09-24 Updated 2026-10-13
A convex set permits every intermediate mixture of two of its points. If two choices meet its constraints, continuously averaging them also meets those constraints. This geometric property makes many feasible regions easier to explore: there is no forbidden gap along a straight move between feasible choices.
Formally, a subset of a real vector space is convex when
The parameter traverses the entire line segment, including both endpoints. The definition does not require a closed subset, a bounded set, or a nonempty interior. The empty set, the whole vector space, and every affine subspace are convex; an open unit disk and a closed unit disk are both convex.[ref]
The triangle inequality verifies the disk example directly: if , then . For the open disk, the last inequality is strict. The unit circle fails the same test: and belong to it, but their midpoint does not. A curved route along the unit circle connects the endpoints, so being path-connected is weaker than being a convex set.
Figure 1.
A disk contains every chord, while a circle omits its chords
. Original comparison of the closed unit disk and the unit circle. The circle's midpoint counterexample is explicit; the shaded disk panel illustrates one line segment, with the general statement established by the triangle inequality. Details.
The distinction between a convex set and a convex function matters. The former concerns where one may choose a point; the latter concerns how a value changes along line segments. Convex optimization combines both: averaging preserves feasibility, and a convex function obeys an upper bound by the corresponding average of endpoint values. A convex set alone does not make an arbitrary objective a convex function or eliminate its inferior local minima.
For a proper cone , suppose a point satisfies and is finite. This generalized Slater condition gives strong duality and attainment of the conic dual problem's optimum. It does not by itself assert primal attainment.[ref]
The two worked examples have strict primal points: has slack in the interior of the nonnegative orthant, and has slack in the interior of the second-order cone. Both optima were already certified by explicit feasible pairs. Slater's condition explains why a matching optimal dual variable can be expected under these hypotheses; checking a supplied zero-gap pair needs only weak duality.
Changing cone geometry preserves the bound mechanism. For a positive semidefinite cone, the dual cone pairing is the Frobenius inner product of two matrices. This connects the same certificate idea to semidefinite programming, while the central path uses strictly interior primal and dual points to approach vanishing gap.
In 1995, Lieven Vandenberghe and Stephen Boyd presented a primal-dual interior-point method for convex optimization with matrix inequalities. Their algorithmic study included exploiting problem structure and allowing incomplete Conjugate gradient method solves within an iteration. This illustrates how the primal-dual viewpoint guides computation as well as checking a final answer.[ref]