Consider a stipulated continuous-allocation problem. Amounts of two activities use units of a common resource, with budget six. The feasible region
is a triangle with extreme points , and . It is the intersection of three closed half-spaces, hence a closed convex set. The general intersection argument is short: a line segment between two points in every constraint set belongs to every constraint set, so it belongs to their intersection.[ref]
For an original numerical check, take and . Their resource totals are and . Every convex combination is nonnegative and has resource total
In particular the midpoint is , using units. This verifies the full line segment, rather than just a plotted sample of it.
Figure 1.
Feasible averages and convex weights in a continuous resource budget
. Original continuous-allocation model , , . The orange line segment joins two feasible allocations; the green point is the equal-weight convex combination of the three extreme points. The shaded region is their convex hull, not just the three generating points. Details.
This is useful whenever divisible quantities share linear limits: the feasible choices remain compatible under averaging. A new linear equation also preserves this property, because averaging two identical constraint values gives the same value. The affine subspace and closed half-space viewpoints explain this without requiring a separate argument for every budget.
For every nonempty closed convex set in a Hilbert space and every in that space, there is a unique satisfying
Closedness and completeness let a limiting approximation attain the infimum; convexity prevents two different minimizers. The proof idea is to choose a sequence approaching the infimum. The parallelogram identity and the admissible midpoint make it a Cauchy sequence; applying the same identity to two putative minimizers proves uniqueness.
For a closed subspace of a Hilbert space, this nearest-point map is an orthogonal projection and is linear. For a general closed convex set it need not be linear: projecting the real line onto clips values below zero to zero and values above one to one. The theorem is therefore useful for both linear approximation and constrained nearest-point problems.[ref]
Closedness is essential even in familiar examples. For the open interval and , the distance infimum is zero but no nearest point exists. The same obstruction appears when approximating by finitely supported sequences: the infimum is zero, but the limit lies outside that subspace until we take its Hilbert space completion.
Hilbert space Created 2026-09-24 Updated 2026-10-14
A Hilbert space is a real or complex inner product space that is complete in the norm . Completeness means that every Cauchy sequence has a limit in the space: if its terms become arbitrarily close in this norm, they converge to an allowed vector. The inner product supplies lengths and orthogonality; completeness ensures that limiting approximation procedures do not leave the space.
Finite-dimensional Euclidean spaces are examples, but the same geometry also works for sequences and functions. In the l2 sequence space,
In the L2 space on with Lebesgue measure,
These formulas use the convention linear in the first argument. Elements of the L2 space are equivalence classes of square-integrable functions agreeing almost everywhere, so zero distance really identifies the same element. A vector can therefore be a whole function, and its squared length can measure an integrated squared error.
For example, approximating by is a nearest-point problem in this Hilbert space. The allowed approximations form the linear span of , and the orthogonal projection is the constant . Its residual is orthogonal to both allowed directions because its integral and its inner product with vanish. The geometry therefore identifies the best approximation without searching through every pair of coefficients.
This is useful whenever a complicated vector must be represented by a tractable collection of directions. Fourier series approximate functions with orthogonal oscillations; the Parseval identity relates the sum of squared coefficients to the squared norm. Least-squares solutions approximate attainable data using a linear operator. The Hilbert projection theorem explains why a nearest element exists and is unique for a nonempty closed convex set. Distinct application settings share the same geometry of useful components and orthogonal residuals. Casey Rodriguez's MIT lectures develop these connections between Hilbert spaces, Fourier series, and nearest-point problems.[ref]
A historical mathematical setting is David Hilbert's Grundzüge einer allgemeinen Theorie der linearen Integralgleichungen (1912). Its preface states that it reprints six communications published during 1904–1910 on linear integral equations. This provides a concrete source for the integral-equation setting associated with the name, while the abstract definition above incorporates later developments.[ref]