Affine minorant Created 2026-10-06 Updated 2026-11-05
An affine minorant of a function on is an affine function satisfying everywhere. Every proper convex function that is lower semicontinuous on has an affine minorant: separate a point strictly below its closed epigraph by a hyperplane. The finiteness of somewhere makes the separating vertical coefficient strictly positive, so the separator can be solved for height.
This supplies a useful existence estimate. For and ,
The proximal objective is therefore coercive and lower semicontinuous; in finite dimensions it attains a minimum. Its strong convexity makes that minimizer unique, giving a well-defined proximal operator.[ref] The finite-dimensional attainment argument should not be applied to arbitrary infinite-dimensional normed spaces merely from boundedness of a minimizing sequence.
For the cubic polynomial, an oriented, normalized tangent vector is
Its Euclidean norm is one and . The sign here follows increasing ; for a general solution branch, choose the sign of each new tangent vector so its dot product with the previous one is positive. First predict , then apply Newton method starting at to
The second equation keeps the correction on the transverse line in this two-dimensional example; in higher dimensions it is a hyperplane. Solving the linear system and updating corrects both coordinates together.
Figure 1.
A tangent predictor and transverse correction step across the upper fold
. From with , the predictor lies above the largest attainable nearby . Correction along the transverse line returns to the solution branch on the far side of the continuation fold. Both axes use the same scale, so perpendicularity is visible. Details.
This step gives and . Check both equations: the solution must satisfy and . Checking only the first could accept any point on the solution branch. The new exceeds , so the step crosses the continuation fold, even though the predictor's exceeds .
At the seed, set . The determinant of the correction Jacobian matrix with the exact unit vector above is
At either continuation fold, , and : the correction remains invertible. More generally, if has full rank and a one-dimensional kernel spanned by , adding gives an invertible matrix, since a vector annihilated by both rows must be zero. This is a local argument; the old transverse hyperplane need not work arbitrarily far along the curve. Reduce and retry when correction fails, and check the equations and orientation after successful steps. Scaling state and parameter coordinates also matters, because it changes the Euclidean norm used to normalize the tangent vector.
// Target: analysis.bigb
Distance from a point to a plane Created 2026-09-24 Updated 2026-10-18
The distance from a point to a plane is the shortest Euclidean distance from the given point to any point on the plane. For with nonzero normal vector , a point has
The numerator is the residual of the plane equation, not yet a length: its size depends on the chosen normal vector. Dividing by that vector's Euclidean norm removes this arbitrary scale.
For the original example and , the normal vector is and . The residual is , so the distance is . Using the equivalent plane equation instead gives numerator and Euclidean norm , hence the same . A point already on the plane has zero residual and zero distance.
Why is the perpendicular route shortest? Let be the closest point on a plane and any other point on it. The displacement is orthogonal to , so the Pythagorean theorem gives
Equality holds only for . This is the closest-point principle of orthogonal decomposition, applied after a translation of an affine plane to its direction linear subspace.[ref]
Figure 1.
The perpendicular route to a plane is shortest, and rescaling its plane equation preserves the distance
. Original cross-section using the worked distance . The comparison point lies two length units along the plane from the closest point on a plane, giving a longer route of . The second panel reverses the unit normal without moving the plane. Details.
The formula is useful whenever the deviation from a flat reference should be measured geometrically. A raw linear equation residual cannot be compared across arbitrary equation scalings; a perpendicular distance can. The same reasoning works for a hyperplane in any finite-dimensional Euclidean space, with the appropriate number of coordinates.
Farkas' lemma Created 2026-10-07 Updated 2026-10-14
For a real matrix and a vector , exactly one of the following systems has a solution:
The linear inequalities here are componentwise. In the first system is nonnegative; in the second system is unrestricted in sign. The second system is a certificate that the first has no feasible point. This nonnegative-equations alternative is developed in Boyd and Vandenberghe, Convex Optimization slides, §5.34.
Build the target, or separate it. Write the columns of as . Then is a conic combination: its coefficients must be nonnegative, but need not sum to one. The obtainable targets form the finitely generated cone
A solution explains how to build from those columns. A certificate instead defines a linear functional . The condition says that its dot product with every generating column is nonnegative, and hence with every point of . But places the target strictly on the other side of the hyperplane . Thus belongs to the dual cone of and rules out every allowed conic combination at once.
A certificate that can be checked by eye. Take the identity matrix
Here is the nonnegative orthant. The equation forces , violating . The certificate gives
The linear functional simply reads the first coordinate: all allowed column combinations have a nonnegative first coordinate, while has first coordinate . For comparison, the target is obtained with .
Figure 1.
Nonnegative column combinations lie in a cone, while a Farkas certificate separates the target
. For , the shaded nonnegative orthant is the conic hull of the two columns. The hyperplane for is the vertical axis; lies strictly on its negative side. The obtainable target illustrates the other alternative. Details.
Why this is useful and striking. A successful search can exhibit one feasible point; an unsuccessful search alone cannot explain why every candidate fails. Farkas' lemma guarantees an equally concrete witness of impossibility for this finite linear problem. Once is supplied, verification needs only matrix multiplication, sign tests and one dot product. The same idea gives a Farkas certificate for linear inequalities and underlies linear programming duality.
Brief geometric proof. The two systems cannot both hold, because they would imply
For existence of a certificate when , closedness of finitely generated cones makes a closed convex cone, so separation from a closed convex cone supplies and for every . Testing each column gives . Concretely, let be the Euclidean projection onto a convex set of onto and set . The projection inequality gives for . Testing and gives , whence . In the example, and . Alternatively, the Fenchel-Moreau theorem applied to the cone's indicator functional proves the same separation through its polar cone.
An original historical source is Julius Farkas's [ref]. The linked archival record verifies the author, title and publication details.
Frattini subgroup Created 2026-10-03 Updated 2026-11-05
For a finite group , the Frattini subgroup is the intersection of all maximal subgroups. Its elements are exactly the non-generators: an element in every maximal subgroup cannot enlarge a proper generated subgroup to , while an element outside a maximal subgroup generates together with it.
For a finite p-group,
where is generated by all th powers and is the commutator subgroup. Every maximal subgroup has index and is normal, so its quotient group is cyclic of order and it contains . Conversely is an elementary abelian p-group; each nonzero vector is excluded by some hyperplane, whose preimage is a maximal subgroup. This proves equality.
Thus is its order- subgroup, whereas . The Frattini quotient records the independent generators in the Burnside basis theorem.
Half-space Created 2026-10-06 Updated 2026-10-07
A closed half-space consists of a hyperplane and one of its two sides in a real affine space. Replacing the weak inequality by a strict inequality gives an open half-space. Half-spaces are convex sets, and finite intersections of closed half-spaces are linear polyhedra.
Householder transformation Created 2026-10-03 Updated 2026-10-31
A Householder transformation is a reflection that leaves every direction in a chosen hyperplane fixed and reverses its normal direction. For a real unit vector , its matrix is
To understand the formula, decompose any vector into its orthogonal projection onto the normal and a perpendicular component:
Then . Subtracting twice the normal component changes its sign while retaining everything parallel to the mirror. A nonzero normal gives the equivalent formula , so normalization can be deferred.
For example, take . Its mirror is the straight line , and
The midpoint of these two vectors is , which lies on the mirror; their connecting segment is parallel to its normal. Both vectors have Euclidean norm five.
Figure 1.
A Householder reflection reverses the normal component and preserves the mirror component
. The mirror is . The vector becomes ; their midpoint is the orthogonal projection onto the mirror. Details.
Several useful properties follow from this decomposition. The Householder reflection is a symmetric matrix and an orthogonal matrix:
Reflecting twice restores the original vector; Euclidean norms and inner products are preserved. The eigenvalue is along and on , so . A reflection reverses orientation even though it preserves lengths.
The computational payoff is that the mirror can be chosen to send a whole vector onto one coordinate axis, eliminating several entries at once. Householder QR decomposition repeats this operation on the remaining parts of successive columns. For a real symmetric matrix, applying the same Householder reflection on both sides gives a matrix similarity that preserves symmetry and eigenvalues; this is the basis of Householder tridiagonalization.
Alston S. Householder's 1958 paper Unitary Triangularization of a Nonsymmetric Matrix develops this elimination method. Its motivation includes reducing the arithmetic needed for triangularization while retaining the conditioning advantages of orthogonal transformations. [ref] Over the complex numbers, for a unit is Hermitian and unitary, with the star denoting the conjugate transpose; the coordinate-axis construction below is stated for real vectors.
Invariant subspaces and annihilators Created 2026-10-25 Updated 2026-10-31
For a linear map , an invariant subspace has an annihilator of a vector subspace invariant under the dual map . Indeed, for and ,
For a finite-dimensional vector space, the converse also holds. If , every vanishes on for each . The dual basis description of shows that the common zero set of its linear functionals is exactly , so . Thus
The dimension identity exchanges a one-dimensional invariant subspace with an invariant hyperplane in the dual space.
Laguerre geometry 2026-11-05
Classical Laguerre geometry studies oriented hyperplanes, oriented spheres and their oriented tangency in Euclidean space. Its transformations preserve that contact relation. In the plane the objects are oriented straight lines and oriented circles; points can be represented as radius-zero circles. The orientation and signed radius are part of the data, so ordinary unoriented tangency alone loses information.[ref]
For example, fix a unit normal and an oriented line . Under a consistent signed-radius convention, a circle with centre and signed radius is in oriented contact when . The absolute-distance equation forgets which side and orientation participate. This linear signed-contact relation motivates coordinate models for tangency and the use of Laguerre geometry in studying incircular nets.
Level sets of a linear numerator over a radial quadratic Created 2026-10-20 Updated 2026-10-25
For a fixed nonzero , a nonzero level set is the sphere
This follows by completing the square after multiplying by the positive denominator. Nonzero levels exist only for . The zero level is the hyperplane ; the extreme levels shrink to points . The Cauchy-Schwarz inequality gives , so these extrema are global. At them the Hessian matrix is respectively and . In two dimensions the spheres are circles whose centres all lie on the axis spanned by .
Linear separability 2026-10-20
Two subsets of a Euclidean space are weakly linearly separable when a hyperplane with nonzero normal vector places them in opposite closed half-spaces. Points on the separating hyperplane may belong to either subset. Strict separation instead requires strictly opposite signs, excluding all boundary ties.
In Minkowski spacetime of metric signature , let be a constant future-directed four-velocity with . The time difference assigned to two spacetime events is . Thus the observer's simultaneous events form an affine hyperplane orthogonal to . This is an invariant relation of the three arguments ; the Minkowski metric alone does not single out one . For fixed , it defines an equivalence relation and the hyperplanes form a foliation. Changing changes this foliation.
Monodromy of hyperplane sections of a smooth curve Created 2026-10-14 Updated 2026-11-05
Let , , be a smooth irreducible nondegenerate projective variety of dimension one and degree . Let be the open subset of the dual projective space consisting of hyperplanes meeting in distinct points. The incidence projection
is a -sheeted covering space in the complex analytic topology. Its monodromy is the full symmetric group .[ref]
The incidence space choosing two distinct ordered intersection points is irreducible, so the monodromy action of a covering space is two-transitive. A small loop around an ordinary tangent hyperplane exchanges its two nearby intersection points and fixes the others. Conjugating this transposition by double transitivity gives every transposition, and these generate . In particular the action on -element subsets is transitive for each . For a degree-one projective line, a transverse section has one point and the corresponding group is the trivial .
Nearest-centroid decision hyperplane Created 2026-10-20 Updated 2026-10-25
For two distinct centroids in a Euclidean space, equal squared Euclidean distances expand to the displayed affine hyperplane. It is their perpendicular bisector; each closed half-space consists of points at least as close to the centroid on that side. This proves weak linear separability after a two-centroid nearest-assignment step, allowing ties on the boundary. Coincident centroids are an essential exception: every point ties and the distance comparison supplies no nonzero normal vector.
An extreme point cannot be written as a nontrivial convex combination of two distinct points of : if with and , then .
A vertex of a linear polyhedron is a feasible point at which the active constraints include linearly independent row normals. Equivalently, some independent bounding hyperplanes intersect uniquely at that point. This definition does not require to be bounded or full-dimensional. For a linear polyhedron, it is also equivalent to the point uniquely maximizing a suitable linear function: sum the selected active inequalities to construct one such linear function.
Choose representatives of the first points. The general-position condition says that these vectors form a basis of . Write a representative of the last point as . Every is nonzero; otherwise the last point and the other basis points would lie in a hyperplane. Rescaling by gives representatives with . Normalize representatives of the second frame in the same way.
There is a unique invertible linear map with for . It also maps to , so its projectivization has the required effect. For uniqueness, the quotient of two candidate projective transformations fixes the normalized frame. A representing matrix must be diagonal in the basis, with entries . Fixing forces all to be equal. Such a scalar represents the identity projective transformation. Thus the ordered projective frame determines the transformation uniquely.
Expanding the squared Euclidean distances gives
For distinct centroids, choose
A point assigned to has the displayed distance difference at most zero and therefore ; assignment to gives the reverse inequality. The separating hyperplane is the perpendicular bisector of the line segment joining the two centroids. Points tied between them lie on that hyperplane. This is the nearest-centroid decision hyperplane.
The requested nonzero needs the additional assumption . It does not follow from the stated algorithm alone. In one dimension, take and , whose centroids are both zero. A tie rule that retains previous assignments can leave this configuration after an iteration. The inequalities at imply , while the inequality at zero implies , forcing . Thus the unconditional nonzero-separator claim has this degenerate exception.
For distinct coordinates , let , where is the matrix unit. For this is a transvection: it fixes the hyperplane with th coordinate zero pointwise, has determinant one and inverse . We show these elementary transvection matrices generate over any field.
Let . Row addition is left multiplication by an . If the current diagonal pivot is zero, a nonzero entry occurs below it in the same remaining column, since the remaining square block is invertible; adding that row makes the pivot nonzero. Row additions then clear the entries below the pivot. Repeating produces an upper-triangular matrix with nonzero diagonal. Clearing the entries above the diagonal, starting from the last column, gives a diagonal matrix with . Thus it remains to realize determinant-one diagonal matrices using elementary transvections.
In a two-coordinate block put
Direct multiplication gives
The diagonal matrix is the product, for , of these blocks on coordinates , with entries . Their final th entry is . Therefore , and hence , is a product of elementary transvections. All row operations used are invertible transvections, and no division except by a nonzero pivot or has been made. This proves
The identity element can be omitted from the generating set. This is transvections generate the special linear group; ordinary row scaling alone would not prove it, because such a scaling can leave .
A vector space over the real numbers is a set with an addition making it an abelian group and a scalar multiplication by satisfying, for scalars and vectors , the identities , , and . A vector subspace is a nonempty subset closed under addition and scalar multiplication; a proper vector subspace is one unequal to . A spanning set is a set whose finite linear combinations give every vector of . A basis is a linearly independent spanning set. The dimension is the number of vectors in a basis, or its cardinality when the basis is infinite.
The sum of vector subspaces and their intersection of vector subspaces are
Both are vector subspaces: addition and scalar multiplication preserve the displayed forms or simultaneous membership. The intersection of vector subspaces is never empty because .
For the two given hyperplanes, adding and subtracting their defining equations gives and . Hence
These two nonzero vectors are orthogonal, and consequently form an orthogonal basis of the intersection of vector subspaces. Put and . Direct substitution gives , . Their dot products with vanish, and . Each defining equation of or is one nonzero linear constraint in four variables, so each vector subspace has dimension three. Thus each space has the indicated orthogonal basis:
The last four vectors are nonzero and mutually orthogonal, so they are a basis of . They lie in , proving . The dimension identity is therefore verified numerically:
A linear polyhedron is full-dimensional if its affine hull is . For a convex set, this is equivalent to containing an open Euclidean ball: an open ball has full affine span, while affinely independent points in the set span a simplex with nonempty interior. In particular, a nonempty linear polyhedron need not be full-dimensional; a singleton or a hyperplane is an example.
Assume , increasing the coefficient bound to one if necessary. If and denotes the th row, then . For and , the Cauchy-Schwarz inequality gives
Thus with , proving that is a full-dimensional linear polyhedron. This part works for every positive ; the particular small value also ensures that relaxation cannot create feasibility when is empty.
Here is that exact-feasibility point. Put . If is empty, a Farkas certificate for linear inequalities gives with and . Normalize , and maximize over the compact linear polyhedron
Choose a maximizing extreme point. Its positive support has size : a dependence among its supported columns would permit small perturbations of both signs in , contradicting extremality. Select independent equations for those coordinates. Cramer's rule expresses them over a common nonzero integer determinant , with . Since is integer and , its numerator is a positive integer after choosing a positive denominator. Hence . This is the normalized integer Farkas infeasibility gap. A point in would imply
a contradiction. Consequently if and only if .
The ellipsoid method takes the integer matrix , vector , dimension , and a bound (or their binary encodings). It computes the prescribed , an inner radius , and an outer radius whose logarithms have polynomial size. For an explicit outer bound, let . A nonempty has a rational feasibility certificate for integer inequalities with . To see this bound, intersect with an orthant containing a feasible point. This intersection is a nonempty linear polyhedron containing no whole nontrivial affine line, and it has an extreme point. Indeed, if its active rows do not yet span the ambient space, move along a nonzero direction annihilating them. The orthant prevents motion in both directions from being feasible forever, so in at least one direction a new independent row becomes active. Repeating at most times produces an extreme point. At that point choose independent active constraints, including coordinate constraints where needed. Cramer's rule and the Hadamard determinant inequality bound the numerators by , while a nonzero integer denominator has absolute value at least one. Thus the point has norm at most . Choosing ensures that, whenever is nonempty, an entire radius- Euclidean ball in lies inside .
Start with the ellipsoid and retain . At each iteration test the centre against every relaxed inequality. If it passes all tests, is nonempty and hence so is . Otherwise a violated row gives the separation oracle: the feasible set lies in . Cut the current ellipsoid by this half-space through its centre and replace it by the standard containing ellipsoid. Every step retains and, for , reduces Lebesgue measure by a factor at most . In dimension one the corresponding step bisects an interval.
If more than cuts occur without finding a feasible centre, the Lebesgue measure is smaller than that of a radius- ball. This contradicts the retained ball whenever is nonempty, so the algorithm can declare empty. Both and are polynomial in and , and each inequality test uses arithmetic operations for rows. The bit implementation uses rational rounding with outward enlargement of the containing ellipsoids; the encoding bounds allow polynomial precision while keeping a constant fraction of the volume decrease. Detailed update and rounding formulae are not needed for this account. The essential role of the full-dimensional relaxation of integer inequalities is to supply a positive inner-volume bound without changing the emptiness decision; applying a Lebesgue measure stopping test directly to a lower-dimensional would fail.