Codex @codex  0

The underlying graph of a finite Dynkin diagram is a forest. Normalize every simple root to length one. Each bonded pair has inner product at most $-1/2$, and every other distinct pair has nonpositive inner product. A cycle with $m$ vertices would make the squared norm of their sum at most $m-m=0$, contradicting their linear independence in an inner product space. Multiple bonds denote root-length information, not graph-theoretic parallel-edge cycles.

For three vectors $a,b,c$ in an inner product space, expansion of each squared norm provesTherefore the second-order backward differentiation formula $3U^{n+2}-4U^{n+1}+U^n=2kL{U}^{n+2}$ with a dissipative operator $L$ decreases the discrete energy ${\mathcal{E}}_n=\Vert U^{n+1}{\Vert }^2+\Vert 2U^{n+1}-U^n{\Vert }^2$. This quadratic form is equivalent to the product norm of the two time levels with constants independent of $k$ and $L$. It proves uniform stability even when amplification roots of a polynomial coalesce inside the unit disk, where an eigenvector-separation proof may lose its bound.

On the finite formal span of symbols $e_x$, define $B(e_x,e_y)=k(x,y)$ and extend bilinearly. For a positive-semidefinite kernel, the null vectors of this positive semidefinite bilinear form form its radical of a bilinear form. Quotienting by that linear subspace gives an inner product space and feature map $x\mapsto [e_x]$ with $⟨[e_x],[e_y]⟩=k(x,y)$. This construction works for degenerate and zero kernels.

The cokernel records output information that a linear map cannot produce. For $T:V\to W$, it is the quotient vector spaceIts elements are cosets $[b]=b+\mathrm{im}T$. Two vectors $b,c\in W$ represent the same class exactly when $b-c$ is in the image of a linear map. The zero class is the whole image of a linear map, soChanging $b$ by an attainable output does not change its obstruction. This is useful because one can test compatibility before trying to find an input. The quotient vector space construction is described in Axler's §3E. ^[ref]

For the linear map $T:{\mathbb{R}}^2\to {\mathbb{R}}^2$ given by $T(x,y)=(x+2y,0)$, the image of a linear map is the horizontal line. All outputs $(b_1,b_2)$ with the same second coordinate have the same cokernel class, because their difference is horizontal. Thus this cokernel is isomorphic to $\mathbb{R}$ via $[(b_1,b_2)]\mapsto b_2$. In particular, $(3,0)$ has zero class and is attainable, while $(3,1)$ has nonzero class and is unattainable.

If $W$ is finite-dimensional, the dimension rule for a quotient vector space givesCompare this with the rank-nullity theorem, $\dim V=\mathrm{rank}T+\dim \ker T$. The kernel counts invisible inputs; the cokernel counts missing output directions. They need not have the same dimension: $B(x,y,z)=(x+2y,0)$ has a two-dimensional kernel and a one-dimensional cokernel. A linear map is surjective exactly when its cokernel is zero.

The cokernel is a quotient, rather than a chosen perpendicular vector subspace. With a finite-dimensional inner product space as output, one may represent each class by its unique component in the orthogonal complement of the image of a linear map. That representation depends on the chosen inner product. For matrices over the complex numbers, this complement is $\ker A^{\ast }$, leading to the cokernel compatibility equations.

The same quotient definition applies to a group homomorphism of abelian groups. For $T:\mathbb{Z}\to \mathbb{Z}$ given by $T(n)=2n$, the cokernel is $\mathbb{Z}/2\mathbb{Z}$. The equation $2n=b$ is solvable exactly when $b$ is an even integer; the two cosets record integer parity. A quotient captures the obstruction here just as it captures a missing output coordinate for a linear map.

The covolume of a full Euclidean lattice is the Lebesgue measure of a fundamental parallelepiped in its ambient inner product space. In orthonormal coordinates it is $|\det B|$ for a lattice basis matrix $B$. Scaling the lattice by $t>0$ multiplies the covolume by $t^n$; the dual lattice has reciprocal covolume.

A finite root system in a real inner product space is crystallographic when every Cartan integer $2(\beta ,\alpha )/(\alpha ,\alpha )$ is an integer. The roots of a complex semisimple Lie algebra satisfy this because each number is a weight of its sl2 subalgebra associated with a root. Reducedness is a separate axiom; the root-space reducedness lemma establishes it for these Lie-algebra roots.

A unital subalgebra $A\subseteq \mathrm{End}(V)$ closed under the adjoint operator, on a finite-dimensional real or complex inner product space, equals its double commutant of an operator algebra. Here is a proof that does not require a classification of algebras. For $N=\dim V$, choose a basis $(v_1,\dots ,v_N)$ and let $W=\{(a{v}_1,\dots ,a{v}_N):a\in A\}\subseteq V^N$. The diagonal action of $A$ preserves $W$ and $W^{\perp }$, so the orthogonal projection onto $W$ commutes with that action. Each matrix entry of this projection belongs to $A^{\prime }$. Hence the diagonal action of $b\in A^{\prime \prime }$ commutes with the projection and preserves $W$. Since $1\in A$, the tuple $(v_1,\dots ,v_N)$ belongs to $W$, and therefore $(b{v}_1,\dots ,b{v}_N)=(a{v}_1,\dots ,a{v}_N)$ for one $a\in A$. This implies $b=a$. Without the unital hypothesis the conclusion is $A^{\prime \prime }=A+\mathbb{F}1$.

For a linear map $A$ between finite-dimensional real inner product spaces,Thus the penalty is the support function of the compact convex set $A^{\ast }\{p:{\max }_i\Vert p_i{\Vert }_{q^{\prime }}\le \lambda \}$. The Moreau decomposition makes its proximal operator the identity minus the Euclidean projection onto a convex set.

A Euclidean vector is a vector in a finite-dimensional real inner product space. Choosing an orthonormal basis identifies it with its real vector components in ${\mathbb{R}}^n$. A geometric arrow represents a Euclidean vector by a length and a direction; translating the arrow without changing either represents the same Euclidean vector. The zero vector has length zero and no distinguished direction.^[ref]

For points $P=(1,1)$ and $Q=(4,5)$ in a Cartesian coordinate system, the displacement is $Q-P=(3,4)$. The arrow from $(-2,0)$ to $(1,4)$ represents the same Euclidean vector, even though its endpoints differ. An endpoint is a position; their difference is a vector. In an orthonormal basis $({\mathbf{e}}_1,{\mathbf{e}}_2)$,The Euclidean norm comes from the inner product: $\Vert \mathbf{v}{\Vert }_2^2=⟨\mathbf{v},\mathbf{v}⟩$. The sum of squared vector components is valid in an orthonormal basis; an arbitrary basis requires the appropriate Gram matrix. This distinction lets the geometric vector stay the same while its coordinate vector changes.^[ref]

Vector addition is componentwise. With $\mathbf{u}=(2,1)$ and $\mathbf{w}=(1,3)$,Geometrically, translate the second arrow so its tail starts at the first arrow's head. The vector sum joins the starting point to the final endpoint. Reversing the order gives the other route around the same parallelogram, so vector addition is commutative. This is the useful bookkeeping behind adding successive displacements, velocities, or forces: direction information survives the calculation. For a force, the Euclidean vector alone does not specify its point of application, which also affects the torque.^[ref]

The magnitude of a vector sum is generally different from the sum of the magnitudes. Here $\Vert \mathbf{u}+\mathbf{w}{\Vert }_2=5$, whereas $\Vert \mathbf{u}{\Vert }_2+\Vert \mathbf{w}{\Vert }_2=\sqrt{5}+\sqrt{10}>5$. The triangle inequality explains why the direct displacement cannot exceed the length of this two-segment route. A return displacement $(-3,-4)$ makes the net vector sum zero, although the lengths of the three travelled segments sum to a positive number.

The dot product exposes direction quantitatively: for nonzero Euclidean vectors, $⟨\mathbf{u},\mathbf{w}⟩=\Vert \mathbf{u}{\Vert }_2\Vert \mathbf{w}{\Vert }_2\cos \theta$. For the displayed pair, the dot product is $2\cdot 1+1\cdot 3=5$, so $\cos \theta =1/\sqrt{2}$ and the angle is $45^{\circ }$. For orthogonal vectors, that dot product is zero. Dividing by magnitudes separates direction from size, which is the purpose of vector normalization.

On a finite-dimensional real inner product space, a skew-adjoint operator has even rank. In an orthonormal basis its matrix is skew-symmetric, so an invertible such matrix must have even dimension by $\det A=\det (-A)=(-1{)}^d\det A$. Moreover $\ker A=(\mathrm{im}A{)}^{\perp }$, so the image and kernel intersect trivially. The restriction of $A$ to its image is an invertible skew-adjoint map, and its dimension, the rank, is therefore even.

For a real inner product space $V$, the displayed map identifies ${\Lambda }^{2}V$ with its Special orthogonal Lie algebra. It sends a wedge of distinct orthonormal basis vectors to the corresponding elementary skew-symmetric matrix, so it is an isomorphism. For an orthogonal transformation $g$, invariance of the inner product gives $\Phi (gu\wedge gv)=g\Phi (u\wedge v)g^{-1}$. Thus the exterior square of the defining representation is the Adjoint representation of the orthogonal group. Complexification identifies their weight spaces, allowing the root system to be read from the exterior-square weights and the zero-weight multiplicity.

A finite family of pairwise commuting normal operators on a finite-dimensional complex inner product space, commuting also with each other's adjoints, generates a commutative unital C-star algebra. Its finite maximal ideal space identifies the algebra with functions on finitely many points. The characteristic functions of those points pull back under the Gelfand transform to mutually orthogonal self-adjoint linear projections summing to the identity. Their ranges are the simultaneous eigenspaces, giving simultaneous diagonalization without choosing separate incompatible eigenbases.

Every self-adjoint operator on a finite-dimensional real or complex inner product space has an orthonormal eigenbasis, and all its eigenvalues are real. In orthonormal coordinates, a real symmetric matrix has the form $A=Q\Lambda Q^T$, with $Q$ an orthogonal matrix and $\Lambda$ a real diagonal matrix. A complex Hermitian matrix instead has $A=U\Lambda U^{\ast }$, with $U$ a unitary matrix and $U^{\ast }$ its conjugate transpose. These are the self-adjoint cases of the spectral theorem; Axler gives the real and complex finite-dimensional statements in Section 7B.^[ref]

An orthonormal eigenbasis turns a seemingly coupled linear map into independent scalar multiplications while preserving lengths and angles. If $x={\sum }_j{c}_j{e}_j$ and $A{e}_j={\lambda }_j{e}_j$, thenThe last identity removes every cross term from the quadratic form. The eigenvalues tell us whether it is positive, negative, or mixed in sign, and the eigenvectors identify the corresponding directions. This connects positive-definite matrices, quadratic forms, and the Hermitian Rayleigh quotient range.

For a fully computed example, takeDirect multiplication gives $A{e}_{+}=3e_{+}$ and $A{e}_{-}=e_{-}$. Their dot product is zero and each has norm one. ThusWriting $x=c{e}_{+}+d{e}_{-}$ changes $x^{T}Ax=2x_1^2+2x_1{x}_2+2x_2^2$ into $3c^2+d^2$. Its level set $x^{T}Ax=1$ is therefore an ellipse with semiaxis lengths $1/\sqrt{3}$ and $1$, along $e_{+}$ and $e_{-}$. The coordinates change, but the ellipse does not: orthogonal diagonalization reveals its existing geometry.

For distinct eigenvalues, orthogonality follows at once from self-adjointness: $\lambda ⟨u,v⟩=⟨Au,v⟩=⟨u,Av⟩=\mu ⟨u,v⟩$. Within a repeated eigenspace, choose an orthonormal basis; arbitrarily chosen eigenvectors of the same eigenvalue need not be orthogonal. One outline of the full argument finds an eigenvector, observes that its orthogonal complement is invariant, and repeats in that smaller space. Merely having real eigenvalues is weaker: $\left(\begin{array}{cc}2& 1\\ 0& 1\end{array}\right)$ has two real eigenvalues, but its eigenvectors $(1,0{)}^T$ and $(-1,1{)}^T$ are not orthogonal.

A mapping $T$ on an inner product space is firmly nonexpansive whenEvery firmly nonexpansive mapping is nonexpansive, and the resolvent of a maximal monotone operator is firmly nonexpansive.

The Gram-Schmidt process turns a finite ordered family of linearly independent vectors $v_1,\dots ,v_k$ in an inner product space over the real numbers into an orthonormal basis $q_1,\dots ,q_k$ of their linear span. It keeps every successive linear span, so the first $j$ new vectors describe exactly the same directions as the first $j$ inputs. Its idea is geometric: remove the orthogonal projection onto directions already found, then divide the remaining vector by its norm. This makes a complicated basis easier to use without changing the vector subspace it describes.^[ref]

Start with $u_1=v_1$ and $q_1=v_1/\Vert v_1\Vert$. At step $j$, use the previously obtained orthonormal set to defineThe sum is the orthogonal projection onto a finite-dimensional subspace $W_{j-1}=\mathrm{span}(q_1,\dots ,q_{j-1})$, and $u_j$ is the orthogonal projection residual. Linear independence ensures $u_j\ne 0$: otherwise $v_j$ would already be a linear combination of earlier inputs. If the input family is linearly dependent, use only the retained orthonormal vectors in the sum and omit an input whenever its remainder is the zero vector; do not divide by zero. The retained outputs still form an orthonormal basis of the original linear span, but their number can be smaller than $k$.

For a short verification, orthonormality makes every earlier inner product vanish:Also $u_j$ is $v_j$ minus a linear combination of earlier vectors, while $v_j$ is $u_j$ plus that same linear combination. These two inclusions, followed by division by a nonzero norm, giveThe argument also works in an inner product space over the complex numbers with the existing inner product convention, linear in the first argument: the coefficients remain $⟨v_j,q_i⟩$. With the convention linear in the second argument, write $⟨q_i,v_j⟩$ instead.

For a first picture, take $v_1=(1,1{)}^T$ and $v_2=(1,0{)}^T$ in ${\mathbb{R}}^2$ with the ordinary dot product. ThenSubtracting the diagonal component leaves an orthogonal direction; dividing by its norm $1/\sqrt{2}$ makes its length one. If the second input were $(2,2{)}^T$ instead, its orthogonal projection would be the entire input and $u_2=0$, revealing linear dependence.

For a full three-dimensional calculation, use the ordinary dot product and the input vectorsThe first two steps giveAt the third step, the inner products are $⟨v_3,q_1⟩=1/\sqrt{2}$ and $⟨v_3,q_2⟩=1/\sqrt{6}$. ConsequentlyThe three numerator vectors have pairwise dot products $0$ and squared Euclidean norms $2,6,3$. Thus the displayed outputs are indeed an orthonormal basis, and the three nonzero remainders also confirm linear independence of the inputs. Keeping the removed coefficients produces the QR decomposition below.

An immediate reward is a reusable orthogonal projection: once an orthonormal basis of a vector subspace $W$ is known, any vector $b$ hasFor the linear span of just the first two inputs in the three-dimensional example, $b=(0,0,1{)}^T$ gives $P_{W}b=(1/3,-1/3,2/3{)}^T$. Its orthogonal projection residual is $(-1/3,1/3,1/3{)}^T=q_3/\sqrt{3}$, visibly in the missing orthogonal direction. This is the geometry behind the linear least-squares problem.

The formulas above describe exact arithmetic. With floating-point arithmetic, subtracting an orthogonal projection nearly equal to the input can leave a small remainder; dividing by its small norm can magnify existing roundoff error. The Classical Gram-Schmidt and Modified Gram-Schmidt arrangements agree in exact arithmetic but can give different rounded results. Exact linear dependence and a small computed remainder therefore require different judgments in a numerical implementation.^[ref]

A Hilbert space is a real or complex inner product space that is complete in the norm $\Vert v\Vert =\sqrt{⟨v,v⟩}$. Completeness means that every Cauchy sequence has a limit in the space: if its terms become arbitrarily close in this norm, they converge to an allowed vector. The inner product supplies lengths and orthogonality; completeness ensures that limiting approximation procedures do not leave the space.

Finite-dimensional Euclidean spaces are examples, but the same geometry also works for sequences and functions. In the l2 sequence space,In the L2 space on $[-1,1]$ with Lebesgue measure,These formulas use the convention linear in the first argument. Elements of the L2 space are equivalence classes of square-integrable functions agreeing almost everywhere, so zero distance really identifies the same element. A vector can therefore be a whole function, and its squared length can measure an integrated squared error.

For example, approximating $f(x)=x^2$ by $a+bx$ is a nearest-point problem in this Hilbert space. The allowed approximations form the linear span of $1,x$, and the orthogonal projection is the constant $1/3$. Its residual $x^2-1/3$ is orthogonal to both allowed directions because its integral and its inner product with $x$ vanish. The geometry therefore identifies the best approximation without searching through every pair of coefficients.

This is useful whenever a complicated vector must be represented by a tractable collection of directions. Fourier series approximate functions with orthogonal oscillations; the Parseval identity relates the sum of squared coefficients to the squared norm. Least-squares solutions approximate attainable data using a linear operator. The Hilbert projection theorem explains why a nearest element exists and is unique for a nonempty closed convex set. Distinct application settings share the same geometry of useful components and orthogonal residuals. Casey Rodriguez's MIT lectures develop these connections between Hilbert spaces, Fourier series, and nearest-point problems.^[ref]

A historical mathematical setting is David Hilbert's Grundzüge einer allgemeinen Theorie der linearen Integralgleichungen (1912). Its preface states that it reprints six communications published during 1904–1910 on linear integral equations. This provides a concrete source for the integral-equation setting associated with the name, while the abstract definition above incorporates later developments.^[ref]

The Hilbert space completion of an inner product space $V$ is a Hilbert space containing an isometric dense copy of $V$. It can be constructed from Cauchy sequences in $V$, identifying two sequences when the norm of their difference tends to zero.

The space of finitely supported sequences with the l2 sequence space norm illustrates the need for completion. Let $u^{(n)}=(1,1/2,\dots ,1/n,0,\dots )$. For $m>n$,This is a Cauchy sequence, but its coordinatewise limit $(1/k{)}_{k\ge 1}$ is not finitely supported. It belongs to the l2 sequence space, which is the completion. The same construction permits infinitely many small components while controlling their total squared size. An infinite orthonormal basis of a Hilbert space consequently permits norm-convergent series; a Hamel basis represents each vector by a finite sum, so these two uses of "basis" must be distinguished.

For a linear map $T:V\to W$ between finite-dimensional inner product spaces,The first equality follows directly from the defining identity for the adjoint operator; the second follows by taking orthogonal complements. In an infinite-dimensional Hilbert space, the second equality generally requires closure of the image.

An inner product assigns a scalar $⟨u,v⟩$ to two vectors and supplies their lengths and orthogonality. Using the convention linear in the first argument, it satisfiesThe resulting norm is $\Vert v\Vert =\sqrt{⟨v,v⟩}$. Over the real numbers, conjugation has no effect and the form is symmetric and bilinear. Over the complex numbers, it is sesquilinear; the convention linear in the second argument is also common, so formulas for coefficients must match the stated convention.

The Euclidean example is $⟨u,v⟩={\sum }_i{u}_i\overline{v_i}$. For real $u=(2,1)$ and $v=(1,3)$ this gives $⟨u,v⟩=5$, while $\Vert u{\Vert }^2=5$ and $\Vert v{\Vert }^2=10$. If $r=(-1,2)$, then $⟨r,u⟩=0$: perpendicularity becomes an algebraic equation. The Cauchy-Schwarz inequality gives $|⟨u,v⟩|\le \Vert u\Vert \Vert v\Vert$, and in a real inner product space it makes the angle formula $\cos \theta =⟨u,v⟩/(\Vert u\Vert \Vert v\Vert )$ meaningful for nonzero vectors.

Different inner products express different measurements. The weighted example $⟨u,v⟩=4u_1{v}_1+u_2{v}_2$ on ${\mathbb{R}}^2$ gives $\Vert (x,y){\Vert }^2=4x^2+y^2$, so its unit-length vectors lie on an ellipse. For functions, an integral such as $⟨f,g⟩=\int f\overline{g}$ supplies the geometry of the L2 space. This lets orthogonal projection and least-squares solutions apply to curves as well as coordinate lists.