Codex @codex  0

A Hermitian inner product is a Hermitian form $H$ on a complex vector space which has positive definiteness: $H(v,v)>0$ for every nonzero vector $v$. It is precisely a complex inner product. Only with this definiteness condition doesdefine a norm rather than a seminorm or an expression that may not be real. The standard Hermitian inner product on ${\mathbb{C}}^n$ is $H(z,w)={\sum }_j{z}_j\overline{w_j}$; positive weights $c_j$ give ${\sum }_j{c}_j{z}_j\overline{w_j}$, with squared norm ${\sum }_j{c}_j|z_j{|}^2$.^[ref]

A Hermitian inner product need not have a real matrix. For instance, with the linear-first coordinate convention,The last expression proves positive definiteness without a lengthy calculation of eigenvalues. For $z=(1,i)$ it gives $6$, while for $z=(1,-i)$ it gives $2$. These unequal values expose why a silent switch to $z^{\ast }Az$ would change this particular Hermitian inner product: with these same entries it gives $2$ at $(1,i)$. All entries must keep their roles from the matrix of a Hermitian form.

The Cauchy-Schwarz inequality for a Hermitian inner product statesEquality holds exactly when $u,v$ are linearly dependent, including when either is zero. For a nonzero $u$, outline the proof by setting $a=H(v,u)/H(u,u)$ and $r=v-au$. Then $H(r,u)=0$, and the Pythagorean theorem givesNonnegativity proves the inequality, while positive definiteness makes equality equivalent to $r=0$. The scalar $a$ has no extra conjugate because the first argument is linear.^[ref]

The Cauchy-Schwarz inequality also holds for a positive semidefinite Hermitian form, but equality need not imply linear dependence: for $H_0(z,w)=z_1\overline{w_1}$, the independent vectors $e_1$ and $e_1+e_2$ give $1=1$. Equality then describes dependence after passing to the quotient vector space by the radical of a Hermitian form. The indefinite Hermitian form in Hermitian form shows that conjugate symmetry alone does not even guarantee the inequality.

For a worked orthogonal projection, take $H_{+}(z,w)=z_1\overline{w_1}+2z_2\overline{w_2}$, $u=(1,1)$ and $v=(2,0)$. Then $a=2/3$, $au=(2/3,2/3)$ and $r=(4/3,-2/3)$, with $H_{+}(r,u)=0$ and $4=4/3+8/3$ for the squared norms. The residual is perpendicular in this Hermitian inner product even though its ordinary real dot product with $u$ is $2/3$. For complex $v=(1,i)$, the same orthogonal projection uses $a=(1+2i)/3$; rotating $v$ multiplies $a$ by $e^{i\theta }$, while rotating $u$ multiplies $a$ by $e^{-i\theta }$. This combines geometric decomposition with sensitivity to the relative complex arguments of the multipliers.

A Hermitian inner product therefore supplies more than a positive diagonal: orthogonality, orthogonal projection onto a span, and the triangle inequality for its norm make approximation and distance meaningful. For the function space of complex continuous functions on $[0,1]$, $H(f,g)={\int }_0^{1}f(t)\overline{g(t)}dt$ has positive definiteness, because a nonzero continuous function has positive modulus on a small interval. The same construction turns overlap under integration into lengths and best approximation in finite-dimensional vector subspaces.

A bounded operator $T:H\to H$ on a real or complex Hilbert space is Hermitian, or self-adjoint, when $T=T^{\ast }$. Equivalently,Its directional values $q_T(x)=⟨Tx,x⟩$ are real, since this identity makes $q_T(x)$ equal its complex conjugate. Reality allows either sign; a positive operator additionally requires nonnegative values in every direction.

The diagram compares Hermitian quadratic forms along paths of unit vectors. The Hermitian matrix $D=\mathrm{diag}(1,-1)$ takes the values $1$ and $-1$ on the standard basis vectors; $P=\mathrm{diag}(1,0)$ takes the values $1$ and $0$; andsatisfies $H{e}_1=e_1$ and $H{e}_3=3e_3$. These eigenvectors form an orthonormal basis, and every $x=a{e}_1+b{e}_3$ has $q_H(x)=|a{|}^2+3|b{|}^2$. Thus $H$ is a positive operator, with eigenvalues $1,3$ and operator norm $3$.

Three conditions describe different geometry. A Hermitian operator satisfies $T=T^{\ast }$; a normal operator satisfies $T^{\ast }T=T{T}^{\ast }$; a unitary operator satisfies $T^{\ast }T=T{T}^{\ast }=I$, where $I$ is the identity operator. Every Hermitian operator and every unitary operator is a normal operator. Concrete matrices separate the conditions:

The spectrum of a bounded Hermitian operator is real. In finite dimension, the spectral theorem supplies an orthonormal basis of eigenvectors, turning its action into independent real scalings. This makes the geometry easy to interpret: each eigenvalue records a signed response along an orthogonal direction. An arbitrary bounded Hermitian operator in infinite dimension need not have any eigenvectors; the general spectral theorem uses a projection-valued measure. MIT's lecture 21 develops the real spectrum and the orthogonality of eigenspaces.^[ref]

A historical connection is the study of forms with conjugate variables. In his 1901 account of Charles Hermite's work, Camille Jordan describes these forms and emphasizes their role in reducing forms with real or complex coefficients. In today's notation, $x^{\ast }Hx$ is the diagonal value of a Hermitian form; the conjugate variables make a real-valued expression possible even with complex coefficients.^[ref]

For a densely defined operator outside this bounded setting, the displayed pairing identity alone defines a symmetric operator. A self-adjoint operator must also have the same operator domain as its adjoint operator.

A Hilbert space is a real or complex inner product space that is complete in the norm $\Vert v\Vert =\sqrt{⟨v,v⟩}$. Completeness means that every Cauchy sequence has a limit in the space: if its terms become arbitrarily close in this norm, they converge to an allowed vector. The inner product supplies lengths and orthogonality; completeness ensures that limiting approximation procedures do not leave the space.

Finite-dimensional Euclidean spaces are examples, but the same geometry also works for sequences and functions. In the l2 sequence space,In the L2 space on $[-1,1]$ with Lebesgue measure,These formulas use the convention linear in the first argument. Elements of the L2 space are equivalence classes of square-integrable functions agreeing almost everywhere, so zero distance really identifies the same element. A vector can therefore be a whole function, and its squared length can measure an integrated squared error.

For example, approximating $f(x)=x^2$ by $a+bx$ is a nearest-point problem in this Hilbert space. The allowed approximations form the linear span of $1,x$, and the orthogonal projection is the constant $1/3$. Its residual $x^2-1/3$ is orthogonal to both allowed directions because its integral and its inner product with $x$ vanish. The geometry therefore identifies the best approximation without searching through every pair of coefficients.

This is useful whenever a complicated vector must be represented by a tractable collection of directions. Fourier series approximate functions with orthogonal oscillations; the Parseval identity relates the sum of squared coefficients to the squared norm. Least-squares solutions approximate attainable data using a linear operator. The Hilbert projection theorem explains why a nearest element exists and is unique for a nonempty closed convex set. Distinct application settings share the same geometry of useful components and orthogonal residuals. Casey Rodriguez's MIT lectures develop these connections between Hilbert spaces, Fourier series, and nearest-point problems.^[ref]

A historical mathematical setting is David Hilbert's Grundzüge einer allgemeinen Theorie der linearen Integralgleichungen (1912). Its preface states that it reprints six communications published during 1904–1910 on linear integral equations. This provides a concrete source for the integral-equation setting associated with the name, while the abstract definition above incorporates later developments.^[ref]

The Hilbert space completion of an inner product space $V$ is a Hilbert space containing an isometric dense copy of $V$. It can be constructed from Cauchy sequences in $V$, identifying two sequences when the norm of their difference tends to zero.

The space of finitely supported sequences with the l2 sequence space norm illustrates the need for completion. Let $u^{(n)}=(1,1/2,\dots ,1/n,0,\dots )$. For $m>n$,This is a Cauchy sequence, but its coordinatewise limit $(1/k{)}_{k\ge 1}$ is not finitely supported. It belongs to the l2 sequence space, which is the completion. The same construction permits infinitely many small components while controlling their total squared size. An infinite orthonormal basis of a Hilbert space consequently permits norm-convergent series; a Hamel basis represents each vector by a finite sum, so these two uses of "basis" must be distinguished.

A function is homogeneous of degree $k$ when rescaling its arguments by a common scalar $\lambda$ rescales its value by ${\lambda }^k$, whenever the arguments and that power are defined. For integer $k$ over a vector space, one can require every nonzero scalar; a homogeneous polynomial gives an example. On a domain stable under positive real rescaling, the positive-scaling version allows real $k$. Degree-one positive homogeneity is the convention used for norms and many convex functions. The Euler theorem for homogeneous functions turns this scaling law into a differential identity for a differentiable function.

A horizontal coordinate system describes a viewing direction using altitude $\gamma$ above the observer's astronomical horizon and azimuth $\eta$ around it. Here azimuth starts at true north and increases through east: north is $0^{\circ }$, east $90^{\circ }$, south $180^{\circ }$, and west $270^{\circ }$, with $0\le \eta <360^{\circ }$. True north is the northward intersection of the celestial meridian with the astronomical horizon, rather than an uncorrected magnetic-compass reading. Other origins and directions are legitimate, but their formulae must be converted consistently. ^[ref].

Construct a local orthonormal basis of east ${\mathbf{e}}_E$, north ${\mathbf{e}}_N$, and upward ${\mathbf{e}}_U$, with ${\mathbf{e}}_E\times {\mathbf{e}}_N={\mathbf{e}}_U$. The upward unit vector points to the zenith; the horizontal plane is perpendicular to it. For a ground instrument, a freely hanging weight establishes the local vertical through gravity. In an elementary spherical-Earth model, this vertical is radial; precision work distinguishes it from the normal to a reference surface. With the observer as origin, write a direction's unit vector asIts local components $(E,N,U)$ obey $E^2+N^2+U^2=1$. Conversely, $\gamma =\arcsin U$ and $\eta =atan2(E,N)$ modulo one turn, except where $E=N=0$. The quadrant-aware arctangent takes east as its first argument and north as its second. A synthetic direction with $\eta =60^{\circ }$ and $\gamma =30^{\circ }$ has $(E,N,U)=(3/4,\sqrt{3}/4,1/2)$. Thus its horizontal component has norm $\sqrt{3}/2$; its altitude is not the angle of the projected arrow in the horizontal plane.

A horizontal coordinate system depends on the observer's site and the observation time. The Earth's rotation changes the local axes relative to a fixed distant direction, while changing the site changes the zenith and the astronomical horizon. This makes the horizontal coordinate system directly useful for pointing an optical telescope and checking whether terrain blocks a target. A pair of angles without a site, time, azimuth convention, and geometric or refracted interpretation is an incomplete pointing instruction.

For a check against an equatorial coordinate system, let $\theta$ be the observer's geographical latitude, $\delta$ the direction's declination, and $h$ its west-positive hour angle, obtained from local sidereal time minus right ascension. In the spherical-Earth, unrefracted fixed-direction model, projection onto the local orthonormal basis givesTaking the dot product with the upward unit vector gives the last formula; the other two follow by the same projection. Recover altitude and azimuth from $(E,N,U)$ as above, using radians inside software trigonometric functions. The minus sign in $E$ is essential: a negative hour angle puts this synthetic direction east of the celestial meridian. ^[ref].

For illustrative geographical latitude $\theta =45^{\circ }$ and invented declination $\delta =15^{\circ }$, hour angle $h=-60^{\circ }$ gives $\gamma \simeq 31.636^{\circ }$ and $\eta \simeq 100.729^{\circ }$. At $h=+60^{\circ }$, the same altitude accompanies $\eta \simeq 259.271^{\circ }$: the direction is now westward. At $h=0$, it is due south with altitude $60^{\circ }$, agreeing with $90^{\circ }-|\theta -\delta |$ at upper meridian transit. These are analytical checks, not present positions of any star. For nearby objects, the direction must also be referred to the observer; simply rotating a geocentric direction omits the change of viewing position. Catalogue-to-observation refinements are described under equatorial coordinate system.

Finite products of Banach algebra exponentials form a subgroup: inverses are $e^{-a}$ and conjugation sends $e^a$ to $e^{ga{g}^{-1}}$. Each product is joined to the identity by $t\mapsto \prod e^{t{a}_i}$. The logarithm of an element near the identity puts a norm neighborhood of $1$ in this subgroup, so its cosets are open and its complement is open. It is therefore exactly the identity component of a topological group, and is an open, closed, normal subgroup. A product of exponentials need not be a single exponential in a noncommutative algebra.

An inverse problem is an ill-posed problem if it fails any requirement of a well-posed problem: existence for every admissible datum, uniqueness, or continuity of the reconstructed object as the data change. These requirements depend on the chosen spaces and norms, not just the equation. Clason's regularization notes formulate this distinction explicitly.^[ref]

Complete averaging illustrates lost information:The difference mode $q_{-}=(1,-1{)}^T/\sqrt{2}$ belongs to the null space because $B{q}_{-}=0$. Even restricting both pixels to $[0,1]$ leaves infinitely many indistinguishable inputs. This is failure of uniqueness. Data such as $(0.51,0.49{)}^T$ also have no exact preimage under $B$, illustrating failure of existence when arbitrary two-component observations are admissible.

The two-pixel matrix $A$ in the inverse problem example has a weakly observed difference mode, not a null space mode. Its inverse is continuous: this finite-dimensional problem is a well-posed problem with noise-sensitive conditioning. Small positive singular values alone do not imply mathematical ill-posedness. In infinite-dimensional problems, positive singular values approaching zero can make inversion unbounded: unit solution modes then produce data tending to zero. This destroys continuity even without a null space. Regularization of an inverse problem must distinguish missing information from information recoverable only at the cost of amplifying measurement noise.

Equip the vector space $c_{00}$ of finitely supported sequences with the norm inherited from the absolutely summable sequence space. Consider the truncationsFor $M>N$, the geometric series givesTherefore $(x^{(N)})$ is a Cauchy sequence. Any possible norm limit must have coordinate $k$ equal to $2^{-k}$, since $|x_k-y_k|\le \Vert x-y{\Vert }_1$. That forces infinitely many nonzero coordinates, so no limit lies in $c_{00}$. There is nothing wrong with the approximations: the space is missing their limit.

Inside the absolutely summable sequence space, the limit is $x=(2^{-k}{)}_{k\ge 1}$ and its exact truncation error is $2^{-N}$. Four retained coordinates leave error $1/16$; ten leave $1/1024$. More generally, truncating any element of the absolutely summable sequence space leaves a tail whose norm tends to zero. Together with completeness, this identifies that Banach space as the completion of a normed space $c_{00}$ with this norm. Finite storage and an infinite mathematical object fit together through a controlled error.

An immersion $F:M\to N$ into a Riemannian manifold $(N,h)$ inherits the Riemannian metric $g=F^{\ast }h$: measure two tangent vectors after mapping them into the surrounding tangent space. This is a pullback of a Riemannian metric, withThe injective derivative of an immersion makes this inner product positive-definite. For a parametrized surface in Euclidean space, its coefficients are simply the scalar products of the coordinate tangent vectors: the first fundamental form.

For the circular cylinder $F(\theta ,z)=(R\cos \theta ,R\sin \theta ,z)$, the tangent vectors $F_{\theta }$ and $F_z$ are orthogonal, with squared norms $R^2$ and $1$. ConsequentlyThe unrolled coordinate $x=R\theta$ gives $d{s}^2=d{x}^2+d{z}^2$. This calculation explains intrinsic flatness of a circular cylinder and makes Riemannian distance on a circular cylinder a planar problem with repeated endpoint lifts.

Preserving a Riemannian metric locally preserves the arc length of every mapped curve, but it need not preserve distances measured by unrestricted paths in the surrounding space. The great-circle distance between two sphere points, for example, exceeds their straight chord length unless they coincide. ^[ref].

In the l2 sequence space, let $e_n$ have value one in coordinate $n$ and zero elsewhere. This orthonormal sequence is bounded: $\Vert e_n{\Vert }_2=1$. For distinct indices $n,m$, its terms obey $\Vert e_n-e_m{\Vert }_2=\sqrt{2}$. No subsequence can therefore be a Cauchy sequence, so none converges in the norm. Thus even a complete metric space can have a bounded sequence with no convergent subsequence. Finite dimension is essential to the usual Euclidean space extension, and in a general metric space the relevant replacement is compactness or total boundedness together with completeness.

An inner product assigns a scalar $⟨u,v⟩$ to two vectors and supplies their lengths and orthogonality. Using the convention linear in the first argument, it satisfiesThe resulting norm is $\Vert v\Vert =\sqrt{⟨v,v⟩}$. Over the real numbers, conjugation has no effect and the form is symmetric and bilinear. Over the complex numbers, it is sesquilinear; the convention linear in the second argument is also common, so formulas for coefficients must match the stated convention.

The Euclidean example is $⟨u,v⟩={\sum }_i{u}_i\overline{v_i}$. For real $u=(2,1)$ and $v=(1,3)$ this gives $⟨u,v⟩=5$, while $\Vert u{\Vert }^2=5$ and $\Vert v{\Vert }^2=10$. If $r=(-1,2)$, then $⟨r,u⟩=0$: perpendicularity becomes an algebraic equation. The Cauchy-Schwarz inequality gives $|⟨u,v⟩|\le \Vert u\Vert \Vert v\Vert$, and in a real inner product space it makes the angle formula $\cos \theta =⟨u,v⟩/(\Vert u\Vert \Vert v\Vert )$ meaningful for nonzero vectors.

Different inner products express different measurements. The weighted example $⟨u,v⟩=4u_1{v}_1+u_2{v}_2$ on ${\mathbb{R}}^2$ gives $\Vert (x,y){\Vert }^2=4x^2+y^2$, so its unit-length vectors lie on an ellipse. For functions, an integral such as $⟨f,g⟩=\int f\overline{g}$ supplies the geometry of the L2 space. This lets orthogonal projection and least-squares solutions apply to curves as well as coordinate lists.

An inner product space is a real or complex vector space equipped with a positive-definite inner product. Over the real numbers the form is symmetric and bilinear; over the complex numbers it is conjugate symmetric and sesquilinear. It defines the norm $\Vert v\Vert =\sqrt{⟨v,v⟩}$. The Cauchy-Schwarz inequality proves the triangle inequality for this norm. A complete inner product space is a Hilbert space; every finite-dimensional inner product space is complete.

For square-free $\delta \equiv 3(\mathrm{mod}4)$, the field $\mathbb{Q}(\sqrt{2},\sqrt{\delta })$ has basis $1,\sqrt{2},\sqrt{\delta },(\sqrt{2}+\sqrt{2\delta })/2$ as an integral basis of its ring of integers. Relative traces force all rational coefficients to be half-integers; the norm to $\mathbb{Q}(\sqrt{\delta })$ forces the constant and $\sqrt{\delta }$ coefficients to be integers and the two other numerators to have equal parity. The half-sum is integral because it satisfies $X^4-(1+\delta )X^2+(\delta -1{)}^2/4=0$.

For $X\sim N_p(\theta ,I)$ and $p\ge 4$, this estimator preserves the sample mean and applies James–Stein shrinkage in its orthogonal $(p-1)$-dimensional contrast subspace. Its risk under quadratic loss is $p-(p-3{)}^2{\mathbb{E}}_{\theta }\Vert X-\bar{X}{1}_p{\Vert }^{-2}$. The noncentrality is $\Vert \theta -\bar{\theta }{1}_p{\Vert }^2$, so the reciprocal moment of a noncentral chi-squared variable makes the risk minimal exactly when all true components coincide; the minimum is $3$. A negative realized shrinkage factor reverses contrast signs, and its magnitude can exceed one for sufficiently small contrast norm.