Use an inner product linear in the first variable. For each , the bounded linear functional is represented uniquely by a vector under the Riesz representation theorem, so . Uniqueness and the conjugate-linearity in the second argument imply . Furthermore
Thus the adjoint operator exists, is linear and bounded, and is unique because a vector orthogonal to every is zero.
A normal operator satisfies . The unilateral unilateral shift operator on is bounded but not normal: , whereas . For general ,
Normality implies equality of norms. Conversely equality for every makes this self-adjoint operator's quadratic form zero; the polarization identity then gives .
An approximate eigenvalue has unit vectors with . It is necessarily in the spectrum, since a bounded inverse would prevent this. Conversely suppose is not an approximate eigenvalue. Then is bounded below, . It is injective and has closed range: a convergent sequence forces to be Cauchy. The operator is normal, so and . The identity makes its range dense. Closed and dense means surjective, and its inverse is bounded by . Hence is in the resolvent. This proves .
A complex square matrix is a unitary matrix when , equivalently . Here denotes the adjoint matrix, the conjugate transpose. Such a matrix preserves the standard complex inner product and its Euclidean norm.
A real symmetric matrix is a Hermitian matrix, so . For arbitrary complex ,
The imaginary cross terms cancel because is Hermitian. Reversing the signs gives the same identity:
In particular, implies , so has zero kernel of a linear map. It is a square matrix, and the rank-nullity theorem therefore makes it invertible. The same argument proves invertibility of .
The proposed matrix
is consequently well-defined. For any , put . The two norm identities show directly that
To verify the unitary matrix identity explicitly, take adjoints:
The two shifts commute, because both are polynomials in . Hence
Thus
The imaginary shifts are invertible, and their equal norm changes cancel in the quotient. This is the Cayley transform of a Hermitian matrix in the convention.
For the real coefficients of the stated self-adjoint Sturm-Liouville problem, define the weighted inner product
Since , a nonzero eigenfunction has positive squared norm. Let . Integration by parts and the Dirichlet boundary conditions give
Taking to be an eigenfunction shows that its eigenvalue is real, since is real. For two eigenfunctions with eigenvalues , the same identity gives
Hence distinct eigenvalues imply orthogonality in the weighted inner product. This is the orthogonality of Sturm-Liouville eigenfunctions. The calculation assumes the regularity needed for the stated self-adjoint boundary problem, so all boundary terms and integrals are defined.
A sequence of real orthogonal polynomials consists of real polynomials with degree of a polynomial and
Orthogonality is relative to the specified inner product, rather than to the ordinary coefficients. A monic polynomial has leading coefficient one, so a monic orthogonal polynomial has the form . In particular, the monic degree-zero polynomial is .
Since has degree of a polynomial at most , expand it in the basis . Multiplication by is self-adjoint for this weighted inner product: . For , the polynomial has degree at most , so
Only the and coefficients remain. Taking their inner products gives the three-term recurrence
For the second formula, a polynomial of lower degree, hence . At , take , and the same formula for . Positivity of the weight ensures that all the squared norms in the denominators are nonzero.
With the inner product , the assumed Hermiticity of and gives
Consequently the adjoint relation is
As with the stated Hermiticity assumption, these identities concern wavefunctions in the appropriate operator domains. Square integrability alone does not guarantee that derivatives or multiplication by are square integrable; one may first work with smooth rapidly decaying wavefunctions, where integration by parts has no boundary term, and then use the operator domains.
Let be the singular values of the normalized adjacency operator of a bipartite graph, with the uniform inner products used above. Its ordinary matrix in an orthonormal basis on each side is . Expanding the trace of proves the box norm singular-value identity
Therefore (ii) immediately implies
which is (iii).
Conversely, the square of the Hilbert-Schmidt norm of this operator is
since a graph indicator function takes values zero and one. Under (iii), every with is at most , so
Thus (iii)(ii) with . This bound also covers the empty and complete bipartite graphs.
Use uniform expectations on the two nonempty parts, and equip their function spaces with the inner product . Let and
Since the bipartite graph is a biregular graph, both row and column averages of vanish. The normalized adjacency operator of a bipartite graph therefore splits into the map between constant functions, of singular value , and between their orthogonal complements.
There is no singular value larger than . Indeed, for , the Cauchy-Schwarz inequality gives
Averaging in uses the constant column degree and gives . For every operator is zero. Thus the second singular value is
If one part has a single vertex, missing singular values are interpreted as zero; the biregular graph then has .
The discrepancy in (i) is exactly . Its supremum over is the cut norm . To pass from this bound to arbitrary bounded real-valued functions, use the positive and negative parts and the identity for . Applying this separately to both factors gives
Here is a bound on , unrelated to any cardinality.
If , take real unit left singular vector and right singular vector with and . The Cauchy-Schwarz inequality and imply . Hence
This proves (i)(iii), with a constant independent of both part sizes. The case satisfies the same conclusion immediately.
Use the normalization
This is ridge regression; the penalty is the squared Euclidean norm. The centering removes the need for an intercept. Differentiating gives the normal equation
For every nonzero , . The coefficient matrix is therefore a positive-definite matrix, even if the design matrix has deficient matrix rank. The objective is a strictly convex function, so the unique minimizer is the closed-form ridge regression estimator, with fitted values
For the primal-dual identity for ridge regression, put and observe
Both parenthesized matrices are positive-definite matrices. Multiplying by their inverses gives
Thus the same fitted vector has the dual expression
No inverse of or alone was needed. This is also the kernel-ridge hat matrix for the linear kernel.
Here a positive-definite kernel means a symmetric real-valued function whose every finite kernel matrix is positive semidefinite: for all , and ,
This is the usual positive-semidefinite kernel convention; strict positivity for distinct points is not required. In particular . Write , and . Positivity of the two-point kernel matrix implies
If , substitute to obtain . If , the affine expression can be nonnegative for every only if . Both cases give the Cauchy-Schwarz inequality for positive-semidefinite kernels:
The zero-diagonal case is essential when the positive-definite kernel is not strictly positive.
To construct a feature map, let be the real vector space of finite formal linear combinations of symbols , one for each . Define a symmetric bilinear form by
The positive-definite kernel property makes this a positive semidefinite bilinear form. It need not yet be an inner product: distinct formal vectors can have zero squared length. The same quadratic-polynomial argument, now applied to , proves
Therefore implies for every . The set
is the radical of a bilinear form, hence a linear subspace. Set
The quotient vector space has a well-defined inner product: changing representatives by elements of changes no pairing, and a zero-length class is exactly the zero class. It is therefore an inner-product space.
Define . By construction,
Every positive-definite kernel thus has a feature representation, including degenerate kernels and the zero kernel. This is its canonical feature space of a positive-semidefinite kernel. The construction already gives the requested inner-product space.
A Non-Abelian gauge theory promotes an internal group representation symmetry to a spacetime-dependent transformation and introduces a gauge field so that differentiation transforms covariantly. The symmetry is a gauge redundancy: physically meaningful quantities must be invariant under local changes of field representative. We work in four-dimensional Minkowski spacetime with signature , and use skew-Hermitian matrix generators throughout.
For the compact Simple Lie group , its real Lie algebra has a negative-definite Killing form. Hence is a positive invariant bilinear form on a Lie algebra. Choose a -orthonormal basis , , with . Invariance makes fully antisymmetric. This construction uses the Adjoint representation and works independently of any chosen scalar representation.
Let be a Lie-algebra-valued gauge potential, with the coupling absorbed into this connection. If is the given finite-dimensional irreducible representation of , its Lie algebra representation defines
For a finite local transformation , require and . Differentiating the first equation forces the gauge-field transformation law
Thus the gauge potential transforms inhomogeneously; an ordinary derivative alone would leave an uncancelled derivative of .
The commutator of gauge covariant derivatives determines the gauge field strength:
The Lie algebra representation preserves the bracket, so this formula holds for any , including a trivial scalar representation. The gauge field strength itself is defined in the gauge algebra. The transformation of the connection implies
It is therefore covariant, rather than invariant as a Lie-algebra-valued quantity.
For infinitesimal , the same equations give the infinitesimal gauge transformation with an anti-Hermitian connection:
Substitution into cancels the terms containing and gives , the gauge covariance of a scalar covariant derivative.
The Yang-Mills theory has Lagrangian density
This is the Killing-form Yang-Mills Lagrangian. Its sign uses a positive internal form and the stated spacetime signature. In a -orthonormal basis it is . Gauge invariance follows because is invariant under the adjoint group action. Infinitesimally, the variation is proportional to
After rescaling , the gauge coupling appears in and in the non-Abelian part of the canonically normalized field strength. Squaring that field strength gives cubic and quartic gauge-field self-interactions. An ordinary local quadratic mass term in the gauge potential is not invariant because its transformation contains .
For the scalar field kinetic term, compactness supplies a positive invariant Hermitian form on its representation space. One can obtain it by averaging any positive form with normalized Haar measure, the unitarization of a compact-group representation. Then is unitary for , and is anti-Hermitian. The Yang-Mills theory coupled to an arbitrary scalar representation has
Here is any real gauge-invariant scalar potential, so . For example,
is available for every unitary representation, with giving a bounded quartic contribution. Other invariant interactions may exist for particular representations; the potential is not required to depend only on .
The scalar kinetic term is gauge-invariant because both covariant derivatives transform by the same unitary . Infinitesimally its variation vanishes by
The potential is invariant by its defining condition. For a real irreducible representation, use the averaged positive symmetric form instead and write the kinetic term as ; all transformation and invariance arguments remain valid. Expansion of the covariant kinetic term produces both the linear gauge-scalar interaction and the quadratic term needed by local gauge invariance.
The invariant inner products, gauge covariant derivatives and gauge field strength together construct the full theory for every compact Simple Lie group and every supplied finite-dimensional irreducible representation of the scalar fields. Both finite and infinitesimal transformation laws have been included, and every sign follows the same anti-Hermitian convention.
Use the orientation selected by the volume form, and let be its normalized Riemannian volume form. The Euclidean metric induces an inner product on the exterior algebra of covectors. The Hodge star operator is the unique map from -forms to -forms satisfying
For an oriented orthonormal coframe , it sends a basis wedge to the complementary wedge with the sign of the permutation that restores . Applying the Hodge star operator twice exchanges blocks of and covectors, so
Here the supplied volume is interpreted in the usual metric-normalized sense. If instead one defines the operator with an arbitrary unnormalized , that operator is and its square on two-forms is . The usual self-duality statements use the metric-normalized Hodge star operator, with the supplied volume specifying orientation.
The projections give the Hodge splitting of Euclidean two-forms:
Both spaces have dimension three. With , bases are
The Hodge star operator is an orthogonal involution on two-forms and therefore is self-adjoint. For a self-dual two-form and an anti-self-dual two-form ,
Consequently
This is the wedge orthogonality of opposite-duality two-forms.
For the Yang-Mills action, take an anti-Hermitian special unitary group connection and the fundamental matrix trace, so the positive invariant pairing on its Lie algebra is . Write its gauge curvature as using the Hodge splitting of Euclidean two-forms, and define
Cross terms vanish by the wedge orthogonality of opposite-duality two-forms. Thus
With this anti-Hermitian convention the Second Chern number is
For example, this normalization follows by expanding and using . Interpreting the integral as an integer Second Chern number on assumes the usual decay and gauge behavior that allow extension over the point at infinity. The following norm inequality itself does not require integrality:
The Yang-Mills instanton Bogomolny bound is saturated precisely when one component vanishes: or . In the stated convention the self-dual case has and the anti-self-dual case has . Reversing orientation, or defining topological charge with the opposite sign, reverses this assignment while leaving the absolute-value bound unchanged.
For the self-dual Yang-Mills equations in temporal gauge, choose and . The relevant Hodge star operator identities are
Writing , the self-dual Yang-Mills equations give
In temporal gauge, , so the gauge curvature component is . Hence
The minus sign follows from placing last in the orientation and first in the mixed curvature component.
Write , . Uniformly for in the source ball,
For fixed and , the outgoing Green function for the three-dimensional Helmholtz equation therefore has the far-field approximation for an outgoing source
Substitution into the source integral yields
Thus the source-to-far-field operator at fixed frequency is
It samples the Fourier transform of the source on the sphere of radius . Its square-integrable kernel makes it a Hilbert-Schmidt operator, hence a compact operator. In fact
Use complex inner products linear in the first argument: . Interchanging the volume and surface integrals gives
Hence the adjoint source-to-far-field operator is
This is a normalized Herglotz wave function; the change in exponential sign comes from the complex conjugation in the adjoint operator.
A singular system of a compact operator consists of positive singular values and orthonormal vectors , , with
The form an orthonormal basis of , and the form one of . There are finitely many positive singular values for finite-rank ; otherwise . Obtain the system by applying the spectral theorem for compact self-adjoint operators to , choosing , and setting . The inner product identities verify orthonormality and the displayed relations.
With inner products linear in the first argument,
The normal equation for a linear inverse problem with the Tikhonov regularization penalty acts separately on each . Hence the singular-system Tikhonov filter gives the regularized solution
This norm-convergent series follows from Bessel's inequality and the bound . Data orthogonal to are annihilated by , and the minimizing solution has no component in . The same formula with reconstructs noisy data. In contrast, the unregularized inverse would divide by , with convergence governed by the Picard criterion.
For a basis of the real vector space , the Gram-Schmidt process constructs an orthonormal basis successively:
The inner product makes orthogonal to all earlier . Moreover , since otherwise would be a linear combination of its predecessors, contrary to linear independence. Induction gives . Starting with a basis of a linear subspace and extending it to a basis of gives the same construction with the first vectors spanning .
The orthogonal complement is . For every , set . Then and . If , then , so by definiteness of the inner product. Thus the direct sum is
This also covers and .
For the polynomial space, the form is immediately a symmetric bilinear form, and . A nonzero polynomial of degree of a polynomial at most two cannot have three distinct roots of a polynomial, so this form is an inner product for . For , the nonzero polynomial has . Therefore, among the stipulated positive integers,
The Riesz-Markov-Kakutani representation theorem identifies the dual of the complex space of continuous functions on a compact space with finite regular complex Borel measures on : each bounded linear functional has a unique representation
Here is the variation measure; positive functionals correspond exactly to positive regular measures. This is the measure representation theorem, rather than the Hilbert-space representation of a functional by a vector.
For the spectral construction use the convention that the Hilbert inner product is linear in its first argument. A unital subalgebra of is understood to contain : an algebra whose abstract identity is a smaller projection could not give a resolution normalized by . On a compact Hausdorff space, a resolution of the identity is understood to be a normalized regular projection-valued measure: its scalar measures are regular, its values are orthogonal projections, and it is countably additive in the strong operator topology. Regularity is part of the usual convention needed for the uniqueness assertion; the statement is interpreted in this sense.
The Commutative Gelfand--Naimark theorem makes the Gelfand transform an isometric unital star-isomorphism , where is compact Hausdorff. Denote its inverse by . For , the bounded linear functional has norm at most . Riesz-Markov-Kakutani gives a regular complex measure such that
Uniqueness makes these measures sesquilinear in . For , the identity shows positivity, so is positive with total mass .
For every Borel set , the bounded sesquilinear form determines an operator by Hilbert-space Riesz representation theorem, with
In particular and is self-adjoint. We now verify the projection identity rather than assume it.
For continuous , uniqueness of the representing measure applied to continuous test functions gives
These identities imply . Testing once more against a continuous gives
The restriction of a finite regular Borel measure is still regular, so uniqueness in Riesz-Markov-Kakutani yields . Consequently, for any Borel ,
Taking proves that is an orthogonal projection. Also and . For disjoint , these projections are orthogonal, and scalar countable additivity gives weak countable additivity. If , then is the projection of the remaining union and
Thus countable additivity holds in the strong operator topology. The scalar measures are the regular measures already constructed. This completes the scalar-measure construction of a projection-valued measure.
By the integral theorem permitted in the question, continuous satisfies , and hence . For , this proves the spectral theorem for a commutative operator algebra:
Any other regular resolution giving these integrals has the same scalar integrals on all of ; Riesz-Markov-Kakutani uniqueness forces the same scalar measures and therefore the same projections on every Borel set.
For nonempty open , compact Hausdorff normality supplies a nonzero continuous function supported in . If , the stated squared-norm identity for spectral integrals gives , contradicting the isometry of . This proves the full support of a faithful spectral measure property
Faithfulness of the representation is essential here.
The spectral theorem for normal operators says that a bounded normal operator on a nonzero complex Hilbert space has a unique regular projection-valued measure on such that . Its support is all of , and bounded Borel functions have the associated Borel functional calculus for a normal operator.
For the proof sketch, is commutative because commutes with ; polynomials in these two operators commute, as do their norm limits. The map , , is onto by the character of an algebra formula and spectral permanence for C-star algebras. It is one-to-one because a character of an algebra preserves the star operation and its values on determine it on their dense polynomial algebra. It is therefore a homeomorphism from compact to the Hausdorff spectrum. Transport the resolution just constructed through this homeomorphism. It gives the formula for and full support; conversely a regular resolution for gives the same integrals for polynomials in , hence by density the same continuous functional calculus and the same resolution. This argument works without separability of .
Finally choose disjoint nonempty relatively open sets around two distinct spectral points, and put . Full support gives and , while , so . The spectral integral, or multiplicativity of its Borel calculus with , gives and also . Thus is closed, nonzero and proper, and . The spectral projection gives a reducing subspace conclusion is
In fact it is a reducing subspace, since it is also invariant under .