Suppose a linear map between finite-dimensional Hilbert spaces has matrix , and their inner products in the chosen bases are and . The Gram matrices are positive-definite matrices. Writing for the ordinary conjugate transpose, the coordinate matrix of the adjoint operator is
Indeed, the defining inner product identity says for all . Thus simply transposing and conjugating is valid in orthonormal bases, where both Gram matrices are the identity matrix.
For the weighted inner product and the coordinate swap , the adjoint operator has matrix . With and , both inner products equal . The coordinate swap is its own ordinary transpose, but is not self-adjoint in this weighted inner product.
For and zero endpoint values, write with , and . The change of variable has and sends , . Thus it is an isometry from the weighted inner product to the ordinary integral on , and the apparent singular operator becomes . Its Dirichlet eigenvalues are and its normalized eigenfunctions are , . The singular endpoint is handled through this transformed regular domain; a zero eigenvalue occurs exactly when .
Decoupled coefficients of orthogonal polynomial projections Created 2026-10-18 Updated 2026-10-20
Let be a real function with , and let be the vector space of real polynomials of degree at most . Its orthogonal projection is the least-squares polynomial in an orthogonal-polynomial basis
Each coefficient depends on just one weighted inner product with and one squared norm. In particular, the coefficients stay the same when the allowed polynomial degree increases. This statement assumes a fixed weight, interval and normalization of the orthogonal polynomials.
To see why the least-squares normal equations decouple, first write a trial polynomial as in any basis of . The residual must be orthogonal to each permitted direction, giving
The Gram matrix usually couples the unknown coefficients. With , it becomes , leaving the separate equations . For the monomial basis on with , by contrast, is zero when is odd and when is even. Distinct even powers, or distinct odd powers, remain coupled.
There is also a proof of the minimum that uses no differentiation. The defining coefficients give for . Thus is orthogonal to all of . For every , the Pythagorean theorem in an inner-product space gives
The second term is nonnegative and vanishes exactly when , proving that the least-squares solution is unique. This is an integrated squared-error optimum; it does not assert a smallest error at every point or a smallest uniform norm.
For , the nested orthogonal projections satisfy the exact residual budget
Indeed, is a linear combination of mutually orthogonal polynomials, and is orthogonal to it. Every newly retained component removes exactly from the squared error. No infinite expansion or completeness assumption is needed for this finite identity. The Legendre least-squares projections of a cubic make every term explicit.
Dirichlet eigenfunctions of the Chebyshev differential operator Created 2026-10-18 Updated 2026-10-20
The Chebyshev differential equation on , with zero endpoint values, has the Sturm-Liouville form
Thus and the weight defining the weighted inner product is . The substitution maps the problem to on with homogeneous Dirichlet boundary conditions. It also transforms into . Consequently the normalized eigenfunctions are
Their weighted inner product is the ordinary sine inner product on . Equivalently, , where is a Chebyshev polynomial of the second kind. These are not the cosine solutions , which have different endpoint values. The original endpoints are singular because vanishes and diverges there, but the transformed Dirichlet problem specifies the self-adjoint realization. The eigenfunctions vanish at both endpoints and their quasi-derivatives have finite limits, so the boundary form vanishes.
For on with zero endpoint values, the natural weighted inner product has measure . Set and . The chain rule gives , so with zero endpoints on . Moreover , so the transformation preserves the norm. The ordinary sine orthonormal eigenbasis therefore gives exactly the displayed spectrum and eigenfunctions for . The factor and the additive distinguish this problem from the operator with measure .
Let be a real continuous function on a nondegenerate compact interval and let be its best approximation among polynomials of polynomial degree at most for a positive integrable weighted inner product. Then has at least distinct zeros. Indeed, if it had at most , multiply it by the polynomial with simple zeros at precisely its interior sign changes. The product has constant nonzero sign away from finitely many zeros, so its weighted integral is nonzero, contradicting orthogonality of to all polynomials of polynomial degree at most .
Take the polynomial on with unit weight. Using the four Legendre polynomials above, direct integration gives
For example, : the omitted odd terms have zero integral. Dividing by gives . Substituting all four coefficients proves the exact identity
The successive orthogonal projections onto degrees at most are therefore
Here is the squared L2 norm, without division by the interval length. Each row retains the previous Legendre polynomial coefficients and appends one new term. The ordinary power coefficients can change: adding changes the constant from to , and adding changes the linear coefficient from to . Independence belongs to the chosen orthogonal polynomial coordinates.
Figure 1.
Nested Legendre least-squares projections of a cubic and the exact squared residual contributed by each omitted mode
. Details.
The full squared L2 norm is , equal to . The residual budgets are the omitted terms:
For a direct check independent of summing the budgets, , and integrating its square gives . This residual is orthogonal to , exactly the conditions for the best quadratic least-squares solution. An orthogonal projection need not be a polynomial interpolant: for example, while . The approximation allocates error across the interval according to the chosen weighted inner product.
For a Cauchy-Euler equation, logarithmic coordinates turn scale changes in into translations in . With , the chain rule gives and . Consequently the Sturm-Liouville operator becomes . Its natural weighted inner product has measure , so this change of variable also preserves the norm when the transformed problem uses ordinary integration in . On with Dirichlet boundary conditions, the orthonormal eigenfunctions are and the eigenvalues are , for .
With the weighted inner product , the Chebyshev differential equation has the Sturm-Liouville form with coefficients , and . The substitution converts its operator to on and its inner product to the ordinary one in . The natural endpoint conditions become zero derivative conditions at .
Consequently the eigenfunctions are the Chebyshev polynomials with eigenvalues , . Their squared norms are for and otherwise. In particular and are orthogonal. The endpoints of the original differential expression are singular; specifying these transformed Neumann boundary conditions defines its self-adjoint realization. The Dirichlet eigenfunctions of the Chebyshev differential operator use a different endpoint condition and have sine rather than cosine profiles.
The Laguerre polynomial normalized by has coefficients . By the Leibniz rule, this is equivalent to Rodrigues' formula, . For any polynomial of degree below , applications of integration by parts give . All endpoint terms vanish: derivatives of of order below vanish at zero and decay at infinity. Since , the same calculation gives
Thus these orthogonal polynomials are already an orthonormal set for the weighted inner product with weight .
Let be the regular self-adjoint operator of a Sturm-Liouville problem, with eigenfunctions orthonormal for the weighted inner product . For outside its spectrum, the displayed kernel satisfies with an ordinary, unweighted Dirac delta. Indeed weighted completeness gives . Thus solves . A kernel integrated against instead omits the prefactor. For real coefficients, the weighted reciprocity relation is when the spectral parameter is real and outside the spectrum. A zero eigenvalue prevents inversion at without a forcing compatibility condition or a projected inverse.
Orthogonal polynomial Created 2026-09-24 Updated 2026-10-18
An orthogonal polynomial family chooses polynomials that do not overlap under a specified inner product. For real polynomials on an interval , use the weighted inner product
Assume , the weight is measurable and positive almost everywhere, and its absolute moments are finite for every integer . These conditions make the integrals finite and give every nonzero polynomial positive squared norm. A sequence is an orthogonal polynomial family when has real coefficients and polynomial degree exactly , and for .[ref]
Here and is the Kronecker delta. Orthogonality does not require : an orthonormal set is obtained only after replacing by . Multiplying each member by any nonzero real constant preserves orthogonality, but changes its norm and the corresponding expansion coefficient. The monic orthogonal polynomial convention instead fixes each leading coefficient to one.
The first four Legendre polynomials, named for Adrien-Marie Legendre, use on and the normalization :
Their orthogonality and squared norms are
Thus their Gram matrix has a positive diagonal and zero entries elsewhere, although their function graphs cross and overlap on the page. Orthogonality measures an integral of products, rather than separation of function graphs.[ref]
Figure 1.
The first four Legendre polynomials and their exact integral Gram matrix: orthogonal, with unequal squared norms
. Details.
For these four polynomials, a short verification expands each product and uses and . For example, and . The same calculation gives the diagonal entries . More generally, apply the Gram-Schmidt process to the monomial basis : at step , subtract projections onto the earlier polynomials. The result retains its leading term, has degree , and has positive norm, proving existence without a differential equation. Different degrees also give linear independence, so form a basis of the polynomials of degree at most .
This basis turns least-squares solutions for functions into independent scalar calculations, as the decoupled coefficients of orthogonal polynomial projections show. In a spectral method, increasing the degree enlarges the approximation space while keeping earlier projection coefficients fixed. Weighted integrals also connect the same orthogonal polynomials to Gaussian quadrature: its nodes are polynomial roots of a member of the family. The projection problem minimizes an integrated squared error; Gaussian quadrature uses the family to choose evaluation points for an integral.
Orthogonal vectors Created 2026-09-24 Updated 2026-10-14
Two vectors are orthogonal when their inner product is zero.
For real Euclidean vectors, the inner product is the dot product, so and are orthogonal: . For nonzero Euclidean vectors, this means their angle is . The zero vector is orthogonal to every vector, although it has no direction or defined angle.[ref]
In an abstract inner product space, orthogonality always refers to its chosen inner product. For example, the weighted inner product makes and orthogonal, since . Their ordinary dot product is , so their arrows are not perpendicular in the usual Cartesian coordinate system. The algebraic definition also applies to functions, where arrows need not be available.
The drift makes the natural measure weighted. Let
Under homogeneous Neumann boundary conditions, the differential operator is self-adjoint in the weighted inner product . Indeed integration by parts gives
when the derivative boundary terms vanish. In particular its eigenvalues are nonpositive and it has the constant stationary eigenfunction. We first construct the weighted Neumann heat kernel with constant drift, then incorporate the two prescribed coordinate derivatives.
Put . The Robin gauge transform for constant drift, , turns into
These are coordinate-derivative Robin boundary conditions, with the same algebraic sign at both endpoints. The left condition for an oscillatory solution of wavenumber gives . The right condition then reduces to , giving . There is also a separate mode , , which must not be discarded by restricting to oscillatory . For , write : the endpoint determinant reduces to , leaving only that zero mode. At , the linear solution satisfies both endpoint conditions only if it vanishes, because . The complete Sturm-Liouville eigenfunction expansion therefore uses
Their squared norms in the weighted measure are
The cancellation of the weight against makes the latter formula an ordinary trigonometric integral. Define
For this kernel is smooth in the interior. It integrates initial values against , not against unweighted Lebesgue measure. It is symmetric in as a weighted kernel, even though the drift operator does not look symmetric in an unweighted inner product.
To determine the boundary forcing, set . Two applications of integration by parts leave
The minus sign at the left endpoint is the sign of the boundary evaluation ; the supplied is , not an outward normal derivative. Solving this linear differential equation by an integrating factor and recombining the modes gives the requested space-time integral representation:
This is the Neumann boundary-forcing formula. The zero mode also gives the useful consistency check
Ordinary unweighted mass instead obeys . Replacing the weighted measure by or deleting the constant mode would therefore give an incorrect solution.
There is a subtle point when checking nonzero derivative data: every homogeneous eigenfunction has zero endpoint derivative, but differentiating the boundary-forcing sum and its time integral term by term at an endpoint is not valid. The kernel is singular as , and the prescribed derivatives are interior limits of the full solution. An explicit Laplace transform form verifies those limits without this interchange and gives an alternative purely contour-integral version.
For , set using the principal square root, and define
Both solve , with , . Their weighted Wronskian is the nonzero constant
Hence the resolvent kernel for Neumann advection-diffusion on an interval is
The first derivative in has jump , giving in the sense of distributional derivatives. If and , an equivalent transformed solution is
In fact and , so and exactly. The inverse Bromwich contour integral of is an alternative final answer. Its poles at and reproduce the constant and decaying modes of , respectively; apparent square-root singularities in the normalized hyperbolic factors are removable. This also independently checks the kernel normalization and boundary signs.
As in question 1, the printed dot on denotes its spatial derivative: the two corner conditions are and . The initial eigenfunction expansion converges to in the weighted space and, for the stated smooth compatible data, has the appropriate classical initial and boundary limits. Differences of solutions with zero data satisfy , proving uniqueness in the usual regular solution class. In the limit , , , and the ordinary Neumann heat kernel on an interval and its boundary signs are recovered.
Use the weighted Neumann heat kernel with constant drift. The spatial operator has the self-adjoint form
so its homogeneous Neumann boundary conditions give a regular Sturm-Liouville problem in the weighted inner product
The constant eigenfunction is , with eigenvalue and squared norm . For , put . Substitution of in gives and the Robin boundary conditions at both endpoints. Hence
Indeed,
The Sturm-Liouville eigenfunction expansion is complete and orthogonal. Its heat kernel, relative to the measure , is
For a coefficient , two applications of integration by parts yield
Solving these scalar linear differential equations and summing gives the Neumann boundary-forcing formula:
This depends only on the given data. In particular, the zero eigenvalue retains the changing weighted mean:
The endpoint derivatives of the boundary integral are understood as interior limits. Differentiating each homogeneous Neumann eigenfunction at the endpoint before summing would incorrectly discard the prescribed boundary forcing: the short-time heat kernel makes that interchange invalid. The stated compatibility conditions give the classical boundary traces.
Multiply the two displayed equations by and subtract the one with indices reversed. The product terms combine into the Lagrange identity for a Sturm-Liouville operator:
Integrating from zero to infinity gives
All factors are polynomials. The endpoint term at zero vanishes because of the factor , and the one at infinity vanishes because the exponential function dominates every polynomial. Therefore, if ,
The integral is absolutely convergent. This is orthogonality in the weighted inner product with weight ; the boundary cancellation is the self-adjoint mechanism behind the Laguerre differential operator on polynomials.
Assume the regular real Sturm-Liouville problem, with , ordered eigenvalues , and real orthonormal eigenfunctions in the weighted inner product
The Rayleigh quotient for an admissible trial function is
The second expression follows by integration by parts. It is the quantity used in the Rayleigh-Ritz method.
For , orthonormality eliminates every cross-term in the denominator:
Applying to the eigenfunction expansion and using the same orthogonality in the numerator gives
Hence, whenever the trial function has finite energy,
Put and . The exact error and its expansion are
In particular, under a common small scaling with fixed finite sums and ,
The fourth-order remainder includes mixed products , not just individual fourth powers.
Error comparison and sign. Since , the relative weighted norm error of the supplied trial function is
For , the relative eigenvalue error is . Thus the Rayleigh quotient has a second-order error for a first-order error in the trial eigenfunction, provided the energy-weighted coefficient sum is controlled. Small weighted norm error alone does not control arbitrarily high-frequency contamination, because can grow without bound. If , an absolute error must replace the undefined relative one.
Finally every summand of is nonnegative. Thus
with strict inequality whenever some . This is the upper-bound property of the Rayleigh-Ritz variational principle for the lowest eigenvalue.
For the given weighted inner product, a self-adjoint operator obeys , including equality of its domain with the adjoint domain. In the differential-equation calculation this requires
for all functions in a specified common domain, with endpoint conditions that remove the boundary form. Equality of these inner products by itself describes symmetry; the domain conditions complete the self-adjoint realization.
Use the drift-removing substitution for a Dirichlet Sturm-Liouville problem, . It gives with . Positive requires ; zero or negative yields only the trivial solution under both endpoint conditions. Hence
Multiplication of the original equation by gives . Thus the appropriate weighted inner product has weight , and
Multiplying each eigenfunction by gives weighted norm one.
Define the weighted inner product . For the stated operator , integration by parts gives the Lagrange identity for a Sturm-Liouville operator
The endpoint terms vanish for Dirichlet boundary conditions. Taking proves each eigenvalue is real, since makes the squared weighted norm positive. For eigenfunctions of distinct eigenvalues, the same identity gives , proving their orthogonality.
For the specific equation, divide by to obtain , so its weight is , with . Put , and . The logarithmic change of variable in a Sturm-Liouville problem gives . Remove the first derivative with ; the equation becomes , with .
The Dirichlet spectrum with inverse-square weight is therefore
Indeed . Values give a linear or hyperbolic transformed solution and no nonzero solution vanishing at both ends.