Orthogonal projection matrix Created 2026-09-24 Updated 2026-10-14
A matrix represents a linear projection when applying it twice has the same effect as applying it once. For an orthogonal projection with the standard Hermitian inner product on , the additional condition is that the conjugate transpose equals the original matrix:
Thus is both idempotent and a Hermitian matrix. Over the real numbers this says . Its image of a linear map is the retained linear subspace, while its kernel of a linear map is the orthogonal complement: vectors in the image are unchanged, and vectors in the kernel become zero.
For a matrix with full column rank, projecting onto its column space gives
The invertibility of follows from linear independence of the columns. If those columns are an orthonormal set, and . These formulas and the conditions in the real case are developed in MIT 18.06SC, Projections onto Subspaces, pp. 1–3.
For the line spanned by ,
In particular, and . The eigenvalues are on the retained direction and on the removed direction. This exposes the meaning of an orthogonal projection as retaining selected components, rather than stretching them.
Symmetry refers to the specified inner product. In the real weighted setting, the formula becomes and satisfies and . For the preceding weighted line example,
It is not symmetric under the ordinary transpose, but it is an orthogonal projection for the weighted Euclidean inner product. The matrix criterion should therefore be used with the standard Hermitian inner product, not silently transferred to a different geometry.
Orthogonal projection onto a finite-dimensional subspace Created 2026-09-24 Updated 2026-10-14
A finite-dimensional linear subspace of an inner product space has a unique closest vector to any given vector . This is its orthogonal projection . If is an orthogonal basis of , compute it one direction at a time:
The inner product convention here is linear in its first argument, including over the complex numbers. For an orthonormal basis, each denominator is one. When consists only of the zero vector, the empty sum gives . The finite-dimensional formula is described in Francis Narcowich, Inner Products and Norms: minimization problems.
Take and , using the dot product. With ,
The orthogonal projection residual has . To verify the best approximation directly, every candidate in the line is , and
The smallest squared Euclidean norm error is therefore , attained only at . The diagram connects the perpendicular residual to this one-variable quadratic polynomial.
Figure 1.
The perpendicular residual identifies the closest point on a line and the unique minimum of the squared error
. Details.
The general mechanism is the Pythagorean theorem in an inner-product space. For any , the vectors and are orthogonal, so
Moving away from inside adds a nonnegative squared norm, which is zero only when . This proves both optimality and uniqueness.
The useful feature is separation of preparation from evaluation. Construct an orthonormal basis once with the Gram-Schmidt process, then obtain each new best approximation using inner products instead of a fresh optimization problem. When is the column space of a matrix, this gives linear least squares; when is spanned by orthogonal polynomials, it gives a least-squares polynomial in an orthogonal-polynomial basis. The ambient inner product space need not be a Hilbert space for this finite-dimensional construction. In an infinite-dimensional target linear subspace, existence requires additional hypotheses, supplied by orthogonal decomposition by a closed subspace.
An orthogonal projection residual is the difference between a vector and its orthogonal projection onto a linear subspace . It is orthogonal to every vector in , so for all . The Gram-Schmidt process uses such residuals to remove directions already represented by earlier basis vectors.
This is an optimality condition as well as a geometric description. No permitted change within can remove a further orthogonal component of . In the preceding dot product example, is perpendicular to the line spanned by .
The selected inner product matters. Keep and the same line, but use the weighted Euclidean inner product with . The projection coefficient and residual become
Now , although . The orthogonality is with respect to , so it need not look perpendicular in the ordinary drawing. The squared weighted error is
The weighted optimum reduces the first-coordinate error from to , at the cost of increasing the magnitude of the second-coordinate error from to . The weights express which errors are more costly.
Figure 1.
Changing the inner product changes the closest point: a circle and a weighted error ellipse touch the same permitted line at different points
. Details.
In linear least squares, residual orthogonality to the column space is expressed by the normal equations for linear least squares. With a weighted Euclidean inner product, the corresponding real-matrix equation is . This makes the choice of error measurement part of the mathematical model, rather than merely a plotting convention.
A fiber metric on a smooth vector bundle gives a smooth orthogonal projection onto any vector subbundle. In a local frame of , let be the metric matrix and the columns of a frame of . Then , proving smoothness. The complementary subbundle maps isomorphically onto the quotient vector bundle. Explicitly is a vector bundle isomorphism , with inverse . This inverse is independent of the representative , but the splitting depends on the chosen metric.
Using the Levi-Civita symbol and the contraction of two Levi-Civita symbols, the th component of the vector triple product is
Thus the triple-product identity is .
Apply this with the unit vector to obtain . Dot products and scalar multiplication are linear in , so . Its matrix representation is
The fixed-vector equation is equivalent to . Since , all its solutions are . Also . Every vector decomposes as , with orthogonal to . Hence is the orthogonal projection onto the plane through the origin normal to : it fixes that plane and removes the perpendicular component.
We prove uniform approximation, not just approximation in . The analytic facts used are: a continuous square-integrable kernel gives a compact integral operator on ; the spectral theorem for compact self-adjoint operators decomposes the closure of its range into its finite-dimensional nonzero eigenspaces; and continuous functions are dense in for normalized Haar measure on a compact Lie group. Normalized Haar measure on a compact group is both left- and right-invariant and is preserved by inversion.
Choose a continuous nonnegative function of integral one, supported in a sufficiently small symmetric neighborhood of the identity, with . Such functions are obtained from a local bump and its inverted bump followed by normalization. Define the convolution operator
Its kernel is continuous on , so is compact. The symmetry of makes it self-adjoint. It commutes with the left translations by a change of variable .
By Cauchy-Schwarz inequality and invariance of Haar measure,
The same integral formula and continuity of the kernel show is continuous for every . Moreover, rewriting gives . Uniform continuity on the compact group therefore makes arbitrarily small when the support of is small. Also because and has integral one.
Fix and take so . Then
Let be the orthogonal projection onto increasing finite sums of the nonzero eigenspaces of . Since lies in the closure of the range, the spectral theorem gives in . Applying the smoothing estimate gives
Thus some satisfies .
Each nonzero eigenspace is finite dimensional, invariant under , and consists of continuous functions: if with , then . The finite sum containing therefore carries the finite-dimensional unitary representation . It is continuous, since translating each of its finitely many continuous basis functions depends continuously on in the uniform and hence the norm.
Let be evaluation at the identity on , and let the dual representation on be . For the linear functional on defined by ,
The rank-one endomorphism of satisfies . Therefore
This is the requested Peter-Weyl theorem, proved via the convolution proof of uniform Peter-Weyl approximation. The extra convolution after the spectral truncation is what upgrades the estimate to a uniform one.
To deduce a faithful finite-dimensional representation, first note that these representations separate points. For , choose a continuous function taking different values at and , and approximate it closely enough by a trace coefficient to retain that difference. The representation appearing in that trace must satisfy .
There is an identity neighborhood containing no nontrivial subgroup. Here is the Lie groups have no small subgroups argument: choose an injective exponential chart on a Lie-algebra ball of radius , and take with . If a subgroup contained a nonidentity in , choose the first integer with . Then , so its power lies outside , a contradiction. For a zero-dimensional group, take .
For every , choose a representation nontrivial at . The sets on which these representations are not the identity are open and cover the compact set . A finite subcover gives finitely many representations, whose direct sum has kernel contained in . A subgroup contained in is trivial, so this direct sum is faithful. Averaging its Hermitian form makes it unitary. Thus the finite faithful representation from point-separating representations yields
Using the no-small-subgroups neighborhood is essential; alone need not be compact, so a finite-subcover argument on that punctured set would not be valid.
Work in discounted units with a riskless asset of value one, trivial initial information and finitely many risky assets. Let be their discounted gains. A terminal attainable claim has the form , whose initial cost is . Their span
is a finite-dimensional closed subspace of a Hilbert space. For , one-period least-squares hedging is its orthogonal projection onto .
Let , and . Remove redundant risky directions so that is invertible. Under absence of arbitrage, a gain direction with zero variance is a constant and must be zero, so this reduction loses no genuine trading opportunity. For freely chosen capital and holdings, minimizing
first gives . The remaining centered error is
Completing the square yields
The residual satisfies and , the least-squares normal equations. Exact claim replication is possible precisely when this residual is zero. If capital is fixed at , its normal equation instead gives the fixed-capital quadratic hedge in a one-period market
Thus fixed-capital and freely optimized hedging are distinct problems.
A dominated martingale measure is a probability measure with integrable gains and . Its density obeys , , . An equivalent martingale measure additionally has almost surely. Every such measure prices an attainable discounted claim at , but different measures may give different expectations to an unattainable claim.
The minimal martingale measure in a one-period market is defined by preserving the mean-zero martingale directions orthogonal to the gain innovation . Among square-integrable densities it is
Indeed , , and for , we have . Conversely preservation of all these orthogonal directions puts in ; normalization and zero gain expectations then determine . Any other square-integrable signed pricing density differs from by a vector in , so also has the smallest norm. Its evaluation of a claim is
This is the capital of the optimal quadratic hedge, not automatically an arbitrage-free price. The formula may define only a signed martingale measure: is a genuine dominated measure only if it is nonnegative, and equivalent only if strictly positive. For example, gains with probabilities have , and . Yet probabilities are all positive and have zero gain mean. Thus absence of arbitrage does not force a positive minimal density.
For the market completeness assertion, assume absence of arbitrage and hence existence of an equivalent martingale measure . In finite states this is the usual fundamental theorem of asset pricing; the one-period version also holds with finitely many assets on a general probability space. Market completeness means that every bounded claim is attainable, equivalently in this square-integrable setting. We now prove completeness and uniqueness of dominated martingale measures.
If the model is complete, replicate every indicator . Two dominated martingale measures both evaluate it at its unique claim replication cost, and therefore assign every event the same probability. They are identical.
Conversely let and suppose the model is incomplete. There exist disjoint events of positive probability. Otherwise the probability space would have at most atoms: any non-atomic positive event could be split to increase the number. Its whole payoff space would then have dimension at most , forcing equality with and market completeness. Choose a basis of . Its members are integrable under , because they are combinations of the constant and the gains. The vectors
are linearly dependent. Hence a nonzero bounded satisfies for every , in particular . For , define
These strictly positive densities integrate to one, preserve every gain expectation, and give distinct equivalent martingale measures. They are also dominated by . Thus uniqueness is impossible in an incomplete market, proving the equivalence under the stated no-arbitrage hypothesis.
That hypothesis is essential. On three positive-probability states, the gain has the unique dominated martingale measure, concentrated on the first state, but its attainable span has dimension only two. The market is incomplete and admits arbitrage. This explains why uniqueness among merely dominated probabilities must not be used without an equivalent pricing measure or a no-arbitrage assumption.
For a bounded linear operator , write the weak square norm of a finite family as
It is a 2-summing operator if for all finite families, and is the least such . This specializes the definition of an absolutely p-summing operator.
First let , be Hilbert spaces. For the column operator , , the Riesz representation theorem gives . If is a Hilbert-Schmidt operator, the Parseval identity applied to orthonormal bases gives
Thus . Conversely test the summing inequality on any finite orthonormal family in . Its weak square norm is , by the Bessel inequality, with equality by choosing one of its vectors. Hence . Taking the supremum over finite subsets of an orthonormal basis proves the Hilbert-Schmidt operator condition and the reverse norm inequality. These basis sums work even for nonseparable Hilbert spaces, being understood as suprema of finite subsums. Therefore
For an -dimensional normed vector space , again associate a family with . By the Hahn-Banach theorem and scalar Euclidean duality,
Let be the orthogonal projection onto , whose dimension is at most . Since , the trace of gives
This proves for every norm, without comparing that norm to an arbitrary Euclidean norm.
To obtain equality and the projection bound, choose a maximum-volume centered ellipsoid inside the unit ball and use coordinates in which it is the Euclidean ball . In the real case this is the John ellipsoid; in the complex case maximize among Hermitian ellipsoids. There are unit contact vectors and positive weights with the John contact decomposition
For completeness, the maximum-volume argument gives this identity. If were outside the closed convex cone of the contact matrices, finite-dimensional separation would supply a symmetric, or Hermitian, matrix with and at every contact. The cone is closed because its compact generators have trace one. Subtract a sufficiently small multiple of the identity to make all contact inequalities strict while retaining positive trace. The support function of decreases near the contact directions for small ; away from them the strict gap between the support functions of and permits the same small deformation. Thus this deformed ball still lies in . Its volume increases, since the real determinant is in the real case and in the complex case. This contradicts maximality. The finite-dimensional convex-cone representation gives finitely many contacts, and taking traces gives the sum of the weights.
At a contact , a supporting hyperplane to also supports . The Euclidean ball has a unique supporting direction there, so the corresponding functional is and has dual norm one on . In the complex case balancedness of turns the real support bound into . Also gives . For any dual-unit functional , this containment implies that its Euclidean norm is at most one. Apply the summing definition to :
The weak square norm is exactly one, since any contact functional attains that Euclidean norm. Hence . Together with the upper estimate, the norm is
This proves the 2-summing norm of a finite-dimensional identity formula.
Finally retain the preceding finite-dimensional hypothesis when . Extend each to a dual-unit functional on using the real or complex Hahn-Banach theorem. Define
The contact identity gives , hence and its range is . The synthesis operator has Euclidean operator norm one, because its product with its adjoint is the identity. Therefore
Thus the linear projection satisfies , the Kadec-Snobar projection bound. If , the zero projection gives the same conclusion. No assertion about arbitrary infinite-dimensional subspaces is required.
Let for a bounded normal operator on a nonzero complex Hilbert space. The zero Hilbert space has the trivial calculus. Take the inner product linear in its first argument. The continuous functional calculus is an isometric unital star-representation with . The Borel calculus will act on , the algebra of actual bounded Borel measurable functions. A quotient by null functions is introduced only after specifying the spectral measure; there is no preferred scalar measure such as plane area on .
Here is a construction that also covers a nonseparable Hilbert space. For , the positive functional has a finite regular Borel measure by the Riesz-Markov-Kakutani representation theorem. On continuous functions,
Continuous functions are dense in . Hence extends to a unitary map from that space onto . This subspace reduces and , which correspond to multiplication by and . Decompose as an orthogonal direct sum of such cyclic reducing subspaces, using maximality: a nonzero vector in the remaining orthogonal complement would generate another summand. The family need not be countable. This is the cyclic multiplication model for a normal operator.
On each summand define to be multiplication by , for , and take their bounded direct sum. It defines a unital star-homomorphism
Thus , , and positivity of gives positivity of . The continuous functional calculus is recovered on .
Set for a Borel subset of . Then is an orthogonal projection, , , and disjoint countable unions add in the strong operator topology. Indeed on every multiplication summand the indicators add pointwise, and the tail squared norm is the measure of a decreasing sequence of sets tending to the empty set. Thus is a projection-valued measure, and
For , polarization gives scalar measures satisfying . Regularity of these finite scalar measures and uniqueness in the Riesz-Markov-Kakutani representation theorem make the projection-valued measure unique: its values on continuous functions determine all scalar measures and hence every projection. This also makes the calculus independent of the chosen cyclic decomposition.
The correct convergence assertion is bounded pointwise convergence in the strong operator topology. If pointwise and , then
by the dominated convergence theorem. This need not be convergence in operator norm. For multiplication by on , the functions converge pointwise to , their operators converge strongly to zero, but their operator norms are all one.
A Borel measurable function can vanish spectrally without vanishing pointwise. Precisely, if and only if for every , and
The upper norm bound follows by integrating against vector measures; a unit vector in any nonzero projection gives . The induced map on the quotient by these spectral-null Borel measurable functions is isometric. Every nonempty relatively open subset of has nonzero spectral projection, since otherwise a nonzero continuous function supported there would contradict faithfulness of the continuous functional calculus. This full support gives the usual continuous spectral mapping theorem, but for a Borel measurable function the exact statement is instead
If an indicated neighborhood has zero projection, define a bounded reciprocal of off it and zero on it; the calculus supplies an inverse. Conversely unit vectors in the nonzero projections for arbitrarily small neighborhoods give arbitrarily small, contradicting invertibility. This is spectral essential range in Borel functional calculus. For example in the multiplication model on , although the pointwise range of that function is .
Spectral projections provide reducing subspaces, and : the squared norm of is . In finite dimension the calculus is simply , the sum over eigenspaces. In general it also permits discontinuous cuts and Borel choices of square roots, such as with , giving a normal operator with even when a continuous scalar branch is unavailable.
Any bounded operator commuting with both and commutes with their continuous functional calculus and with all . To justify the latter, regularity approximates by uniformly bounded continuous functions in the norms of any finite list of vector measures; the resulting net converges strongly to . Thus the Borel calculus lies in the Von Neumann algebra generated by . On a separable Hilbert space, a countable dense list of vectors gives a controlling measure ; spectral-null sets are exactly its null sets, and the range is the represented , equal to that Von Neumann algebra. Without separability this last equality is not automatic: for the diagonal operator with one eigenvector for each , the generated Von Neumann algebra has arbitrary bounded diagonal functions, while the original Borel calculus has Borel diagonal functions. The spectral-measure construction and the strong convergence theorem themselves require no separability. This distinguishes the Borel functional calculus for a normal operator from its continuous predecessor without confusing pointwise functions, spectral equivalence classes and topological closure.
Let denote the columns. The Gram-Schmidt process begins with , so
The second column has and residual
This residual has norm , giving and .
For the third column the orthogonal projections are and . Subtracting them gives
Its norm is , so and . Thus the requested thin QR decomposition is
The three displayed columns have pairwise zero inner products and unit norms; direct multiplication gives .
Write for the all-ones vector and set
The centering assumption makes . Thus the full normal linear model has fitted-value orthogonal projection , and its residual sum of squares is . Assume , as is needed to estimate the unknown error variance from residuals.
For the null that all slopes vanish, the reduced fitted value is , with residual sum of squares . The F-test is
Reject for an upper-tail value exceeding the quantile of this F-distribution. The required theorem is Cochran's theorem: for an isotropic normal distribution, projections onto orthogonal subspaces are independent, and the squared norm on a rank- subspace divided by has a chi-squared distribution with degrees of freedom. Here the null makes the projected mean in zero, so , independently of .
Let be the numbers of columns in the two predictor blocks. To test the first block while retaining the second as nuisance, form
The partial F-test for nested linear models is
Again reject in the upper tail. The difference of the nested fitted-value projections has rank , is orthogonal to the full residual projection, and annihilates the null mean, which gives the same independent chi-squared argument. If a block has no columns, the corresponding test is vacuous.
The phrase orthogonal statistical parameters refers to zero cross-block Fisher information, not to the numerical parameter vectors being perpendicular. In this model the cross-block information is , so the orthogonal coefficient blocks in a centered normal linear model condition is
Then the two fitted subspaces are orthogonal, the block least-squares estimators have zero covariance and are independent because they are jointly Gaussian, and each block's extra sum of squares is unchanged by including the other block. Centering also makes both blocks orthogonal to the intercept.
The calculation is principal component analysis on a correlation matrix, rather than on an unscaled covariance matrix. For each of the eleven rating variables, subtract its column mean and divide by its column standard deviation. If is the resulting matrix, use the divisor convention of the fitted object to write
Here the scaling standard deviations use divisor , consistently with this convention. Using sample standard deviations with divisor gives the same correlation matrix and directions, with the corresponding score scale. Every diagonal entry of is one, so .
A principal component is the linear combination of the standardized ratings along . Its principal component score for judge is , and its variance is . The displayed component standard deviations are ; the explained variance of a principal component is . In particular,
The first component explains about of the standardized variation, and the first two jointly explain . Components three, four and five add about , and . The cumulative line adds these proportions successively; it is not the proportion explained by that component alone. Retaining two components discards about of the total standardized squared variation.
The displayed principal component loadings are the unit eigenvector coefficients . The first direction has positive, broadly similar weights for all ratings. It measures an overall favorable-rating tendency: a judge high on most ratings has a high first score. The second direction compares integrity and demeanour, with large positive coefficients, against such attributes as decision promptness, case-flow management and physical ability, with negative coefficients. Thus among similarly rated judges, a positive second score indicates relatively stronger integrity/demeanour compared with those operational ratings. This is a description of a data direction, not a causal interpretation. Multiplying a whole eigenvector and its scores by minus one reflects the display but changes nothing substantive.
These principal component loadings are not themselves variable-component correlations. With standardized variables,
For example, the integrity correlation with component one is approximately . Blank loadings in the printed second column indicate suppressed small entries, not exact zeros. The complete unrounded loading vectors in the fitted object must be used to calculate scores.
A two-dimensional representation plots the 43 pairs
with each point labeled by its judge. In the fitted software object these are the first two columns of the score matrix. Nearby points have similar projections of their standardized ratings. The rank-two reconstruction is the orthogonal projection onto the leading principal plane and minimizes the total squared reconstruction error over all two-dimensional linear subspaces. To see this, for any orthonormal pair of directions the captured variance is the sum of its two Rayleigh quotients, at most by diagonalizing ; the remaining variance is the total minus that captured sum. Distances in the plot omit the smaller components, so a close projected pair need not be equally close in every original rating. The actual 43 coordinates cannot be recovered from the summary alone; the supplied data matrix or fitted score matrix is needed.
The printed descriptive list omits INTG, although the loading table includes it. INTG denotes integrity and supplies the eleventh variable. The standard data set also contains a contacts variable; the stated eleven-rating analysis uses the ratings, not contacts.
Put , , and . Assume positive bulk modulus and shear modulus. For a unit vector , direct contraction of the isotropic elastic stiffness tensor gives the acoustic tensor and its inverse:
These are its transverse and longitudinal orthogonal projections. Symmetrizing the definition of the directional elastic strain Green operator consequently gives
Substitution into the spherical representation is already the isotropic specialization. We can also evaluate its angular integrals as distributions. For , direct integration with the polar axis parallel to gives
The first identity holds as a locally integrable distribution. Since the second derivative of is , taking two derivatives in the first identity and four in the second gives
Thus an explicit complete isotropic elastic strain Green kernel is
All derivatives here are distributional derivatives, which retain the contribution at the origin.
For the requested contraction, , or equivalently trace the complete kernel and use . Therefore
More explicitly, its distribution form is
where the Cauchy principal value uses spherical exclusions about the origin. The coefficient of the Dirac delta can be checked by integrating by parts over a punctured ball: has contact term . Taking the trace, the principal-value part has zero trace and , so
Keeping only the ordinary kernel away from the origin would incorrectly give zero for this double trace.
Now extend the elastic polarization by zero outside . Since the shear modulus is unchanged, the stiffness contrast acts only on the spherical strain:
Hence is its scalar coefficient. Relative to the same external loading, the elastic strain Green operator gives . Taking the trace and using the contact identity reduces this nonlocal equation to
Solving the scalar equation gives the constant-shear bulk-modulus inclusion formula
Using the single contraction instead of the double trace gives
Finally eliminate the actual trace using the scalar formula:
The reference trace in this last formula is essential and is what the original PDF prints; the converted TeX loses its superscript. The second derivatives are interpreted distributionally, or with their principal-value and contact terms explicitly included. With ordinary regularity they give the corresponding pointwise formula at regular interior points.
At the double threshold, . For , , so and every remaining eigenvalue is strictly negative. There is a spectral gap separating this two-dimensional kernel from the stable modes. The centre manifold theorem therefore gives a two-dimensional state centre manifold, with
If the two detuning parameters are adjoined as variables with zero time derivatives, the extended centre manifold has total dimension four; its state fibers still have dimension two.
The only nontrivial spatial symmetry of the bounded interval is the reflection . Since is even and odd, its group action on the amplitudes is . Thus equivariance requires to be even and odd in . There is no sign symmetry , because the quadratic nonlinearity breaks it. The general smooth form is , , with the zero solution preserved. The quadratic even-odd mode interaction follows on truncation:
Writing and , the exact linear growth rates are and . To first order in detuning,
The orthogonal projection of the quadratic term onto the neutral eigenfunctions determines the leading coefficients. Both eigenfunctions have squared norm one, and parity kills the unwanted products. The quadratic correction contributes no term through , since is self-adjoint and the projected modes lie in its kernel. Consequently
These projections are also a concrete way of computing the normal form. In this normalization they give , and , consistent with the stated coefficient ratios.
Use the standard -oriented partition normalization of B-splines, in contrast to the unit-integral normalization. Thus and on , with equality for a complete basis on its basic knot interval. This terminology does not mean that each basis function's maximum is exactly one; for example an order-three cardinal spline has maximum . Assume the basis has positive support on the integration interval and is continuous, as is needed for a projection taking values in .
Let
The ordinary Gram matrix is positive definite by linear independence. The appropriate row-normalized, or mixed-normalization spline Gram matrix, is
Here is a unit-integral nonnegative spline. Unlike , need not be symmetric. If the full support lies inside the interval, ; otherwise use the actual interval integral rather than that full-support formula.
The normal equations for the orthogonal projection say , with . Divide each row by to obtain
Nonnegativity and unit integral give . The subpartition of unity for B-splines then gives
Taking the supremum over and then over nonzero proves the uniform norm bound for B-spline orthogonal projection:
The row normalization is essential; replacing with the ordinary Gram matrix would not be the same asserted estimate. The operator is defined on and maps into its finite-dimensional spline subspace, onto , not onto all of as one phrase in the PDF says. Its range follows both from the formula and from reproducing every .
If “-normalized” were instead read literally as individually peak-one splines, their sum can exceed one. The basis-dependent factor must then be retained: . Equivalently the displayed bound without an outside factor uses . The standard partition-normalized convention has and yields the sharper bound proved above.
Write . If is a best approximation in the finite-dimensional linear subspace, then for every in it and every real ,
A nonzero real linear coefficient would make this negative for sufficiently small of the appropriate sign. Hence . In a complex inner product space, apply the argument to too; the imaginary part also vanishes. Thus for every in the subspace.
Conversely, if that orthogonality holds, every other candidate has the form , and the Pythagorean theorem in the inner product norm gives
Equality requires . Therefore
The next part constructs this orthogonal projection explicitly. No completeness of the whole inner product space is required for projection onto a finite-dimensional subspace.
Model the two samples as independent multinomial counts with fixed row totals and three category probabilities. The null hypothesis is for every category . Up to combinatorial factors the likelihood is . Without the null restriction its maximizers are ; under the null, maximizing subject to gives
The observed column totals are , giving fitted expected counts in each row.
To derive the null distribution, put . Under the null its mean is zero and covariance is . The multivariate central limit theorem gives, asymptotically, the standardized contrast a centered normal distribution with covariance
This is the orthogonal projection onto a two-dimensional plane. In an orthonormal basis of that plane, the two nonzero coordinates are independent standard normal variables, so tends to . The pooled estimates are consistent; substituting them for leaves this limit unchanged by Slutsky's theorem. Since and , the resulting statistic is precisely the Pearson chi-squared test of homogeneity statistic
This supplies the two degrees of freedom rather than treating all six cells as independent. Every fitted expected count is large, supporting the approximation.
For these data,
It exceeds the two-degree-of-freedom 95th percentile , but not the 99th percentile . Hence reject equal score distributions at the 5% level, but not at the 1% level. The asymptotic p-value is .
The finite-dimensional inner product space has the orthogonal decomposition . Define for , . This is a linear map with image , satisfies , and is self-adjoint by taking inner products between decomposed vectors. Hence it is an orthogonal projection.
Any other orthogonal projection with image has kernel by part (a); it is identity on by idempotence and zero on its kernel. Its values are therefore forced to agree with , proving uniqueness.
If , every has , so and . Conversely, if , every image is killed by . Therefore