Interpret the angle as the directed subspace angle defined by the infimum of projected unit vectors; it is different from the smallest angle between two subspaces. Write
Consider the bounded linear operator given by . Its adjoint operator, between these two Hilbert spaces, is : for and , the orthogonal projections give . The two positive directed subspace angle cosines yield
The first bound makes injective and gives a closed range. Explicitly, if converges, then , so is a Cauchy sequence. The closed subspace of a Hilbert space is complete, and its limit maps to the proposed range limit. The second bound gives . A vector orthogonal to the range has , so it must be zero. The range is therefore dense as well as closed in , and is onto. This is the mechanism of invertibility from lower bounds on an operator and its adjoint.
For any , choose the unique with . Then , so . Moreover, if , then and hence . Every vector has a unique decomposition, and
The direct sum is a topological one as well: the component depends boundedly on , with operator norm at most .
For precision, the quoted equality of the norms of complementary oblique projections needs both summands nonzero. For example, with , and , the oblique projection is , so but . The secant function has value one here, so the second equality in the quoted formula fails. With nonzero complementary summands its intended version is valid. The proof above does not use that formula. The angle itself is undefined on a zero source space because it has no unit vectors; expressing the hypotheses as the two lower bounds handles zero spaces without ambiguity.
The linear independence of the first elements of each orthonormal system shows that and have the same finite dimension and are closed subspaces of a Hilbert space. Apply part (b) with and . Since , the positive directed subspace angle cosine gives
Let be the oblique projection onto along . Define . Its residual is orthogonal to every with , so the required measurements agree. Conversely, if has the same measurements, then ; uniqueness of the direct sum decomposition gives . Thus this is finite-dimensional Hilbert sampling reconstruction.
There is also an explicit coefficient description. Use the inner product convention linear in its first entry and put
Then . The orthonormal systems show and , so the smallest singular value of is . Hence , another direct proof of existence and uniqueness.
For , both summands of this direct sum are nonzero: the infinite orthonormal system contains . The permitted oblique projection norm formula therefore applies without its degenerate exception, giving
The operator norm immediately yields the stability estimate . For the approximation bounds, put . Because fixes , we have
so the operator norm estimate gives . For the lower bound, while . The Pythagorean identity gives
The unique measurement-matching reconstruction is stable and within the secant function factor of the best orthogonal projection approximation:
If a zero-dimensional reconstruction is admitted, it is simply and its error equals the norm of ; that case is best stated directly instead of using the angle of a zero space.
Since , . Also exactly when , which is exactly the range of . Thus
A bounded self-adjoint idempotent is an orthogonal projection: if and , then . Here the orthogonal complement is precisely the zero-mass subspace .
Using and the orthogonal projection identity , we have . The orthogonal decomposition then gives
The sign is negative, as in the PDF; the converted TeX loses it at the last equality. This establishes the exact spectral gap of normalized velocity relaxation: on the zero-mass subspace , with gap one rather than the weaker half-gap estimate.
The orthogonal projection satisfies , hence and . Set . Then and . Crucially, applying the energy identity of part (e) to gives
Solving this scalar equation and taking square roots proves
This argument uses (e) explicitly, rather than bypassing the requested energy method with an explicit solution formula.
Apply part (i) to the continuous difference . Every Fourier coefficient of vanishes, so every Fourier partial sum is zero. The orthogonal projection convergence from part (i) therefore gives .
If , continuity gives an interval on which is bounded below by a positive number. That interval would contribute positively to , a contradiction. Hence
The continuity hypothesis upgrades equality almost everywhere to pointwise equality.
Use normalized Fourier coefficients and the inner product
The functions are orthonormal. Hence the Fourier partial sum is the orthogonal projection onto the trigonometric polynomials of degree at most . For any such polynomial , orthogonality gives
so .
Given , the permitted density result supplies a trigonometric polynomial with . Once includes its degree,
Therefore the Fourier partial sums converge to in the normalized norm, giving exactly the stated mean-square limit.
For the normal linear model, the log-likelihood is
The full column rank of the design matrix makes invertible. Differentiating in gives the normal equations . With the minimized residual sum of squares substituted, differentiation in gives
These are the maximum-likelihood estimators almost surely; almost surely when and . The linear transformation of the multivariate normal distribution yields
Define the hat matrix . The fitted values are , the regression residuals are , and . The orthogonal projection has rank and annihilates . By Cochran's theorem,
Consequently , with bias . The unbiased estimator is
Its square root, the reported residual standard error, estimates ; the assertion of unbiasedness applies to the variance, not generally to its square root.
For the paper-strength analysis, let be the measured percentage and . Both normal linear models use independent errors of common variance . Their mean functions are for lm1, and for lm2, with separately fitted coefficients. The reported residual standard errors are and , respectively.
For lm1, the estimated conditional expectation at a new percentage is
The original data mean must be used for centering the new percentage; its numerical value is not supplied in the excerpt. Because , the two columns of this design matrix are orthogonal, and . Hence the coefficient standard errors in the output give
This estimates uncertainty in the mean. Predicting an individual future batch would additionally require the new-error variance, estimated by .
To compare the nested normal linear models, test against within the quadratic model. The Student t-test statistic is
Its two-sided p-value is . Equivalently is a partial F-test statistic with null distribution . Reject the linear restriction and prefer lm2 at the 5% level. Its residual spread is much smaller; the increase in the coefficient of determination from to supports the same conclusion, although the test is the relevant complexity-adjusted comparison.
For regression diagnostics, inspect regression residuals against fitted means and hardwood percentage for omitted curvature, a scale-location plot for nonconstant variance, and a quantile-quantile plot against the normal distribution for departures from the error assumption. Check unusual observations using regression leverage and Cook's distance, and examine residuals in collection or batch order if dependence is plausible. Independence and a common variance require substantive justification as well as these plots; a small p-value for a polynomial term does not itself check the error model.
The closest point theorem in a Hilbert space says that, for every nonempty closed convex set and , there is exactly one minimizing .
Put and choose with . The midpoint belongs to because it is a convex set. The parallelogram law gives
Thus is a Cauchy sequence. Completeness of the Hilbert space and closedness of give a limit , with . Applying the same identity to two minimizers gives their squared distance at most zero, proving uniqueness.
The resulting projection is characterized by
Indeed, differentiate at ; the minimum there gives the inequality. Conversely, expanding proves minimality from this inequality. For a closed linear subspace, both signs of each direction are allowed, so is orthogonal to that subspace: this recovers the orthogonal projection.
The Riesz representation theorem states that every bounded linear functional on a real or complex Hilbert space is represented by a unique :
For the complex case take the inner product to be linear in its first argument.
If , choose . Otherwise its kernel is a closed linear subspace. Choose with and let , using the orthogonal projection. Then , , and . For every ,
Therefore take in the real case, and in the complex case. The conjugate in the latter formula compensates for conjugate linearity in the second argument.
The Cauchy-Schwarz inequality gives , and evaluation at when gives equality of the norms. If two vectors represent , their difference is orthogonal to every vector, including itself, hence zero. This proves all assertions of the Riesz representation theorem.
Let be the orthogonal projection onto the good vector subspace , and let the normalized input be . Set with , and define
Assuming coherent access to the two reflections, the amplitude amplification theorem states that
preserves the plane spanned by and acts as a rotation, giving
Hence the good-outcome probability is . When is known, choose the nearest nonnegative integer to . The resulting angle is within of , so the good probability is at least . For small this is close to one and requires iterations. Exact success occurs when . Known also allows exact amplitude amplification by ancilla qubit dilution or selective phase adjustment when ordinary integer iterations would overshoot.
If has a known coherent preparation, its reflection is implemented with , and a zero-state phase flip. A coherent membership test supplies the reflection about . Merely possessing an unknown copy of does not automatically supply its reflection. For the state is already good; for this two-reflection construction cannot generate a good component. These cases delimit the theorem's algorithmic assumptions.
Assume is normalized and the Hilbert space has dimension . The rank-one orthogonal projection satisfies and .
For , has eigenvalue zero on the orthogonal complement of , so it cannot be a unitary operator. The complementary orthogonal projection kills and is not unitary in any positive dimension. In contrast, the Householder reflection
is Hermitian and obeys . Its eigenvalues are along and on the orthogonal complement.
For , only is unitary. In the exceptional one-dimensional case, is also unitary; its complement remains zero.
Use the unitary change of basis from part (b). It reduces the Feynman-Kitaev Hamiltonian to , where
The positive eigenvalues of are positive integers, since its commuting ancilla projectors act on different qubits. The positive spectral gap of is . Thus both positive spectra are bounded below by , for .
Let , and split the work space into and . The common ground space is . A unit vector in orthogonal to has the form , where . Its orthogonal projection onto simply removes its time-zero component, so the projected norm is . Consequently the smallest angle between two subspaces, after removing their common intersection, satisfies
The Kitaev geometrical lemma now gives
Here supplies the penultimate step. Hence
If there are no input constraints, and the propagation gap is already , which is stronger.
The printed geometric-lemma notation needs a correction: the maximum overlap defines , not , and is taken over normalized vectors in the two kernels, with the common ground space removed. The ground space restriction is essential when many quantum witnesses are allowed.
Use probability measure-preserving systems: is measurable and . Its invariant sigma-algebra is
Ergodicity means that every invariant measurable set has measure zero or one:
Equivalently, every invariant measurable function is constant almost everywhere. Indeed all rational sublevel sets of a real invariant function belong to , so the zero-or-one alternative forces its distribution to concentrate at one value. Apply this to real and imaginary parts for complex functions. Conversely, an invariant set has an invariant indicator, so the function criterion implies the set criterion. This is the invariant-function characterization of ergodicity.
For an irrational rotation of the circle, with , an invariant has Fourier coefficients satisfying
For the multiplier is nonzero. Completeness of the Fourier series basis therefore makes constant. Apply this to an invariant indicator to prove the irrational rotation is ergodic. A second example is the cyclic permutation of points with equal masses: a nonempty invariant set contains the whole cycle and hence has measure one.
The identity on with Lebesgue measure is not ergodic, since is invariant and has measure . Nor is rotation by on the circle: the set
is invariant and has measure . These examples also show why preservation of measure does not imply ergodicity.
Let be the Koopman operator, , and set
The Von Neumann mean ergodic theorem says that, for , these Cesàro averages converge in to the orthogonal projection onto the invariant functions:
For an invertible system, is a unitary operator. The Hilbert-space theorem states more generally that the Cesàro averages of any unitary operator converge strongly to its fixed-space projection.
Here is the requested invertible-case proof. Since ,
Thus the orthogonal decomposition for unitary ergodic averages is
On the first summand, . On a vector , telescoping gives
Because , approximation extends this convergence to the closure of the range. The orthogonal decomposition now proves the theorem for every . An invariant function is -measurable, and an -measurable function is invariant by approximation with indicators; hence the projection is the stated conditional expectation.
In an ergodic system, invariant functions are constants by the criterion already proved. Their orthogonal projection is obtained by taking the inner product with , whose norm is one. Therefore the ergodic limit is the space average:
The Birkhoff ergodic theorem states that, for ,
The limit is invariant, integrable, and has the same integral as . On a probability space convergence also holds in . In an ergodic system the limit is almost everywhere.
For the topological sharpening, take a continuous map on a compact metric space. Unique ergodicity means there is exactly one invariant Borel probability measure . The uniform ergodic convergence for uniquely ergodic systems says that every continuous real or complex satisfies
Thus convergence holds at every point and uniformly in that point. The continuity, compactness and continuous-observable hypotheses belong to this theorem; it is not a claim of uniform convergence for all measurable functions.
The ordinary least squares objective has gradient . The normal equation therefore gives
The Gram matrix is a positive-definite matrix because has full column rank. More explicitly, for any ,
since . This proves that the displayed solution is the unique global minimum.
The fitted values are , where the hat matrix is
The inverse of the symmetric matrix is symmetric, so . Multiplication gives . Thus is the orthogonal projection onto the column space of the design matrix.
The regression residual vector is with . Consequently , , and the residual sum of squares is
By fitted-residual orthogonality, . Using , the cross-covariance matrix is
Both vectors are jointly normal, so they are also independent by independence of uncorrelated jointly normal variables. The zero covariance calculation itself only needs the common error variance and lack of error correlations.
For the first wind fit, let be wind velocity and electrical output. The simple linear regression is , with independent . It has two fitted mean parameters and residual degrees of freedom. The missing analysis of variance entries are therefore velocity degrees of freedom , velocity mean square , and residual degrees of freedom . The residual mean square is , and , consistent with the printed value after rounding.
Because the model includes a regression intercept, the coefficient of determination is the explained sum of squares divided by the total centered sum of squares:
A large coefficient of determination does not rule out a wrong mean function. In the PDF's first residual-versus-fitted plot, residuals are negative at both ends and positive in the middle. This curved pattern agrees with the visibly flattening output-versus-velocity relationship and motivates a polynomial regression with a quadratic term.
The second wind model is , again with independent common-variance normal errors. Its fitted mean is . The line marked (A) is a two-sided Student t-test of against , conditional on retaining the intercept and linear term. Under the null hypothesis,
Its two-sided p-value is . This is far below , so reject a purely linear mean in favour of the quadratic fit. Equivalently, the extra-term nested-model F-test has and null law .
The third fit is a reciprocal-predictor regression, , with estimated mean . It has two mean parameters rather than the quadratic model's three. Its residual standard error is smaller, versus , and its coefficient of determination is larger, versus . The corresponding residual sums of squares are approximately and . The reciprocal fit is preferable on both these fit measures and parsimony. The two models are not nested, so an ordinary extra-term F-test between them is inappropriate. On the common normal-error likelihood, the difference also favours the third model.
Neither lower residual sum of squares nor a higher coefficient of determination establishes adequate assumptions. The quadratic residual-versus-fitted plot removes the original pronounced curvature; the reciprocal plot also has no comparably obvious mean trend. The low-output residuals appear somewhat more spread out, so check scale-location plots and residuals against velocity for heteroscedasticity. Q-Q plots assess normality; residuals against observation order assess serial dependence; regression leverage and Cook's distance identify influential observations. Further cross-validation, replicate observations at comparable velocities, and prediction errors would help choose between their extrapolation behaviours. Both fitted shapes should be judged principally over the observed positive-velocity range.
In the Gaussian white noise model, observe the entire path
where is standard Brownian motion and the deterministic drift belongs to L2 space on . Equivalently, . For every deterministic , the observed stochastic integral satisfies
The noise is an isonormal Gaussian process. In particular its variance is . Gaussian white noise is interpreted through these integrals, rather than as an ordinary random function with a pointwise value at every time. No smoothness of is needed.
Here is the Gaussian maximum bound without independence. Put . It is integrable since it is bounded by . For every ,
The second inequality uses only the moment-generating function of the standard normal distribution, so independence is unnecessary. Jensen inequality gives , hence
Minimizing at proves
For the dyadic partition, let , , putting the endpoint into the final interval. The Haar scaling functions
form an orthonormal basis of the space of functions constant on each interval. The Haar wavelets can be written as
For , the constant function together with , , is another orthonormal basis of . Indeed, each successive level splits a cell's two constants into their sum and difference; the number of basis elements is . Thus the Haar projection is the orthogonal projection
On cell its value is . The first formula also applies to .
Estimate each coefficient by its observed stochastic integral:
This is the Haar projection estimator in Gaussian white noise. The noise integrals over disjoint intervals form a Gaussian vector with zero off-diagonal covariance. The principle that uncorrelated jointly Gaussian variables are independent then makes these coefficients independent. Therefore
Taking expectations shows that is an unbiased estimator of , both coefficientwise and pointwise for the stated step-function representatives.
Only one scaling function is nonzero in each cell, so the supremum norm of the error has the exact form
The endpoint convention ensures the same identity at . Apply the Gaussian maximum bound without independence with to obtain the supremum norm risk of a Haar projection estimator:
The factor comes from cellwise scaling, while the extra square root of comes from taking the maximum over Gaussian errors.
For a centered weakly stationary process with , the autocorrelation function is
For , let be orthogonal projection in L2 space onto the linear span of . The lag- partial autocorrelation function is the correlation coefficient of and . It removes the linear contribution of the intervening observations. At lag one it is just . For nonsingular prediction covariance matrices, it is equivalently the last coefficient in the order- linear predictor of from . Equal residual variances, by stationarity, identify that coefficient with the residual correlation. If a residual has zero variance, this correlation is undefined; the nondegeneracy condition matters.
Fix an integer radius and put . Starting with , scan the layers of from right to left. In each layer retain precisely those bond orthogonal projections whose supports meet the current support; multiply them onto the current operator and enlarge that support to include their bonds. Discard every other projection: it commutes through the current operator and acts as the identity on , by frustration freeness.
If denotes the ordered product of the retained projections, define
Each layer expands the support by at most one lattice spacing. Therefore the local projector cone in a frustration-free chain lies within radius of , and
The last equality holds because every retained projection also fixes the ground-state bra.
For , the stronger estimate from (i) gives
For , choose ; the error is at most , so the same bound holds. Hence
Here is exactly the value in (i), and the prefactor is independent of and chain length. Counting as rather than layers would give an incorrect support claim; the powers of a product of two orthogonal projections are what avoid a lost factor of two in the decay rate.
Figure 1.
Retained bond projectors in the six-layer cone of a single-site operator under three applications of K
. Details.