Coarse-grid correction Created 2026-10-06 Updated 2026-10-14
A coarse-grid correction improves a fine-grid approximation by solving a smaller equation for the part of its approximation error representable on a coarse mesh. Use the signed convention and the linear-system residual . A prolongation linear map interpolates coarse corrections into fine-grid corrections, and a restriction linear map transfers the linear-system residual. Solve exactly or approximately and update . The plus sign follows from defining the approximation error as exact minus approximate. It is the correction equation's right-hand side , rather than merely restricted solution values, that determines the update.
For the multigrid method model , take , so and the coarse nodes coincide with every second fine node. Use linear interpolation with zero boundary corrections :Use full-weighting restriction for the interior linear-system residual:Here is the matrix transpose in ordinary unweighted coordinates. With these specific transfers, the Galerkin coarse-grid operator isThus it equals the rediscretized Poisson equation operator on this constant-coefficient one-dimensional mesh. The equality is special to the stated model and transfers. In particular, dropping from the fine matrix while using on the coarse mesh changes the correction unless the right-hand sides and transfers are rescaled consistently.
Take seven interior points, , three coarse unknowns, and the deliberately constructed approximation errorFor example, choose , so and . Direct matrix multiplication givesThe exact coarse solve returns , so adding removes the entire chosen approximation error. A broad triangular error can have a sharply localized linear-system residual: the latter measures discrete curvature, not error height. This is why the two should not be confused. A smooth sine mode instead has linear-system residual , so interpreting its magnitude also requires the eigenvalue and the equation's scaling.
Constructed seven-point Poisson example: residual restriction, coarse solve, interpolation, and the error remaining after exact or partial correction
. Details. The algebra explains the exact cancellation beyond this example. Assume has linearly independent columns and choose an invertible Galerkin coarse-grid operator . With an exact coarse solve, the iteration matrix for the remaining approximation error isThe short proof is to substitute . Thus every vector in the column space of is eliminated, and the corrected linear-system residual restricts to zero. These are exact projection identities, not a statement that every visually smooth vector belongs to that column space. If is a symmetric matrix and a positive-definite matrix, and with , then is also a positive-definite matrix. Moreover : is an orthogonal projection onto the complement of the column space of in the energy norm . Equivalently, the added correction is the best approximation to from that column space in this energy norm. Without these symmetry and transfer assumptions, the projection need not be orthogonal.[ref]
For an approximate coarse solve represented by a fixed linear map , replace by . ThenThere is no exact cancellation of coarse-representable approximation error unless on the relevant directions. For the triangular example, deliberately returning half the exact correction, , leaves , as the figure shows. This controlled mathematical comparison illustrates an incomplete coarse solve; it is not a measured performance result or a prescription for a geometric multigrid V-cycle. More generally, if , then an approximate leaves , separating the nonrepresentable remainder from the coarse-solve defect.
With pre- and post-relaxation iteration matrices and , a two-grid error step has iteration matrix . A geometric multigrid V-cycle supplies by one recursive coarse cycle from zero, with a direct solve only at the bottom. Effective smoothing, a coarse column space that approximates the surviving approximation error, and a sufficiently accurate coarse correction must work together. Coarsening alone supplies no convergence guarantee, and correcting an arbitrary fine-grid vector exactly would require a coarse column space large enough to contain it.
Let self-adjoint orthogonal projections sum to the identity. For in the range of ,The th term already equals , so for every . Hence and the projective measurement operators commute.
// Target: quantum-theory.bigb
Conditional variance Created 2026-09-28 Updated 2026-10-14
The conditional variance measures the remaining squared uncertainty after specified information has been used to form a conditional mean. For a real square-integrable random variable and a sub-sigma-algebra , let . ThenIt is a -measurable random variable, nonnegative almost surely, rather than necessarily a single number. With the information , its value is the variance in the group identified by . Its expected value is the mean squared error of predicting by its conditional mean.[ref]
In the exact mixture distribution in law of total expectation, group contains around mean two, and group contains around mean eight. Both groups have conditional variance four because their deviations from their own means are with equal probabilities. Therefore . Meanwhile, the two group means have variance . The law of total variance givesDirect calculation gives and , checking the decomposition.
For any square-integrable -measurable predictor , the error identity isThe cross term vanishes because . Thus using the conditional mean minimizes mean squared error, while conditional variance quantifies what this information still cannot predict. This is the orthogonal projection interpretation in L2 space.[ref]
In a unitary representation of a finite group, if a cyclic vector satisfies for some , then there are no invariant vectors. Indeed the averaging orthogonal projection satisfies , so . All translates of also project to zero, and they span the representation.
Density matrix 2026-10-13
A finite-dimensional density operator represents a quantum state on a Hilbert space. It is Hermitian, positive semidefinite, and has trace one:The density matrix is its matrix in a chosen orthonormal basis. In dimension it has real parameters: a Hermitian matrix has , and fixing its trace removes one; positivity restricts the allowed values.
A quantum state ensemble of normalized pure states with positive probabilities givesZero-weight terms can be omitted. Conversely, the spectral theorem gives such an ensemble for every density operator, using its orthonormal eigenvectors and nonnegative eigenvalues, with zero eigenvalues omitted. A pure state has ; a mixed state needs at least two nonzero eigenvalues. [ref]
https://cs.uwaterloo.ca/~watrous/TQI/TQI.2.pdf. Watrous, The Theory of Quantum Information, chapter 2, section 2.1.2, pp. 62–64
For a projective measurement with orthogonal projections , the Born rule isThis is the average of the component pure state probabilities. Positivity makes each outcome probability nonnegative, and makes them sum to one. The same density operator therefore predicts every measurement on the system without requiring a unique preparation history. [ref]
For a closed system, Schrödinger picture evolution under a unitary operator iswhen denotes the time-independent Heisenberg picture state and . In the Schrödinger picture the density operator evolves; in the Heisenberg picture the observables evolve instead, with identical measurement predictions. This unitary operator preserves the eigenvalues and hence the purity of a density operator. [ref]
A historical source for the probabilistic formulation of quantum mechanics is von Neumann's 1927 paper Wahrscheinlichkeitstheoretischer Aufbau der Quantenmechanik. [ref]
https://geodesic.mathdoc.fr/item/NGWGMP_1927__1927_59230/. von Neumann, Nachrichten von der Gesellschaft der Wissenschaften zu Göttingen, Mathematisch-Physikalische Klasse, 1927, pp. 245–272
Detectability lemma 2026-10-06
In a nearest-neighbour frustration-free Hamiltonian chain, multiply the bond orthogonal projections in two disjoint alternating layers. The resulting product fixes the common ground state space but contracts its orthogonal complement by a factor bounded away from one in terms of the spectral gap. A bound implies exponentially convergent powers. The product is generally neither Hermitian nor normal.
Double commutant theorem for star-algebras 2026-10-14
A unital subalgebra closed under the adjoint operator, on a finite-dimensional real or complex inner product space, equals its double commutant of an operator algebra. Here is a proof that does not require a classification of algebras. For , choose a basis and let . The diagonal action of preserves and , so the orthogonal projection onto commutes with that action. Each matrix entry of this projection belongs to . Hence the diagonal action of commutes with the projection and preserves . Since , the tuple belongs to , and therefore for one . This implies . Without the unital hypothesis the conclusion is .
Efficient score 2026-10-07
The efficient score is the residual after orthogonal projection of the parametric score function onto the nuisance tangent space. It is centered and orthogonal to every nuisance direction. Its squared L2 norm is the efficient information.
With unknown independent covariate and centered error distributions, take the regular mean-preserving error tangent space, let , and . Under , and finite second moments, orthogonal projection removes from . Thus the efficient score and efficient information are and . The reduction to is valid for a normal distribution of errors or for constant , but need not hold otherwise. Centered covariates and logistic distribution errors give the counterexample .
Elliptical polarization 2026-10-13
For an elliptically polarized wave, the tip of its transverse vector traces an ellipse at a fixed point during each wave period. For polarization of an electromagnetic wave, this is the electric field vector. With the real components in polarization of waves, assume and . Eliminating time givesA short derivation uses and the cosine addition formula to obtain ; squaring and using the sine and cosine identity gives the displayed equation. Outside phase quadrature, the mixed term gives a tilted ellipse; are component wave amplitudes and need not be its semi-major and semi-minor axes.
In phase quadrature, , the mixed term vanishes. For , the ellipse is , its semi-major and semi-minor axes have lengths and , and its electric field magnitude varies between and . At with , the electric field is and has magnitude . Equal wave amplitudes instead give circular polarization, a special case of elliptical polarization with constant magnitude. As approaches or , the ellipse collapses to a line segment and gives linear polarization; this limit is degenerate rather than a nondegenerate ellipse.
Changing from to reverses traversal of the same ellipse. In the displayed plot, moves from toward negative as time increases. A label such as right- or left-handed circular polarization additionally requires a stated viewing direction and naming convention: viewing along propagation and viewing against propagation reverse the apparent rotation. [ref]
https://www.feynmanlectures.caltech.edu/I_33.html#Ch33-S1. Feynman Lectures, I §33–1: polarization conventions
.The ellipse records both the relative wave amplitudes and the phase difference of two transverse oscillations. This separates a change of polarization of waves from a change of overall wave amplitude: multiplying both components by the same positive factor enlarges the ellipse while preserving its shape and orientation.
A rotating ideal linear polarizer can probe this geometry. For the ellipse in phase quadrature, orthogonal projection onto a pass axis at angle gives , in . Averaging its square over a wave period gives , while the incoming squared electric field magnitude averages to . Thus the transmitted fraction of light intensity is : it is at , at and at . There is no single incident line of linear polarization to insert into Malus's law; projecting the electric field and averaging its square is the appropriate generalization. This measurement cannot distinguish from , because reversing the traversal leaves all these squared averages unchanged.
Expectation value Created 2026-09-24 Updated 2026-10-14
The expectation value of a quantum observable is the expected value of its measurement outcome random variable in a specified quantum state. It predicts the mean of outcomes from many identical quantum state preparations. It need not equal any one possible outcome: for a spin one-half particle, equal probabilities of and give mean zero even though zero is never an outcome of that spin component. Here is the reduced Planck constant.
Let be a Hermitian operator on a finite-dimensional Hilbert space, and let be a normalized pure state, . The spectral theorem writesThe are distinct real eigenvalues, are orthogonal projections onto their eigenspaces, and is the identity operator. For an ideal projective measurement of , the Born rule and the expectation value giveThus the expectation value is a probability-weighted average of eigenvalues, including all vectors in a degenerate eigenspace in its . In an orthonormal eigenbasis, , this is , where repeated are allowed. The weighted average lies between the smallest and largest eigenvalues; it can lie in a gap between them. The statistical meaning and operator expression are connected in this way in the authored treatment of average energies.[ref]
Chapter 20: Operators. The Feynman Lectures on Physics, Volume III, Chapter 20: Operators, §20–2, equations (20.11)–(20.20): outcome frequencies, weighted mean, and operator expectation
If a nonzero vector has not been normalized, use ; the denominator is essential. A global phase cancels between the bra and ket, so and have the same expectation value and outcome probabilities.
The outcome variance measures the spread about this mean, whereas the quantum uncertainty is its standard deviation:For a pure state, zero variance means that lies entirely in one eigenspace. That eigenspace need not be one-dimensional. Knowing only a mean generally does not determine the entire outcome probability distribution.
For a mixed state, the same formulas use its density matrix , a positive operator with trace one:A pure state is the special case . For a quantum state ensemble , the expectation value is . This linearity is useful when preparations vary between trials; different quantum state ensembles can have the same density matrix.
These formulas require no operator-domain qualifications in finite dimension. For an unbounded self-adjoint operator, the spectral theorem instead gives a spectral probability measure; a finite mean requires an integrable absolute first moment, and finite variance requires a finite second moment. Writing as an operator inner product additionally requires in the operator domain of . The quadratic form of a positive quantum Hamiltonian explains the useful wider form-domain version.
For equal finite-dimensional closed subspaces of a Hilbert space , positivity of makes invertible. The displayed reconstruction is the unique element of whose orthogonal projection onto matches that of . It is the oblique projection onto along . Its operator norm is the value of the secant function at the directed subspace angle, and its error is at most that secant function value times the best orthogonal projection error. The lower error bound follows from the Pythagorean identity. Zero-dimensional cases are handled directly.
Finite element method Created 2026-09-28 Updated 2026-10-14
The finite element method replaces an infinite-dimensional weak formulation by finitely many unknowns attached to a finite element mesh. Simple local functions, often piecewise polynomial functions, join to form a global approximation. The attraction is that each finite element can be integrated separately, while the assembled equations enforce a global balance. A piecewise-linear hat function only meets its immediate neighbors, so a large problem can have a sparse matrix rather than a dense one. Gilbert Strang's MIT lecture develops this connection from the one-dimensional weak formulation through local hats to the stiffness matrix and load integrals.[ref]
https://ocw.mit.edu/courses/18-085-computational-science-and-engineering-i-fall-2008/676ba0a00eef45a6cb3823c4da61ee11_18-085F08-L18.pdf. Gilbert Strang, MIT 18.085, Lecture 18: Finite Elements in 1D, transcript pp. 2–8, 2008; accessed 2026-10-11
For the conforming Galerkin method, let be a real Hilbert space, a bounded coercive bilinear form, and a bounded linear functional. Given a conforming finite element space , the continuous and discrete problems areWriting in a basis of gives the linear systemHere is the stiffness matrix and is the vector of loads tested against the basis functions. The Galerkin method uses the same trial and test space in this construction. Finite element methods also use the Petrov-Galerkin method, with different trial and test spaces; testing against the trial space is therefore a property of this construction, rather than a definition of every finite element method.
The finite element solution of the one-dimensional Poisson equation below gives every entry explicitly. Refining the finite element mesh then improves the approximation by adding local degrees of freedom. For a symmetric coercive bilinear form, Galerkin orthogonality makes the discrete solution the best approximation in the energy norm; the geometry of orthogonal projection explains why this local construction yields a globally meaningful answer.
Finite-rank projection kernel 2026-10-07
An orthonormal set in an space defines the integral kernel of the orthogonal projection onto its span by this sum. It satisfies and . Its evaluation matrices are positive semidefinite Gram matrices.
Fitted values Created 2026-09-24 Updated 2026-10-14
Fitted values are the predictions at the predictor values used to fit a regression model. In linear regression with an explicit regression intercept,Here is the slope design matrix, and is the regression residual vector. The fitted values estimate the regression function at the observed predictors; they need not equal the observed responses, which may also contain random errors. Prediction at a new predictor vector uses with the same centering and scaling used in fitting. A prediction interval addresses uncertainty in a new response rather than just displaying this point prediction.
For the five constructed observations in linear regression, ordinary least squares gives fitted values . The ridge regression fit at instead gives . Both fitted vectors have sample mean because the regression intercept is unpenalized; their regression residuals differ and their residual sums of squares are and , respectively.
For ordinary least squares, the fitted values are the orthogonal projection of onto the column space of the complete design matrix, including its regression intercept column. They remain unique even in rank-deficient ordinary least squares, although the regression coefficients can be nonunique. The regression residuals are then orthogonal to every column.[ref]
Regression 1: Different perspectives. slides 6–10: fitted values, hat matrix, projection and orthogonal residuals
With centered slopes, ridge regression instead satisfies , so the regression residuals need not be orthogonal to the slope columns. Their sum is still zero because the regression intercept remains free.For fixed predictors and scales and a fixed positive penalty, ridge regression gives a linear smoother,For with at least one nonzero slope direction, this matrix is not an orthogonal projection matrix: applying it twice shrinks that direction again. Its effective degrees of freedom are , where are the positive singular values of ; the extra counts the free regression intercept. If the penalty is selected using , the resulting fitting rule need not be a linear smoother, since its chosen also depends on .
Fredholm index 2026-10-14
For a Fredholm operator between Hilbert spaces, the index is the difference of the finite dimensions of its kernel and cokernel. Since the range is closed, its cokernel identifies with by orthogonal projection. An invertible operator has index zero. Conversely, an index-zero Fredholm operator becomes invertible after adding a finite-rank operator: choose an isomorphism , extend it by zero on , and observe that maps the two summands bijectively onto .
Galerkin orthogonality Created 2026-09-28 Updated 2026-10-14
Let be a conforming finite element space. Suppose the exact solution satisfies for every and its Galerkin method approximation satisfies for every , using the same bilinear form and linear functional. Subtracting the two identities gives Galerkin orthogonality:This identity itself does not require symmetry. Its interpretation as an orthogonal projection in an energy norm does require a bounded symmetric coercive bilinear form: then is an inner product, is perpendicular to every available discrete correction, andConsequently is the unique closest point in in the energy norm. This Pythagorean theorem in a function space explains the beauty of the Galerkin method: integrated local equations compute a global best approximation. The Céa lemma supplies the corresponding estimate in a chosen reference norm.
For the finite element solution of the one-dimensional Poisson equation, and . Testing the error against the th piecewise-linear hat function on a uniform mesh givesIn this model vanishes at every node, so each of these integrals is individually zero, although is positive inside every element. Galerkin orthogonality controls the derivative-weighted balance; it does not say that the pointwise error vanishes.
The exact identity assumes conformity and exact evaluation of the continuous forms, including any numerical integration that is used. If assembly instead uses and , subtraction gives the consistency defectThus inexact numerical integration need not preserve the projection. In the Petrov-Galerkin method the error is tested against a different test space, and for a nonsymmetric bilinear form the displayed identity need not describe perpendicularity in any energy norm.
Gaussian Johnson–Lindenstrauss transform 2026-10-14
Draw a random matrix whose entries are independent random variables with the standard normal distribution, and setThe factor makes the expected value of the squared L2 norm equal to the original squared L2 norm. This Gaussian Johnson–Lindenstrauss transform is a linear map, generally not an orthogonal projection: its rows are not required to be orthogonal vectors. [ref]
Lecture notes on metric embeddings by Jiří Matoušek. Lecture notes on metric embeddings, §2.1(b), p. 21, and Lemma 2.3.1, p. 24: independent Gaussian coefficients and normalization
For the fixed finite set , let be an allowed failure probability, and defineWith denoting the natural logarithm, a sufficient integer target dimension isThen one draw of this specified random matrix satisfies all the squared Euclidean distance bounds simultaneously with probability at least . Since , the simpler sufficient bound also works. Both are sufficient bounds for this argument; they do not claim the smallest possible target dimension.
This is a probability statement about a map drawn independently of the fixed finite set. It implies existence because the success probability is positive, but permits failed draws. The set cannot be chosen after inspecting the map with this same guarantee. In particular, no single draw preserves every possible finite set in the ambient Euclidean space when .
Gaussian posterior in the zero-noise limit 2026-10-05
For , with independent and , the multivariate normal distribution of the Bayesian posterior has posterior mean and covariance matrix . The singular value decomposition shows that the variance on a right singular vector of nonzero singular value is , while the variance along the null space is one. Thus, for fixed data, the mean tends to the minimum-norm least-squares solution and the covariance tends to the orthogonal projection onto the null space. Unobserved components retain their prior distribution even as the noise vanishes.

