The three linearly independent eigenvectors still form a basis, so the same coefficient calculation applies to this diagonalizable matrix matrix. The general solution is
A repeated eigenvalue alone does not create a polynomial factor in time; that factor is needed only when a nontrivial Jordan block prevents a full eigenvector basis.
The independence of eigenvectors for distinct eigenvalues ensures that such eigenvectors form a linearly independent set. For completeness, apply to a proposed relation . It leaves , so every . Thus the three eigenvectors form a basis over the relevant field and . Substitution into the linear system of ordinary differential equations gives ; linear independence implies . Hence
A real matrix may have a complex conjugate pair of eigenvalues. In that case the calculation is over and conjugate coefficients yield real solutions; equivalently use real and imaginary parts of the complex modes. No unstated assumption that all three eigenvalues are real is needed.
Extend complex-linearly to the complexification of a real vector bundle . Since , its and eigenbundles have smooth projections
Each has complex rank : complex conjugation interchanges them, and together they have rank . These are the type decomposition of the complexified tangent bundle. For an arbitrary almost complex structure, they are smooth complex vector bundles; a holomorphic vector bundle structure requires integrability.
When comes from a holomorphic atlas, write a holomorphic coordinate as . Its Wirtinger derivatives are
The induced almost complex structure has and . Hence the displayed vector fields are respectively and eigenvectors. They are linearly independent, and each collection has elements. Thus they give local frames for and respectively, with the holomorphic tangent bundle. The repeated in the first sentence of the printed item must be read as the two complementary eigenbundles.
A nilpotent endomorphism satisfies for some positive integer . A nilpotent Lie algebra has a terminating lower central series of a Lie algebra: with and , one has for some . These are different conditions: the first concerns a particular linear map, whereas the second concerns repeated Lie brackets.
The representation form of Engel theorem says that if a finite-dimensional Lie subalgebra consists entirely of nilpotent endomorphisms, with , then contains a nonzero vector annihilated by every element of . Consequently there is a basis in which every element of is strictly upper triangular. No assumption on the characteristic of a field or algebraic closure is required.
We prove the common-vector assertion by induction on , simultaneously for every nonzero finite-dimensional representation space. The zero algebra is immediate. First, nilpotence of commutation by a nilpotent endomorphism follows from
If , the right-hand side vanishes for , in every characteristic of a field. For any proper Lie subalgebra , its Adjoint representation on therefore consists of nilpotent endomorphisms. Its image has dimension at most , so the inductive assertion gives a nonzero class annihilated by . Equivalently and . Thus the Engel normalizer lemma gives .
Choose a maximal proper Lie subalgebra . Its normalizer of a Lie subalgebra must be all of , so is an ideal of a Lie algebra. Moreover has dimension one: otherwise a one-dimensional Lie subalgebra of this quotient would have a proper inverse image strictly between and . By induction the space is nonzero. It is invariant under , since . Write . The restriction of the nilpotent endomorphism to has a nonzero kernel, and any vector in that kernel is annihilated by all of . This completes the induction. Apply the assertion repeatedly to to obtain a complete invariant flag with . A basis adapted to that flag makes every matrix strictly upper triangular.
A nilpotent abstract Lie algebra need not act by nilpotent matrices. For , the scalar algebra is an abelian Lie algebra, hence a nilpotent Lie algebra, but . No change of basis makes strictly upper triangular. The failed implication is precisely the distinction described in nilpotent Lie algebras need not act nilpotently.
If is a nilpotent Lie algebra, then , so every is a nilpotent endomorphism. Conversely, apply Engel theorem to acting on . Its invariant flag is lowered by every Adjoint representation matrix, so every product of such matrices vanishes. Since is spanned by expressions , the lower central series of a Lie algebra terminates. Therefore
Finally suppose is an algebraically closed field. If some is not a nilpotent endomorphism, it has a nonzero eigenvalue and an eigenvector , giving . The vectors are linearly independent and span a nonabelian two-dimensional Lie subalgebra. Conversely, a Lie subalgebra of a nilpotent Lie algebra is nilpotent because its lower central series of a Lie algebra lies termwise in the ambient series. A nonabelian two-dimensional Lie algebra has a basis with : choose spanning the nonzero derived algebra and rescale a complementary vector. Its Adjoint representation has the nonzero eigenvalue , so it is not nilpotent. This proves the two-dimensional subalgebra criterion for Lie algebra nilpotence:
Put , which is a positive-definite matrix by the full column-rank assumption. The ordinary least squares estimator is
For ridge regression use the criterion . Differentiating gives
If instead the squared-error term is normalized by , replace in this formula and the calculations below by . Only the scale of the tuning parameter changes.
As usual for this linear regression model, use zero-mean errors; more generally suffices. Since the columns are centred, , so the random centring term disappears from both estimators. Thus
Let . The bias and covariance matrix of the ridge regression estimator are
The bias-variance decomposition of mean squared error therefore represents directional risk by the quadratic forms
Their difference has the useful factorization
To check it, multiply on both sides by : the resulting matrix is .
The Cauchy-Schwarz inequality gives in the Loewner order. Therefore the middle matrix is positive-definite whenever . For example,
works, independently of the eigenvalues of . Since is invertible, the risk difference is strictly positive for every nonzero , in particular simultaneously for every unit . This proves uniform directional risk improvement by ridge regression. For the normalized-loss convention, take the displayed choice divided by .
For the final assertion, fix any and choose a unit eigenvector of with eigenvalue . Put and . Directly,
Choosing
makes the squared bias alone greater than , proving the required strict inequality. Thus unbounded directional risk of fixed ridge shrinkage is compatible with the existence of a beneficial signal-dependent small penalty: no fixed positive penalty uniformly improves risk over all possible signals.
The mean assumption matters if the printed covariance condition is read in isolation. With , , , and , the columns and response are still centred and , but the ordinary least squares risk is . Writing , the ridge regression risk is for every . Hence the standard zero-mean regression-error convention, or its stated orthogonality version, is necessary for the first risk comparison; covariance alone is insufficient.
The relevant fixed coordinate subspace is . Let be the first columns of and let
The Gaussian empirical Gram matrix is the empirical second moment with the known mean zero; no subtraction of an estimated mean is involved. For , the ratio under consideration is . Since is a real symmetric matrix, the finite-dimensional spectral theorem gives
Indeed, diagonalizing bounds every unit-vector quadratic form by the largest absolute eigenvalue, and a corresponding unit eigenvector attains the bound.
We first construct a unit sphere net from ball covering. Enlarge the numerical covering constant, if necessary, to . Cover the unit ball in with at most balls of radius at most . For each such ball meeting the unit sphere, choose a point of the sphere in it and discard the others. These selected points form a metric net of the unit sphere with radius : any two points in one covering ball have distance at most . This argument ensures that the net points have unit length even if the original covering centers did not.
Take and put , so . For unit vectors with ,
Taking a net point for every unit and then a supremum proves the quadratic form net bound
It follows that
Fix . The rows of are independent vectors of independent random variables with the standard normal distribution, and . Their scalar products with are therefore independent variables , so
Use the supplied chi-squared concentration inequality with . Its threshold is
Consequently . The union bound gives the stronger fixed-subspace estimate
This is Gaussian Gram matrix concentration on a fixed subspace.
Since , we have . Under ,
Choose the numerical constant . Then the parenthesis is at least one, so is a valid choice, and
The covering factor is only because the coordinate subspace is fixed. The ambient dimension enters through the assumed sample-size bound.
The history-subspace propagation Hamiltonian has diagonal entries at the endpoints and in the interior, and nearest-neighbour entries . The spectrum of a path propagation Hamiltonian is
To see the indexing directly, set and . The interior difference equation gives . The endpoint equations correspond to and , both satisfied by these . The distinct eigenvalues and their nonzero eigenvectors exhaust the matrix.
The zero eigenvalue is simple, so
The inequality uses on and .
The supplied path-matrix hint sums through while listing a basis ending at . That last summand would introduce an extra vertex. The matrix derived in (a) has exactly edges and vertices, as used here; this also proves the needed spectrum without relying on the misindexed summation.
The filtered decomposition is not necessarily frustration-free. Commuting with makes an eigenvector of each term; it does not make that eigenvector a lowest-energy state of each term. This is the distinction expressed by commuting with a ground projector does not imply frustration freeness.
For an explicit positive, two-local counterexample on three qubits, let and , and use the two distinct interaction sets and :
Both are positive semidefinite and commute with their sum. The total energy on a computational basis vector is
Thus has unique ground state , energy , and spectral gap . Since , spectral filtering of Hamiltonian terms leaves both terms unchanged for every normalized filter:
But , whereas . The global ground state therefore does not minimize , proving that the resulting decomposition is not a frustration-free Hamiltonian.
There is a useful positive result if the original decomposition already is a frustration-free Hamiltonian. If and , then . Averaging its unitary conjugates with nonnegative gives , while . Thus filtering preserves existing frustration freeness; it does not create it for an arbitrary gapped Hamiltonian.
Set and . The Dirichlet discrete Laplacian has the eigenvectors
and its negative has the eigenvalues
The discrete sine transform therefore reduces the method of lines equations to . Each coefficient is an oscillator, a linear function, or a hyperbolic function according to the sign of . A finite collection of oscillators is bounded in every fixed-grid norm. A zero-frequency mode can grow linearly, and a negative-frequency-square mode can grow exponentially. Consequently,
is necessary and sufficient for all-time boundedness of a semidiscrete reaction wave equation on this grid. Equality allows bounded displacement only when the initial velocity has zero projection onto the first eigenvector; above it, the growing components must be absent in every unstable mode. A strictly positive spectral gap also gives a time-independent displacement bound uniform over grids whose gaps are bounded below.
The discrete threshold is strictly smaller than , because for , and tends to as . A coarse grid can therefore introduce long-time growth into a continuum problem with . This is distinct from displacement stability of a symmetric semidiscrete wave equation on fixed finite time intervals. As in part (a), if existence of the printed limit is required for every initial datum, no qualifies: any one mode admits oscillatory, secular, or growing initial data, depending on its coefficient.
For an evolutionary partial differential equation, stability of a numerical method means that errors in the starting data and forcing stay controlled on each fixed interval , with constants independent of the mesh. Fourier stability analysis is especially effective for a constant-coefficient finite difference method on a uniform infinite or periodic grid: translation invariance makes different Fourier modes evolve independently.
For a scalar one-step scheme on the integer lattice, insert , with . The Fourier symbol of each shift is , and the update reduces to
The amplification factor must be defined for every relevant frequency; for an implicit scheme this includes checking that its denominator is nonzero. The Parseval identity turns a bound into a discrete L2 norm bound. Thus gives contractivity, while the more general bound gives for . Conversely, frequencies with amplification uniformly greater than one produce unstable wave packets or periodic Fourier modes under refinement.
For a system, is an amplification matrix; for a multilevel scheme, a companion matrix evolves the vector of time levels. The actual requirement is a uniform bound on matrix powers, not just their spectral radius. A nontrivial Jordan block at a unit-modulus eigenvalue creates polynomial growth in the time index. Even simple eigenvalues inside the unit disk can fail to give a uniform bound if the eigenvector matrices become ill-conditioned as the mesh changes. Uniformly controlled diagonalization of a matrix, or a suitable quadratic energy estimate, resolves this issue. The power boundedness of a two-level Fourier scheme illustrates why root multiplicities and conditioning matter.
For the heat equation, put . Centered space with the Forward Euler method has
The von Neumann stability analysis condition holds exactly for on the full frequency interval. The Backward Euler diffusion scheme instead has and is stable for every . The Crank-Nicolson diffusion scheme has
It too is unconditionally stable, but poorly resolved high-frequency modes have for large , giving oscillatory numerical transients. A-stability therefore does not guarantee strong damping; L-stability distinguishes the damping of the Backward Euler method.
For the advection equation , let . Forward time and centered space give
For nonzero fixed , repeated steps amplify some modes by a fixed factor greater than one, so the method is unstable under the usual refinement . This calculation also shows the refinement qualification: if , its finite-time growth can be bounded by , though the restrictive scaling defeats the usual hyperbolic time-step choice. For , the upwind finite difference scheme has
so it is stable for . The Lax-Wendroff advection scheme instead has
giving . These examples separate the effects of the spatial stencil, temporal approximation and Courant number; a higher order of a numerical method by itself does not establish stability.
A periodic boundary condition is ideal for this analysis. The discrete Fourier transform diagonalizes the circulant update, with only the discrete frequencies needed on a grid of points. A bound on all is a convenient guarantee over every such grid. On the whole line, the Fourier transform uses a continuous frequency interval and the Parseval identity proves the corresponding square-summable-data estimate.
Homogeneous Dirichlet boundary conditions do not admit arbitrary complex exponential Fourier modes. For the standard centered second difference on interior points, a discrete sine transform diagonalizes the actual boundary-value matrix:
The same heat amplification formulas then apply at these sine frequencies. For example, the exact forward-Euler contractivity limit on that fixed grid is ; the mesh-independent sufficient limit follows by including all frequencies. Homogeneous Neumann boundary conditions can similarly permit a discrete cosine transform, provided the endpoint discretization and its weighted inner product are chosen consistently. The constant mode is then present, reflecting conservation of the heat equation's spatial mean. For inhomogeneous boundary conditions, subtract a suitable lifting of the prescribed boundary data and estimate the induced source using the homogeneous evolution's bound and a Duhamel principle estimate. Bounds for the lifting and source must themselves be uniform in the mesh.
General boundary conditions require separate boundary stability of a finite-difference method. For an advection equation, incoming data are prescribed at the inflow boundary, while an outflow closure must respect the outgoing characteristics. An interior periodic Fourier symbol cannot detect a growing mode confined near a boundary. A normal-mode test on a half-line seeks modes with and that satisfy both the interior recurrence and boundary closure. Their existence proves instability, and uniform control requires more than merely excluding isolated growing roots; the Uniform Kreiss--Lopatinskii condition addresses boundary resolvent bounds. Alternatively, a direct energy method using summation by parts can include the boundary terms and establish the required estimate.
Variable coefficients and nonuniform meshes usually destroy exact Fourier transform diagonalization. Frozen-coefficient Fourier stability analysis is then a useful diagnostic, but it is not automatically a proof for the full variable-coefficient boundary problem. The mesh-uniform energy method in question 5 is an example of a direct proof. Also, an L2 norm proof is not automatically a mesh-uniform maximum-norm proof: finite-dimensional norm-equivalence constants may grow with the number of grid points.
Finally, stability measures error propagation; consistency of a numerical method measures the defect of inserting the exact solution. For a well-posed linear initial-value problem in the chosen norm, the Lax equivalence theorem says that a consistent approximation is convergent exactly when it is stable. Boundary discretization and starting data must be included in that assertion. A Fourier calculation proves convergence only after consistency, well-posedness and the actual boundary treatment have also been checked.
Consider the operators on all of or , extending the displayed positive-function formula linearly. Here is the space of continuous functions vanishing at infinity. The multiplier has modulus at most one, so , and multiplication of exponentials gives and . For strong continuity on , choose a compact outside which is small. On the continuous is bounded, making uniform; outside , . For , use pointwise convergence and the dominated convergence theorem with bound . Thus both are contraction semigroups, even when is unbounded.
The generator of a multiplication semigroup is
Indeed pointwise difference quotients converge to . A norm limit therefore forces the displayed domain condition, using an almost-everywhere convergent subsequence for the case. Conversely , so the dominated convergence theorem proves the limit when . In write the error as times , with the value at supplied by continuity. That second factor tends uniformly to zero where is bounded and has modulus at most one; the compact-set and small-tail argument applied to proves uniform convergence. To prove directly that is a closed operator, take and . Pointwise limits in , or a common almost-everywhere convergent subsequence in , give . Thus is in the appropriate generator domain and . In the domain is dense because ; in compactly supported continuous functions are a dense subspace contained in the domain.
A real multiplication operator on its maximal domain is an unbounded self-adjoint operator. One direct verification is to test the adjoint relation against functions supported on . If is in the adjoint operator domain with representing vector , those tests force on each such set, hence . The converse follows by integration. On the sigma-finite measure spaces used below, the spectrum of a real multiplication operator is its essential range; spectral values are detected by unit vectors supported where the multiplier is arbitrarily close to that value, while outside the essential range its reciprocal is a bounded resolvent multiplier.
For the heat semigroup on , take the normalization . The unitary Fourier transform converts it to multiplication by , and converts the semigroup to multiplication by . Consequently
The Sobolev space domain is exactly . The continuous spectrum comes from the full essential range of , not from square-integrable Fourier eigenvectors.
For the Ornstein-Uhlenbeck semigroup on standard Gaussian measure, the normalized Probabilists' Hermite polynomials form an orthonormal basis. The construction below gives and , so the Hermite coefficient map turns it into a real multiplication operator on . Therefore
Finally, the heat semigroup on the whole real line has no positive spectral gap, whereas the standard Ornstein-Uhlenbeck semigroup has gap one. For the first claim, take a nonzero smooth compactly supported and set . Then , but . This disproves a uniform whole-line Poincaré inequality ; one can also choose . Lebesgue measure here is infinite, so it has no normalized probability mean to subtract. For Gaussian measure, the Hermite expansion instead gives the sharp Gaussian Poincaré inequality
Equality holds for affine functions. The identity on the right is interpreted on the energy-form domain, which is larger than the full operator domain.
Use the convention required by the printed expansion:
where and form the positive-singular-value parts of the singular system of a compact operator. Consequently . Apply part (b)'s polynomial to each such eigenvector, using noisy data:
The geometric series then gives the full inverse coefficient, or Landweber full inverse filter,
In particular, for the unrelaxed iteration , . The dimensionless Landweber spectral filter is instead ; the printed expression uses the full coefficient and therefore needs the denominator .
For each fixed finite , the filter extends continuously at zero by , since as . Small singular values are suppressed rather than immediately divided into noisy data. A component of in contributes nothing. The parameter here is discrete: is an integer. This matters when ; arbitrary real powers are not intended. A family for every can use instead.
Let be the adjacency matrix of a graph, the all-ones matrix and the all-ones vector. Counting two-step walks gives
Because , any two nonadjacent vertices have a common neighbour, so the graph is connected. The eigenvalue is simple: for a real eigenvector at , a maximal entry and the averaging equation force its neighbours, and then every vertex, to have the same value. Since is real symmetric, its other eigenvectors lie in , where vanishes. Their eigenvalues are therefore
Here for the present incomplete connected graph. Indeed ; if , then , which conflicts with for an edge. If have multiplicities , dimension and zero trace give and . Thus
These are dimensions of eigenspaces, hence integers. A multiplicity may be zero; that does not affect the conclusion.
Order the interior grid values into a vector. The coefficient matrix has diagonal and off-diagonal entries at horizontal and vertical neighbours, with boundary values already zero. Every row is strictly diagonally dominant because . The standard convergence theorem for strict diagonal dominance gives convergence of both the Jacobi method and the Gauss-Seidel method. The matrix is also symmetric positive definite.
For , the weighted Jacobi method is , with iteration matrix . The sine-product grid eigenvectors give
These weighted Jacobi eigenvalues for a square Dirichlet grid determine convergence. All eigenvalues of are positive. Thus for fixed convergence requires , where . As , this upper bound tends to from above. Any fixed therefore fails on sufficiently fine grids; also fails. Consequently is necessary for all mesh sizes, and it is sufficient, since for every finite grid.
Let the distinct eigenvalues be . Distinct-eigenvalue eigenvectors are independent. A relation becomes , with . Since every , it requires for every . No nonzero polynomial of degree below has that many distinct roots. Thus the first powers are independent, while gives the next dependence. Hence . Equivalently the coefficients of these powers form a full-rank Vandermonde matrix through this index.
For a normal mode write . The generalized eigenvalue problem is
The three independent eigenvectors and corresponding squared frequencies are
The last two have zero mass-weighted displacement and are orthogonal in the mass inner product. The lowest frequency is zero: it represents a rigid translation with both springs unchanged. Its general motion includes uniform centre-of-mass velocity, not just a constant displacement. Superpositions of the two oscillatory normal modes and this translation give the general solution.