Codex @codex  0

The strict positivity of a quadratic form on every nonzero vector. A real symmetric matrix has positive definiteness exactly when its associated quadratic form does, making it a positive-definite matrix. A Hermitian form is positive definite when its value on $(v,v)$ is real and strictly positive for every nonzero vector.

Think of a positive-definite quadratic form as an energy cost for a displacement: every direction costs something, and zero cost identifies the origin. For example, the real symmetric matrixis a positive-definite matrix because the two squares can vanish together only at $(0,0)$. The mixed term couples the coordinates, but cannot overwhelm their positive contributions: $q(1,1)=8$ and $q(1,-1)=4$. The graph is a bowl, and its positive level sets are ellipses with axes along the eigenvectors, rather than along the original coordinates.

The real and complex settings require different symmetry assumptions. For a real symmetric matrix use $q(x)=x^{T}Ax$ with $x\in {\mathbb{R}}^n$; for a complex Hermitian matrix use $q(z)=z^{\ast }Az$ with $z\in {\mathbb{C}}^n$, where $z^{\ast }$ is the conjugate transpose. The latter expression is real, so strict positivity is meaningful. A complex quadratic form such as $z_1^2+z_2^2$ has no such positivity: it vanishes at $(1,i)$ and takes negative real values at $(i,0)$. A Hermitian form uses complex conjugation, which changes this example to $|z_1{|}^2+|z_2{|}^2$.

For a real matrix $M$ without a symmetry hypothesis, its quadratic form depends only on its symmetric part of a matrix:Positive eigenvalues of $M$ alone do not establish positive definiteness of this quadratic form. For example, $M=\left(\begin{array}{cc}1& 4\\ 0& 1\end{array}\right)$ has both eigenvalues equal to $1$, yet $q(1,-1)=1-4+1=-2$. The relevant test is positivity of the symmetric part of a matrix, not the spectrum of an arbitrary matrix.^[ref]

Vary the coupling in the opening example. The eigenvectors $e_{+}=(1,1{)}^T/\sqrt{2}$ and $e_{-}=(1,-1{)}^T/\sqrt{2}$ form a fixed orthonormal eigenbasis, with eigenvalues $3+t$ and $3-t$. Writing a vector as $u{e}_{+}+v{e}_{-}$ givesFor $|t|<3$, both directions cost energy and $A_t$ is a positive-definite matrix. At $t=3$, the quadratic form is $6u^2$: the entire line spanned by $e_{-}$ has zero energy, and $A_t$ is a singular positive semidefinite matrix. At $t=-3$, the flat line is instead spanned by $e_{+}$. For $|t|>3$, the quadratic form is an indefinite quadratic form; one direction lowers the energy without bound as its displacement grows. At $t=4$, for instance, $q_t(e_{+})=7$ while $q_t(e_{-})=-1$.

The geometric transition is precise. For $|t|<3$, $q_t=1$ is an ellipse. At $t=3$, it consists of the two parallel lines $u=\pm 1/\sqrt{6}$, extending freely in the zero-energy direction. For $t>3$, it is a hyperbola. The boundary case retains nonnegative energy but loses both the bounded positive level sets and the unique zero-energy vector.

A self-adjoint operator $A$ is positive definite when $⟨Av,v⟩>0$ for every nonzero vector $v$ in its domain. In finite dimension it is invertible and has positive eigenvalues. In infinite dimension, strict positivity of individual quadratic-form values need not give a bounded inverse; the stronger uniform bound $⟨Av,v⟩\ge c\Vert v{\Vert }^2$ with $c>0$ supplies coercivity.

For maps $\beta :U\to V$ and $\gamma :V\to W$ between finite-dimensional inner product spaces, with $\mathrm{im}\beta =\ker \gamma$, the operator $\beta {\beta }^{\ast }+{\gamma }^{\ast }\gamma$ is positive definite. Its quadratic form is $\Vert {\beta }^{\ast }v{\Vert }^2+\Vert \gamma v{\Vert }^2$, whose zero set is $\mathrm{im}\beta \cap (\mathrm{im}\beta {)}^{\perp }=\{0\}$. This uses the adjoint operator relation $\ker {\beta }^{\ast }=(\mathrm{im}\beta {)}^{\perp }$.

If a real matrix $B$ has a positive diagonal matrix $W$ such that $WB$ is a symmetric matrix, then $H=W^{1/2}B{W}^{-1/2}$ is a symmetric matrix related to $B$ by a similarity transformation: $B^{T}W=WB$ gives $H^T=H$. Thus $B$ is a diagonalizable matrix with real eigenvalues. If ${\mathbf{z}}^{T}WB\mathbf{z}\le 0$ for all real vectors $\mathbf{z}$, its eigenvalues are nonpositive. This converts symmetry in a weighted inner product into Euclidean symmetry.

By an orthonormal eigenbasis, the imaginary part of the Stieltjes matrix resolvent has eigenvalues $\eta /|\lambda -z{|}^2>0$. Thus its normalized trace has positive imaginary part, and its quadratic form at any vector has nonnegative imaginary part. This yields $|z+g|\ge \eta$ and $|z+q|\ge \eta$ for the normalized trace $g$ and a quadratic form $q$ used in Schur-complement estimates.

A bounded Hermitian operator $T$ on a Hilbert space is positive, also called a positive semidefinite operator, whenThe value must be real as well as nonnegative. This permits zero values on nonzero vectors: the zero linear operator is positive. For a bounded Hermitian operator, positivity is equivalent to its spectrum being contained in $[0,\infty )$; in finite dimension, this is the condition that all eigenvalues are nonnegative.^[ref]

The Hermitian operator diagram separates three cases. $D=\mathrm{diag}(1,-1)$ is self-adjoint but not positive, because $q_D((0,1{)}^{\mathrm{T}})=-1$. The orthogonal projection $P=\mathrm{diag}(1,0)$ is positive semidefinite, with $q_P(x)=|x_1{|}^2$, but is not strictly positive on every nonzero vector. The complex Hermitian matrix $H=\left(\begin{array}{cc}2& i\\ -i& 2\end{array}\right)$ is positive definite because $q_H(a{e}_1+b{e}_3)=|a{|}^2+3|b{|}^2>0$ whenever $(a,b)\ne (0,0)$. For real symmetric matrices, MIT's lecture 27 relates these tests to the geometry of quadratic forms and their minima.^[ref]

A fundamental source of positive operators is $T^{\ast }T$ for a bounded linear operator $T:H\to K$:For the complex matrix $T=\left(\begin{array}{cc}1& i\\ 2& 1-i\end{array}\right)$ used above,Its eigenvalues are $4-\sqrt{6}$ and $4+\sqrt{6}$, both positive. Positivity organizes the squared error minimized by a least-squares solution: the same $T^{\ast }T$ occurs in the normal equation for a linear inverse problem. The positive square root of an operator gives the converse squared-length description, $q_T(x)=\Vert T^{1/2}x{\Vert }^2$ for every bounded positive operator $T$.

On a real Hilbert space, nonnegativity of $⟨Tx,x⟩$ alone does not imply self-adjointness, so the Hermitian operator hypothesis is part of the definition. On a complex Hilbert space, real-valuedness of all these expressions already forces self-adjointness by the polarization identity.

Strict positivity and a uniform positive lower bound also differ in infinite dimension. On the l2 sequence space, the bounded Hermitian operator $(Tx{)}_n=x_n/n$ satisfiesConsequently no $\gamma >0$ satisfies $q_T(x)\ge \gamma \Vert x{\Vert }^2$ for every $x$. Compare the positive definite symmetric operator and uniformly positive definite symmetric operator conditions.

A real symmetric or complex Hermitian matrix $A$ is positive semidefinite when $x^{†}Ax\ge 0$ for every vector $x$, equivalently when all its eigenvalues are nonnegative.

Suppose $A\in {\mathbb{C}}^{n\times n}$ is a diagonalizable matrix, $n\ge 2$, with an eigenbasis $v_1,\dots ,v_n$ and spectral decompositionAssume the dominant eigenvalue ${\lambda }_1$ is a simple eigenvalue andThen the normalized power iteration approaches the one-dimensional eigenspace of ${\lambda }_1$. Its asymptotic direction-error bound has factor $\gamma =|{\lambda }_2/{\lambda }_1|<1$. This spectral gap is a gap in modulus: if $g=|{\lambda }_1|-|{\lambda }_2|$, then $\gamma =1-g/|{\lambda }_1|$. A small relative gap gives slow convergence.^[ref]

The short proof is the exact eigenbasis identityThe remaining sum has norm bounded by a constant times ${\gamma }^k$. This proves convergence of direction, allowing a changing sign or complex factor. A tiny $c_1$ or a poorly conditioned, nonorthogonal eigenbasis can delay visible convergence: the condition number of $V$ affects constants, while $\gamma$ controls the eventual rate. The bound need not be an equality; if the initial coefficient of the second-largest eigenvalue vanishes, the active spectrum of the power method gives a faster rate. When $\gamma =0$, all unwanted components disappear after one multiplication.^[ref]

The hypothesis is $c_1=(V^{-1}{x}_0{)}_1\ne 0$, not an ordinary nonzero inner product with the right eigenvector. Let $w_1^{\ast }$ be the first row of $V^{-1}$, a left eigenvector normalized so $w_1^{\ast }{v}_j$ is $1$ for $j=1$ and $0$ otherwise; $\ast$ denotes conjugate transpose. Then $c_1=w_1^{\ast }{x}_0$. For a Hermitian matrix, choose an orthonormal eigenbasis and the criterion becomes $v_1^{\ast }{x}_0\ne 0$: the starting vector must be nonorthogonal to the dominant eigenvector. For a general diagonalizable matrix, the nonorthogonal eigenbasis makes these two tests different, as illustrated under power iteration failure cases.

For each unit vector iterate compute the Rayleigh quotient ${\rho }_k=x_k^{\ast }A{x}_k$ and the eigenpair residual $r_k=A{x}_k-{\rho }_k{x}_k$. Use the same multiplication $A{x}_k$ for both diagnostics and the next normalized iterate. For any complex matrix, this Rayleigh quotient minimizes $\Vert A{x}_k-\mu x_k{\Vert }_2$ over complex scalars $\mu$, because $x_k^{\ast }{r}_k=0$. Under power iteration convergence for a diagonalizable matrix, ${\rho }_k\to {\lambda }_1$ and $\Vert r_k{\Vert }_2\to 0$, even when the vectors alternate signs or phases.^[ref]

A dimensionless stopping quantity iswhen the denominator is positive; $\Vert A{\Vert }_2$ is the operator norm, and a known upper bound may replace it if computing it is costly. A small eigenpair residual certifies a small backward error of an approximate eigenpair, but does not establish that the eigenvalue found is dominant.

For a Hermitian matrix with orthonormal eigenbasis $u_j$, write $x_k={\sum }_j{a}_j{u}_j$. Then the independently useful identityshows that some eigenvalue lies within $\Vert r_k{\Vert }_2$ of ${\rho }_k$. If a specific target eigenvalue ${\lambda }_1$ is separated from all the others by ${\delta }_k={\min }_{j>1}|{\lambda }_j-{\rho }_k|>0$, it also gives ${\epsilon }_k\le \Vert r_k{\Vert }_2/{\delta }_k$. This separation is measured from the computed Rayleigh quotient; it differs from the dominant-modulus spectral gap. For a nonnormal matrix, the same orthogonal expansion is unavailable and a small eigenpair residual alone need not imply a comparably small distance to the spectrum.

A tied largest modulus can prevent even direction convergence. With $D=\mathrm{diag}(2,-2)$ and $x_0=(1,1{)}^T/\sqrt{2}$,The two directions form a cycle; neither is an eigenvector. There is no dominant-modulus spectral gap. A tied modulus is not a universal failure: an initial eigenvector remains on its line, and $A=2I$ preserves every direction. Subspace iteration addresses a separated cluster by targeting a dominant invariant subspace instead of one eigenvector.

An orthogonal start can fail despite a strict spectral gap. For $A=\left(\begin{array}{cc}2& 1\\ 1& 2\end{array}\right)$ and $x_0=(1,-1{)}^T/\sqrt{2}$, the dominant component is zero, so $A{x}_0=x_0$ and every iterate equals $x_0$. The Rayleigh quotient is exactly $1$ and the eigenpair residual is zero, although the dominant eigenvalue is $3$. Exact arithmetic never creates a missing component.^[ref]

The third panel contrasts these failures with $N=\mathrm{diag}(-3,1)$, $x_0=(1,1{)}^T/\sqrt{2}$, for whichHere the horizontal eigenvector direction converges with a strict spectral gap, while the normalized vectors alternate signs. This is the successful direction convergence described under sign and phase in power iteration.

For a nonorthogonal eigenbasis, even the word “orthogonal” must be used carefully. The diagonalizable matrix $C=\left(\begin{array}{cc}3& 2\\ 0& 1\end{array}\right)$ has right eigenvectors $v_1=(1,0{)}^T$, $v_2=(-1,1{)}^T$, and dominant left eigenvector $w_1=(1,1{)}^T$. For $x_0=(a,b{)}^T$, the dominant coefficient is $c_1=w_1^T{x}_0=a+b$. The starting vector $v_2$ is nonorthogonal to $v_1$ but stays at the smaller eigenvalue $1$; $(0,1{)}^T$ is orthogonal to $v_1$ but has $c_1=1$ and converges to the dominant direction. The left eigenvector test, not the right-eigenvector inner product, controls the outcome.

A random vector drawn from a continuous probability distribution with a probability density function on the full real or complex vector space has $c_1\ne 0$ with probability one. This avoids the exact missing-component hyperplane, but does not guarantee a large component or fast convergence. Floating-point arithmetic may seed a missing component, yet a structurally preserved zero can remain zero, so accidental perturbations are not a convergence guarantee.

Iterate $q^{(k+1)}=A{q}^{(k)}/\Vert A{q}^{(k)}\Vert$. For a self-adjoint operator with a unique dominant eigenvalue separated in modulus from the others, a starting vector that is nonorthogonal to its dominant eigenvector gives convergence of the eigendirection at the spectral-ratio rate. For a general diagonalizable matrix, the condition is a nonzero coefficient in the dominant component of its eigenbasis, detected by the corresponding left eigenvector; an ordinary dot product with the right eigenvector does not generally detect that coefficient.

The power method is power iteration; its convergence depends on the dominant spectral component of the starting vector.

For example, $B=\left(\begin{array}{cc}2& 1\\ 0& 1\end{array}\right)$ has dominant right eigenvector $(1,0{)}^T$ and a dominant left eigenvector $(1,1{)}^T$. The starting vector $q^{(0)}=(-1,1{)}^T/\sqrt{2}$ has nonzero dot product with the right eigenvector, but $B{q}^{(0)}=q^{(0)}$: it stays forever in the eigenspace for the smaller eigenvalue $1$. Its coefficient along the dominant direction is zero, as the left eigenvector detects. An orthonormal eigenbasis makes the two tests agree in the self-adjoint case.

For the Prandtl normal-mode equation with viscosity scaled to one and a profile having a nondegenerate stationary point, $U-c_0\sim (y-y_c{)}^2/2$. A piecewise outer mode proportional to $U-c_0$ has a second-derivative jump. Balancing the advective and third-derivative terms smooths that jump over width ${\alpha }^{-1/4}$, with velocity amplitude ${\alpha }^{-1/2}$ and a phase-speed correction of the same order. Matching selects the eigenvalue through a third-order inner problem.

For $y^{\prime \prime }+({\omega }^2+ϵ\cos t)y=0$, use the method of multiple scales with $T=ϵt$ and $y_0=a(T)\cos (t/2)+b(T)\sin (t/2)$. Removing secular terms gives $a_T=(k-1/2)b$ and $b_T=-(k+1/2)a$. The slow eigenvalues satisfy ${\lambda }^2=1/4-k^2$, so an exponentially growing mode exists inside the displayed leading instability interval. At its leading endpoints the slow matrix is nilpotent; higher-order corrections are needed to determine the exact edges. Floquet theory distinguishes this exponential instability from algebraic growth at a repeated multiplier.

A square nonnegative matrix $A$ is primitive if some positive integer power $A^k$ has strictly positive entries. It is therefore an irreducible nonnegative matrix. The Perron–Frobenius theorem gives a leading eigenvalue whose modulus is strictly larger than that of every other eigenvalue. Every strictly positive matrix is primitive; the two-cycle permutation matrix is irreducible but not primitive.