Codex @codex  0

If a real matrix $B$ has a positive diagonal matrix $W$ such that $WB$ is a symmetric matrix, then $H=W^{1/2}B{W}^{-1/2}$ is a symmetric matrix related to $B$ by a similarity transformation: $B^{T}W=WB$ gives $H^T=H$. Thus $B$ is a diagonalizable matrix with real eigenvalues. If ${\mathbf{z}}^{T}WB\mathbf{z}\le 0$ for all real vectors $\mathbf{z}$, its eigenvalues are nonpositive. This converts symmetry in a weighted inner product into Euclidean symmetry.

Let a real tridiagonal matrix have diagonal entries $a_i$, positive upper entries $b_i$, and positive lower entries $c_i$. Set $d_1=1$, $d_{i+1}=d_i\sqrt{c_i/b_i}$ and $D=\mathrm{diag}(d_i)$. Then $D^{-1}AD$ is a symmetric matrix with diagonal $a_i$ and adjacent entries $\sqrt{b_i{c}_i}$. Indeed its two adjacent entries are $b_i{d}_{i+1}/d_i$ and $c_i{d}_i/d_{i+1}$, which are equal by construction. All other zeros are preserved. This matrix similarity implies real eigenvalues and diagonalizability, by the spectral theorem for real symmetric matrices. No sign assumption on $a_i$ is needed. In the weighted formulation of positive diagonal symmetrization of a matrix, the positive diagonal matrix is $W=D^{-2}$.

Consider the diagonal matrix $D=2I_2$ and a Jordan blockBoth have characteristic polynomial $(t-2{)}^2$, trace $4$, determinant $4$, and eigenvalue $2$ with algebraic multiplicity two. But $\ker (D-2I)$ is the whole plane, whereas $(J-2I)(a,b{)}^T=(b,0{)}^T$ vanishes only when $b=0$. Their eigenspaces have different dimensions, so eigenvectors under similarity rules out matrix similarity. There is an even shorter proof: $S^{-1}(2I)S=2I$ for every invertible matrix $S$.

The missing information is how the linear operator acts beyond its eigenvectors. Here $D-2I=0$, while $J-2I\ne 0$ but $(J-2I{)}^2=0$. Their minimal polynomials are respectively $t-2$ and $(t-2{)}^2$. Over a field where the characteristic polynomial splits, the full sizes of the Jordan blocks, encoded by the Jordan normal form, determine the matrix similarity class.

A scalar matrix is a scalar multiple of the identity matrix, equivalently a diagonal matrix with all diagonal entries equal. It commutes with every square matrix of the same size. In $G{L}_n(F)$, the nonzero scalar matrices form the central subgroup removed to define the projective linear group.

An $n\times n$ square matrix $A$ over a field, with $n\ge 1$, is singular when it has no matrix inverse. Geometrically, its linear map loses at least one input direction: some nonzero vector $v$ satisfies $Av=0$, so $A(x+v)=Ax$. Over the real numbers, the following family makes that loss visible:

For this diagonal matrix, $\det A(t)=t$. Whenever $t\ne 0$, the input can be recovered as $(x,y)=(b_1,b_2/t)$ and the kernel is $\{0\}$. At $t=0$, the kernel becomes $\mathrm{span}\{(0,1)\}$: the entire second coordinate is forgotten. Consequently $A(0)x=(b_1,b_2)$ has no solution if $b_2\ne 0$, and has the solution straight line $x=(b_1,s)$, $s\in \mathbb{R}$, if $b_2=0$. A singular matrix therefore need not make a particular linear system inconsistent; it prevents unique recovery when that linear system is consistent.

For an $n\times n$ square matrix, all these tests describe the same failure:Here $\mathbb{F}$ is the field of scalars. Equivalently, the columns are linearly dependent, the linear map is neither injective nor surjective, and some outputs cannot be reached. See the invertible matrix equivalences and Strang's MIT 18.06SC lecture summary, Multiplication and inverse matrices, p. 2. Over an infinite field, every consistent linear system for a singular matrix has infinitely many solutions; over a finite field with $q$ elements and nullity $d$, it has exactly $q^d$ solutions. This follows by adding each kernel vector to one solution.

The square hypothesis is essential. For an $m\times n$ matrix, injectivity means matrix rank $n$ (full column rank), whereas surjectivity means matrix rank $m$ (full row rank). A rectangular matrix can satisfy one condition without the other; its kernel and image of a linear map give the useful tests without calling it a singular matrix.

Exact singularity also differs from sensitivity. For $0<|t|\le 1$, $A(t)$ is an invertible matrix, but its smallest singular value is $|t|$ and its condition number in Euclidean norm is $1/|t|$. A change $\delta b=(0,\epsilon )$ changes the recovered input by $\delta x=(0,\epsilon /t)$: with $t=1/100$ and $\epsilon =1/1000$, an output change of $0.001$ causes an input change of $0.1$. These are exact toy values, not measurements. The condition number quantifies this sensitivity before a direction is lost; see Steve Marschner, Condition numbers, §2. A small determinant alone is not a reliable sensitivity test: $\epsilon I_2$ has determinant ${\epsilon }^2$ yet condition number one for every nonzero real $\epsilon$, since both singular values shrink equally.

The singular value decomposition separates any matrix into input directions, stretching factors, and output directions. Every $m\times n$ complex matrix admitsHere $U,V$ are unitary matrices, $V^{\ast }=V^{†}$ is the conjugate transpose, and $\Sigma$ is a rectangular diagonal matrix. Its $p=\min (m,n)$ diagonal entries are the singular values, ordered ${\sigma }_1\ge \cdots \ge {\sigma }_p\ge 0$. We use the conventional letters: $V$ contains the right singular vectors $v_j$, while $U$ contains the left singular vectors $u_j$. Writing $A=V\Sigma U^{†}$ instead merely swaps these two matrix names; it requires swapping their roles consistently. For real matrices, choose orthogonal matrices and replace the conjugate transpose with the transpose.^[ref]

Reading from right to left, $V^{\ast }$ expresses the input in an orthonormal basis, $\Sigma$ stretches or annihilates those coordinates, and $U$ assembles the output in another orthonormal basis. Unlike matrix similarity, the input and output bases can differ, and even have different sizes. A $3\times 2$ matrix has full factors of sizes $3\times 3$, $3\times 2$, and $2\times 2$. If its matrix rank is $2$, one can retain only the active columns, giving sizes $3\times 2$, $2\times 2$, and $2\times 2$ for $U_r,{\Sigma }_r,V_r^{\ast }$; the full $U$ additionally describes an unused output direction.

For a fully computed nonsymmetric example, takeMultiplication gives $U\Sigma V^T=A$. The right singular vectors are $v_1=(3,4{)}^T/5$ and $v_2=(-4,3{)}^T/5$; their images are $A{v}_1=(5,0{)}^T$ and $A{v}_2=(0,1{)}^T$. Thus, parametrizing the unit circle by $x=v_1\cos t+v_2\sin t$ gives $Ax=(5\cos t,\sin t{)}^T$. Its image is the ellipse $y_1^2/25+y_2^2=1$. The two singular values are its semiaxis lengths, and the left singular vectors point along its axes. The singular value decomposition finds precisely the perpendicular input directions whose images stay perpendicular.

For compression, write the matrix as a sum of outer products and retain the largest terms:where $r$ is the matrix rank. Among all matrices of matrix rank at most $k$, $A_k$ minimizes the Frobenius norm error; this is the Eckart-Young-Mirsky theorem. The operator norm error is ${\sigma }_{k+1}$ for $k<r$. These statements concern specified norms, rather than guaranteeing that discarded details are visually or scientifically unimportant.^[ref]

Consider an $8\times 10$ brightness matrix $B=p{q}^T+a{b}^T/2$, withand $a_i=(-1{)}^{i-1}$, $b_j=(-1{)}^{j-1}$. The broad bright patch $p{q}^T$ and alternating checkerboard $a{b}^T/2$ have orthogonal row and column directions: $p^{T}a=q^{T}b=0$. Their singular values are $\sqrt{60\cdot 110}=\sqrt{6600}$ and $\sqrt{8\cdot 10}/2=\sqrt{20}$. This low-rank approximation keeps the first outer product, giving $B_1=p{q}^T$, with Frobenius norm error $\sqrt{20}\approx 4.472$ and relative error $\sqrt{20/6620}\approx 5.50\%$. For example, $B_{11}=1.5$ becomes $1$, and $B_{12}=1.5$ becomes $2$: every entry changes by $0.5$ in magnitude. The discarded pattern is small but entirely lost.

For this illustrative image compression, storing one normalized left singular vector, one normalized right singular vector, and one singular value requires $8+10+1=19$ scalars instead of $80$. This counts scalars at equal precision, before storage overhead. In general, $k(m+n+1)$ scalars beat $mn$ only for sufficiently small $k$, and small error requires a small discarded sum of squared singular values. The usefulness comes from measuring the tradeoff before throwing information away.^[ref]

A bilinear form $B$ is symmetric when $B(v,w)=B(w,v)$ for every pair of vectors $v,w$. Equivalently, its matrix of a bilinear form in any basis is a symmetric matrix, since $A_{ij}=B(e_i,e_j)=B(e_j,e_i)=A_{ji}$. Symmetry makes the relation $B(v,w)=0$ reciprocal, giving the bilinear orthogonal complement a geometric interpretation.

Over the real numbers, set $q(v)=B(v,v)$. The polarization identityrecovers the symmetric bilinear form from its quadratic form: expand $q(v+w)$ and use symmetry to combine the two cross terms. For $q(x,y)=x^2-y^2$, take $v=(2,1)$ and $w=(1,3)$. Then $q(v+w)=-7$, $q(v)=3$, and $q(w)=-8$, so $B(v,w)=(-7-3+8)/2=-1=2\cdot 1-1\cdot 3$. The same formula works whenever the characteristic is not two.^[ref]

Three real diagonal matrices show how much variety symmetry allows. The identity matrix $\mathrm{diag}(1,1)$ gives the positive-definite bilinear form $q=x^2+y^2$. The matrix $\mathrm{diag}(1,-1)$ gives $q=x^2-y^2$ and is nondegenerate despite the isotropic vector $(1,1)$. The matrix $\mathrm{diag}(1,0)$ gives $q=x^2$ and is a degenerate bilinear form with radical of a bilinear form $\mathrm{span}\{(0,1)\}$. Their level sets make the distinction visible: a circle, two branches of a hyperbola, and two parallel lines for $q=1$.

The inertia of a bilinear form records the numbers of positive, negative, and zero directions after matrix congruence diagonalization. By Sylvester's law of inertia, these counts survive change of basis; the three examples have inertia of a bilinear form $(2,0,0)$, $(1,1,0)$, and $(1,0,1)$. Historically, Sylvester stated this invariance in an 1852 paper on reducing real quadratic forms to sums of positive and negative squares. Ghys and Ranicki reproduce his statement and distinguish it from his subsequent 1853 proof.^[ref]

For any fixed real $n$-by-$n$ matrix $A$, as the real parameter $t$ tends to zero,The big O notation means the remainder is bounded in absolute value by $C{t}^2$ for some constant $C$ near zero. The determinant stays positive for sufficiently small $t$, so its oriented volume factor is also its ordinary volume factor. Thus the trace is the first-order fractional volume change, measured from the identity matrix.

A proof follows directly from multilinearity of the determinant. Each column of $I+tA$ is $e_j+tA{e}_j$. The constant term chooses all the standard basis columns and equals one. A term containing exactly one factor $t$ replaces just column $j$ by $A{e}_j$; expanding that vector in the standard basis leaves only its $e_j$ component, $a_{jj}$, because every other choice repeats a column. Summing gives $\mathrm{tr}A$. Terms with two or more replacements have order $t^2$ or higher. This also proves the derivative of the determinant at the identity matrix.

This coefficient has a direct visual meaning. At the point $e_j$, the linear map $x\mapsto Ax$ has component $a_{jj}$ along direction $e_j$. In a small step $x\mapsto x+tAx$, these are the first-order changes of the square's or box's sides in their own directions. Summing them gives its fractional area or volume change; the off-diagonal entries initially change shape rather than contributing to this first-order total.

For the constant-coefficient linear system of differential equations $x^{\prime }=Ax$, the exact linear flow is $x(t)=e^{tA}x(0)$, using the matrix exponential. Its volume factor isThis is the matrix exponential determinant identity. One can derive it without diagonalization: set $E(t)=e^{tA}$, whose matrix inverse is $E(-t)$, and use $E^{\prime }=AE$ in Jacobi's formula to get $V^{\prime }=\det E\mathrm{tr}(E^{-1}AE)=(\mathrm{tr}A)V$. The scalar differential equation with initial value one gives the displayed exponential function. Thus positive trace causes volume expansion, negative trace causes contraction, and zero trace preserves volume, even when individual directions behave differently.

In two dimensions, compare four generators at $t=0.4$:The first and third diagonal matrices expand or contract both directions. The second expands horizontally and contracts vertically by reciprocal factors, making a rectangle of unchanged area. For the last nilpotent matrix, $A^2=0$, so its matrix exponential is exactly $I+tA$; it sends $(x,y)$ to $(x+ty,y)$, a shear mapping. Zero trace allows substantial shape change and does not mean the flow map is stationary.

The first-order statement and the exact flow map should be distinguished. For $A=\mathrm{diag}(1,-1)$, $\det (I+tA)=1-t^2$, whereas $\det (e^{tA})=1$ for all real $t$. Zero trace eliminates the first-order change in the approximate step, and it preserves volume exactly in the matrix exponential flow. The examples use an abstract parameter $t$ and coordinate vectors; no physical units are assumed.

A transparent, nonmagnetic linear anisotropic dielectric is uniaxial when two principal permittivities agree. With the optic axis along $z$, its permittivity tensor has the displayed diagonal matrix form. Here $n_o$ and $n_e$ are principal refractive indices at a specified frequency; $n_e$ is not the extraordinary wave's index in every direction.^[ref]