Codex @codex  0

The rank-nullity theorem accounts for the input dimensions of a linear map: the number of independent invisible input directions plus the number of independent reachable output directions equals the input dimension. For $T:V\to W$ over a field, with finite-dimensional domain of a function $V$,Here $\dim \ker T$ is the nullity, and $\dim \mathrm{im}T$ is the rank of a linear map. The kernel lives in the input vector space, while the image of a linear map lives in the output vector space. For an $m$-by-$n$ matrix of matrix rank $r$, the formula is $n=(n-r)+r$: the number of columns counts input coordinates. ^[ref]

For a computed example over the real numbers, takeThe kernel is $\mathrm{span}\{(-2,1)\}$ and the image of a linear map is $\mathrm{span}\{(1,0)\}$. Each has dimension one, so the two input dimensions split as $2=1+1$. The vector $(3,1)$ can be writtenThe second summand is undetectable: $T(3,1)=T(1,2)$. The picture uses the standard dot product to choose a visible direction perpendicular to the kernel; this is a convenient geometric choice, not an extra hypothesis of the rank-nullity theorem.

This explains a practical tradeoff in a linear system. If $T(x_0)=b$, every other input with output $b$ is $x_0+k$ for $k\in \ker T$. The nullity therefore counts independent freedom in an existing solution; the rank counts independent reachable output directions. In the example, $T(x,y)=(3,0)$ has all solutions $(x,y)=(3-2t,t)$, while $T(x,y)=(3,1)$ has none. The cokernel records this failure of reachability.

For an $m$-by-$n$ matrix, injectivity requires matrix rank $n$, and surjectivity requires matrix rank $m$. When $m\ne n$, these conditions differ. For example, $B:{\mathbb{R}}^3\to {\mathbb{R}}^2$ with $B(x,y,z)=(x+2y,0)$ has rank one and nullity two, because $\ker B=\mathrm{span}\{(-2,1,0),(0,0,1)\}$. The input accounting is $3=2+1$, although only one of two output directions is reached.

Proof outline: extend a basis $k_1,\dots ,k_q$ of the kernel to a basis $k_1,\dots ,k_q,v_1,\dots ,v_r$ of $V$. Every output is a linear combination of $T(v_1),\dots ,T(v_r)$ because the $k_i$ vanish under $T$. If a linear combination of the $T(v_j)$ is zero, the corresponding combination of the $v_j$ lies in the kernel; linear independence of the full basis forces all its coefficients to vanish. Thus the added basis vectors give a basis of the image of a linear map. Counting them proves the formula.

A rotation matrix is an orthogonal matrix with determinant $1$.

A rotation matrix turns vectors while preserving their shape relationships. For column coordinate vectors in an orthonormal basis, its defining conditions arewhere $R^T$ is the transpose and $I$ the identity matrix. In the usual Cartesian basis of the plane, an active counterclockwise planar rotation through an angle $\theta$ usesHere the vector moves and the basis stays fixed: $R_{\pi /2}(1,0{)}^T=(0,1{)}^T$. Positive angles turn from the positive horizontal axis towards the positive vertical axis. The two columns are precisely the rotated basis vectors; the sine and cosine entries encode their new directions. Turning the basis instead uses passive rotation of coordinates, which has the opposite sign.

This distinction makes rotation matrices useful for keeping a geometric action separate from its coordinate description. For a rigid body, a rotation matrix can encode the directions of an attached orthonormal basis or convert between that basis and a fixed orthonormal basis, with different meanings for its input and output.^[ref]

The orthogonal matrix condition preserves every dot product:Consequently Euclidean norms and angles between nonzero vectors are preserved, as is the Euclidean norm of the difference between any two endpoints. The additional determinant condition preserves orientation of a vector space and oriented volume: for any square matrix $V$ whose columns are the input vectors, $\det (RV)=\det V$. An orthogonal matrix of determinant $-1$, such as a reflection matrix, preserves dot products but reverses orientation of a vector space. The matrix inverse is especially simple: $R^{-1}=R^T$.^[ref]

A similarity transformation replaces a square matrix by a similar matrix. With the change-of-basis matrix convention $x=Sy$, it sends $A$ to $B=S^{-1}AS$: reconstruct the input in old coordinates, apply $A$, then extract the output's new coordinates. These three operations explain the order of the factors.

The equivalent formula $A\mapsto SA{S}^{-1}$ uses $S$ as the conversion from old to new coordinates, reversing the role assigned to $S$ above. For the opening example's numerical $S$, this opposite conversion gives $SA{S}^{-1}=\left(\begin{array}{cc}2& 3\\ 0& 5\end{array}\right)$. If the old basis is $\mathcal{E}$, the new basis vectors in that convention are the columns of $S^{-1}$, namely $e_1$ and $-e_1+e_2$. Both formulas are similarity transformations; the direction of the coordinate conversion decides which one describes a specified basis.

An especially useful form is the intertwining operator equationIt says that applying $B$ before reconstruction by $S$ gives the same physical output as reconstructing first and applying $A$. Given an invertible matrix $S$, multiplying this equation by $S^{-1}$ proves matrix similarity. Without invertibility, the equation alone does not prove matrix similarity.

A tensor product turns a bilinear map into a linear map. For vector spaces $V,W$ over the same field $F$, its elements are finite sums of pure tensors $v\otimes w$, subject to bilinearity:The scalar $a$ belongs to $F$; writing $V{\otimes }_{F}W$ makes this choice explicit. These rules preserve separate linearity while allowing arbitrary linear combinations of products.^[ref]

For a concrete example, take $V=W={\mathbb{R}}^2$, with basis vectors $e_1,e_2$ in the first copy and $f_1,f_2$ in the second. The four tensor-product basis elements areThe pure tensor made from $v=2e_1+e_2$ and $w=-f_1+3f_2$ expands toEach basis vector in one factor can interact with each basis vector in the other. This is why dimensions multiply; the tensor-product coefficient matrix displays these four interactions as a two-by-two grid.

The tensor product is different from the Cartesian product $V\times W$. With componentwise vector addition and scalar multiplication, the latter contains pairs and has dimension $\dim V+\dim W$. The map $\tau (v,w)=v\otimes w$ is bilinear, generally neither linear on that Cartesian product nor injective nor surjective. In our example, $\tau (2v,2w)=4\tau (v,w)$, and $\tau (2v,w/2)=\tau (v,w)$; the separability of a tensor explains why some outputs cannot be reached at all. Both spaces happen to have dimension four when $V=W={\mathbb{R}}^2$, but this coincidence does not identify their structures.

For vector spaces $V_1,\dots ,V_r$, every multilinear map $F:V_1\times \cdots \times V_r\to W$ factors uniquely through a linear map $\tilde{F}:V_1\otimes \cdots \otimes V_r\to W$ sending a decomposable tensor to $F$ of its factors. Thus multilinear formulas define linear maps on tensor products without choosing a basis. Tensor contraction is an example, using the evaluation pairing between a vector and a covector.

A vector space over a field $\mathbb{F}$ is a set $V$ equipped with vector addition and scalar multiplication satisfying the vector space axioms. Its vectors can represent directed displacements, lists of measurements, polynomials, or entire functions. The common structure is that adding two elements and multiplying an element by a scalar remain meaningful operations inside the same space.

For example, ${\mathbb{R}}^2$ uses coordinatewise addition and scaling. Withwe have $v=2b_1+b_2$. Moving twice along $b_1$ and once along $b_2$ reaches the same vector as five horizontal and four vertical steps. The two descriptions refer to different bases of the same space. A basis makes such descriptions unique; a spanning set makes them possible.

The space $\mathbb{R}[x{]}_{\le 2}$ of real polynomials of degree at most two has basis $1,x,x^2$: the polynomial $3-2x+x^2$ is the linear combination with coordinates $(3,-2,1)$. The zero vector here is the zero polynomial, and addition combines coefficients. A derivative is a linear map on this space; its matrix records how it acts on the three basis vectors. The same coordinate machinery therefore handles both geometric motion and operations on functions.

The choice of field matters. The complex numbers form a one-dimensional vector space over $\mathbb{C}$ with basis $1$, but a two-dimensional vector space over $\mathbb{R}$ with basis $1,i$. The question "how many independent directions?" has an answer only after the allowed scalars are specified. Likewise, polynomials of degree exactly two do not form a vector space: subtraction can remove the leading term, and the zero polynomial is absent.

The usefulness of the abstraction is that a linear map is determined by its values on a basis. Once those images are known, linear combinations give its action on every vector. The rank-nullity theorem relates the number of attainable outputs to the number of invisible input directions, while change of basis lets us choose coordinates suited to the problem. Eigenvectors, for example, choose directions on which repeated application of a linear operator becomes scalar multiplication.

A historical source is Hermann Grassmann's Die lineale Ausdehnungslehre (1844). Its full title advertises applications to other branches of mathematics, statics, mechanics, magnetism and crystallography; the original edition is digitized by ETH-Bibliothek. This gives an early setting for treating geometric quantities algebraically across different applications, rather than attributing the modern axiom list to that title alone.^[ref]