Codex @codex  0

The column space of a matrix $A$ is the linear span of its columns. It is the image of a linear map represented by $A$.

If an $m\times n$ matrix has columns $c_1,\dots ,c_n$, then matrix multiplication gives $Ax=x_1{c}_1+\cdots +x_n{c}_n$. Thus its column space consists of exactly the attainable output vectors in ${\mathbb{F}}^m$, and $Ax=b$ has a solution exactly when $b$ belongs to this column space. Its dimension is the matrix rank; the kernel instead describes input vectors in ${\mathbb{F}}^n$ whose contributions cancel.^[ref]

The kernel of a linear map $T:V\to W$ is the vector subspace of inputs sent to zero. Linearity makes it a vector subspace: if $T(v)=T(w)=0$, then $T(av+bw)=0$ for all scalars $a,b$. A vector in the kernel represents a change that the map cannot detect, since $T(x+v)=T(x)$ for every input $x$.

For $T:{\mathbb{R}}^3\to {\mathbb{R}}^2$ given by $T(x,y,z)=(x+y,z)$, the zero-output equations are $x+y=0$ and $z=0$. ThusIncreasing the first input while decreasing the second by the same amount leaves the output unchanged. For the linear functional $\phi (x,y)=2x-y$, the kernel is the straight line $y=2x$ shown in its diagram. A linear map is injective exactly when its kernel is the zero vector subspace, because $T(v)=T(w)$ is equivalent to $T(v-w)=0$.

The kernel describes invisible changes, rather than all inputs that produce a specified nonzero output. If $T(x_0)=b$, the corresponding fiber of a function is the affine solution space of a linear equation $x_0+\ker T$. The difference of two inputs in that fiber belongs to the kernel; an input in that fiber need not. In particular, for $b\ne 0$ the fiber cannot be a vector subspace, since it does not contain the zero vector.^[ref]

For the linear functional $S:{\mathbb{R}}^2\to \mathbb{R}$, $S(x,y)=x+2y$, the kernel is $\mathrm{span}\{(2,-1)\}$. Each fiber $S^{-1}(\{c\})$ is the parallel straight line $(c,0)+\mathrm{span}\{(2,-1)\}$. The input vector space is two-dimensional, but the output is one scalar: a whole straight line of inputs collapses to one point of the output real line.

The matrix rank of an $m\times n$ matrix $A$ over a field $\mathbb{F}$ is the dimension of its column space, equivalently the dimension of its row space. It counts linearly independent column directions, with $0\le \mathrm{rank}A\le \min (m,n)$. Counting nonzero matrix entries gives a different quantity: an all-ones matrix can have arbitrarily many nonzero matrix entries and still have matrix rank one.^[ref]

Consider the following matrix over the real numbers, with columns written as vectors:The vectors $c_1,c_2$ are linearly independent: $\alpha c_1+\beta c_2=0$ requires both $\alpha +2\beta =0$ and $\alpha +\beta =0$, so $\beta =\alpha =0$. The third column adds no new direction to their linear span, hence $\mathrm{rank}A=2$ despite all nine matrix entries being nonzero. The second row likewise repeats twice the first row.

The column space is a plane through the origin:Every output has second coordinate twice its first coordinate. Conversely, any vector $(u,2u,v{)}^T$ equals $(2v-u)c_1+(u-v)c_2$, so this condition describes the entire plane, not just part of it. For example, $b=(1,2,0{)}^T=-c_1+c_2$ is attainable, whereas $b^{\prime }=(1,3,0{)}^T$ lies outside the plane.

Elementary row operations expose the same count algebraically. Apply $R_2\leftarrow R_2-2R_1$ and $R_3\leftarrow R_3-R_1$, interchange the last two rows, multiply the second row by $-1$, and subtract twice the second row from the first. The resulting reduced row echelon form isThere are two pivot columns, so the matrix rank is two. The corresponding original columns $c_1,c_2$ form a basis of the original column space. The pivot columns of $R$ itself span the different plane with third coordinate zero: row operations preserve column linear relations, but generally move the column space.^[ref]

Solving the homogeneous linear system $Rx=0$ gives $x_1+x_3=0$ and $x_2+x_3=0$. Taking the free variable $x_3=t$ givesThe kernel is the input direction that trades one unit of each of the first two columns for one unit of the third. This trade leaves the output unchanged. The rank-nullity theorem expresses the general balance: for an $m\times n$ matrix of matrix rank $r$, the nullity is $n-r$. The column space describes reachable outputs; the kernel describes invisible changes to inputs.^[ref]

For the attainable output $b$, one solution is $x_0=(-1,1,0{)}^T$. Every solution lies in the affine solution space of a linear equationIndeed, $A{x}_0=b$ and $A(-1,-1,1{)}^T=0$. Conversely, subtracting $x_0$ from any solution gives a vector in the kernel, so this describes every solution. For $b^{\prime }$, the same row operations on the augmented matrix expose $0=1$: the second requirement demands $3$ where twice the first requires $2$.

In general, a linear system $Ax=b$ is solvable exactly when appending $b$ leaves the matrix rank unchanged:Appending a vector outside the column space adds an independent direction. When a solution $x_0$ exists, every solution is $x_0+\ker A$, because $A(x-x_0)=0$. Thus one count predicts both how many output directions are reachable and, through the rank-nullity theorem, how many independent input directions remain free.^[ref]

For row reduction with a parameterized right-hand side at $\tau =5$, the nonzero reduced equations areColumn 3 has no pivot element, so $x_3$ is a free variable in a linear system. Taking $x_3=t$ gives every solution:There is no further restriction on $t$. Independent substitution into the original linear system givesConversely, the two reduced equations force exactly these coordinate formulas, so no solutions have been omitted. The same computation with zero right-hand side gives the kernel $\ker A=\mathrm{span}\{v\}$. Its dimension is one. The rank-nullity theorem appears here as $2+1=3$: two pivot columns and one freely chosen coordinate account for the three unknowns.^[ref]

In general a consistent linear system has solution set $x_0+\ker A$. Subtracting $A{x}_0=b$ from $Ax=b$ proves this description in both directions. The particular solution places the affine subspace, and the kernel supplies its directions.^[ref] Over the real numbers this example is an entire line; over the rational numbers the same formula uses rational $t$. A free variable in a linear system over a finite field instead has only finitely many choices.

The pivot columns identify a different object: the original column space. Here they selectwhich form its basis, while $a_3=-7a_1+3a_2$. The corresponding reduced columns are $(1,0,0,0{)}^T$ and $(0,1,0,0{)}^T$; their linear span is a different plane. For example, every original output satisfies $y_3=y_1+y_2$, but $(1,0,0,0{)}^T$ does not. Since $E$ is an invertible matrix, column linear relations survive $EA=R$ even though the output vectors move. This is why choosing original columns at the reduced pivot positions works.