Linear dependence (${\sum }_i{a}_i{v}_i=0,(a_1,\dots ,a_n)\ne 0$)

A finite family of vectors in a vector space over a specified field $F$ is linearly dependent if it has a nontrivial linear relation: ${\sum }_i{a}_i{v}_i=0$ with $a_i\in F$ and at least one coefficient nonzero. One can then solve for a vector whose coefficient is nonzero as a linear combination of the others; removing that entry preserves the linear span. Repeated vectors in a list give linear dependence: for example $(v,v)$ has the linear relation $1v+(-1)v=0$. A list keeps both entries even though the set $\{v,v\}$ has only one element. Strang's notes illustrate redundant columns by expressing one as the sum of two others.^[ref]

Keep $v_1=(1,1)$ and $v_2=(1,-1)$, and add $v_3=(2,0)=v_1+v_2$. The three vectors still have linear span ${\mathbb{R}}^2$, but nowThe two coefficient triples $(2,1,0)$ and $(1,0,1)$ differ by the nontrivial linear relation $(-1,-1,1)$. In fact all linear combination representations of this target areTo check both completeness and correctness, use $c_1{v}_1+c_2{v}_2+c_3{v}_3=(c_1+c_3)v_1+(c_2+c_3)v_2$. Linear independence of $v_1,v_2$ forces $c_1+c_3=2$ and $c_2+c_3=1$, giving exactly the displayed family. Redundancy therefore preserves attainable targets while allowing their coefficients to move. For solving a linear system, these alternatives matter; for assigning unique coordinate vectors, one instead chooses a basis.

The following example shows why linear independence depends on the scalar field.

Consider the vectors $1,i$ in the complex numbers, where $i$ is the imaginary unit. With scalar field $\mathbb{R}$, a linear relation $a\cdot 1+b\cdot i=0$ has $a,b\in \mathbb{R}$. Taking its real part and imaginary part gives $a=b=0$, so the pair is linearly independent. Every complex number $x+iy$ also has coefficients $(x,y)$ in the real numbers, so $1,i$ form a basis and the dimension of a vector space is two.

With scalar field $\mathbb{C}$, the same pair is linearly dependent, sinceuses the nonzero coefficients $(i,-1)$ from the complex numbers. The single vector $1$ is now a basis, because $z=z\cdot 1$ for every complex number $z$, giving dimension of a vector space one. For example $3+i=3\cdot 1+1\cdot i=(3+i)\cdot 1+0\cdot i$: the second representation uses a coefficient unavailable over the real numbers. Specifying the field is part of the definition of linear independence.

A linear relation among vectors $v_1,\dots ,v_n$ is a coefficient tuple $(a_1,\dots ,a_n)$ satisfying ${\sum }_i{a}_i{v}_i=0$. It is nontrivial if at least one coefficient is nonzero. For the matrix with these vectors as columns, the space of relations is its kernel. The vectors are linearly independent exactly when this kernel is zero. An invertible change of coordinates preserves every relation, since $S{\sum }_i{a}_i{v}_i=0$ if and only if ${\sum }_i{a}_i{v}_i=0$.