Change of basis

A change of basis rewrites a vector using a different ordered basis of the same vector space. The vector stays fixed; its coordinate vector changes because the measuring directions change. Both bases must describe every vector uniquely, so a change of basis is reversible.

Start with the Cartesian basis $e_1=(1,0)$, $e_2=(0,1)$, and choose the new basis vectors $u=(1,1)$ and $v=(1,-1)$. For the vector $z=(2,0)$,The second coordinate vector says to travel once along $u$ and once along $v$. Their vertical contributions cancel, leaving exactly the original horizontal arrow. The diagram shows two descriptions of that same arrow, with the same origin and endpoint.

Choosing a useful basis can reveal simple structure hidden by the old coordinate vectors. Here the new basis describes common and opposing contributions. For two equal measurements $(5,5)$, the new coordinate vector is $(5,0)$: only the common contribution is present. In larger examples, a suitable basis can concentrate important information into a few coefficients. Strang's lecture on change of basis develops this principle through applications: the reversible change of basis preserves information, while subsequently discarding small coefficients loses information.^[ref]

An orthogonal change of coordinates relates two orthonormal bases of a real inner product space. With the new basis vectors as columns of an orthogonal matrix $Q$, old and new coordinate columns obey $x=Qy$. Then $x^{T}x=y^{T}y$, so Euclidean norm, Euclidean distance and angles are preserved. A quadratic form $x^{T}Ax$ becomes $y^T(Q^{T}AQ)y$. For a symmetric matrix, orthogonal diagonalization chooses $Q$ so that the transformed quadratic form is a sum of eigenvalues times squared coordinates. This explains the principal-axis descriptions of a quadric surface.

Fix the convention: the columns of the change-of-basis matrix $P$ are the new basis vectors written in the old basis. Thus $P$ converts new coordinate vectors into old ones; its matrix inverse converts old coordinate vectors into new ones. For the preceding basis,Its determinant is $-2$, so $P$ is an invertible matrix. Checking which direction $P$ converts is essential: different books may call either $P$ or $P^{-1}$ the change-of-basis matrix.

For a linear operator, convert the input into the old basis, apply the old matrix, and convert the output back. Reading that sequence from right to left givesFor example, let the old diagonal matrix stretch horizontal components by $2$ and vertical components by $3$. ThenThe output represents $2u+2v=(4,0)$, just as $A_{\mathrm{old}}(2,0{)}^T=(4,0{)}^T$. The matrices look different because their bases differ, but they encode the same linear operator. This relation is called matrix similarity; it preserves the underlying action.^[ref]