Each elementary matrix is obtained by applying one invertible elementary row operation to the identity matrix. Its inverse is the elementary matrix for the reverse operation. A product of elementary matrices is therefore invertible and has full rank .
Conversely, if , Gaussian elimination has a pivot in every column and reduces to the identity. Writing the successive row operations as left multiplication gives . Hence , a product of elementary matrices. This proves both directions of the elementary-matrix factorization theorem.