The product is , so multiplying it by the matrix gives an matrix. The product is , so multiplying it on the left by the matrix also gives an matrix. Both multiplications have matching inner dimensions.
Suppose a vector lies outside the span of . Then is linearly independent: in an equation , a nonzero would express in that span, and with the independence of forces every .
This would give linearly independent vectors in a space with an -vector basis, contrary to the supplied claim. Therefore spans . Independence plus spanning makes a basis.
For the equal-cardinality basis criterion, because spans , repeatedly remove a vector whenever it is a linear combination of the others. Such a removal does not change the span. The finite process ends with a linearly independent spanning subset , hence a basis of .
If the original were linearly dependent, at least one removal would occur and . But a basis of an -dimensional vector space has vectors. Equivalently, apply the allowed claim to the basis and any fixed -vector basis of : the latter would wrongly be linearly dependent. Thus no removal was possible. The original spanning set is linearly independent and therefore a basis.
The supplied factors give . Back substitution in yields and , so
Multiplying by the original matrix gives , so this least-squares minimizer has residual zero: this particular overdetermined system is exactly consistent. Full column rank still guarantees uniqueness of the minimizer.
Substitution gives . Since is invertible, cancel it on the left to obtain the nonsingular triangular system
This is the reduced QR least-squares solution. Its geometric justification is the orthogonal decomposition
The second term is independent of , while invertibility of lets the first term be zero at exactly one point. Although , one must not replace by : is tall and its product is the orthogonal projection onto its column space.
From the zero initial vector, the linear-system residual is . Then , , and . The step is , giving
As a check, the new residual is , orthogonal to the preceding residual as expected after this exact line search. It is nonzero, so one iteration has not already solved the system.
Real symmetry and positive definiteness are sufficient, and the preceding parts establish both properties for this matrix. If a residual becomes zero, stop: the solution has been reached and the displayed step quotient should not be evaluated as .
For a convergence justification, let solve , let , and let . The quadratic energy error is . Moving by , with , is exact line search for a positive-definite quadratic and gives
Writing for the extreme eigenvalues, one has and . Therefore
The factor lies below one, so the energy tends to zero and positive definiteness forces . Here the bound is , since the eigenvalues are 1 and 11. This proves convergence for every initial vector, rather than merely checking one numerical iteration.
Set . Because is an orthogonal matrix, and exactly when . The preceding diagonalization gives
Consequently , with equality only when . The matrix is a symmetric positive-definite matrix, not merely positive semidefinite. In the original coordinates the same identity is
which also makes positivity transparent.
The characteristic polynomial is
Thus the eigenvalues are 1 and 11. Corresponding eigenvectors are and . Their dot product is zero and each has Euclidean norm . Normalizing gives
The columns are orthonormal, so . The eigenvector equations give and hence , proving the claimed orthogonal diagonalization of a real symmetric matrix.
Not unique in general. For any invertible matrix ,
is another rank factorization, with the same full ranks. This is a change of basis in the intermediate -dimensional space. For example, even has different full-rank factors. Once a particular ordered basis is fixed, its coordinate matrix is unique; it is the basis choice that creates the freedom.
Choose independent columns of that form a basis of its column space, and put them in . For each column of , let be its coordinate vector in that basis; put these coordinate vectors in . The column equations give .
By construction has full column rank . The columns of corresponding to the selected basis columns are the standard vectors of , so has full row rank . This proves the requested rank factorization. When , and the corresponding empty-column and empty-row factors have the required shapes and rank zero.
True. Using the same transpose identity and gives
The final equality follows by multiplying and in either order and obtaining the identity. Thus the inverse is a skew-symmetric matrix as well. The invertibility hypothesis is retained throughout.
True. Transposing the inverse identities shows . If , this becomes , exactly the symmetric matrix condition. The reasoning uses the matrix inverse and transpose identities, without assuming that different matrix factors commute.
The system is consistent for every : take , since . Thus is a right inverse giving an explicit solution for every right-hand side.
All solutions are with in the kernel of a linear map represented by . The rank-nullity theorem gives kernel dimension ; the solution is unique when , and is nonunique when .

Pinned article: Introduction to the OurBigBook Project

Welcome to the OurBigBook Project! Our goal is to create the perfect publishing platform for STEM subjects, and get university-level students to write the best free STEM tutorials ever.
Everyone is welcome to create an account and play with the site: ourbigbook.com/go/register. We belive that students themselves can write amazing tutorials, but teachers are welcome too. You can write about anything you want, it doesn't have to be STEM or even educational. Silly test content is very welcome and you won't be penalized in any way. Just keep it legal!
We have two killer features:
  1. topics: topics group articles by different users with the same title, e.g. here is the topic for the "Fundamental Theorem of Calculus" ourbigbook.com/go/topic/fundamental-theorem-of-calculus
    Articles of different users are sorted by upvote within each article page. This feature is a bit like:
    • a Wikipedia where each user can have their own version of each article
    • a Q&A website like Stack Overflow, where multiple people can give their views on a given topic, and the best ones are sorted by upvote. Except you don't need to wait for someone to ask first, and any topic goes, no matter how narrow or broad
    This feature makes it possible for readers to find better explanations of any topic created by other writers. And it allows writers to create an explanation in a place that readers might actually find it.
    Figure 1.
    Screenshot of the "Derivative" topic page
    . View it live at: ourbigbook.com/go/topic/derivative
  2. local editing: you can store all your personal knowledge base content locally in a plaintext markup format that can be edited locally and published either:
    This way you can be sure that even if OurBigBook.com were to go down one day (which we have no plans to do as it is quite cheap to host!), your content will still be perfectly readable as a static site.
    Figure 5. . You can also edit articles on the Web editor without installing anything locally.
    Video 3.
    Edit locally and publish demo
    . Source. This shows editing OurBigBook Markup and publishing it using the Visual Studio Code extension.
  3. https://raw.githubusercontent.com/ourbigbook/ourbigbook-media/master/feature/x/hilbert-space-arrow.png
  4. Infinitely deep tables of contents:
    Figure 6.
    Dynamic article tree with infinitely deep table of contents
    .
    Descendant pages can also show up as toplevel e.g.: ourbigbook.com/cirosantilli/chordate-subclade
All our software is open source and hosted at: github.com/ourbigbook/ourbigbook
Further documentation can be found at: docs.ourbigbook.com
Feel free to reach our to us for any help or suggestions: docs.ourbigbook.com/#contact