No, except when started at the exact solution. Merely failing the usual symmetric positive-definite matrix hypothesis would not by itself prove divergence. For this particular matrix one can prove that every defined nonzero-residual step increases the linear-system residual norm.
Write , put and . For , direct substitution into the stated iteration gives
For , both
are strictly positive; completing squares gives and . Hence and the residual norm strictly increases at every defined step. If before the residual vanishes, the algorithm is instead undefined. Neither behavior converges to residual zero. The matrix is invertible, so this also rules out convergence of the iterates to its unique solution.
For example, from the zero starting guess the first two step sizes are and , giving and . This demonstrates the failure without treating a sufficient convergence theorem as a necessary one. The general calculation is residual growth in an indefinite steepest-descent iteration.
At , the linear-system residual is . Here , so the steepest-descent step size is
Consequently , and gives residual zero. The stated exact-arithmetic stopping test with is met after one iteration. Stop there rather than trying to evaluate the next, undefined step. This is the special case where the initial residual is an eigenvector.
The line passes through and has the same direction as in part (i). Translate by , reflect by , then translate back. In homogeneous coordinates the affine reflection is
Act on column , reading the product from right to left. Every point with is fixed. The translation column is , as for any reflection in an affine hyperplane.
A unit vector along the line is . Reflection fixes its component parallel to and negates its perpendicular component, so the reflection matrix is
Indeed , and . These characterize the orthogonal reflection in that line.
The first column has norm two, giving . Its inner products with the second and third columns are both one. Subtracting from the second column leaves , of norm three, so . The inner product of with the third column is one. Subtracting from that column leaves , of norm two. Thus the Gram-Schmidt process gives
The columns of have unit norm and pairwise zero inner products, so . Direct multiplication verifies .
For independent columns in a real inner product space, the Gram-Schmidt process recursively forms
Each subtracts the orthogonal projections onto earlier normalized vectors. Their independence ensures . The resulting are orthonormal and preserve the span of every initial column set. Putting and for , with zeros below the diagonal, gives a QR decomposition with . Dependent input columns require omitting a zero residual or treating rank deficiency separately.
A linear map is one-to-one, or injective, when equal outputs imply equal inputs. Equivalently its kernel is : subtracting inputs converts equality of outputs to a zero output. Here is not one-to-one, since its kernel has dimension two. Concretely, for distinct inputs.
A linear map is onto, or surjective, when every equals for some ; equivalently its image is all of . Here is not onto, because its image has dimension two while its declared codomain has dimension three. Indeed every image vector satisfies , so, for example, is not attained.
Gaussian elimination gives
The first two original columns form an image basis:
Their independence follows already from their third and first coordinates. The third column is twice the first plus the second, and the fourth is the first plus twice the second, so they span every output of .
If is an invertible upper triangular matrix, is invertible and lower triangular. Part (ii) makes lower triangular, while part (i) identifies it with . Transposing gives that is upper triangular. This deduction uses both the inverse-transpose identity and the lower-triangular result.
Let column of be , so . Every diagonal entry of the invertible lower triangular matrix is nonzero, since its determinant is the product of those entries. In row one through row , the right-hand side is zero. Forward substitution first gives , then , and successively for all . These are precisely the entries above the diagonal in column of . Every column satisfies this, proving that is lower triangular. This is triangularity of an inverse matrix.
True. Existence follows because the basis spans . If , subtract to get . The basis vectors' linear independence forces every , proving uniqueness. For an infinite basis, both representations have finite support, so the same argument applies to their finite union. These coefficients are the coordinates relative to a basis.
Each elementary matrix is obtained by applying one invertible elementary row operation to the identity matrix. Its inverse is the elementary matrix for the reverse operation. A product of elementary matrices is therefore invertible and has full rank .
Conversely, if , Gaussian elimination has a pivot in every column and reduces to the identity. Writing the successive row operations as left multiplication gives . Hence , a product of elementary matrices. This proves both directions of the elementary-matrix factorization theorem.
The reduced equations are and . Thus the null space is the line
The nonzero spanning vector gives a one-element basis, so the nullity is one.
The pivot columns of the reduced matrix in part (i) are columns one and two. Select those columns of the original matrix, giving the column-space basis
They are independent, for example their first two entries have determinant . The remaining original column is the first plus twice the second. Taking the reduced matrix's columns instead would generally give the wrong column space.

Pinned article: Introduction to the OurBigBook Project

Welcome to the OurBigBook Project! Our goal is to create the perfect publishing platform for STEM subjects, and get university-level students to write the best free STEM tutorials ever.
Everyone is welcome to create an account and play with the site: ourbigbook.com/go/register. We belive that students themselves can write amazing tutorials, but teachers are welcome too. You can write about anything you want, it doesn't have to be STEM or even educational. Silly test content is very welcome and you won't be penalized in any way. Just keep it legal!
We have two killer features:
  1. topics: topics group articles by different users with the same title, e.g. here is the topic for the "Fundamental Theorem of Calculus" ourbigbook.com/go/topic/fundamental-theorem-of-calculus
    Articles of different users are sorted by upvote within each article page. This feature is a bit like:
    • a Wikipedia where each user can have their own version of each article
    • a Q&A website like Stack Overflow, where multiple people can give their views on a given topic, and the best ones are sorted by upvote. Except you don't need to wait for someone to ask first, and any topic goes, no matter how narrow or broad
    This feature makes it possible for readers to find better explanations of any topic created by other writers. And it allows writers to create an explanation in a place that readers might actually find it.
    Figure 1.
    Screenshot of the "Derivative" topic page
    . View it live at: ourbigbook.com/go/topic/derivative
  2. local editing: you can store all your personal knowledge base content locally in a plaintext markup format that can be edited locally and published either:
    This way you can be sure that even if OurBigBook.com were to go down one day (which we have no plans to do as it is quite cheap to host!), your content will still be perfectly readable as a static site.
    Figure 5. . You can also edit articles on the Web editor without installing anything locally.
    Video 3.
    Edit locally and publish demo
    . Source. This shows editing OurBigBook Markup and publishing it using the Visual Studio Code extension.
  3. https://raw.githubusercontent.com/ourbigbook/ourbigbook-media/master/feature/x/hilbert-space-arrow.png
  4. Infinitely deep tables of contents:
    Figure 6.
    Dynamic article tree with infinitely deep table of contents
    .
    Descendant pages can also show up as toplevel e.g.: ourbigbook.com/cirosantilli/chordate-subclade
All our software is open source and hosted at: github.com/ourbigbook/ourbigbook
Further documentation can be found at: docs.ourbigbook.com
Feel free to reach our to us for any help or suggestions: docs.ourbigbook.com/#contact