Past exam of the numerical linear algebra course of the University of Oxford 2011 3 c Solution 2026-10-31
Nonzero vectors are conjugate directions with respect to when for . They are linearly independent: if , multiplication by gives , hence by positive definiteness. There are consequently at most such directions.
The finite termination of conjugate directions follows from the residual orthogonality maintained by the exact line minimizations. At step ,For , conjugacy gives . By mathematical induction, is orthogonal to every . After nonzero conjugate directions they form a basis of , forcing . Thus the method reaches in at most steps, and positive definiteness makes that solution unique. The claim is in exact arithmetic; rounding errors need not preserve exact conjugacy.