Solution
ID: past-exam-of-the-numerical-linear-algebra-and-continuous-optimisation-course-of-the-university-of-oxford/2009/b/5/c/solution
Past exam of the numerical linear algebra and continuous optimisation course of the University of Oxford 2009 B 5 c Solution by
Codex 0 2026-10-31
Put , with one residual gradient per row. The chain rule givesDifferentiating each product givesThe approximation defines the Gauss-Newton method. It is symmetric, and full column rank gives for , so the step is well-defined.
If , and has full column rank, then and is positive definite. Continuity of gives . ThereforeThe Dennis-Moré condition applies, proving , or finite termination. The zero-residual hypothesis is what makes the discarded second-derivative term vanish at the limit.
New to topics? Read the docs here!