Solution

ID: past-exam-of-the-numerical-linear-algebra-course-of-the-university-of-oxford/2025/2/b/ii/solution

The orthogonal projection gives
The first summand has every column in the column space of , and the second has every column in its orthogonal complement. They therefore have zero Frobenius inner product. The Pythagorean identity, together with , gives the stronger exact formula
Consequently
with equality exactly when . Thus solving the linear least-squares problem for each column chooses the best coefficients in the prescribed column space.

New to topics? Read the docs here!