Solution

ID: past-exam-of-the-mathematics-course-of-the-university-of-cambridge/2018/iii/paper-326/1/1/b/solution

The map is a bounded linear operator, so the inverse image of the closed singleton is closed. That inverse image is also a convex set: if , every convex combination has the same image.
The identity gives
Consequently such a exists exactly when is the sum of an element of and one of its orthogonal complement. Thus
These are precisely the least-squares solutions. Indeed, if and , then for every the Pythagorean identity gives
Conversely, differentiating the squared residual along any real direction forces , hence the normal equation for a linear inverse problem. For any , the difference of two solutions of the normal equation for a linear inverse problem lies in , since . Therefore
a closed affine subspace; the empty case is closed and convex as well.

New to topics? Read the docs here!