Past exam of the mathematics course of the University of Cambridge / 2019 / ib / Paper 4 / 10F / Solution

For $u\in U$, define $\varphi (u)\in U^{\ast }$ by $\varphi (u)(u^{\prime })=⟨u,u^{\prime }⟩$. If $\varphi (u)=0$, then in particularso $u=0$. Thus $\varphi$ is injective. Since a finite-dimensional vector space and its dual space have the same dimension, $\varphi$ is also surjective and hence an isomorphism. This is the finite-dimensional real case of the Riesz representation theorem.

The adjoint operator of $\alpha :V\to W$ is the unique linear map ${\alpha }^{\ast }:W\to V$ satisfyingfor every $v\in V$ and $w\in W$. In the stated orthonormal bases, if $v$ and $w$ denote coordinate columns, thenTherefore the matrix of ${\alpha }^{\ast }$ is the matrix transpose $A^T$.

For $w\in W$,Hence $\ker {\alpha }^{\ast }=(\mathrm{im}\alpha {)}^{\perp }$. Taking orthogonal complements in the finite-dimensional space $W$ proves the image-kernel orthogonality for an adjoint

Put $r=\alpha (v_0)-w_0$. For any $h\in V$,This is minimized at $h=0$ exactly when $r\perp \mathrm{im}\alpha$, equivalently when ${\alpha }^{\ast }r=0$. Thus the normal equation for a linear inverse problem is

For the given linear least-squares problem,The normal equations $2x+y=3$ and $x+2y=5$ have the unique solution