Write and retain the Landweber relaxation parameter . The printed allows the fixed choice , since then . It does not justify a unit step: the scalar linear operator has norm below , but unit-step error is multiplied by and diverges. We use throughout.
From the recurrence and , induction yields the closed form
For the compact operator in part ii, take a singular system of a compact operator with , and . Thus are the eigenvalues of ; this fixes the notation implicit in the printed hint. In the singular component , the recurrence is
Summing the geometric series gives the Landweber spectral filter
There is no contribution from data in or from in the reconstruction. Starting at zero is what selects the minimum-norm least-squares solution.
For fixed , , so the numerator tends to . The assumption is the Picard criterion
with an arbitrary additional component in . The squared reconstruction error is
Each term tends to zero and is bounded by a summable term from the Picard criterion. The dominated convergence theorem therefore proves , where is the Moore–Penrose inverse of an operator.
For each finite , the regularization of an inverse problem is stable. Set . The geometric series and imply
Consequently the Landweber noise amplification bound in this general step-size convention is . If additionally , the sharper numerator bound gives .
To see the regularization parameter directly, put . Modes with have numerator approximately , so their inverse coefficient is approximately rather than . Each fixed nonzero mode is eventually restored as . Thus
The finite iterates suppress unstable small singular values; infinitely many iterations remove this suppression. For noisy data , the noise-bias decomposition for linear regularization gives
Choosing and proves noisy-data convergence. The reciprocal iteration index is a regularization parameter, and early stopping controls noise amplification.
Add and subtract the exact-data iterate. The noise-bias decomposition for linear regularization gives
so the supplied Landweber noise amplification bound yields
With unit step and zero initial iterate, the exact-data error is . Its squared norm is
by the dominated convergence theorem. Stopping with but therefore makes both errors vanish.