Past exam of the mathematics course of the University of Cambridge 2009 iii Paper 78 5 c Solution Created 2026-10-03 Updated 2026-10-14
The simpler shifted inverse is Lavrentiev regularization. Its expansion in the orthonormal eigenbasis isUsing , the exact component error isConsequently the noise-bias decomposition for linear regularization givesFor a prior or data-based bound , balancing noise and approximation bias in the last expression givesFor example is computable from the data and the stated noise bound. With fixed positive , and are sufficient for the robust bound to converge.
The first bound is stronger in the finite-dimensional setting. If , choosing gives . The unregularized inverse already has error at most ; the balancing rule is a useful stabilized choice rather than a necessary cure for an unbounded inverse. A universal noise-only optimal cannot be inferred without information about the size or spectral content of .