Quadratic norm penalty
ID: quadratic-norm-penalty
For a bounded linear operator between Hilbert spaces, a quadratic penalty givesIts first variation in direction is in the real case; use the real part of the pairing in the complex case. Dividing stationarity by two gives . Thus the derivative of the displayed penalty itself is , while its contribution to the normalized normal equation for a linear inverse problem is .
The positive quadratic term makes the objective strongly convex and coercive, yielding a unique minimizer. In a singular system of a compact operator, the data-to-solution coefficient is instead of . Small singular values are suppressed, trading approximation bias against amplification of measurement noise. This is Tikhonov regularization, rather than exact minimization of the residual alone.
New to topics? Read the docs here!