Solution

ID: past-exam-of-the-numerical-linear-algebra-and-continuous-optimisation-course-of-the-university-of-oxford/2010/b/5/iii/solution

Complete the square in the augmented Lagrangian method objective:
For fixed , the last term is constant in . Thus its minimization is the quadratic penalty method applied to the shifted constraint .
Its practical advantage is that multiplier updates, typically , can drive the original constraint residual to zero while stays moderately sized. The plain quadratic penalty method generally needs very small to produce the same feasibility accuracy, exposing the conditioning problem in part (ii).

New to topics? Read the docs here!