Past exam of the continuous optimisation course of the University of Oxford 2011 1 iv Solution 2026-10-31
Convert to minimization with and retain . A continuously differentiable inequality augmented Lagrangian method uses the merit functionFor its contribution is ; otherwise it is the constant . This shifted truncation permits multipliers to decrease as well as increase while remaining nonnegative.
Quadratic penalty method 2026-10-31
For constraints , , minimize the displayed merit function for progressively smaller , where . Increasing the quadratic penalty discourages constraint violation. In a violated inequality, differentiation gives the multiplier estimate ; an inactive inequality has estimate zero. Thus obtaining small violations by this method alone typically requires a very small , which may cause a large condition number in the inner minimization.