Quadratic minimization with a moving upper bound
ID: quadratic-minimization-with-a-moving-upper-bound
Consider the minimization problemThe objective function is a strictly convex function with its unconstrained optimization minimum at . If , it decreases throughout the feasible set until the bound is reached. If , the feasible set already contains . HenceWith , the optimization Lagrangian and KKT conditions areSubstituting gives the unique inequality Lagrange multiplierFor , the active constraint has . For , there is strict slack and . At , the active constraint has zero Lagrange multiplier: the boundary happens to pass through the unconstrained optimum. Feasibility and complementary slackness must both be checked; solving only would allow infeasible candidates.
The same quadratic objective with active, just-touching and inactive upper bounds
. Details. An independent certificate follows by completing the square:The Lagrange dual function is a concave function of . Its maximum over occurs at and equals . Thus every case has an explicit lower bound attained by a feasible point; the KKT conditions provide a certificate that can be checked without searching all real numbers.
New to topics? Read the docs here!
