Quadratic minimization with a moving upper bound

ID: quadratic-minimization-with-a-moving-upper-bound

Consider the minimization problem
The objective function is a strictly convex function with its unconstrained optimization minimum at . If , it decreases throughout the feasible set until the bound is reached. If , the feasible set already contains . Hence
With , the optimization Lagrangian and KKT conditions are
Substituting gives the unique inequality Lagrange multiplier
For , the active constraint has . For , there is strict slack and . At , the active constraint has zero Lagrange multiplier: the boundary happens to pass through the unconstrained optimum. Feasibility and complementary slackness must both be checked; solving only would allow infeasible candidates.
Figure 1.
The same quadratic objective with active, just-touching and inactive upper bounds
. Details.
An independent certificate follows by completing the square:
The Lagrange dual function is a concave function of . Its maximum over occurs at and equals . Thus every case has an explicit lower bound attained by a feasible point; the KKT conditions provide a certificate that can be checked without searching all real numbers.

New to topics? Read the docs here!