Let for the limit . Quadratic convergence means that eventually for a fixed constant ; exact asymptotic order two has with .
For this iteration and , direct algebra givesUsing the stipulated convergence , the ratio of successive squared errors isThus the convergence is quadratic. The iteration is well defined here: , and thereafter implies . The initial point is not already the limit, so the error ratio is meaningful.
Assume and are continuously differentiable near the point. At a regular feasible point, meaning and , a differentiable constrained local extremum satisfies the Lagrange multiplier equationsThey arise by differentiating the optimization Lagrangian with respect to all coordinates and the multiplier. Geometrically, the objective has zero derivative along the tangent space of the constraint surface, so its gradient must lie in the normal direction.
Solve these equations for candidates, examine feasible points where the regularity condition fails separately, and compare objective values or use a second-order test restricted to feasible directions. The equations locate stationary points; they do not by themselves establish which are minima or whether a global minimum is attained.
Use and . Every feasible point has , so cannot vanish. The Lagrange multiplier equations areThe first gives . If , the second would give , a contradiction. Therefore , and the constraint gives . The only constrained stationary points are .
For a global certificate, feasibility implies , and henceEquality requires and . ThusThe case split is essential: dividing by would discard precisely the minimizers.
Here the constraint surface is compact and regular, so a global minimum exists and satisfies the Lagrange multiplier equationsKeep the zero-coordinate cases. If , the two points are , with value . If , the two points are , with value . If both coordinates are nonzero, the equations give . The constraint becomes , whose only positive solution is . These are the four points , all with value .
These cases exhaust the stated eight constrained stationary points. Comparing their values givesFor additional classification, substituting gives , withIt decreases from to and increases from to . Thus the two -axis points are constrained local maxima, the two -axis points are global maxima, and the four mixed-coordinate points are global minima.
Both terms and are nonnegative, and they vanish simultaneously only at . That point satisfies . Consequentlyand the global minimum is unique. No Lagrange multiplier calculation is needed: nonnegativity gives a lower bound attained at a feasible point.
Articles by others on the same topic
There are currently no matching articles.