The arithmetic-geometric mean inequality for the positive numbers and givesEquality holds precisely when , hence at . Thus , attained only at . Equivalently, the exact identity proves the same global bound.
For , its derivative is . Substitution into Newton's method givesEvery positive input gives another positive input, so a starting value keeps the denominator nonzero at every step.
The update in Newton's method is exactly . Positivity is preserved, and the arithmetic-geometric mean inequality from part (a) applies to every update. ConsequentlyThis holds even when : the first update moves to or above the positive square root.
Subtract the previous iterate in Newton's method:The denominator is positive and the numerator is negative. If , the difference is zero and all subsequent iterates equal the root.
After the first update, the sequence lies in and is nonincreasing. The monotone convergence theorem for sequences gives a limit . The update is continuous on this interval, so passing to the limit givesPositivity forces . If an iterate reaches the root exactly, the constant tail gives the same conclusion. The Exact Newton error identity for a quadratic here is , also showing quadratic convergence once the error is small.
The constraint implies , so and its gradient never vanishes on the feasible set. The Lagrange multiplier equations giveThus , , , and feasibility gives . The two stationary points and their values areThey are both global minima. Indeed, on the constraint, completing the square givesEquality holds only at the two displayed points. There are no other constrained stationary points, and the objective is unbounded above as .
Articles by others on the same topic
There are currently no matching articles.