Cubic convergence of Newton optimization for an even quartic

ID: cubic-convergence-of-newton-optimization-for-an-even-quartic

For the strictly convex polynomial , applying Newton root-finding iteration to gives
The unique minimum is at zero. For any sufficiently small nonzero initial point, the errors satisfy , so the order is cubic, not merely quadratic. This provides a simple counterexample to treating the usual quadratic convergence theorem as an upper bound on possible orders. In general, the quadratic coefficient for Newton optimization near a nondegenerate stationary point is ; when it vanishes, a higher order is possible.

New to topics? Read the docs here!