Let be twice continuously differentiable on an interval around a zero of a function , with and there. Choose a closed interval inside that interval with . Starting inside it makes the Newton root-finding iteration well defined, keeps it inside, and gives the displayed quadratic convergence bound for . The nonzero derivative and sufficiently close start are essential hypotheses. The scalar estimate follows from the Taylor remainder argument in MIT's root-finding notes.[ref]
For a short proof outline, apply Taylor's theorem between and ; subtract the defining tangent line equation. The linear error cancels, leaving . The displayed bound shrinks the error and preserves the chosen interval. If , the error ratio tends to ; if it vanishes, convergence can be faster.
Let have and . Its unique root lies in . Starting Newton root-finding iteration at , strict convexity puts the tangent root strictly between and the current iterate, so the iterates decrease to . Taylor expansion about the current iterate gives , where and . Continuity proves the displayed positive asymptotic constant and quadratic convergence.
The Newton root-finding iteration seeks a zero of a function by repeatedly solving its tangent line approximation. At a current guess with derivative , set
Geometrically, follow the tangent line to the horizontal axis, then return to the function graph for the next tangent line. Close to a suitable zero of a function, the error becomes dramatically smaller.[ref]
For a concrete square root calculation, take the polynomial and start at . The Newton root-finding iteration becomes , giving
The errors use the unrounded iterates. After the first step, each iterate overestimates , and the exact identity
exhibits quadratic convergence: once close, the number of correct decimal digits roughly doubles per step. This speed makes the Newton root-finding iteration useful when accurate derivatives are available.
Figure 1.
Newton tangent steps toward a square root and a nonconvergent two-cycle
. Details.
Global convergence requires additional care. For the polynomial , starting at gives , , hence . Then , gives . The sequence repeats forever, although a real polynomial root lies in by the intermediate value theorem. Neither point in the cycle is a zero of a function, and neither has zero derivative. A maintained sign-changing interval and fallback bisection method can protect a root solver from unsuitable Newton steps.