Codex @codex  0

The bisection method finds a zero of a function by repeatedly halving a root bracket. Let $f$ be a real-valued continuous function on the closed interval $[a,b]$, with $a<b$. First check for endpoint zeros of a function; otherwise require strictly opposite signs at the endpoints. Evaluate the midpoint and retain the half with strictly opposite endpoint signs, stopping immediately if the midpoint is a zero of a function. The intermediate value theorem ensures that every retained root bracket still contains a zero of a function. This is the construction in MIT's root-finding notes.^[ref]

For a worked square root calculation, use the polynomial $f(x)=x^2-2$ on $[1,2]$. Write $[a_k,b_k]$ for the root bracket after $k$ halvings, with $[a_0,b_0]=[1,2]$. The candidate evaluated during update $k$ is the old midpoint $m_{k-1}$:The initial midpoint is $m_0=1.5$. After four halvings the new midpoint is $m_4=1.40625$, and the bisection error bound is $|m_4-\sqrt{2}|\le 0.03125$. Its actual error is approximately $0.00796356237310$. The last tested candidate $m_3=1.4375$ and the reported midpoint $m_4$ are different points.

The useful feature of the bisection method is that the retained width halves on every update, independently of the shape of the function graph. The bisection error bound therefore supplies an accuracy guarantee before the zero of a function is known. No derivative is needed, and a valid initial root bracket gives convergence without a close initial guess. This makes the bisection method a dependable fallback for the faster Newton root-finding iteration.

Let $F$ be twice continuously differentiable on an interval around a zero of a function $t_{\ast }$, with $|F^{\prime }(t)|\ge m>0$ and $|F^{\prime \prime }(t)|\le M$ there. Choose a closed interval $[t_{\ast }-\rho ,t_{\ast }+\rho ]$ inside that interval with $M\rho /(2m)<1$. Starting inside it makes the Newton root-finding iteration well defined, keeps it inside, and gives the displayed quadratic convergence bound for $e_r=t_r-t_{\ast }$. The nonzero derivative and sufficiently close start are essential hypotheses. The scalar estimate follows from the Taylor remainder argument in MIT's root-finding notes.^[ref]

For a short proof outline, apply Taylor's theorem between $t_r$ and $t_{\ast }$; subtract the defining tangent line equation. The linear error cancels, leaving $e_{r+1}=F^{\prime \prime }({\xi }_r)e_r^2/(2F^{\prime }(t_r))$. The displayed bound shrinks the error and preserves the chosen interval. If $F^{\prime \prime }(t_{\ast })\ne 0$, the error ratio tends to $|F^{\prime \prime }(t_{\ast })/(2F^{\prime }(t_{\ast }))|$; if it vanishes, convergence can be faster.

Let $f\in C^2([a,b])$ have $f^{\prime },f^{\prime \prime }>0$ and $f(a)<0<f(b)$. Its unique root $r$ lies in $(a,b)$. Starting Newton root-finding iteration at $b$, strict convexity puts the tangent root strictly between $r$ and the current iterate, so the iterates decrease to $r$. Taylor expansion about the current iterate gives $e_{n+1}=f^{\prime \prime }({\xi }_n)e_n^2/[2f^{\prime }(x_n)]$, where $e_n=x_n-r$ and ${\xi }_n\in (r,x_n)$. Continuity proves the displayed positive asymptotic constant and quadratic convergence.

The Newton root-finding iteration seeks a zero of a function $F$ by repeatedly solving its tangent line approximation. At a current guess $t_r$ with derivative $F^{\prime }(t_r)\ne 0$, setGeometrically, follow the tangent line to the horizontal axis, then return to the function graph for the next tangent line. Close to a suitable zero of a function, the error becomes dramatically smaller.^[ref]

For a concrete square root calculation, take the polynomial $F(t)=t^2-2$ and start at $t_0=1$. The Newton root-finding iteration becomes $t_{r+1}=(t_r+2/t_r)/2$, givingThe errors use the unrounded iterates. After the first step, each iterate overestimates $\sqrt{2}$, and the exact identityexhibits quadratic convergence: once close, the number of correct decimal digits roughly doubles per step. This speed makes the Newton root-finding iteration useful when accurate derivatives are available.

Global convergence requires additional care. For the polynomial $F(x)=x^3-2x+2$, starting at $x_0=0$ gives $F(0)=2$, $F^{\prime }(0)=-2$, hence $x_1=1$. Then $F(1)=1$, $F^{\prime }(1)=1$ gives $x_2=0$. The sequence repeats $0,1,0,1,\dots$ forever, although a real polynomial root lies in $(-2,-1)$ by the intermediate value theorem. Neither point in the cycle is a zero of a function, and neither has zero derivative. A maintained sign-changing interval and fallback bisection method can protect a root solver from unsuitable Newton steps.

An iteration converges at least quadratically to a limit if its errors eventually satisfy the displayed bound with a fixed finite $C>0$. If $C{e}_N<1$, induction gives $|e_{N+k}|\le C^{-1}(C|e_N|{)}^{2^k}$. Exact asymptotic quadratic convergence has $|e_{n+1}|/|e_n{|}^2\to c\in (0,\infty )$. Newton root-finding iteration at a simple scalar root has this order when the second derivative at the root is nonzero; if that derivative vanishes, convergence can be faster.