Bisection method Created 2026-10-14 Updated 2026-10-20
The bisection method finds a zero of a function by repeatedly halving a root bracket. Let be a real-valued continuous function on the closed interval , with . First check for endpoint zeros of a function; otherwise require strictly opposite signs at the endpoints. Evaluate the midpoint and retain the half with strictly opposite endpoint signs, stopping immediately if the midpoint is a zero of a function. The intermediate value theorem ensures that every retained root bracket still contains a zero of a function. This is the construction in MIT's root-finding notes.[ref]
For a worked square root calculation, use the polynomial on . Write for the root bracket after halvings, with . The candidate evaluated during update is the old midpoint :
The initial midpoint is . After four halvings the new midpoint is , and the bisection error bound is . Its actual error is approximately . The last tested candidate and the reported midpoint are different points.
Figure 1.
Bisection of a square-root bracket: the graph and first four retained intervals
. Details.
The useful feature of the bisection method is that the retained width halves on every update, independently of the shape of the function graph. The bisection error bound therefore supplies an accuracy guarantee before the zero of a function is known. No derivative is needed, and a valid initial root bracket gives convergence without a close initial guess. This makes the bisection method a dependable fallback for the faster Newton root-finding iteration.
Intersecting a parametric curve with a plane reduces to isolating zeros of a scalar function. A certified range for rejects intervals that do not contain zero. On an interval whose derivative range excludes zero, a sign-changing endpoint bracket gives exactly one root, which bisection method or a safeguarded Newton root-finding iteration refines. Other intervals are subdivided conservatively; tangencies and coplanar pieces need multiplicity or identity tests supported by the representation. An unresolved small interval is a possible contact, not a proof of an intersection. With finitely many transverse intersections and convergent enclosures, isolation terminates to any prescribed tolerance.
At a regular differentiable interior nearest point of a parametric curve, the displacement from the query point is perpendicular to the tangent vector. A branch and bound search uses distances to certified enclosing bounding volumes as lower bounds, and evaluated limit points as upper bounds. Refine the most promising restricted pieces until the upper bound differs from the global lower bound by the chosen distance tolerance. Safeguarded Newton root-finding iteration accelerates local candidates, but endpoints, nonregular points, ties and other stationary branches must not be omitted.
Suppose , , and . Starting at , the Newton root-finding iteration remains below and increases strictly to it. To prove this, assume . Strict increase of gives , so the Newton step is positive. Taylor's theorem between and gives, with ,
Its coefficient is negative and at least , proving both the stated error bound and . Mathematical induction establishes the invariant. The increasing bounded iterates have a limit ; continuity in forces , hence . The error bound supplies local quadratic convergence.
For the strictly convex polynomial , applying Newton root-finding iteration to gives
The unique minimum is at zero. For any sufficiently small nonzero initial point, the errors satisfy , so the order is cubic, not merely quadratic. This provides a simple counterexample to treating the usual quadratic convergence theorem as an upper bound on possible orders. In general, the quadratic coefficient for Newton optimization near a nondegenerate stationary point is ; when it vanishes, a higher order is possible.
Exact Newton error identity for a quadratic Created 2026-10-18 Updated 2026-10-25
For the quadratic polynomial with , consider the Newton root-finding iteration towards the polynomial root . If , its signed error satisfies
Indeed the iteration for is , and subtracting yields . This exact identity explains quadratic convergence near the simple polynomial root. If an initial error is asymptotic to and as , one step changes its leading power to and its coefficient to .
An approximation to a Jacobian matrix obtained using finite differences instead of analytic partial derivatives. For a vector-valued function , the forward-difference entry is , where is a coordinate basis vector. The step balances truncation and rounding errors; the resulting matrix can be used in a Newton root-finding iteration.
Local quadratic convergence of Newton iteration Created 2026-10-14 Updated 2026-10-18
Let be twice continuously differentiable on an interval around a zero of a function , with and there. Choose a closed interval inside that interval with . Starting inside it makes the Newton root-finding iteration well defined, keeps it inside, and gives the displayed quadratic convergence bound for . The nonzero derivative and sufficiently close start are essential hypotheses. The scalar estimate follows from the Taylor remainder argument in MIT's root-finding notes.[ref]
For a short proof outline, apply Taylor's theorem between and ; subtract the defining tangent line equation. The linear error cancels, leaving . The displayed bound shrinks the error and preserves the chosen interval. If , the error ratio tends to ; if it vanishes, convergence can be faster.
Logarithmic gradient of an exponential squared-distance sum Created 2026-10-25 Updated 2026-10-31
For fixed vectors in a finite-dimensional Euclidean space, define
The gradient and Hessian matrix of are
To derive the first identity, differentiate each exponential function and divide the sum of its gradients by . For the second, differentiating a normalized weight gives . Thus , where the weighted covariance matrix is the sum in the displayed Hessian matrix. Differentiating completes the calculation.
The weighted covariance matrix is positive semidefinite, so . Also as . Therefore and share a unique global minimizer, characterized by . The weights place that minimizer in the convex hull of the centres.
For stable numerical evaluation, subtract the largest exponent before computing the normalized weights. This is the log-sum-exp principle and avoids floating-point overflow without changing the gradient. A naive iteration need not converge: in one dimension, centres give with derivative at its unique fixed point. A Newton root-finding iteration or a suitable quasi-Newton method instead uses the positive curvature of .
Let have and . Its unique root lies in . Starting Newton root-finding iteration at , strict convexity puts the tangent root strictly between and the current iterate, so the iterates decrease to . Taylor expansion about the current iterate gives , where and . Continuity proves the displayed positive asymptotic constant and quadratic convergence.
The finite-dimensional Newton root-finding iteration for a vector equation . At a point with invertible Jacobian matrix, solve the displayed linear system. For , its Jacobian matrix is the Hessian matrix, giving Newton's method in optimization. The update solves the affine first-order approximation ; it can converge to any nondegenerate critical point, including a saddle point.
If a sufficiently smooth function has the form with and , then the Newton root-finding iteration satisfies
Thus the ratio of successive nonzero errors tends to : the usual iteration has only linear convergence. Cancelling the common factor in produces a continuous extension at the multiple root, although the original quotient is undefined there. An implementation should stop upon finding an exact zero of a function.
The Newton root-finding iteration seeks a zero of a function by repeatedly solving its tangent line approximation. At a current guess with derivative , set
Geometrically, follow the tangent line to the horizontal axis, then return to the function graph for the next tangent line. Close to a suitable zero of a function, the error becomes dramatically smaller.[ref]
For a concrete square root calculation, take the polynomial and start at . The Newton root-finding iteration becomes , giving
The errors use the unrounded iterates. After the first step, each iterate overestimates , and the exact identity
exhibits quadratic convergence: once close, the number of correct decimal digits roughly doubles per step. This speed makes the Newton root-finding iteration useful when accurate derivatives are available.
Figure 1.
Newton tangent steps toward a square root and a nonconvergent two-cycle
. Details.
Global convergence requires additional care. For the polynomial , starting at gives , , hence . Then , gives . The sequence repeats forever, although a real polynomial root lies in by the intermediate value theorem. Neither point in the cycle is a zero of a function, and neither has zero derivative. A maintained sign-changing interval and fallback bisection method can protect a root solver from unsuitable Newton steps.
The intermediate value theorem gives a root , unique because makes strictly increasing. We show that Newton root-finding iteration, started at , always stays to the right of . If , the mean value theorem gives for some . Since , is strictly increasing, so . It follows that
Induction gives , so the bounded monotone sequence theorem supplies a limit . The continuous positive is bounded away from zero on , making continuous. Passing to the limit in gives and hence . Uniqueness implies .
For the rate, apply the Taylor theorem with Lagrange remainder to between and :
With , rearrangement gives
Thus the monotone Newton convergence for a strictly convex function has quadratic convergence. More concretely, if , then . Once , induction gives , exhibiting the repeated squaring of small errors.
An efficient parametric curve interrogation interface should provide the parameter domain and open/closed status, point evaluation, one-sided endpoint enquiries, first and second derivatives wherever defined, and information about knots or singular parameters. It should also restrict a curve to an interval and subdivide it without changing its limit, return a certified bounding volume for that restriction, and supply derivative or chord error bounds when supported. These enquiries allow cheap geometric rejection before expensive exact evaluation. For a subdivision curve, limit evaluation is distinct from returning a vertex of a finite refined control polygon; the latter is usually an approximation.
For a query point , minimize . At a differentiable interior minimizer,
At a regular curve point this says that the query displacement is perpendicular to the tangent vector. If a second derivative exists, the local second-order test is
a strictly positive value is sufficient for a strict local minimum. The stationarity equation alone also includes local maxima and is automatic at , so it cannot be used as the only global search criterion.
A reliable efficient closest-point search on a subdivision curve uses branch and bound. Cover the compact curve by restricted pieces with certified enclosures . For each piece set , a lower bound on its true distance. Distances to actually evaluated limit points give upper bounds; keep the best point and distance . For an axis-aligned bounding box , the squared lower bound is inexpensive:
For positive partition-of-unity refinement, a convex hull of the active control points is an enclosure. A negative-weight scheme requires a separate certified enclosure; its control hull need not contain the limit.
The algorithm is:
  • Initialize the pieces at representation breaks and evaluate endpoints and one or more interior limit points. Place pieces in a priority queue ordered by their .
  • Discard any piece with , since it cannot improve the best known point. If only one nearest point is required, equality may also be discarded; keep equality candidates when all ties matter.
  • Remove the smallest-bound piece. Evaluate new limit points to reduce , subdivide the piece, compute tighter child enclosures, and insert children that can still improve .
  • Use the best chord projection or current candidate to seed a safeguarded Newton root-finding iteration for . Its derivative is . Keep iterates inside the restricted interval, fall back to bisection method on an isolated sign-changing bracket, and accept an improvement only after evaluating its actual curve distance. This is an accelerator; rejection still depends on certified geometric bounds.
  • Terminate when , also regarding the best evaluated point as a retained candidate. If no pieces remain, the evaluated candidate is already optimal relative to the exhausted bounds. Return and with the global distance guarantee.
Because , the reported point is at most farther from than a true nearest point. Include endpoints, nondifferentiable joins, and singular parameters in the candidate bookkeeping, or split them into separate pieces. With enclosures converging in diameter under subdivision on a compact continuous curve, the bounds converge to arbitrary prescribed positive distance tolerance. Interval bounds or outward-rounded arithmetic are needed if the guarantee is intended to be certified in floating-point computation. A single Newton root-finding iteration from a single seed supplies no such global guarantee.
An efficient subdivision surface interrogation interface needs the mesh topology and patch adjacency, boundary and trimming information, patch-local parameter charts and their transition maps, and local restriction/refinement with the complete influencing control net. Numerical enquiries should supply limit positions , first derivatives , and second derivatives where defined; these determine normal vectors and curvatures at regular points. It must also return certified patch bounding volumes and convergent geometric/derivative error bounds. Near an extraordinary subdivision vertex, use the local subdivision matrix and limit/tangent evaluation appropriate to that scheme; second derivatives need not exist merely because a tangent plane does. Finite refined mesh vertices are not exact limit positions.
Represent the cutting plane as , with normalized. On each chart set
The desired plane section of a subdivision surface is the image of the zero set . For a bounding volume , compute a certified interval for the plane functional over . If that interval is strictly positive or strictly negative, reject the patch. With positive partition-of-unity weights, the minimum and maximum of over all influencing control points already bound its limit patch. For masks without this convex hull property, the interface must provide a different valid enclosure.
An adaptive algorithm that isolates components before tracing is:
  • Build or reuse a bounding volume hierarchy over limit patches. Traverse only patches whose plane-functional interval contains zero; entirely rejected subtrees need no limit evaluation.
  • Recursively restrict every retained patch. At regular spline patches, use their exact polynomial/rational basis to refine range and derivative bounds. Split at representation breaks, boundaries and extraordinary neighborhoods rather than differentiating across them blindly.
  • In a sufficiently small transverse patch, certify that at least one of stays away from zero. Then the zero set is locally a graph by the implicit function theorem, with no interior closed component in that chart. Isolate all zeros on its patch edges, using certified scalar ranges, derivative bounds and safeguarded Newton root-finding iteration. Pair edge intersections according to the monotone graph structure, subdividing further if the connectivity is not certified. A certified transverse graph with no boundary zero can be rejected.
  • For every isolated branch, trace a predictor-corrector continuation method. The parameter tangent vector is . Normalize by when physical arc length steps are desired, predict , then correct with the two scalar equations and . The Newton correction solves the explicit system with rows and . Reduce the step if this system is ill-conditioned or the correction leaves its chart.
  • Transfer branches consistently across patch edges and assemble the resulting segments into connected curves, including boundary endpoints and closed loops. Edge intersection records must be shared between neighboring patches to avoid cracks or duplicate branches.
  • Keep unresolved patches containing possible tangent contacts, singular vertices, or coplanar pieces for a separate degeneracy treatment. Do not discard them solely because no sampled edge changes sign. Refine, use local polynomial/interval tests if available, or return an explicitly flagged unresolved contact region at the selected tolerance.
This is exhaustive to a chosen tolerance when certified subdivision isolates finitely many regular transverse branches and enclosures converge. If locally and , a residual tolerance corresponds locally to a geometric correction bounded by , using the gradient flow toward the level set. Bounds on second derivatives similarly control curve-segment chord error bound. As approaches zero, a fixed residual tolerance no longer gives a fixed geometric error, so the step and stopping rules must reflect conditioning.
Seeding must not rely just on corner signs. For example cut by has a closed circle wholly inside a patch whose corner values are all positive. Certified range tests plus subdivision retain it; a corner-only marching rule can miss it. Tangencies also change the nature of the output: meets in one isolated point, while a coplanar patch contributes an area rather than a curve. Thus a general plane section is not necessarily a union of regular curves; the algorithm should classify these cases instead of silently fabricating or deleting a branch.
For efficiency, cache subdivision stencils, patch extraction, limit-evaluation coefficients and bounds; reuse child data instead of reconstructing the entire refined mesh. Use local influencing neighborhoods, with the halo dictated by mask support, and keep adjacency/boundary topology separate from changing geometric coordinates. Plane-functional bounds can be computed by refining scalar signed-distance controls, which is cheaper than refining all three coordinates. Combine coarse inexpensive boxes with tighter local convex hull or interval arithmetic tests only where needed. Adapt steps to curvature and transversality, reuse branch seeds, and use regular spline evaluation away from extraordinary points. Stable edge ownership, outward-rounded bounds, scale-aware tolerances, and explicit degeneracy flags are correctness requirements as well as performance issues. The result is a limit-surface intersection computation; merely intersecting a finitely refined control polyhedron with the plane supplies only an uncontrolled approximation.
A parametric curve interrogation interface first supplies the parameter domain and the point . At regular parameters, it also supplies and, when needed, higher derivatives. The unit tangent vector, speed and curvature are then obtained from
in three dimensions. The formulas require ; a Frenet normal additionally requires nonzero curvature. A practical interface can restrict the curve to a parameter interval, provide endpoints, and give a certified bounding volume or a derivative-range bound. Arc length, closest-point and intersection queries are higher-level operations built from these elementary enquiries rather than consequences of point evaluation alone.
For a plane with , define
This reduces certified curve-plane intersection to scalar root isolation. A subdivision curve can expose the parametric enquiries by evaluating its limit at a parameter address: refine the corresponding piece until its certified positional enclosure reaches the requested accuracy, or use its exact local spline representation. Derivative evaluation similarly needs the derivative refinement rule and its error bound. A finite control vertex is not automatically a point of the limit curve.
One reliable algorithm is range-based isolation followed by safeguarded Newton iteration:
  • Split the domain at representation breaks. For each interval , enclose by projecting its certified curve bound onto . Reject if this interval excludes zero.
  • If the derivative enclosure excludes zero and the endpoint values have opposite signs, there is exactly one intersection in . Record any endpoint zero separately and avoid counting it twice.
  • Within such a bracket, propose using the Newton root-finding iteration. Accept only a well-conditioned step inside a suitably smaller portion of the bracket; otherwise use the bisection method. Update the sign bracket and stop when its parameter width and the curve's positional error meet the tolerances.
  • Subdivide every other undecided interval. Use representation-supported tests for tangent roots and coplanar pieces; do not reject an interval merely because its endpoint signs agree.
For a transverse root, the derivative is nonzero nearby, so sufficiently fine intervals have monotone and the sign bracket isolates it. Bisection provides a global error bound; near a simple root Newton iteration gives quadratic convergence. Good enclosures discard most of the curve before expensive limit evaluation, and the method does not require a specific subdivision mask.
The weaknesses are equally important. Near tangency is small and Newton steps are ill-conditioned; same-sign endpoints may conceal a tangent root or two crossings. An arc lying in the plane has infinitely many intersections and should be returned as an interval, not a point. Finite-precision evaluations require error enclosures before a sign is certified. For an arbitrary smooth point-evaluation oracle, no finite sampling scheme can certify all intersections: a smooth bump between sampled parameters can create extra crossings without changing any sampled values or derivatives. With finitely many isolated transverse intersections and convergent certified enclosures, the algorithm terminates to any prescribed tolerance. For tangencies it either uses stronger representation tests or reports unresolved possible-contact intervals, rather than silently omitting them.
A subdivision curve interrogation interface provides its control/topology data, a parameter interval or address, and a refinement operation returning restricted child pieces with their parameter correspondence. It also provides a certified enclosing bounding volume, endpoints or limit-point enclosures, and an error estimate for replacing a sufficiently small piece by its chord. Positional and derivative limit queries may be implemented by refinement or by conversion to the appropriate spline. Nonnegative masks often imply a control-point convex hull bound; a generic scheme with negative weights needs a separate bound.
These enquiries can be applied to a parametric curve by using interval restriction as the subdivision operation and constructing its enclosure from its representation. For example, a Bézier curve is split by De Casteljau's algorithm, and each child's control-point convex hull encloses exactly that child arc. More generally, if a restricted curve has a certified bound , the midpoint supplies
This ball gives a signed plane-range enclosure. Such an upper derivative bound must be supplied or proved; taking the largest derivative seen in a few samples is not a certificate.
The recursive intersection algorithm is as follows. Start with the whole domain. For each piece with enclosure , compute
If or , discard that piece. Otherwise split it and process the children, unless a root has already been uniquely isolated and can be polished as in Question 3. For a convex hull bound, the extrema of this affine plane function are attained among its control points, so only dot products are required. For an axis-aligned bounding box, choose the low or high coordinate in each term according to the sign of .
At a small flat piece, the chord-plane parameter is
when the denominator is nonzero. It supplies an initial estimate, which is corrected on the actual curve. A chord of a piece with geometric error gives plane-function error at most ; a transverse root additionally needs a positive derivative lower bound to convert that into a parameter error. A chord hit is not by itself a proof of the exact crossing count. Keep unresolved tangent contacts, merge shared-endpoint hits, and return any certified coplanar parameter intervals separately.
Good speed comes from a bounding volume hierarchy, conservative cheap rejection before accurate evaluation, caching shared subdivision work, local rather than uniform refinement, and fast root polishing only after isolation. Convex-hull or box extrema cost far less than solving every potential intersection. Tight bounds shrink rapidly with subdivision and reduce the active search to neighborhoods of actual crossings. Derivative information can prove monotonicity, accelerate with the Newton root-finding iteration, or tighten range bounds using interval arithmetic. There is no universal fixed speed guarantee when the curve is nearly coplanar or has arbitrarily many intersections: those are genuinely difficult inputs. The representation must provide meaningful bounds and restriction operations; point/derivative enquiries alone do not imply such capabilities.
The polynomial factors as , so is a multiple root of multiplicity two. The Newton root-finding iteration is
For , cancelling a factor gives
This expression extends continuously to . Let . On this closed interval,
Thus is increasing, and
By the mean value theorem, for all . The contraction mapping theorem states that a contraction mapping from a nonempty complete metric space into itself has a unique fixed point, and every fixed-point iteration converges to it. The closed interval with ordinary Euclidean distance is complete, and , so
In fact . The Newton iteration at a multiple root here has linear convergence, since . Thus the convergence assertion is true for the simplified fixed-point iteration, and for the usual Newton root-finding iteration that stops upon reaching an exact root of a polynomial. If one insists on applying the unsimplified quotient at every step, it is undefined for the allowed starting value , since both and vanish there; that literal version of an infinite sequence requires the stated stopping convention or continuous extension.
The Newton root-finding iteration follows the current tangent line to its horizontal-axis intersection. Since , it gives
A positive initial guess is appropriate for the positive square root; negative starting values instead target the negative root.