Past exam of the approximation of functions course of the University of Oxford 2011 3 Solution 2026-10-31
The equioscillation theorem says that is the unique best uniform approximation to a real continuous function on exactly when its error attains alternating values at ordered distinct points. If , the error vanishes everywhere and the conclusion is immediate.
For the exponential function, write the candidate line as . Its error is strictly convex. Equal endpoint errors require , and the interior minimum is at , because . Equating the endpoint error to the negative interior error givesIndeed and ; convexity puts every other error value between these extremes. The equioscillation theorem proves optimality.
For the reference-point assertions, put . The alternating-reference error bound gives . In fact this inequality is strict here. To see the equality obstruction explicitly, let be optimal, , andSince has polynomial degree at most , its order- divided difference vanishes: . If , change the overall sign to take . The error bound for implies . The signs of the weights are , so every term in this sum has the same weak sign. Every term must vanish; then has distinct zeros, forcing . This contradicts . If , and the same zero-count argument again forces , also a contradiction. ThusAt every old reference point the absolute error is only , so a maximizer cannot be one of those points. The printed same-sign choice of additionally presumes ; when , none of the reference errors has the nonzero sign of the maximal error.
The printed replacement rule needs an endpoint qualification. For an interior and nonzero , replacing the adjacent endpoint of its containing reference interval with the same error sign preserves spatial order and alternating signs. The single-point exchange in polynomial minimax approximation then gives the requested strict increase. On an irregular grid, the globally nearest same-sign reference point need not be that adjacent endpoint, so adjacency must be specified. More generally, for any correctly ordered replacement set on which the old error alternates in sign, let . The vanished divided difference of and the new alternation equations showThis is a strict weighted average because all the weights are positive in absolute value and .
For an exterior whose error sign is opposite that at the nearest endpoint, merely replacing the nearest same-sign point, as printed, need not preserve alternation. A concrete counterexample uses , , , and reference pointsLet be the piecewise linear function through . Then at , and : the upper bound is achieved by the trial constant , while equality at the lower bound is excluded by the preceding zero-count argument. The printed rule selects and hence . Neverthelesssatisfy every printed new alternation equation, with . Direct substitution at the four points checks this failure; reordering those points would destroy their assigned alternating signs.
The corrected exterior rule inserts as the new extreme reference point and drops the farthest endpoint when its sign is opposite the nearest endpoint. If its sign agrees with the nearest endpoint, replace that endpoint. Interior exchanges replace the adjacent reference point with the same sign. These rules preserve an ordered alternating set, so the strict-increase formula applies in every case.
The resulting Remez algorithm solves the linear alternation equations for the polynomial coefficients and reference height, locates a global maximum of the error, and performs a valid exchange unless . The interval is an explicit optimality certificate; a small gap gives a stopping test. Strict increase of bounded reference heights alone does not prove convergence, so that stronger conclusion needs the additional analysis of the chosen exchange algorithm.
Minimax linear approximation to the exponential and a counterexample to the unqualified exterior exchange rule
. Details. The equioscillation theorem says that a best degree-at-most- polynomial approximation to a continuous real function on has ordered extreme-error points with alternating signs and equal absolute error. Conversely such alternation proves optimality. If the error is zero, the target is already a polynomial of the required degree.
For the single-point exchange in polynomial minimax approximation, start with ordered reference points and solve the linear systemfor the polynomial coefficients and . Locate a point of largest absolute error on the interval. If its magnitude is no larger than within the desired tolerance, alternation certifies the approximation.
Otherwise insert that point and delete one old reference point so that the ordered signs still alternate. If the new point lies between two reference points, delete the neighboring point with the same error sign. If it lies outside the reference range, either replace the adjacent same-sign endpoint or, for opposite sign, insert it and drop the far endpoint. Solve again and repeat. This is the one-point Remez algorithm; a global extreme-error search is required for its stopping certificate, rather than merely checking the old reference points.
Here the exchange point lies between adjacent reference points and has the same, positive error sign as the point it replaces. Hence the new set remains spatially ordered, and the old error at its points alternates in sign. Its magnitudes are everywhere except at , where .
Set . Apply the order- divided difference to and ; both vanish because their degrees are at most . In the new alternation equations, all products have the same sign. Thus the single-point exchange in polynomial minimax approximation givesThe Remez algorithm repeatedly solves for the reference polynomial and common signed height, locates a larger error extreme, and performs an order-preserving exchange. The reference height bounds the optimum from below and the global error maximum bounds it from above. Their gap provides an optimality stopping certificate. A general implementation also needs the endpoint exchange rule when the new extreme lies outside the reference set.
