Use weighted decision stump optimization with the convention , and write . For each coordinate , sort the examples by their th coordinate and group all equal coordinate values. For a threshold between the th and st distinct values, the decision stump predicts on the left and on the right. Its weighted misclassification risk isStart with a threshold below the minimum observed value. Every prediction is then , and the initial error is . Sweep the threshold from left to right. When it passes an entire group of equal coordinate values, that group's prediction changes from to , so updateRecord the smallest value and a threshold achieving it, including the final threshold above all observations, which predicts everywhere on the sample. Representatives can be chosen strictly between successive distinct values; the two outer representatives are finite real numbers below the minimum and above the maximum.
Every threshold has exactly the same sample predictions as one of these representatives. In particular, if a threshold equals an observed value, the equality group is on the side under the chosen sign function convention, which duplicates the representative immediately before that group. Thus the sweep includes every possible sample labelling by the stated decision stump. Repeating for all coordinates and returning the globally smallest error proves optimality.
Sorting costs per coordinate and the grouped sweep costs . The overall time complexity iswith working storage when coordinates are processed one at a time. Pre-sorted coordinate orders can be reused across repeated AdaBoost rounds, leaving work per round for changing weights. The paper allows only the orientation ; reversing its polarity would enlarge the hypothesis class and is unnecessary here.
Past exam of the mathematics course of the University of Cambridge 2025 iii Paper 218 1 f Solution Created 2026-09-24 Updated 2026-09-25
Among all depth-one regression tree splits, the best split separates the second observation from the first and third by cutting advert1 between and . The test point with advert1 equal to zero reaches the leaf containing responses and , so the output is their arithmetic mean,This decision stump makes a piecewise-constant prediction far outside the observed predictor range and cannot extrapolate the spending trend towards the origin. Its shallow structure and leaf averaging keep its variance of an estimator modest, while that extrapolation failure can produce substantial bias of an estimator.