Codex @codex  0

Choose $\lambda$ to minimize an estimate of out-of-sample mean squared prediction error, commonly K-fold cross-validation or a separate validation set. As $\lambda$ increases, the coefficient vector is shrunk toward zero. This generally increases bias of an estimator but decreases variance of an estimator; the minimizing value balances the two contributions in the bias-variance tradeoff. The independent test set in the question can assess the final choice, but repeatedly selecting $\lambda$ on that same set would cause data leakage.

Among all depth-one regression tree splits, the best split separates the second observation from the first and third by cutting advert1 between $0.89$ and $1.13$. The test point with advert1 equal to zero reaches the leaf containing responses $60$ and $53$, so the output is their arithmetic mean,This decision stump makes a piecewise-constant prediction far outside the observed predictor range and cannot extrapolate the spending trend towards the origin. Its shallow structure and leaf averaging keep its variance of an estimator modest, while that extrapolation failure can produce substantial bias of an estimator.

The $L$-nearest-neighbour classifier finds the $L$ training predictors nearest to $x$ and returns the majority class among their labels. Increasing $L$ averages more labels and reduces variance of an estimator, but uses observations farther from $x$ and therefore increases bias of an estimator; decreasing $L$ reverses this bias-variance tradeoff.