Solution (source code)

= Solution

By optimality and part a,
$$
\lambda\|\widehat\theta(Z')\|_1
\leq L_{Z'}(\widehat\theta(Z'))
\leq L_{Z'}(0)
\leq h\rho(M_y).
$$
Since the <Euclidean norm> is at most the $L^1$ norm,
$$
\|\widehat\theta(Z')\|_2\leq\frac{h\rho(M_y)}\lambda
$$
uniformly over all replacements of at most $n-h$ observations. The distance from the original finite estimate is therefore uniformly bounded, proving
$$
\epsilon^*(Z,\widehat\theta)\geq\frac{n-h}{n}.
$$