Put with the paper's normalized Hellinger distance. The Hellinger affinity is
The last bound follows from the Cauchy-Schwarz inequality and the unit integrals of the two probability density functions. Using a common dominating probability measure, for example , makes the product calculation immediate. The probability density functions of the product measures factor, and Tonelli's theorem gives
The Squared Hellinger distance is independent of the choice of common dominating measure, so this calculation applies to the original distributions. We obtain the exact identity and then apply Bernoulli's inequality:
For completeness, the scalar bound follows by induction: , and multiplying by the nonnegative gives .
Use two translated uniform distributions, with parameters and . Their distance in the usual metric is , so take the separation radius and the loss function . The supplied testing reduction, equivalently the Le Cam two-point lemma, and part (a)(i) imply
To see the reduction directly, turn any estimator into a binary hypothesis test by choosing the closer of and . If the test is wrong, the absolute estimation error is at least . The worst quadratic risk is at least its average over these two parameters, giving precisely this bound.
Under Lebesgue measure on , the two sample probability density functions are the indicators of the cubes and . Their intersection is , of volume . Therefore
where the inequality is Bernoulli's inequality. Consequently
This also fits the Hellinger distance approach: the two one-sample affinities give , while equal-height indicator densities imply . Part (a)(ii) thus yields the same bound . The change of support produces Squared Hellinger distance proportional to , explaining the parameter scale and quadratic risk scale .
With exact data , the iteration error obeys
The source condition for quadratic regularization excludes any null space component. Using its singular system of a compact operator coefficients,
By Bernoulli's inequality, . Also . Therefore
Summing the squared coefficients and using Bessel inequality yields
This is an a priori error rate from the source condition for quadratic regularization, with constant independent of .
It is sufficient that
and that the stopping rule obey
For example, works.
For exact data , each factor tends to zero. The Picard criterion makes square summable, while is uniformly bounded. The dominated convergence theorem on the resulting series yields .
For noisy data with , the filter representation gives
Indeed, when , Bernoulli's inequality gives ; when , the quotient is uniformly bounded because . Hence the triangle inequality gives
which proves that early-stopped Landweber iteration is a convergent regularization of an inverse problem.
Replace the same last vectors by . Applying part a to each independent Gaussian coordinate shows that the probability its contaminated coordinate median exceeds is at least . Independence across coordinates and Bernoulli's inequality give
For sufficiently large as a function of and , the last expression is at least . On this event,
which proves the stated lower bound for the supremum over adversarial perturbations.
Put , so . By Bernoulli's inequality, , and hence
More explicitly, for choose an integer . For , the right-hand side is less than . Thus the geometric sequence has limit of a sequence zero, either directly by the definition or by the squeeze theorem.
True. Since , there is such that for . Positivity then gives on this tail.
Fix . If , Bernoulli's inequality gives
For , this contradicts . Therefore eventually , proving