Past exam of the mathematics course of the University of Cambridge 2019 iii Paper 210 4 Solution 2026-10-03
Because white-noise observations are not themselves in , define the least-squares estimator as a minimizer of the Gaussian least-squares contrast, equivalently a maximizer over ofwhere is the isonormal Gaussian process on . The entropy assumption makes sample-continuous on compact , so a maximizer exists.
Put . Comparison with gives the basic inequalityForthe entropy assumption and the Dudley entropy integral giveThe Borell-TIS inequality further gives
Set . This is the balanceOn the shell , the basic inequality would requireFor sufficiently large, the expectation bound is at most half this threshold for every . Borell concentration then bounds the shell probability bySumming the geometric sequence of shell bounds gives a quantity tending to zero, uniformly in . Therefore