Solution

ID: past-exam-of-the-mathematics-course-of-the-university-of-cambridge/2020/ii/paper-4/30j/iii/solution

The stochastic gradients obey
The nonexpansiveness of metric projection and the subgradient inequality imply, after conditioning on ,
Summing telescopes. Since both and lie in the radius- set , their distance is at most . By the Jensen inequality and convexity of ,
Choose
The two terms are then equal, and

New to topics? Read the docs here!