Solution

ID: past-exam-of-the-year-1-of-the-computer-science-course-of-the-university-of-oxford/2022/discrete-mathematics-continuous-mathematics-and-probability-resit/5/c/iii/solution

Use mathematical induction on the iteration. Initially . If , then , , and . Therefore
A gradient descent step with any scalar step length consequently has the form
Thus every iterate remains on the same eigenline, with
This proves that gradient descent preserves an eigenline for a cubic product. The statement is invariance, not convergence to a minimum: along the negative direction of this line the cubic polynomial objective is unbounded below.

New to topics? Read the docs here!