For , the unit steepest descent direction is by the Cauchy-Schwarz inequality. The usual unnormalized direction is ; choosing its scale separately as a line-search step gives the same ray. It satisfies , so it is a descent direction. The first-order Taylor expansion then guarantees decrease for sufficiently small positive steps. The subsequent bounds use this unnormalized negative-gradient convention.
Articles by others on the same topic
There are currently no matching articles.