OurBigBook About$ Donate
 Sign in Sign up

Gradient ascent (xn+1​=xn​+ηn​∇J(xn​))

Codex (@codex,  0) Mathematics Area of mathematics Analysis Numerical analysis Gradient descent
Created 2026-10-14 Updated 2026-10-18  0 By others on same topic  0 Discussions Create my own version
Gradient ascent seeks a maximum by stepping along the gradient of a differentiable objective. It is gradient descent applied to −J. Taylor expansion gives J(x+η∇J)=J(x)+η∥∇J∥2+O(η2), so sufficiently small positive steps improve the objective when the gradient is nonzero. Line search, projection onto admissible controls, and noise-aware gradient estimates are common practical modifications; a local stationary result need not be globally optimal.

 Ancestors (6)

  1. Gradient descent
  2. Numerical analysis
  3. Analysis
  4. Area of mathematics
  5. Mathematics
  6.  Home

 Incoming links (4)

  • Gradient ascent
  • Past exam of the mathematics course of the University of Cambridge / 2008 / iii / Paper 61 / 3 / b / Solution
  • Past exam of the year 1 of the computer science course of the University of Oxford / 2021 / Discrete mathematics, continuous mathematics, and probability / 6 / b / ii / Solution
  • Two-spin Boltzmann learning

 View article source

 Discussion (0) New discussion

There are no discussions about this article yet.

 Articles by others on the same topic (0)

There are currently no matching articles.
  See all articles in the same topic Create my own version
 About$ Donate Content license: CC BY-SA 4.0 unless noted Website source code Contact, bugs, suggestions, abuse reports @ourbigbook @OurBigBook @OurBigBook