A search direction is the nonzero vector used in the displayed optimization update. In a line search with positive step size, its orientation matters: a descent direction has negative directional derivative of the objective function. Minimization over a full line instead permits either sign of .
New to topics? Read the docs here!