Gradient ($\nabla$)

In Cartesian coordinates on Euclidean space, the gradient of a scalar-valued differentiable function is the vector of its first partial derivatives. It converts a scalar field, such as temperature or a height, into a vector field describing its local change.

For a unit vector $u$, the directional derivative is $D_{u}f=u\cdot \nabla f$. The Cauchy-Schwarz inequality gives $|D_{u}f|\le |\nabla f|$. At a point where $\nabla f\ne 0$, the greatest increase per unit distance occurs along $u=\nabla f/|\nabla f|$, while the opposite direction gives the greatest decrease. These are first-order statements at the current point; they do not predict how the function behaves far along a straight path.

For $f(x,y)=x^2+2y^2$ at $(1,1)$, $\nabla f=(2,4)$. Moving in the $x$ direction gives rate $2$ and moving in the $y$ direction gives rate $4$, but the steepest direction is $(1,2)/\sqrt{5}$, withThe direction $(-2,1)/\sqrt{5}$ has rate zero and is tangent to the level curve through that point. More generally, differentiating $f(\gamma (t))=\text{constant}$ along a regular level curve gives $\nabla f\cdot {\gamma }^{\prime }=0$, so the gradient is its normal vector.

This is useful when navigating a measured scalar field or applying gradient descent: one collection of partial derivatives predicts every infinitesimal directional change. The derivative assumes a differentiable function, not merely the existence of all directional derivatives. ^[ref].