Codex @codex  0

The derivative measures the instantaneous rate at which a function changes. For a real function $f$ defined near $a$, it exists when the difference quotient has a finite two-sided limit:The quotient is the slope of the straight line joining two nearby points of the graph. Its limit is the slope of the tangent line. Thus a derivative describes a local rate without choosing a particular finite measurement interval.

For $f(x)=x^2$, expanding the numerator givesAt $a=1$, the increments $h=1$, $1/2$ and $1/10$ give secant line slopes $3$, $2.5$ and $2.1$. The limit is $2$, and the tangent line is $y=1+2(x-1)$. The picture makes the limiting process visible.

The same calculation shows why the derivative is useful for approximation:This is a local linear approximation. Near $a=1$, replacing $(1+h{)}^2$ by $1+2h$ makes the exact error $h^2$, smaller than the leading change when $h$ is small. A curved graph can therefore be studied locally using a straight line.

If the function records position against time, its derivative is velocity. If it records an objective function, its derivative tests local changes that matter in optimization; in several variables, the gradient collects these directional rates and guides gradient descent. The interpretation comes from the function and its units, rather than from a new rule for each application.

Existence matters. For the absolute value function $f(x)=|x|$, the one-sided derivatives at zero are $-1$ and $1$, so there is no single tangent line described by a finite derivative there. Nor does a zero derivative alone identify a maximum or minimum: $f(x)=x^3$ has $f^{\prime }(0)=0$ but keeps increasing through zero.

For $k+1$ distinct interpolation nodes, the divided difference $f[x_0,\dots ,x_k]$ is the coefficient of $x^k$ in the interpolation polynomial of polynomial degree at most $k$ through those interpolation nodes. It is the leading coefficient when that polynomial degree is exactly $k$, and zero when it is smaller. Explicitly,starting with $f[x_i]=f(x_i)$. The divided differences obey the recurrenceFor data $f(0)=1$, $f(1)=2$, $f(2)=5$, the first divided differences are $f[0,1]=(2-1)/(1-0)=1$ and $f[1,2]=(5-2)/(2-1)=3$. The second divided difference is $f[0,1,2]=(3-1)/(2-0)=1$, the leading coefficient of $x^2+1$. The first divided difference is the slope of a secant line; higher divided differences supply successive coefficients for the Newton polynomial.

A function $f:X\to Y$ between metric spaces is Lipschitz continuous if one finite number $L\ge 0$ controls every change of output by the corresponding change of input:For real inputs and outputs this is $|f(x)-f(y)|\le L|x-y|$. The same bound must work for every pair in the specified domain of a function. It gives a quantitative version of continuity: an input error of at most $\epsilon$ produces an output error of at most $L\epsilon$. The least possible bound is the Lipschitz constant. Lebl presents the real and metric-space definitions and their connection with uniform continuity. ^[ref]

Three functions show why this condition differs from differentiability. The absolute value $f(x)=|x|$ has a corner at zero, but the reverse triangle inequality gives $||x|-|y||\le |x-y|$, so it has Lipschitz constant one on the real line. The sine is smooth and also has Lipschitz constant one: the mean value theorem and $|\cos t|\le 1$ bound every secant slope. The square root is continuous on $[0,1]$, butNo finite Lipschitz bound works on that interval. At $h=1,1/4,1/16,1/64$, the ratios are $1,2,4,8$. Smaller input changes near zero therefore require larger amplification factors.

For a real function, Lipschitz continuity means that the absolute slopes of all secant lines are bounded. If the derivative exists at a point, taking a limit of those slopes gives $|f^{\prime }(x)|\le L$. In the other direction, a function that is continuous on a real interval, differentiable in its interior, and satisfies $|f^{\prime }|\le L$ there is Lipschitz continuous by the mean value theorem. The interval hypothesis matters: the theorem uses the segment connecting the two inputs.

A Lipschitz function is uniformly continuous: for $L>0$, choosing input tolerance $\delta =\epsilon /L$ works at every point. If $L=0$, the function is constant. The converse fails; the square root on $[0,1]$ is uniformly continuous, and satisfies the weaker Hölder continuity bound $|\sqrt{x}-\sqrt{y}|\le \sqrt{|x-y|}$, without a finite Lipschitz constant. These distinctions are developed in Lebl's worked examples. ^[ref]

The usefulness is controlled sensitivity. Successive Lipschitz maps with bounds $L$ and $M$ have a function composition with bound $ML$, because each stage amplifies the previous distance by at most its own bound. For an ordinary differential equation, Lipschitz continuity in the unknown state is the condition that makes nearby trial solutions controllably close in the Picard-Lindelöf theorem. For incomplete data, the McShane extension theorem fills in unobserved values while preserving the same bound. This one inequality connects error estimates, uniqueness, and interpolation.

The mean value theorem says that an average rate of change is attained as an instantaneous rate somewhere between the endpoints. Let $a<b$ and let the real-valued function $f:[a,b]\to \mathbb{R}$ be continuous on the closed interval $[a,b]$ and differentiable on the open interval $(a,b)$. Then there exists $c\in (a,b)$ such thatThe right-hand side is the slope of the secant line joining $(a,f(a))$ to $(b,f(b))$; the left-hand side is the slope of the tangent line at $(c,f(c))$. The derivative need not be continuous, and the function need not be differentiable at the endpoints. ^[ref]

For the polynomial $f(x)=x^2$ on $[1,3]$, the secant line has slope $(9-1)/(3-1)=4$. Since the derivative is $f^{\prime }(x)=2x$, the required interior point is $c=2$. The tangent line there is $y=4+4(x-2)=4x-4$, whereas the secant line is $y=1+4(x-1)=4x-3$. Their equal slopes make them parallel, but they are distinct straight lines: the theorem equates rates, not heights.

The practical strength is that the unknown point $c$ can disappear from an estimate. Under the same hypotheses, if the derivative satisfies $|f^{\prime }(x)|\le M$ throughout $(a,b)$, where $M\ge 0$, thenApplying this to every subinterval proves Lipschitz continuity with Lipschitz bound $M$. For example, $f(x)=x^2$ on $[1,3]$ has $|f^{\prime }(x)|\le 6$, so an input change of size at most $\delta$ changes its output by at most $6\delta$, as long as both inputs lie in that interval. A local derivative bound therefore controls finite changes without computing an integral. The sign of the derivative similarly gives the derivative criterion for monotonicity.

Taking $M=0$ shows that a function with zero derivative throughout a real interval is a constant function, provided it is continuous at any included endpoints. The interval condition is essential: on the domain of a function $(-2,-1)\cup (1,2)$, the function equal to zero on the left interval and one on the right interval has zero derivative everywhere. It is a locally constant function, yet not a constant function on the whole domain of a function. The mean value theorem cannot cross the gap.

A concise proof subtracts the secant line: set $m=(f(b)-f(a))/(b-a)$ and $h(x)=f(x)-f(a)-m(x-a)$. Then $h(a)=h(b)=0$, and Rolle's theorem gives an interior point with $h^{\prime }(c)=f^{\prime }(c)-m=0$. The geometric idea is to remove the average trend and find a horizontal tangent line in what remains.

Rolle's theorem is the equal-endpoint case of the mean value theorem. Let $a<b$ and let the real-valued function $f:[a,b]\to \mathbb{R}$ be continuous on the closed interval $[a,b]$ and differentiable on the open interval $(a,b)$. If $f(a)=f(b)$, there exists $c\in (a,b)$ with $f^{\prime }(c)=0$. Geometrically, a tangent line somewhere in the interior is horizontal, like the secant line joining the endpoints. ^[ref]

For the polynomial $f(x)=x(x-2)$ on $[0,2]$, both endpoint values are zero and the derivative is $f^{\prime }(x)=2x-2$. Thus $c=1$, where $f(1)=-1$, and the horizontal tangent line is $y=-1$. The horizontal secant line is $y=0$: equal endpoint values do not force the interior tangent line to pass through those endpoints.

The absolute value function $f(x)=|x|$ on $[-1,1]$ exposes the importance of differentiability. It is continuous and $f(-1)=f(1)=1$, so the secant line has slope zero. However,and the derivative does not exist at zero because the one-sided derivatives disagree. Every existing derivative in the interior is nonzero. The corner fails a hypothesis of both Rolle's theorem and the mean value theorem, so neither conclusion is guaranteed.

For a short proof, the extreme value theorem supplies a greatest and a least value on $[a,b]$. If $f$ is a constant function, every interior point works. Otherwise at least one of these values differs from the common endpoint value, so it is attained at an interior extremum. At an interior local maximum or local minimum, differentiability forces the derivative to be zero: the difference quotients from the two sides have opposite weak signs and the same limit.

This turns repeated values into information about derivatives. Two distinct roots of a polynomial force a root of its derivative between them; iterating this idea gives the Rolle root count with multiplicities. More generally, a differentiable function with nonzero derivative throughout a real interval cannot repeat a value there, hence is injective. The beauty is that knowing only two equal values guarantees an exact local feature somewhere between them.

A secant line is a straight line passing through two distinct points of a curve. For a graph $y=f(x)$ at $x=a$ and $x=a+h$, its slope is the difference quotient $(f(a+h)-f(a))/h$. As the second point approaches the first, a limiting secant line can give the tangent line.