Continuous function Created 2026-09-24 Updated 2026-10-14
A continuous function sends sufficiently nearby function inputs to nearby function outputs. For a real-valued function and a point that is an accumulation point of , this meansThe approached value and the assigned value must agree. Continuity on means continuity at every point of the domain of a function. At an endpoint of an interval, only approaches inside that domain of a function count. The epsilon-delta definition of continuity below also applies at an isolated point, where continuity holds automatically.[ref]
Calculus Volume 1, §2.4 Continuity. §2.4, Continuity at a Point: definition; Continuity over an Interval: one-sided endpoint conditions
For the polynomial function , approaching makes the function output approach . The continuity bounds for the square function turn this observation into an explicit guarantee: implies . This is useful whenever a small error in an function input must produce a controlled error in an function output. The required input tolerance can depend on the point and on the chosen output tolerance.
The absolute value function is also a continuous function, including at zero: . But its left and right derivatives there are and , so it is not a differentiable function at zero. Continuity controls values without requiring a tangent line. Conversely, a differentiable function is continuous wherever it is differentiable: if , the difference tends to zero with .
Several useful consequences reuse this one local idea. Addition, multiplication and function composition preserve continuity; a quotient of functions is continuous where its denominator is nonzero. On an interval, the intermediate value theorem turns continuity into a guarantee that no intermediate function output is skipped. On a compact set, the extreme value theorem guarantees attained maximum and minimum values. Those extra hypotheses matter: continuity alone on an unbounded domain of a function does not provide a global bound or an attained global maximum.
A rational function such as is continuous on its domain of a function . Zero is excluded from that domain of a function; the missing point prevents a continuous extension there, but it does not make the existing map discontinuous at one of its actual inputs. Always state the domain of a function before judging continuity.
Convex KKT optimality certificate 2026-10-14
For differentiable functions that are convex functions on an open convex set and affine functions , the KKT conditions certify a global minimum. Once Lagrange multipliers satisfy them, no extra Slater condition is needed.[ref]
Convex Optimization by Stephen Boyd and Lieven Vandenberghe. §5.5.3, printed p. 244: sufficiency under convexity and affine equalities
The certificate is a short chain of inequalities. Nonnegative Lagrange multipliers and affine equalities make a convex function. Its zero gradient gives a global minimum at by the first-order optimality condition. For every feasible point ,The first equality uses feasibility and complementary slackness; the last inequality uses and . Equivalently, the Lagrange dual function attains the same value as the primal objective function, proving strong duality. A strictly convex function makes the primal optimum unique, although the Lagrange multipliers need not be unique.
Affine equality optimization constraints matter: an arbitrary signed multiple of a nonlinear equality can destroy convexity of the optimization Lagrangian. For example, minimizing subject to the affine equality gives and for . This equality Lagrange multiplier is positive for , zero at , and negative for . Completing the square gives the certificate for every real number .
Outside convex optimization, KKT stationarity alone does not certify an optimum: minimizing with no optimization constraints gives the stationary candidate , which is a global maximum. The Lagrangian sufficiency theorem remains applicable whenever a global minimum of the optimization Lagrangian can be proved directly.
Critical point Created 2026-09-24 Updated 2026-10-13
For a smooth function on an open set , a critical point is an input where the gradient vanishes: . Equivalently, every first partial derivative is zero. Such a critical point is a stationary point; in one variable the condition is .
There is a broader convention in elementary one-variable calculus: a "critical number" is an interior input where the derivative is zero or does not exist, provided the function itself is defined there. Thus a corner can be a critical number without being a stationary point. Here the smooth meaning of critical point is used unless the broader convention is explicitly stated. [ref]
https://openstax.org/books/calculus-volume-1/pages/4-3-maxima-and-minima. Gilbert Strang and Edwin Herman, OpenStax Calculus Volume 1, §4.3: critical numbers
For the polynomial on the real line,The stationary points at are strict local minima and attain the global minimum; the stationary point at is a strict local maximum. One can check the local classifications from , which is positive at and negative at zero. The identity proves the global minimum directly. Since as , there is no global maximum on .
A zero derivative alone does not guarantee an extremum. The polynomial has but is strictly increasing through zero: every neighbourhood of zero contains both positive and negative values, so zero is neither a local minimum nor a local maximum. Conversely, the absolute value function has a strict local minimum and a unique global minimum at zero, but its left and right derivatives are and . It is not differentiable there, so zero is a critical number under the broader convention and is not a stationary point.
The usefulness of critical points is that they reduce the search for smooth interior extrema to equations. Every local minimum or local maximum of a differentiable function at an interior point has zero gradient; this condition is necessary, and shows that it is not sufficient. The striking feature is that all the first directional derivatives must vanish together, even though the surrounding values can form a valley, a peak, or a saddle point of a scalar function. [ref]
https://www.ocw.mit.edu/ans7870/18/18.013a/textbook/HTML/chapter14/section01.html. Daniel Kleitman, MIT Calculus with Applications, §14.1: necessary conditions for an interior extremum
Proof outline: at an interior local minimum in one variable, the difference quotient is nonnegative for small and nonpositive for small . If the derivative exists, the two sides have the same limit, forcing . Reverse the inequalities for a local maximum. In several variables, apply this argument along each coordinate line to obtain zero partial derivatives and hence zero gradient. At a domain boundary, both directions may not be available: on attains its global minimum at zero although for its smooth extension.
Exponential-linear separable potential 2026-10-18
Let be nonzero real constants with . The real function displayed in the title has exactly one stationary point:Indeed the partial derivatives are , each of which has precisely one zero. The Hessian matrix at that point is .
If every , each summand is a strictly convex function tending to as its argument tends to either infinity. Consequently has a unique global minimum. If every , negating gives the preceding case, proving a unique global maximum. If both signs occur, restricting to two coordinate directions of opposite signs gives a saddle point of a scalar function. No degenerate Hessian matrix is possible under the nonzero assumptions.
Extreme value theorem Created 2026-09-24 Updated 2026-10-14
A real-valued function that is continuous on a nonempty compact space attains both a global minimum and a global maximum. In particular, for a continuous function on a nonempty closed interval, there are points such thatThe important word is “attains”: the best values occur at actual allowed inputs, rather than merely being approached. The interval version is [ref].
For a worked example, take on . Its global minimum is , and its global maximum is . Nonnegativity gives the first answer; on the specified closed interval gives the second. The endpoint is essential: looking only for a zero derivative would find the minimum and miss the maximum.
An attained minimum and maximum on a closed interval, compared with excluded endpoints and a discontinuous endpoint value
. Details. For comparison, the continuous function on the open interval has infimum and supremum , but neither is a value of . Even a closed domain is insufficient without continuity: define for , and . On , its supremum is , approached by for , but every function value is strictly less than . This endpoint change makes discontinuous, preventing attainment. On the unbounded real line, the continuous function has neither a global minimum nor a global maximum. These examples show what can fail when a hypothesis is dropped; functions outside the hypotheses may still have extrema.
The extreme value theorem is an existence tool for optimization: first establish that a continuous objective function on a nonempty compact feasible set has a best value, then investigate where it occurs. It neither locates the optimizing point nor promises uniqueness or differentiability. For example, the absolute value function on has its global minimum at zero although no derivative exists there; a constant function has every input as a minimizer. This role in optimization is explained in University of Toronto MAT237 notes, section 1.4: compactness and the extreme value theorem.
A short proof outline identifies the mechanism. The continuous image of a compact space is compact; a nonempty compact subset of the real line contains its infimum and supremum. For a closed interval, one can instead choose inputs whose outputs approach the supremum, extract a convergent subsequence by the Bolzano-Weierstrass theorem, and use continuity to make its limiting output equal that supremum. The closed interval retains the limiting input. Repeating the argument for the infimum supplies the minimum.
The nonzero gradient condition in the equality Lagrange multiplier rule cannot simply be dropped. Minimize subject to . The only feasible point is , so it is a global minimum and a global maximum of on that feasible set. Nevertheless,and no real number satisfies . The point is singular for this representation of the optimization constraint; the usual constraint qualification fails. The linearized equation permits every direction, even though the actual feasible set permits no motion at all. This example explains why blindly solving the multiplier equations can miss an optimum.
Global maximum Created 2026-09-24 Updated 2026-10-14
A global maximum is one type of extremum of a real-valued function; global minima reverse the inequality.
Global minimum Created 2026-09-24 Updated 2026-10-14
A real-valued function attains a global minimum at whenThe point is a global minimizer; is the minimum value. A global maximum reverses the inequality throughout the same domain of a function. Unlike a local minimum or local maximum, a global minimum or global maximum compares every permitted input, however distant. The domain of a function is part of the claim.
For on , completing the square giveswith equality exactly at . This proves that is the global minimum and that the two global minimizers are and . Neither is a strict global minimizer, because the other attains the same value; both are strict local minima. There is no global maximum on , whereas on the global maximum is , attained at zero.
Finding critical points supplies candidates rather than a global certificate. The squared expression above is beautiful because one inequality compares infinitely many inputs at once. A global minimum is always a local minimum under the relative-neighbourhood convention; the converse fails. For example, has a strict local minimum at , but as , so it has no global minimum on the real line.
Existence also matters: on has infimum zero and supremum one but attains neither a global minimum nor a global maximum. By the extreme value theorem, a continuous function on a nonempty closed interval attains both. To find those values, compare all interior critical numbers, including points where the derivative does not exist, and both endpoints. Checking only stationary points can miss a corner or an endpoint. [ref]
https://openstax.org/books/calculus-volume-1/pages/4-3-maxima-and-minima. Gilbert Strang and Edwin Herman, OpenStax Calculus Volume 1, §4.3: locating absolute extrema
Lagrange multiplier Created 2026-09-24 Updated 2026-10-13
For continuously differentiable functions on an open subset of , suppose is a local extremum of subject to , with . Then a real number , the Lagrange multiplier, satisfiesThe nonzero gradient assumption excludes singular points of the optimization constraint. With several equality optimization constraints, require their gradients to be linearly independent; the gradient of is then a linear combination of them. These are necessary conditions, not automatic certificates of a global maximum or global minimum.
Why can the gradient be nonzero at an optimum? In unconstrained optimization, every direction is available at an interior local extremum, so all directional derivatives vanish and . On a regular equality feasible set, only directions in its tangent space are available to first order. The gradient of must be perpendicular to those directions, so it is parallel to the gradient of . In two dimensions this explains the tangency of their level sets. See MIT, Lagrange multipliers and contour geometry.
For the product example, set and use the optimization LagrangianIts partial derivatives give , , and . Hence . At , : increasing both inputs would help, but is infeasible. Along the allowed direction , the directional derivative is zero. The endpoints must still be checked because of the nonnegativity optimization constraints; completing the square establishes the unique global maximum.
The sign convention matters: writing instead gives . Neither equality Lagrange multiplier has a universal nonnegativity requirement. Also, the displayed is unbounded above along , so stationarity here does not meet the global hypothesis of the Lagrangian sufficiency theorem.
The Lagrange multiplier also measures the value of extra resources. For a positive budget , the optimizer is , the optimum value is , and . At , an extra units predicts a gain of ; the exact gain is . This is the envelope theorem in a computed sensitivity analysis: the multiplier translates a binding budget constraint into a marginal benefit.
Lagrange multiplier for quadratic cost 2026-10-18
Suppose two adjustable inputs must deliver a prescribed total , and their combined cost is the quadratic form . These are chosen, dimensionless quantities; the coefficient makes concentrating an input in more expensive. Initially allow all real numbers , with the equality optimization constraint . The optimization Lagrangian with our chosen sign isThe stationary point equations give , , and . ConsequentlyFor , the unique global minimum is at , with cost and Lagrange multiplier . Equal allocation would cost ; assigning everything to would cost . At the optimum, the two marginal costs agree: . Moving a little input from one component to the other therefore has zero first-order effect on cost. When , this solution also meets the extra nonnegativity optimization constraints , so it remains optimal with those added.
Here the Lagrange multiplier equations locate a candidate, and a short independent check certifies it. On the entire feasible set, substitute and use completing the square:The squared term is nonnegative and vanishes only at . Thus the candidate is the unique global minimum; there is no global maximum on this unbounded feasible set, a line. This separates finding a stationary point from proving optimality. The geometric beauty is that equal marginal costs, parallel gradients, tangency of level sets, and completing the square identify the same allocation.
Local maximum Created 2026-10-05 Updated 2026-10-14
A real-valued function , with , has a local maximum at if some satisfiesOnly a neighbourhood within the domain of a function is compared. Equality is allowed; a strict local maximum requires for every other point in that neighbourhood. A constant function therefore has a local maximum and a local minimum at every input, with neither strict. This is a local form of an extremum of a real-valued function.
For , zero is a strict local maximum because when . It is not a global maximum: values far away grow without bound. This distinction makes a local maximum useful for describing a nearby peak without claiming that it is the highest value anywhere.
Negating the function exchanges local maxima and local minima, including their strict versions. At a smooth interior local maximum, the critical point argument forces zero gradient; for a function twice continuously differentiable nearby, its Hessian matrix is negative semidefinite. These necessary conditions alone do not establish a local maximum.
Mathematical optimization Created 2026-09-24 Updated 2026-10-13
Mathematical optimization turns a preference into a precise question: among the allowed decisions, which gives the best outcome? A model separates the objective function, which measures quality, from the optimization constraints, which determine the feasible set. This language unifies finding a cheap plan for a transportation problem, efficient scheduling, or an accurate model in linear regression. The separation is useful because changing a preference and changing what is possible are different modeling decisions. See Boyd and Vandenberghe, introductory optimization models.
For an objective function , a maximization problem asks for a feasible point satisfying for every ; a minimization problem reverses the inequality. This is a global extremum. A local maximum or local minimum compares only nearby feasible points, so finding one does not settle the global question.
Consider allocating ten units between two complementary inputs:The budget constraint forces a tradeoff: an extra unit of costs a unit of . The best allocation is , with objective function value . Without the budget constraint, gives : there is no global maximum. Constrained optimization can therefore have a finite answer even when the corresponding problem with fewer optimization constraints does not. Its beauty is that geometry, calculus, and an arithmetic-geometric mean inequality can certify the same answer.
For a real symmetric invertible matrix , the full undamped Newton step for the displayed quadratic function sends every starting point to the unique stationary point:This follows because the gradient is affine and its first-order expansion is exact. If is a positive-definite matrix the result is the unique global minimum; a negative-definite matrix gives a global maximum, and an indefinite matrix gives a saddle point. Thus exact arrival does not by itself show that a minimization method has minimized anything. A line search, damping, or a positive-definite matrix replacing the Hessian matrix changes this exact one-step assertion.
The printed minimization of the evidence lower bound has no solution. To distinguish that literal result from the usual variational inference optimum, put . The preceding Kullback-Leibler divergence satisfiesIts unique global minimum occurs at . Since , this is the unique global maximum of the evidence lower bound:The optimal common variance is the harmonic mean of the two posterior variances. However, as either or . ThereforeThe source PDF confirms the minimization wording; replacing it by maximization would give the finite value above, consistently with part (i).
Set and . Balancing , diffusion and the cubic gives , hence . The drift term cancels the contribution in , leavingMultiply by and integrate. The limiting equilibrium has , fixing the constant and giving . The increasing branch from zero to one obeys . ThereforeThe first integral also shows why another turning branch cannot reach the required limit from zero.
At a space-time interior maximum, and . The equation would then give , so . Hence a positive interior maximum is impossible. In particular, a global maximum cannot be attained at an interior point, since the far-field boundary has positive values. If “maximum” instead means every local maximum of an arbitrary signed solution, the calculation only excludes positive local maxima; nonnegativity must be added for the broader usual interpretation. Positive boundary values alone do not impose nonnegativity on arbitrary initial data.
For uniqueness in the standard bounded classical solution class on finite time strips, set , , and . The equation becomeswith , and prescribed . For two solutions let . ThenThe bracket is at most since . Thus solves with , zero initial data and zero boundary difference.
For completeness on the unbounded interval, compare with on a large rectangle. This is a strict positive supersolution becauseFinite-strip boundedness lets its right boundary dominate when the rectangle is sufficiently wide. The weak parabolic maximum principle then bounds by this barrier. Send the width to infinity and then to zero. Hence , giving . The boundedness or a suitable uniform far-field/growth condition is the usual hypothesis that makes this unbounded-domain argument valid; pointwise limits at spatial infinity should not silently replace it. This is similarity reduction for a cubic absorption equation with dilating drift.
Past exam of the mathematics course of the University of Cambridge 2006 iii Paper 42 4 iv Solution Created 2026-10-03 Updated 2026-10-20
For independent observations in a natural exponential family, the log likelihood isIn a minimal exponential family the observed Fisher information matrix is positive definite, so the log likelihood is strictly concave. Any finite solution of the likelihood equation is therefore the unique global maximum likelihood estimator. Existence is a separate issue: the observed sufficient-statistic mean must belong to the image of the mean parameter map .
For a full regular minimal natural exponential family this image is the interior of the convex support of an exponential family, . The necessity follows from a supporting hyperplane argument. If a finite parameter had its mean on a boundary face, some nonzero would satisfy almost surely and . Equality of the expectation forces almost surely. Exponential tilting preserves the base-measure null sets, so this contradicts minimality.
For sufficiency, let be an interior point of . Choose finitely many points of the support whose convex hull contains a ball about , say of radius . Such points exist because is interior to the closed convex hull; one may approximate the vertices of a small simplex surrounding it by finite convex combinations of support points. Take support neighbourhoods of radius at most with positive finite base-measure masses . These masses can be taken finite by restricting to bounded neighbourhoods and using finiteness of the normalizing integral at any fixed interior parameter. For every vector , at least one has . Integrating over that neighbourhood yieldsThus the negative log likelihood grows to infinity as . At a finite boundary point of the full open natural parameter space, the normalizing integral is infinite, since otherwise that point would itself belong to the full domain. Fatou's lemma makes diverge on approach to such a boundary. A minimizing sequence for therefore stays in a bounded subset away from the boundary; it has an interior limit where the minimum is attained. Its gradient vanishes, giving the required likelihood equation. Strict convexity gives uniqueness.
Hence, under these full, regular and minimal conventions,This is maximum likelihood existence in a full regular natural exponential family. Regularity alone does not make every sample admissible: in a Bernoulli distribution an all-zero or all-one sample has its sample mean on the boundary of , and the canonical maximum is approached only as or . The usual probability parameter then has a boundary maximum in an enlarged model, but no finite canonical maximizer. A regular restriction of the natural parameter space requires membership in its actual mean-map image, rather than merely in . Without minimality, affine redundancies may prevent uniqueness of the canonical parameter even when the fitted probability distribution is unique.
Past exam of the mathematics course of the University of Cambridge 2006 ii Paper 2 5I Solution Created 2026-09-24 Updated 2026-10-14
Independence and the Poisson probabilities give the log-likelihoodIts score and curvature areIf some , this is strictly concave. A finite maximum is therefore the unique zero of the score when such a zero exists. Newton iteration givesStart from a finite value, compute the score and curvature, and iterate until both the score and step are small. A line search that shortens a step until the likelihood increases improves robustness. Strict concavity identifies any converged stationary point as the global maximum. A finite root need not exist, for example when all observations are zero and all , in which case the likelihood supremum is at . If all , the parameter is unidentifiable.
Past exam of the mathematics course of the University of Cambridge 2016 ia Paper 1 9E Solution Created 2026-09-24 Updated 2026-10-06
The Bolzano-Weierstrass theorem states that every bounded sequence of real numbers has a convergent subsequence. We first use it to show that a continuous function on is bounded above. Otherwise, choose with . A convergent subsequence exists, with because the interval is closed. Continuity would give , contradicting .
Let , which is finite. By the definition of supremum, there are with . Another application of the Bolzano-Weierstrass theorem gives a subsequence . By continuity,Thus the supremum is actually attained:This proves the maximum part of the extreme value theorem from sequential compactness rather than assuming it.
Now suppose on . Applying the mean value theorem to shows that is strictly decreasing. At a local maximum of a differentiable function, the left difference quotients are nonnegative and the right difference quotients are nonpositive; existence of the derivative forces . A strictly decreasing function has at most one zero. ThereforeIf that zero exists, is positive to its left and negative to its right, so the local maximum is also a global maximum.
For the uniform bound by , defineIts derivative is , so is strictly decreasing by the mean value theorem. Comparing with givesBecause , this makes negative at sufficiently large positive and positive at sufficiently large negative . The function is continuous, since it is differentiable; the intermediate value theorem supplies a zero between such points. Its strict decrease makes this zero unique. Again using the mean value theorem for , the derivative signs imply that increases up to and decreases after :This illustrates uniform negative curvature and global maximization.
Merely requiring does not force existence. TakeThen and , but is strictly increasing, approaches as , and never equals . The answer to the final question is no, even for a function bounded above:The stronger uniform curvature assumption prevents this behaviour. Here at the end where the supremum is approached, so no uniform negative bound of that kind is available.
Past exam of the mathematics course of the University of Cambridge 2019 ii Paper 4 38A c Solution Created 2026-09-24 Updated 2026-10-03
The obstacle and wave pattern are stationary, so . Withthe dispersion relation becomesHence , so , and
Differentiating the dispersion relation with respect to the wavevector giveswhere the zero-frequency relation
was used. Its first component is always negative, so the ray angle lies inMoreover,
was used. Its first component is always negative, so the ray angle lies inMoreover,
Put . The magnitude of the slope relative to the negative -axis isIts derivative isso its global maximum occurs at and equalsTherefore all group-velocity rays lie in the stationary square-root-dispersion wakea wedge of semi-angle extending in the negative -direction.
Past exam of the mathematics course of the University of Cambridge 2022 ia Paper 3 4A Solution Created 2026-09-23 Updated 2026-09-25
Use as the parameter of the smooth curve:Its velocity vector and speed areThe unit tangent vector is therefore
The parameter-independent formula for the curvature of a space curve givesDifferentiating,Hence increases for and decreases for . Its global maximum occurs at and equalsThe corresponding point is



