Asynchronous Hopfield energy descent Created 2026-10-14 Updated 2026-10-18
For symmetric zero-diagonal weights and zero thresholds, update one binary unit to the sign of its current field, retaining it at a zero field. The displayed energy change is negative on every actual flip. There are finitely many states, so a fair asynchronous update schedule eventually reaches a fixed point that is a minimum against single-unit flips. Synchronous updates can instead cycle, and local minima need not be global minima.
To obtain the displayed identity, subtract the two energies. Terms not involving cancel, and symmetry combines the two copies of each pair. With thresholds included the result is . The zero-threshold expression above is its specialization. At , keeping the old state rules out motion along equal-energy states. Finiteness then excludes infinitely many strict decreases, while fairness ensures that an unstable unit cannot be ignored forever. A local minimum here means no single flip lowers energy; equality directions can remain.
Boltzmann machine 2026-10-18
A Boltzmann machine is a stochastic neural network that learns a probability distribution specified by pairwise energies. To compare it directly with a Hopfield network, use the bipolar energy . Here controls the preference for low energy, and the partition function normalizes all states. In a computational model, is an algorithmic inverse temperature; interpreting it as additionally requires physical energy units.
A random single-unit Gibbs sampling update has conditional probabilityIndeed, the two possible energies differ by ; their normalized Boltzmann weights give this logistic function. Random selection of one unit at a time satisfies detailed balance. For finite weights and finite positive , all conditional probabilities lie strictly between zero and one, so the finite Markov chain can reach every state and can remain in place. Its unique stationary distribution is . A short run need not yet sample that distribution accurately.
As , a nonzero field selects its sign, approaching asynchronous Hopfield energy descent. At zero field the stochastic rule remains a fair coin, whereas the deterministic convention above retains the old value. At finite inverse temperature, uphill moves permit exploration beyond one local minimum. Recall and learning are different operations: sampling changes the units at fixed weights; learning changes the weights to fit the training data.
A stationary point on the domain must be tested using allowed one-sided variations. For with , the boundary is a local minimum when and a local maximum when . At , the leading negative cubic term makes it a one-sided local maximum even though ; on an unrestricted real line it is instead a stationary inflection point.
Constraint qualification Created 2026-10-14 Updated 2026-10-20
A constraint qualification is a regularity hypothesis on optimization constraints that guarantees a specified optimality or duality conclusion. For the necessity of Karush-Kuhn-Tucker conditions, an appropriate constraint qualification ensures that a local minimum admits suitable Lagrange multipliers; linear independence of the gradients of equality optimization constraints and active constraints is one sufficient hypothesis in KKT regularity at a local minimum.[ref]
Lecture 7: Lagrange Multipliers and KKT Conditions. Lecture 7, §L7.1.3, Theorem L7.3, printed p. 4: independent active gradients
Slater's condition provides a different constraint qualification for convex optimization, yielding strong duality and dual attainment.[ref]Convex Optimization by Stephen Boyd and Lieven Vandenberghe. §5.2.3, printed pp. 226–227: Slater's condition, strong duality and dual attainment
Convex function Created 2026-09-24 Updated 2026-10-14
A function on a convex set is a convex function if, for every and ,Geometrically, a line segment joining two points of its graph of a function lies on or above that graph of a function. The convex set condition ensures that the intermediate input stays in the domain of a function. An affine function satisfies the defining inequality with equality.
For the quadratic function , the inputs and have equally weighted arithmetic mean . Evaluating at the arithmetic mean gives , whereas averaging the outputs gives . Averaging first saves one unit in this example. More generally, direct expansion givesThis identity proves convexity and also shows exactly when its defining inequality is strict.
The graph of a convex quadratic lies below its endpoint interpolation and above its supporting tangent
. For , the line segment through and has height at , while the graph of a function has height . The tangent line is an affine minorant: everywhere. Details.For a differentiable convex function, the tangent line in one dimension, or the corresponding supporting affine function in several dimensions, lies below the entire graph of a function. This is the subgradient inequality. The equivalent geometric statement is that the epigraph, consisting of points on or above the graph of a function, is a convex set. These characterizations are developed in Boyd and Vandenberghe's convex-function slides, sections 3.1–3.4.
Convexity does not require differentiability: the absolute value function is a convex function with a corner at . When a function is twice continuously differentiable on an open interval, it is a convex function exactly when its second derivative is nonnegative throughout that interval. In several dimensions, the corresponding criterion on an open convex set is that its Hessian matrix is positive semidefinite everywhere. The domain of a function matters: is a convex function on , but not on all of . A strictly positive second derivative is sufficient for strict convexity, but is not necessary: is a strictly convex function although its second derivative vanishes at .
The usefulness of convexity is that local information can certify a global conclusion. Every local minimum of a convex function on a convex set is a global minimum: if a lower value existed elsewhere, the defining inequality would produce lower values arbitrarily close to the proposed local minimum. For a differentiable convex function on an open convex set, a zero gradient therefore certifies a global minimum. Strict convexity gives uniqueness when a global minimum exists; it does not supply existence by itself. These facts explain the role of convex functions in convex optimization.
Convex optimization Created 2026-09-24 Updated 2026-10-13
Convex optimization is a minimization problem with a convex function as its objective function and a convex set of feasible points. For a finite-valued , the problem is to find with for every . The displayed infimum describes its value even when no minimizing point exists. The two convexity requirements concern different objects: the allowed decisions and the scores assigned to them.
A convex set contains the whole line segment between any two of its points:A convex function lies below the interpolation of its endpoint values:Thus mixing two allowed decisions preserves feasibility, and the mixed score is no worse than the same mixture of endpoint scores. The objective function may have flat regions or corners. For a strictly convex function, the second inequality is strict when and .
A useful constraint representation iswhere are convex functions on a common convex set , and the equalities are affine functions. Each inequality defines a convex sublevel set; their intersection with and the equality set is a convex set. An equality involving a general convex function need not preserve this geometry: allows and but excludes their midpoint . See Boyd and Vandenberghe, Convex Optimization (2004), §4.2.1 for the standard problem form.
Why local information can certify a global answer. Every local minimum of a convex optimization problem is a global minimum, including minima on the boundary. If a feasible point had , points would remain feasible and have value strictly below for every . Taking arbitrarily small contradicts a local minimum at . This argument explains the special power of convexity: a better distant decision would reveal an improving direction immediately nearby.
If a minimizer exists and the objective function is strictly convex on , it is unique. Two distinct minimizers of value would have a feasible midpoint with value strictly below . Existence is a separate question: the exponential function is strictly convex on , but its infimum is approached only as . Even a bounded convex set need not suffice: on also has unattained infimum . A continuous function on a nonempty compact set attains its minimum by the extreme value theorem.
Nor does strict convexity imply differentiability. For , the squared term gives the strict inequality while the triangle inequality gives the weak inequality for the absolute value. At zero the left and right derivatives are and , so no derivative exists there, although zero is the unique minimizer. Such objectives require subgradients or proximal operators rather than an ordinary gradient at every point.
For a differentiable convex function on an open convex set containing , the constrained first-order condition isIndeed, the subgradient inequality makes this sufficient; taking the one-sided derivative along feasible line segments makes it necessary. At an interior minimizer, both directions are feasible and the gradient must vanish. At a boundary minimizer it can be nonzero: it only needs to make every feasible direction nondecreasing. See Boyd and Vandenberghe, §§3.1.3 and 4.2.3.
A fully computed nearest-point problem. Project onto the half-space by minimizing half the squared Euclidean distance:The Hessian matrix is the identity matrix, so the objective function is strictly convex. The unconstrained minimizer violates the inequality. With the convention , the optimization Lagrangian is , where the Lagrange multiplier satisfies . Its Karush-Kuhn-Tucker conditions areThe last two equations give , . The choice is infeasible, so complementary slackness forces . Consequently , giving , and . The Euclidean distance is , rather than the objective function value . The gradient at the answer balances ; the displacement from to is a normal vector to the boundary.
There is an exact certificate independent of numerical search. Completing squares givesFor every feasible point, implies . Thus every feasible objective is at least , and attains this bound. More generally the Lagrangian dual problem has objective for . Its maximum is also , illustrating strong duality through matching computed bounds. This makes the example a model for Euclidean projection onto a convex set and the projection step in projected gradient descent.
What the multiplier conditions require. For differentiable convex functions on an open convex set and equalities defined by affine functions, the KKT conditions combine feasibility, , complementary slackness , and stationaritywith unrestricted equality Lagrange multipliers . They suffice to certify a global minimum without an additional regularity assumption: the optimization Lagrangian is convex, stationarity minimizes it, and feasibility with complementary slackness gives the same certificate as above. To guarantee their necessity at an attained finite optimum, a regularity hypothesis suffices: Slater's condition requires some with and . The projection example has the strictly feasible point . See Boyd and Vandenberghe, §§5.2.3 and 5.5.3. This hypothesis guarantees suitable multipliers, not existence of a primal minimizer.
Without regularity, necessity can fail even for convex functions: minimize subject to . The sole feasible point is optimal, but stationarity would require . No Lagrange multiplier works. There is no strictly feasible point, and the gradient of the constraint vanishes at the answer.
The nonconvex contrast. The polynomial has derivative and second derivative . Numerically solving the cubic gives stationary points , , and . Their objective values are respectively , , and , with second derivatives , , and . Hence both outer points are local minima, and the middle point is a local maximum. Since at both ends, its global minimum exists and must be one of the stationary minima: it is the left one. A method stopping at the right local minimum misses a better value by approximately .
A strictly convex quadratic has one minimum; a tilted quartic has two local minima with different values
. Details. The practical appeal of convex optimization is the ability to check an answer globally using geometry and matching Lagrangian duality bounds. The projection certificate certifies every feasible alternative at once; the tilted quartic shows why a zero gradient alone cannot do that for general nonlinear optimization.
Historically, an early landmark is Kuhn and Tucker's [ref]
https://digicoll.lib.berkeley.edu/record/112776/files/math_s2_article-35.pdf. Nonlinear Programming, Second Berkeley Symposium (1951), pp. 481–492
. Its §3 explicitly states a regularity hypothesis for inequality-constrained Lagrange multipliers; its discussion of saddle points explains how concave functions support global conclusions for maximization. This documents an early formulation of the multiplier approach; it does not establish sole discovery of today's KKT conditions or of convex optimization as a whole. Cooling schedule for simulated annealing 2026-10-18
A cooling schedule for simulated annealing specifies successive effective temperatures and how many proposals to attempt at each. For example, with , using the geometric sequence, can define stages of equal chosen length. Changing changes the transition matrix: if the state probability distribution is , then , which generally differs from . Time spent at one temperature must be compared with its mixing time before equilibrium intuition is justified.
In the five-state barrier example for simulated annealing, fixed gives a finite irreducible Markov chain, so is eventually visited with probability one. That unbounded-time statement gives no fixed finite deadline. Over any finite number of trials starting at , the probability of staying at throughout isEach factor is the rejection probability at . This is an explicit failure event even when every is positive: the best visited objective function value remains , above the global minimum value . More exploratory proposals can help cross a barrier; cooling before those moves occur can preserve a poor local minimum. Successful asymptotic schedules need additional analysis of the allowed moves and barriers.
Historically, Scott Kirkpatrick, Charles Daniel Gelatt Jr. and Mario P. Vecchi connected statistical mechanics with mathematical optimization in 1983. They adapted the Metropolis–Hastings algorithm to cooling searches with symmetric proposals and illustrated computer-design problems.[ref]
Optimization by Simulated Annealing by Scott Kirkpatrick and others. Printed pp. 672–673 and 675: Metropolis procedure, cooling schedule, logic partitioning
Covalent bond Created 2026-10-13 Updated 2026-10-31
A covalent bond joins chemical atoms through shared electrons. In the familiar two-centre description, one bond pair contributes to a connection between two atomic nuclei. Sharing means that the electrons belong to the combined arrangement and interact with both atomic nuclei; it does not mean that identifiable dots shuttle along drawn paths. The [ref] emphasizes the concentration of electrons between atomic nuclei and the resulting attraction and characteristic separation. The pair picture is especially useful for simple molecules, but is not a universal description of every covalent bond.
A Lewis structure turns this picture into practical bookkeeping. Count the valence electrons, indicate which chemical atoms are connected, and allocate two electrons to each line. A bond pair is shared; a lone pair is assigned to one chemical atom without connecting it to another. A double line represents two bond pairs. Dots and lines record allocations, rather than positions, trajectories, or a measured three-dimensional arrangement. [ref]
https://openstax.org/books/chemistry-2e/pages/7-3-lewis-symbols-and-structures. Flowers et al., Chemistry 2e, Lewis symbols and structures
For molecular hydrogen, , each neutral hydrogen chemical atom supplies one valence electron. Thus valence electrons make one bond pair, represented by , with no lone pairs. Each hydrogen counts the same shared pair when checking its two-electron arrangement. The molecule still contains two electrons, not four: counting a pair around both endpoints does not create extra electrons.
For water, , neutral oxygen supplies six valence electrons and the two hydrogen chemical atoms supply one each: . Two O–H connections consume four electrons as two bond pairs. The remaining electrons form two lone pairs on oxygen. Around oxygen, the two bond pairs and two lone pairs count as eight electrons; each hydrogen counts two. The whole water molecule has ten electrons, because two additional oxygen electrons are omitted from this valence electron drawing.
For Ammonia, , the total is valence electrons: five from nitrogen and three from hydrogen. Three N–H connections use six electrons as three bond pairs, leaving two electrons as one lone pair on nitrogen. Thus water and Ammonia have the same total of eight valence electrons but different allocations: two plus two pairs versus three plus one. This small calculation already distinguishes their connectivity without a detailed quantum mechanics calculation.
Lewis structures count bond pairs and lone pairs in molecular hydrogen, water, Ammonia, and molecular oxygen; schematic layouts do not specify molecular shapes
. Details. For molecular oxygen, , valence electrons give the conventional Lewis structure. Its two bond pairs use four electrons, leaving eight as four lone pairs, two on each oxygen. Each oxygen consequently counts eight electrons locally. However, actual molecular oxygen has two unpaired electrons and exhibits paramagnetism: it is attracted into a stronger magnetic field. The all-paired Lewis structure cannot capture this observation. Molecular orbital theory describes the unpaired electrons; the successful counting diagram alone is insufficient. [ref]
Why does sharing produce a stable separation? For molecular hydrogen, the electronic arrangement responds as the atomic nuclei approach. Their interactions can lower the energy, but pushing them too close raises it. A curve of potential energy against separation therefore has a local minimum, rather than falling forever. Attraction and repulsion balance there. This is a statement about the combined system, not a claim that stationary electrons sit between otherwise motionless atomic nuclei. [ref]
The following Morse potential makes those features calculable. Set , where is separation and its equilibrium value, and let be the well depth. With the self-chosen parameter , define the dimensionless quantitiesHere is the net separating force, obtained from the derivative of the potential energy. Positive pushes the chemical atoms apart; negative draws them together. These are illustrative curves with in chosen units, not measured molecular hydrogen data or fitted parameters.
Illustrative dimensionless Morse potential and its force: a stable local minimum, short-distance repulsion, and separation toward zero potential energy
. Details. At , and . The second derivative is , confirming a local minimum. At , ; at , . As increases without bound, approaches zero from below. Thus moving from the well bottom to separated chemical atoms requires an increase of in this model's potential energy. An actual quantum mechanics dissociation threshold also depends on the initial motion of the atomic nuclei, so the well depth alone is not every measured dissociation energy.
The force panel separates into a positive term and a negative term . At they are and , cancelling exactly; nearer separations favour the positive term. These are algebraic components of the chosen Morse potential, not separately measured microscopic forces. Their usefulness is to show how a balance arises from the slope of one energy curve.
The beauty of the pair picture is its economy: a few marks summarize connectivity and constrain what a proposed molecule can contain. Its historical anchor is Gilbert N. Lewis's 1916 paper [ref]
https://doi.org/10.1021/ja02261a002. The Atom and the Molecule, Journal of the American Chemical Society 38, 762–785
, also available as an [ref]https://zenodo.org/records/1429068. archived original paper
. Lewis structures remain useful because they answer counting questions quickly; quantum mechanics supplies the richer account when energy, shape, or unpaired electrons matter. Critical point Created 2026-09-24 Updated 2026-10-13
For a smooth function on an open set , a critical point is an input where the gradient vanishes: . Equivalently, every first partial derivative is zero. Such a critical point is a stationary point; in one variable the condition is .
There is a broader convention in elementary one-variable calculus: a "critical number" is an interior input where the derivative is zero or does not exist, provided the function itself is defined there. Thus a corner can be a critical number without being a stationary point. Here the smooth meaning of critical point is used unless the broader convention is explicitly stated. [ref]
https://openstax.org/books/calculus-volume-1/pages/4-3-maxima-and-minima. Gilbert Strang and Edwin Herman, OpenStax Calculus Volume 1, §4.3: critical numbers
For the polynomial on the real line,The stationary points at are strict local minima and attain the global minimum; the stationary point at is a strict local maximum. One can check the local classifications from , which is positive at and negative at zero. The identity proves the global minimum directly. Since as , there is no global maximum on .
A zero derivative alone does not guarantee an extremum. The polynomial has but is strictly increasing through zero: every neighbourhood of zero contains both positive and negative values, so zero is neither a local minimum nor a local maximum. Conversely, the absolute value function has a strict local minimum and a unique global minimum at zero, but its left and right derivatives are and . It is not differentiable there, so zero is a critical number under the broader convention and is not a stationary point.
The usefulness of critical points is that they reduce the search for smooth interior extrema to equations. Every local minimum or local maximum of a differentiable function at an interior point has zero gradient; this condition is necessary, and shows that it is not sufficient. The striking feature is that all the first directional derivatives must vanish together, even though the surrounding values can form a valley, a peak, or a saddle point of a scalar function. [ref]
https://www.ocw.mit.edu/ans7870/18/18.013a/textbook/HTML/chapter14/section01.html. Daniel Kleitman, MIT Calculus with Applications, §14.1: necessary conditions for an interior extremum
Proof outline: at an interior local minimum in one variable, the difference quotient is nonnegative for small and nonpositive for small . If the derivative exists, the two sides have the same limit, forcing . Reverse the inequalities for a local maximum. In several variables, apply this argument along each coordinate line to obtain zero partial derivatives and hence zero gradient. At a domain boundary, both directions may not be available: on attains its global minimum at zero although for its smooth extension.
Critical point of a smooth map 2026-10-14
Imagine folding a sheet along its horizontal axis by the smooth map , . The inputs and have the same output. Along , horizontal motion still changes the output, but vertical motion produces no first-order change: . These inputs are critical points of a smooth map even though their differential is not the zero linear map. The missing direction in the target tangent space is what matters.
Precisely, let be a smooth map between smooth manifolds without boundary. An input is a critical point of a smooth map when its differentialis not surjective, equivalently when its rank of a linear map is less than . An input where it is surjective is a regular point; a map with no critical points of a smooth map is a submersion. The threshold is the target dimension, not . In manifold charts, compute the matrix rank of the Jacobian matrix; changes of charts preserve that matrix rank. [ref]
For the fold,Thus its set of critical points of a smooth map is the entire horizontal axis. Away from that axis, its differential can produce every infinitesimal target displacement. At the axis, it can produce only horizontal ones. This diagnoses where the two inverse branches in the picture merge.
For a scalar smooth function , the target dimension is one. A linear map to fails to be surjective exactly when it is zero, so here a critical point of a smooth map means . In Euclidean space this is precisely the familiar critical point condition : every first partial derivative vanishes. On a Riemannian manifold, it is equivalently for the chosen Riemannian metric; the Riemannian gradient depends on that metric, but whether it vanishes does not. See Loring W. Tu, An Introduction to Manifolds, Proposition 8.23 for the scalar coordinate criterion. The scalar smooth function has a critical point at zero without a local maximum or local minimum.
A source of lower dimension gives a different warning. For the smooth map , , the Jacobian matrix is the column , of matrix rank one at every input. Every input is a critical point of a smooth map, since the target dimension is two, even though this parametric curve has nonzero velocity everywhere and is an immersion. More generally, if , no differential can be surjective, so every input is critical. The terminology measures the ability to fill target directions, rather than whether the parametrized curve looks smooth.
Cubic degenerate saddle 2026-10-31
At the origin the gradient vanishes and the Hessian matrix is , which is positive semidefinite. Nevertheless, takes both signs arbitrarily close to the origin. Thus the origin is a saddle point of a scalar function. This example shows why a zero eigenvalue prevents the ordinary second-derivative test from establishing a local minimum.
Degenerate critical point 2026-10-31
A critical point whose Hessian matrix is a singular matrix. The second-derivative test does not completely classify such a point. Higher-order terms can produce a local minimum, a local maximum, or a saddle point of a scalar function.
Diatomic bond stretch Created 2026-10-14 Updated 2026-10-18
Let be the instantaneous bond length, its equilibrium value, and the stretching displacement. Assume one fixed electronic quantum state, a smooth potential energy with a nondegenerate local minimum at , and omit molecular rotation initially. The Taylor series has no linear term because :Keeping only the quadratic term is the harmonic approximation near a potential minimum. The bond force constant has units . It measures local stiffness; it is not the bond-dissociation energy, which concerns the depth and distant shape of the entire well.
The two-particle relative coordinate explains the reduced mass. For stretching along a fixed axis in a stationary centre of mass frame, let be the nuclear displacements from equilibrium. Then and , soHere is the internal kinetic energy, and are the two nuclear masses. The lighter partner moves farther; the reduced mass is smaller than either individual mass. The restoring force gives simple harmonic motion:The angular frequency is , the ordinary frequency is , and is the corresponding spectroscopic wavenumber; is the speed of light. Use in to obtain in . The symbol here is a bond force constant, not an angular wavenumber.
For an original dimensionless example, choose and in consistent model units. Then and . Releasing at with gives and , . Each atomic nucleus moves only half the stretching amplitude, while the conserved internal mechanical energy above is . Fixing one partner instead would give , demonstrating why a one-body calculation changes the model.
For canonical Kähler potential, set , , . The supplied supergravity F-term potential is . Adding with , and gives a supersymmetric vacuum at , . The branch has positive energy , D-term breaking and a flat direction of a scalar potential in . Its charged squared masses are , so it is a local minimum valley only when both are positive. For negative , exchange the charged fields. These are branches rather than two isolated minima; a conventional constant Fayet–Iliopoulos term additionally needs a consistent supergravity gauge completion.
Fermat's theorem on stationary points Created 2026-10-25 Updated 2026-10-31
If a function is differentiable at an interior local minimum or local maximum, its derivative there is zero. At a local minimum , for small the difference quotient is nonnegative, while for small it is nonpositive. The one-sided limit of a function from each side equals , forcing and . Apply the same argument to at a local maximum.
The converse fails: has but no local minimum or local maximum at zero. The interior hypothesis is essential; a minimum attained only at an endpoint need not have derivative zero.
For independent exponential lifetimes with rate , recording all lifetimes gives Fisher information . Recording only the count alive at a fixed time gives a binomial distribution with success probability . Its information in is , and the change of parameter gives the displayed information.
The retained fraction is , . It is strictly below one, so every single snapshot loses information. The inequality follows, for instance, from : its derivative is for positive , because that derivative has its minimum at with value . Also tends to zero as and as .
Differentiating shows that the best snapshot time solves . The difference of the two sides is strictly concave, starts at zero with positive derivative, and eventually becomes negative, so it has exactly one positive root, approximately . The largest retained fraction is about . Thus even an optimally timed snapshot keeps less than two thirds of the full lifetime information. This is a local design result: choosing that time requires a nominal rate or a preceding estimate.
Consider the chosen finite minimization problemOnly adjacent integers are neighbors. At each interior state propose left or right with probability each; at an endpoint propose its sole neighbor with probability and itself with probability . This proposal distribution is symmetric, including at the endpoints. The local minimum at is relative to these allowed moves; is the unique global minimum.
At , improving-only local search rejects both neighbors because and exceed . For simulated annealing, choose , using the natural logarithm. Conditional on proposing from , the acceptance probability isThe one-step transition probability is instead . Both subsequent rightward proposals are downhill, so the conditional probability of the precise next three states being , given and fixed , isThis is one possible escape route, not the probability of eventually reaching . Rejections, excursions toward , and repeated attempts give many other sample paths. The calculation establishes possibility, without claiming a general performance advantage from a selected sample path.
For comparison, halving makes the uphill acceptance probability ; doubling it makes that probability . Cooling makes it harder to leave this local minimum, even though the stationary distribution increasingly favors the global minimum. That tension is the central scheduling problem.
Near a smooth local minimum with and , Taylor's theorem givesIf evaluated function values have absolute uncertainty of order , differences on that scale cannot reliably identify smaller displacements than order . In ordinary floating-point arithmetic, when and evaluations have relative error of order , this becomesFor unit-scale values and curvature, this is the square root of machine epsilon, rather than machine epsilon itself. It explains why a derivative-free golden-section search can lose reliable comparisons while candidate positions remain representably different.[ref]
One dimensional minimization in the GNU Scientific Library manual. Caveats: loss of the quadratic term when added to a nonzero minimum value
This is a precision limit of the evaluated values, not an invariant property of the minimizer. Accurately subtracting a known constant, obtaining values at higher precision, or locating a zero of an accurately evaluated derivative can change the attainable position accuracy. A zero minimum with relative error controlled on its small values also needs separate analysis.
Global minimum Created 2026-09-24 Updated 2026-10-14
A real-valued function attains a global minimum at whenThe point is a global minimizer; is the minimum value. A global maximum reverses the inequality throughout the same domain of a function. Unlike a local minimum or local maximum, a global minimum or global maximum compares every permitted input, however distant. The domain of a function is part of the claim.
For on , completing the square giveswith equality exactly at . This proves that is the global minimum and that the two global minimizers are and . Neither is a strict global minimizer, because the other attains the same value; both are strict local minima. There is no global maximum on , whereas on the global maximum is , attained at zero.
Finding critical points supplies candidates rather than a global certificate. The squared expression above is beautiful because one inequality compares infinitely many inputs at once. A global minimum is always a local minimum under the relative-neighbourhood convention; the converse fails. For example, has a strict local minimum at , but as , so it has no global minimum on the real line.
Existence also matters: on has infimum zero and supremum one but attains neither a global minimum nor a global maximum. By the extreme value theorem, a continuous function on a nonempty closed interval attains both. To find those values, compare all interior critical numbers, including points where the derivative does not exist, and both endpoints. Checking only stationary points can miss a corner or an endpoint. [ref]
https://openstax.org/books/calculus-volume-1/pages/4-3-maxima-and-minima. Gilbert Strang and Edwin Herman, OpenStax Calculus Volume 1, §4.3: locating absolute extrema
Harmonic optical trap Created 2026-10-14 Updated 2026-10-18
A harmonic optical trap approximates one coordinate near a stable equilibrium by a quadratic potential energy. Measure displacement from that equilibrium, set its potential energy to zero there, and take a positive effective spring constant , also called the trap stiffness:The restoring force points left when and right when . This is a local model: a Taylor series of a smooth potential energy about a nondegenerate local minimum gives as its leading curvature. A real optical trap has a finite capture region; the endlessly rising parabola does not describe its escape boundary. A three-dimensional optical trap can have different stiffnesses along different axes, and nonconservative optical forces can limit the potential energy description.








