Take the fixed source and receiver to be and on the same side of the mirror, with . In the uniform medium, the Fermat principle minimizes the length through a reflection point :
Its stationary equation is
The two fractions are the signed tangential components of the ray directions. Equality of their magnitudes gives , where both angles are measured from the normal vector to the mirror and lie in . Hence the law of reflection is
For uniqueness, differentiate once more:
Thus is a strictly convex function, its derivative increases from to , and it has exactly one stationary point, its global minimum. Explicitly,
Substitution gives , verifying the reflection angles and the existence of that unique solution. Equivalently it is the point where the line from to the mirror image crosses the mirror.
Differentiating the Gaussian variational bound for an attractive Gaussian well gives
Thus an interior stationary point obeys
The left side of the first equation increases strictly from zero to infinity, so there is exactly one such point. More explicitly,
so is a strictly convex function on and is its global minimum. At that minimum the stationarity equation gives
There is a continuous limiting zero at , although at exactly is not a square-integrable function and hence is not an admissible trial. For a positive zero, division by and squaring gives , so
is the unique positive zero. The other quadratic root is negative and inadmissible. Near zero,
so the graph leaves the origin with slope , falls to its unique negative minimum, rises through , and grows as at infinity.
Figure 1.
The Gaussian variational bound for an attractive Gaussian well at , showing its negative minimum and positive zero
. Details.
By the Rayleigh-Ritz variational principle,
Thus the attractive well supports a negative-energy bound state for every .
Put and . The proximal operator for the L1 norm separates into independent scalar minimization problems:
The subgradient optimality condition is . By the subgradient of the absolute value, a positive solution must satisfy , and a negative solution must satisfy . At zero, the subgradient optimality condition holds exactly when . The squared term makes the objective function a strictly convex function, so these cases give its unique minimiser.
Thus the proximal operator is the soft-thresholding operator
Consequently the requested proximal gradient mapping, rather than just the proximal operator, is
The corresponding proximal gradient method update is . Small coordinates are set exactly to zero. When , the soft-thresholding operator is the identity and the proximal gradient mapping reduces to .
A strictly convex function satisfies that inequality strictly whenever and .
For necessity of the strict supporting-tangent property, convexity gives a nonnegative gap along a segment from to . If the gap at its other endpoint were zero, convexity of the gap and its zero initial value would force it to be zero all along the segment. That would make affine on this nontrivial segment, contrary to strict convexity. Conversely let with distinct endpoints. Apply the strict supporting inequality at to both endpoints, multiply by and , and add. The linear terms cancel, yielding strict convexity. Thus
For strict Jensen's inequality, put . The supporting gap is nonnegative everywhere and strictly positive where . That set has positive measure because is not almost everywhere constant. Its integral is therefore strictly positive. The linear term integrates to zero, giving the requested strict integral Jensen inequality.
The conditions on the cumulative distribution function imply almost surely. With , adjoin and the trivial . The random variables are nonnegative, adapted, and bounded by at each fixed time. Independence and give
Thus this is the product martingale from independent mean-one factors, with . The almost sure supermartingale convergence theorem states that a nonnegative supermartingale converges almost surely to a finite integrable random variable. Applied to this nonnegative martingale, it shows almost surely. Every convergent real sequence is bounded, so almost surely.
The printed maximum can in fact be taken literally here. If almost surely, all products equal . Otherwise the strict Jensen equality criterion, applied to the strictly convex function on , gives . Independence yields . By Markov's inequality, for every . The First Borel-Cantelli lemma and the countable choices give almost surely. Since , a sequence with this limit attains its positive supremum among finitely many initial terms. This is an instance of fractional moment decay of independent mean-one products.
The fixed common temperature, rigid external container and fixed particle numbers on either side make the total Helmholtz free energy the appropriate thermodynamic potential. Let the barrier have cross-sectional area , and let increasing expand the left compartment. Then and . At fixed temperature and particle number, , so
Thus mechanical equilibrium, , makes stationary. The physical force on the barrier towards increasing is . If the barrier is displaced slightly from , strict mechanical stability requires a restoring force:
Consequently
The Taylor expansion proves that thermodynamic equilibrium is a strict local minimum of the Helmholtz free energy, rather than merely a stationary point.
For individually stable gases, the positive isothermal compressibilities make the sign especially transparent:
If these inequalities hold throughout the accessible interval, is a strictly convex function and an interior stationary point is the unique global minimum of the Helmholtz free energy. Stability at one point alone proves only the local statement. A vanishing restoring derivative describes marginal stability and requires examining higher-order terms.
Apply the mean value theorem, the first-order case of Taylor's theorem, to between and . It yields
Also , so the initial point is to the right of the root . For an increasing strictly convex function, its tangent at a point to the right of a root meets the axis between that root and the point. Hence the exact Newton root-finding iteration remains in and decreases towards .
On every relevant interval, and , so the stated quadratic convergence bound gives, with ,
Iterating the bound gives
Thus four Newton corrections suffice to reduce the exact-iteration error bound below the floating-point spacing scale. The quadratic convergence doubles the approximate number of correct digits at each late step. Beyond this point further corrections cannot reliably improve a generic floating-point answer. This is a bound on useful accuracy under the usual stable-evaluation model, not a claim that the data specify the exact iteration at which every implementation must stagnate.
For negative , the mean value theorem gives . In particular,
Since is continuous and strictly increasing, it vanishes at exactly one point . The positive second derivative makes a strictly convex function on the entire real line. Its derivative changes from negative to positive at , so is the unique global minimum. One may also use to verify coercivity.
In the endpoint-bracketing form of golden-section search, begin with , a width-one interval known to contain this unique minimum, and place the two standard interior probes. The attainable position accuracy is different from that for a simple root. Around , Taylor's theorem gives
Here the minimum value is nonzero and of order one: the lower quadratic bound gives , while . Ordinary relative round-off error in these function values therefore hides changes of order , once has that size. The function-value resolution near a nondegenerate minimum is consequently of order
Each golden-section search contraction multiplies the bracket width by . Using as the nominal target width gives
Unknown evaluation-error constants can change the actual stopping point; is the standard scale-based count. Requiring position accuracy from these function-value comparisons would disregard the quadratic flatness of the minimum. The same precision effect is documented for one-dimensional numerical minimization.[ref]
Consider the minimization problem
The objective function is a strictly convex function with its unconstrained optimization minimum at . If , it decreases throughout the feasible set until the bound is reached. If , the feasible set already contains . Hence
With , the optimization Lagrangian and KKT conditions are
Substituting gives the unique inequality Lagrange multiplier
For , the active constraint has . For , there is strict slack and . At , the active constraint has zero Lagrange multiplier: the boundary happens to pass through the unconstrained optimum. Feasibility and complementary slackness must both be checked; solving only would allow infeasible candidates.
Figure 1.
The same quadratic objective with active, just-touching and inactive upper bounds
. Details.
An independent certificate follows by completing the square:
The Lagrange dual function is a concave function of . Its maximum over occurs at and equals . Thus every case has an explicit lower bound attained by a feasible point; the KKT conditions provide a certificate that can be checked without searching all real numbers.
Relative entropy nonnegativity Created 2026-10-06 Updated 2026-10-14
For probability distributions , relative entropy satisfies , with equality exactly when . Thus truthful prediction uniquely minimizes expected log-loss whenever the comparison is well defined, explaining the strictly proper scoring rule property of the logarithmic scoring rule.
For a short proof with probability density functions and , set . Their integrals both equal one, giving
The strictly convex function is minimized only at , so equality means almost everywhere. Its value at zero is one by . Where , relative entropy is infinite; where both vanish, the contribution is zero. These conventions extend the argument beyond positive reference probability density functions.
Let be an integrable random variable taking values in an open interval . Suppose is a differentiable strictly convex function. Then its expected value has equality in Jensen's inequality exactly when is constant almost surely.
First lies in : at each finite endpoint, taking the expected value of the strictly positive distance to that endpoint gives a strictly positive distance for . A tangent affine function supports at , so
Strict convexity forces for . Indeed, equality at another point would force the graph to coincide with its supporting line on the connecting line segment, contradicting strict convexity. Therefore
and the right side is zero exactly when almost surely.
The tangent affine function of is an integrable random variable, so has an integrable negative part. Thus is well defined, possibly , even if absolute integrability was not assumed. Equality to automatically excludes that infinite case.
The utility sums logarithmic utilities over individual flows. Its first-order condition gives proportional fairness. Its negative is a strictly convex function on active flow rates, giving uniqueness of those rates on a convex set of feasible allocations.