Take the fixed source and receiver to be and on the same side of the mirror, with . In the uniform medium, the Fermat principle minimizes the length through a reflection point :Its stationary equation isThe two fractions are the signed tangential components of the ray directions. Equality of their magnitudes gives , where both angles are measured from the normal vector to the mirror and lie in . Hence the law of reflection isFor uniqueness, differentiate once more:Thus is a strictly convex function, its derivative increases from to , and it has exactly one stationary point, its global minimum. Explicitly,Substitution gives , verifying the reflection angles and the existence of that unique solution. Equivalently it is the point where the line from to the mirror image crosses the mirror.
Differentiating the Gaussian variational bound for an attractive Gaussian well givesThus an interior stationary point obeysThe left side of the first equation increases strictly from zero to infinity, so there is exactly one such point. More explicitly,so is a strictly convex function on and is its global minimum. At that minimum the stationarity equation givesThere is a continuous limiting zero at , although at exactly is not a square-integrable function and hence is not an admissible trial. For a positive zero, division by and squaring gives , sois the unique positive zero. The other quadratic root is negative and inadmissible. Near zero,so the graph leaves the origin with slope , falls to its unique negative minimum, rises through , and grows as at infinity.
The Gaussian variational bound for an attractive Gaussian well at , showing its negative minimum and positive zero
. Details. By the Rayleigh-Ritz variational principle,Thus the attractive well supports a negative-energy bound state for every .
Past exam of the optimisation for data science course of the University of Oxford 2023 1 a Solution 2026-10-25
Put and . The proximal operator for the L1 norm separates into independent scalar minimization problems:The subgradient optimality condition is . By the subgradient of the absolute value, a positive solution must satisfy , and a negative solution must satisfy . At zero, the subgradient optimality condition holds exactly when . The squared term makes the objective function a strictly convex function, so these cases give its unique minimiser.
Thus the proximal operator is the soft-thresholding operatorConsequently the requested proximal gradient mapping, rather than just the proximal operator, isThe corresponding proximal gradient method update is . Small coordinates are set exactly to zero. When , the soft-thresholding operator is the identity and the proximal gradient mapping reduces to .
For necessity of the strict supporting-tangent property, convexity gives a nonnegative gap along a segment from to . If the gap at its other endpoint were zero, convexity of the gap and its zero initial value would force it to be zero all along the segment. That would make affine on this nontrivial segment, contrary to strict convexity. Conversely let with distinct endpoints. Apply the strict supporting inequality at to both endpoints, multiply by and , and add. The linear terms cancel, yielding strict convexity. ThusFor strict Jensen's inequality, put . The supporting gap is nonnegative everywhere and strictly positive where . That set has positive measure because is not almost everywhere constant. Its integral is therefore strictly positive. The linear term integrates to zero, giving the requested strict integral Jensen inequality.
The conditions on the cumulative distribution function imply almost surely. With , adjoin and the trivial . The random variables are nonnegative, adapted, and bounded by at each fixed time. Independence and giveThus this is the product martingale from independent mean-one factors, with . The almost sure supermartingale convergence theorem states that a nonnegative supermartingale converges almost surely to a finite integrable random variable. Applied to this nonnegative martingale, it shows almost surely. Every convergent real sequence is bounded, so almost surely.
The printed maximum can in fact be taken literally here. If almost surely, all products equal . Otherwise the strict Jensen equality criterion, applied to the strictly convex function on , gives . Independence yields . By Markov's inequality, for every . The First Borel-Cantelli lemma and the countable choices give almost surely. Since , a sequence with this limit attains its positive supremum among finitely many initial terms. This is an instance of fractional moment decay of independent mean-one products.
The fixed common temperature, rigid external container and fixed particle numbers on either side make the total Helmholtz free energy the appropriate thermodynamic potential. Let the barrier have cross-sectional area , and let increasing expand the left compartment. Then and . At fixed temperature and particle number, , soThus mechanical equilibrium, , makes stationary. The physical force on the barrier towards increasing is . If the barrier is displaced slightly from , strict mechanical stability requires a restoring force:ConsequentlyThe Taylor expansion proves that thermodynamic equilibrium is a strict local minimum of the Helmholtz free energy, rather than merely a stationary point.
For individually stable gases, the positive isothermal compressibilities make the sign especially transparent:If these inequalities hold throughout the accessible interval, is a strictly convex function and an interior stationary point is the unique global minimum of the Helmholtz free energy. Stability at one point alone proves only the local statement. A vanishing restoring derivative describes marginal stability and requires examining higher-order terms.
Apply the mean value theorem, the first-order case of Taylor's theorem, to between and . It yieldsAlso , so the initial point is to the right of the root . For an increasing strictly convex function, its tangent at a point to the right of a root meets the axis between that root and the point. Hence the exact Newton root-finding iteration remains in and decreases towards .
On every relevant interval, and , so the stated quadratic convergence bound gives, with ,Iterating the bound givesThus four Newton corrections suffice to reduce the exact-iteration error bound below the floating-point spacing scale. The quadratic convergence doubles the approximate number of correct digits at each late step. Beyond this point further corrections cannot reliably improve a generic floating-point answer. This is a bound on useful accuracy under the usual stable-evaluation model, not a claim that the data specify the exact iteration at which every implementation must stagnate.
For negative , the mean value theorem gives . In particular,Since is continuous and strictly increasing, it vanishes at exactly one point . The positive second derivative makes a strictly convex function on the entire real line. Its derivative changes from negative to positive at , so is the unique global minimum. One may also use to verify coercivity.
In the endpoint-bracketing form of golden-section search, begin with , a width-one interval known to contain this unique minimum, and place the two standard interior probes. The attainable position accuracy is different from that for a simple root. Around , Taylor's theorem givesHere the minimum value is nonzero and of order one: the lower quadratic bound gives , while . Ordinary relative round-off error in these function values therefore hides changes of order , once has that size. The function-value resolution near a nondegenerate minimum is consequently of orderEach golden-section search contraction multiplies the bracket width by . Using as the nominal target width givesUnknown evaluation-error constants can change the actual stopping point; is the standard scale-based count. Requiring position accuracy from these function-value comparisons would disregard the quadratic flatness of the minimum. The same precision effect is documented for one-dimensional numerical minimization.[ref]
One dimensional minimization in the GNU Scientific Library manual. Caveats: Taylor expansion near the minimizer and the square-root precision limit; Minimization Algorithms: golden-section contraction
Consider the minimization problemThe objective function is a strictly convex function with its unconstrained optimization minimum at . If , it decreases throughout the feasible set until the bound is reached. If , the feasible set already contains . HenceWith , the optimization Lagrangian and KKT conditions areSubstituting gives the unique inequality Lagrange multiplierFor , the active constraint has . For , there is strict slack and . At , the active constraint has zero Lagrange multiplier: the boundary happens to pass through the unconstrained optimum. Feasibility and complementary slackness must both be checked; solving only would allow infeasible candidates.
The same quadratic objective with active, just-touching and inactive upper bounds
. Details. An independent certificate follows by completing the square:The Lagrange dual function is a concave function of . Its maximum over occurs at and equals . Thus every case has an explicit lower bound attained by a feasible point; the KKT conditions provide a certificate that can be checked without searching all real numbers.
Relative entropy nonnegativity Created 2026-10-06 Updated 2026-10-14
For probability distributions , relative entropy satisfies , with equality exactly when . Thus truthful prediction uniquely minimizes expected log-loss whenever the comparison is well defined, explaining the strictly proper scoring rule property of the logarithmic scoring rule.
For a short proof with probability density functions and , set . Their integrals both equal one, givingThe strictly convex function is minimized only at , so equality means almost everywhere. Its value at zero is one by . Where , relative entropy is infinite; where both vanish, the contribution is zero. These conventions extend the argument beyond positive reference probability density functions.
Strict Jensen equality criterion 2026-10-25
Let be an integrable random variable taking values in an open interval . Suppose is a differentiable strictly convex function. Then its expected value has equality in Jensen's inequality exactly when is constant almost surely.
First lies in : at each finite endpoint, taking the expected value of the strictly positive distance to that endpoint gives a strictly positive distance for . A tangent affine function supports at , soStrict convexity forces for . Indeed, equality at another point would force the graph to coincide with its supporting line on the connecting line segment, contradicting strict convexity. Thereforeand the right side is zero exactly when almost surely.
The tangent affine function of is an integrable random variable, so has an integrable negative part. Thus is well defined, possibly , even if absolute integrability was not assumed. Equality to automatically excludes that infinite case.
Weighted logarithmic utility 2026-10-05
The utility sums logarithmic utilities over individual flows. Its first-order condition gives proportional fairness. Its negative is a strictly convex function on active flow rates, giving uniqueness of those rates on a convex set of feasible allocations.

