The multivariable chain rule gives, at ,
Sufficient conditions for a strict local minimum at are and .
At a stationary point, in every direction. Its second derivative is the quadratic form of the Hessian matrix. If
then completing the square gives
for every nonzero direction . The Hessian is therefore positive definite, and the stationary point is a strict local minimum.
The power supplied to overcome drag equals the viscous dissipation:
For a nonzero rigid translation the strain cannot vanish throughout a fluid at rest at infinity, so the integral is strictly positive. Since ,
Thus the symmetric resistance matrix is positive definite.
Fix and write
The matrix is positive definite. Applying the Sherman–Morrison formula to yields
Because is a real symmetric positive-definite matrix, the finite-dimensional spectral theorem supplies an orthonormal eigenbasis with
Its eigendecomposition is also its singular value decomposition. If , then
so
The operator norms satisfy and . Therefore the worst-case relative perturbation bound is
The ratio is the spectral condition number of a positive-definite matrix. A large ratio means that data noise aligned with an eigenvector for the smallest eigenvalue is strongly amplified, so the inverse problem is ill conditioned.
If , the defining equation becomes , so .
A map is firmly nonexpansive in the -inner product when
Put and . The two implicit equations give
Because is a monotone operator,
Therefore
which is precisely firm nonexpansiveness. In particular, the preconditioned proximal point algorithm map is nonexpansive in the norm induced by the positive-definite matrix .
Assume with , with , and . The natural energy space is the Sobolev space . Multiplying
by and using integration by parts gives the weak formulation
where
The form is bounded, and the Poincaré inequality together with makes it coercive:
The functional is bounded by the Cauchy-Schwarz inequality. The Lax-Milgram theorem therefore gives a unique weak solution.
Define the energy
If is the weak solution, then for every ,
Thus is the unique minimizer of . Conversely, differentiating at recovers , so the minimization and weak problems are equivalent.
The Ritz method chooses a finite-dimensional conforming space and minimizes over . Its minimizer satisfies
For a basis this becomes , with
Coercivity makes the stiffness matrix symmetric positive definite, so the discrete minimizer exists and is unique.
Subtracting the continuous and discrete equations gives Galerkin orthogonality,
In the energy norm , for any ,
After cancellation and minimization over , this proves the sharp symmetric form of the Céa lemma:
For a mesh , take to be the continuous functions that are affine on each interval and vanish at the endpoints. The interior piecewise-linear hat functions form a basis, and each overlaps only its two neighbours, so is symmetric tridiagonal. In the illustrative case and on a uniform mesh, its diagonal and neighbouring entries are
If , its nodal interpolant satisfies . The best-approximation estimate therefore gives , and a standard duality argument improves the error to under the corresponding elliptic regularity. This completes the route from the boundary-value problem through its variational principle to a sparse, stable finite-element approximation.
Condition on the information available before time . The current wealth is then fixed, while is independent of that information. Put
For any portfolio , use the inner product induced by the positive-definite matrix to write
The linear image of a multivariate normal vector shows that the two portfolio returns are jointly normal, and
Thus independence of uncorrelated jointly normal variables makes the residual return independent of the aligned return; it also has expected value zero.
The continuation value is concave by part (c). Conditional Jensen inequality therefore shows that adding the independent centered residual cannot improve the objective:
where . Since the optimal portfolio is unique, its residual must be zero.
It remains to determine the sign. If , the portfolios and have the same return variance, namely , while their means are and . The latter return has the distribution of the former plus the positive constant . Since is increasing, replacing by cannot reduce the objective, contradicting uniqueness. Hence .
Applying this conditional argument at every time gives nonnegative, past-measurable random variables such that
This is the Gaussian one-fund theorem.
For
the gradient is . The steepest descent method with exact line search for a positive-definite quadratic therefore uses
For and , the minimizer is . Put
Starting from , direct substitution gives and, inductively,
The Euclidean norm is unchanged by the alternating sign, so
For a positive-definite matrix, the spectral condition number of a positive-definite matrix is
Here , and hence
The conjugate gradient method starts with and updates
By finite termination of the conjugate gradient method, it reaches the exact solution in at most the number of distinct eigenvalues. This matrix has two, so at most
are required in exact arithmetic.
Suppose a feature map represented the Gaussian kernel. Choose , a unit vector , and points for . Their kernel matrix is
For sufficiently large , hence sufficiently small , every row satisfies
Thus is a symmetric strictly diagonally dominant matrix with positive diagonal and is therefore a positive-definite matrix, so .
On the other hand, if is the matrix whose th row is , then and , a contradiction. Hence every feature-space realization of the Gaussian kernel requires an infinite-dimensional vector space.
The differential of the log-determinant is . The subdifferential of the entrywise norm consists of symmetric matrices with
The Karush-Kuhn-Tucker conditions for the Graphical Lasso are therefore
Because is strictly convex on the positive-definite matrices, these conditions characterize the unique minimizer whenever it exists.
At , the diagonal entries of are , while every off-diagonal entry is
Hence is exactly the Coxeter Gram matrix , and part c gives
For a Finite Coxeter group the Gram matrix is positive definite, and for a Hyperbolic Coxeter group it is nondegenerate with Lorentzian signature. In either case , so is not an eigenvalue of and the Coxeter element fixes no nonzero vector.
For an Affine Coxeter group, the Gram form has a nonzero radical. If , then for every , and every generating reflection satisfies
Their product therefore fixes . Thus every affine Coxeter element has a nonzero fixed vector.
For an unconstrained differentiable function of two real variables, an interior local minimum must solve the simultaneous stationary point equations
Apply Newton's method in optimization to this gradient equation. The Jacobian matrix of the gradient is the Hessian matrix
At , solve the linear system , then set . When the Hessian matrix is invertible, this is
This follows by setting the first order Taylor expansion equal to zero. Solving the linear system avoids explicitly computing a matrix inverse. A stationary point need not be a local minimum: for example, a positive-definite matrix suffices to classify a stationary point as a strict local minimum, whereas an indefinite Hessian matrix identifies a saddle point of a scalar function.
The gradient and constant Hessian matrix are
At , and . Hence one multivariable Newton iteration gives
At this point the gradient vanishes, so every subsequent iterate is . The one-step result follows because the gradient of a quadratic polynomial is affine and its linearization is exact. Since the leading principal minors of are and , it is a positive-definite matrix. Alternatively,
directly proves that is the unique global minimum, with value .
The partial derivatives are and , so all stationary points are for integers . Their Hessian matrix is . At even multiples of it is a positive-definite matrix, whereas at odd multiples it has one positive and one negative eigenvalue. Consequently
There are no local maxima. Since both and are nonnegative, these are also global minima. In the requested open plotting window, the stationary points are and ; the local minima at lie on excluded edges.
For a level set , solving for the vertical coordinate gives
For these level sets are closed ovals around each local minimum. At the level sets shrink to the local minima. The level set through the saddle points is
where the two signed branches together describe the same set as . They cross at and reach . The crossing slopes at a saddle point are , as also follows from the local quadratic form . For , the upper and lower level sets remain separate and extend across the plotting window without meeting the horizontal axis.
Figure 1.
Contours of the cosine-plus-quadratic function, with its saddle level and stationary points labelled
. Details.
The first partial derivatives factor as
If either coordinate vanishes, the other equation forces the other coordinate to vanish as well. If both are nonzero, subtracting the two bracket equations gives , and then . Thus the complete list of stationary points is and the four points .
The Hessian matrix is
At the origin it is , which is a positive-definite matrix. At the four other points its eigenvalues are and , independently of the signs. The second-derivative test therefore gives
There are no local maxima. The minimum at the origin is not global, since as .
The Hessian matrix is
At each nonzero stationary point, its diagonal entries are and the off-diagonal entries are . Its eigenvalues are and , both positive. Thus the Hessian matrix is positive definite, and the second-derivative test proves that
Their common value is . In fact they are global minima: with , the arithmetic-geometric mean inequality gives , so
The last one-variable polynomial attains its minimum at , and equality in the first bound requires , precisely the four points above.
Near a nonzero stationary point , Taylor expansion of the gradient gives . Since the Hessian matrix is positive definite, for sufficiently small nonzero . Thus the gradient arrows point away from each of the four local minima, with different strengths in the two eigenvector directions.
At the origin, on the -axis the gradient is and on the -axis it is , so arrows point outward. On the gradient is , and on it is , so arrows point toward the origin for small . Away from the axes the leading terms are , pointing inward in both coordinate signs. The narrow outward sectors close to the axes are visible in the exact vector field.
Figure 1.
Gradient directions near all five stationary points
. Arrows show normalized gradient directions, not the direction of descent. They point outward near the four minima, while the degenerate origin has outward axis directions and inward diagonal directions. Details.
Set . The equilibrium equations cancel the constant gravitational and elastic terms, leaving the small-oscillation mass and stiffness matrices
The off-diagonal mass terms arise because rope-length coordinates are not absolute climber displacements. For any nonzero velocity vector, , so is a positive-definite matrix.
Within the vertical Hookean model, the displacement equations are exactly linear while all ropes stay taut. Small amplitudes ensure that none reaches the slack regime .
Complete the square in the Hermitian matrix polynomial:
For every nonzero vector ,
Thus is a positive-definite matrix, so . In finite-dimensional spectral theorem terms, each eigenvalue is
If , the scalar polynomial has real roots of a polynomial
An allowed nonzero root can be an eigenvalue of , a Hermitian matrix which is also an invertible matrix, in which case has a zero eigenvalue. For example, , , gives . The weaker inequality does not force failure for every ; it removes the general positive lower bound. There is also the harmless corner , for which stays positive definite because is invertible, even though the strict discriminant hypothesis is absent.
On , , so and therefore . Yet and . The same continuous image of a connected space argument shows that is not connected.
Put . The required three disjoint nonempty open sets are
Their union is precisely , the complement of the double cone . The eigenvalues are , so consists of positive-definite matrices above the upper sheet, of negative-definite matrices below the lower sheet, and of indefinite matrices outside the double cone. Examples are respectively.
The two definite cones are convex sets. The indefinite region is path-connected: shrink continuously to zero while keeping , then change the nonzero vector within the punctured plane. Thus these sets are also exactly the three connected components. This is the determinant cone for real symmetric two-by-two matrices.
Figure 1.
The determinant-zero cone separates three components of invertible symmetric matrices
. The left panel shows the double cone. The right panel is a radial section: the exterior indefinite region is connected around the cone in three dimensions, although its two sides appear separated in this section. Details.