A norm is nonnegative with exactly when , satisfies , and obeys . The Euclidean norm has positivity and absolute homogeneity immediately. For the triangle inequality, positivity of for all real gives the Cauchy-Schwarz inequality (with immediate). Hence
which proves the triangle inequality after taking square roots.
For the prescribed set, use the Minkowski functional
Since is open and contains zero, some Euclidean ball of radius lies inside it. Since it is bounded, it lies inside a ball of radius . These inclusions imply , so the functional is finite and positive for nonzero ; it is zero at zero. Symmetry gives , and substitution in the infimum gives for , hence absolute homogeneity for all real scalars.
Convexity and imply for . Consequently, for and , one has . Convexity then gives
so . Letting and proves the triangle inequality.
Finally, if , there is a with . Conversely, if and , openness permits for some , so ; zero is immediate. Thus , completing the norm from a bounded symmetric convex neighbourhood construction.
For and nonempty , let
The Talagrand convex distance is
Equivalently,
For completeness, let be a closest point of the finite convex hull to zero. If , minimality gives for every . Taking proves that the supremum is at least . Conversely each permitted has by Cauchy-Schwarz. The weights are nonnegative because the hull has nonnegative coordinates. If , both sides are zero. This proves the dual definition used below.
We prove Talagrand's convex distance inequality by induction on the number of factors. Write , with measure , and . For a last-coordinate value , let . Choose a section of largest probability , and put . The total event probability is .
If has positive probability, combine mismatch vectors from and from . A weight on the second section contributes at most in the last coordinate. Convexity of the squared Euclidean norm gives, for every ,
The last-coordinate contribution is actually zero if , so the displayed upper bound remains valid. Hölder's inequality and the induction hypothesis yield
For a zero-probability section use directly, so no division by zero or exponent of an infinite quantity is needed.
The scalar estimate for Talagrand product induction is
Here is its proof. For set . If , take ; the logarithm of the left expression is . Put . Then and
since for . Thus . If , choose . The already proved boundary case gives . The same direct choice covers .
Average the resulting section bounds over :
where the last inequality is equivalent to . The induction starts on the zero-coordinate singleton, where every positive-probability event is the whole space and the moment is one. Hence
We assume ; a zero-probability event has no finite right-hand bound to prove. Markov's inequality also gives
For the subsequence application, let be the longest increasing subsequence length for independent sequence coordinates. A witness of length uses only positions. If and satisfies , at least witness positions must change: all unchanged witness positions remain in increasing order. Put weights on the witness and zero elsewhere. The dual distance definition gives
where the latter expression increases with for . Therefore the increasing-subsequence certificate concentration bound is
If the lower event has probability zero the conclusion is immediate.
Let be an integer median, so . Taking the two thresholds in the bound gives, for ,
For the lower event is empty. In a nonempty sequence . Integration of these tails gives an explicit mean-median estimate: use for and for , obtaining
Writing , the median property also gives . Consequently, for a universal constant , all satisfy
Thus the subsequence length is concentrated near its mean on the scale , rather than the generic coordinate-exposure scale . This argument applies directly to finite-valued independent sequences. Independent continuous samples follow by refining finite coordinate discretizations; the strict-order pattern stabilizes almost surely when ties have probability zero. A uniform random permutation is the rank sequence of independent continuous samples, so it has the same subsequence-length concentration. Arbitrarily dependent random sequences are not covered by the product-space assumption.
Suppose two distinct minimizers have the same minimum distance from . Convexity puts their midpoint in . Expanding the Euclidean norm gives
contradicting minimality. Therefore the nearest point is unique. Together with the preceding existence proof, this defines the metric projection onto a nonempty closed convex set.
If the roots are parallel, their Euclidean norms are equal by reducedness. For nonparallel, nonorthogonal roots, the Cartan integers above are nonzero integers of the same sign and have product or . Also
The absolute pairs are , , or . Hence
More precisely, angles require equal lengths; angles require a long-to-short ratio ; and angles require a ratio . The exclusion of orthogonality matters: orthogonal irreducible components can be scaled independently.
For the sample, put and use the sample covariance matrix
Order its eigenvalues decreasingly and choose unit orthogonal eigenvectors . The sample principal components are the score columns
Their sample means are zero and their sample covariance is diagonal, since . The th sample variance is , and its explained variance of a principal component is . Using divisor instead changes the numerical variances by a common factor but leaves the component directions unchanged.
Standardizing means replacing a variable with positive sample variance by . This gives principal component analysis on a correlation matrix, using with . It removes arbitrary differences of measurement units and prevents a large-variance coordinate from dominating solely through its scale. It also changes the question being optimized: small-variance and possibly noisy coordinates receive equal marginal weight. Principal component analysis based on the covariance matrix can be more appropriate when the variables have common meaningful units and absolute variability matters. Standardization is therefore a substantive choice, not an automatic improvement. A zero-variance variable must first be removed. In the word-rating example the variables share the same numerical range, but their across-word dispersions can differ; standardization gives each attribute equal initial variance.
For the standardized eight-variable analysis, total variance is . The first three fractions of explained variance of a principal component are approximately 59.6%, 19.1% and 10.1%, respectively. The first two account for about 78.8%, and the first three for 88.9%. The first direction is dominant but one direction alone loses substantial variation. Retaining two principal components is a plausible descriptive summary: their eigenvalues exceed , whereas the third is below . That cutoff is a heuristic, and the third principal component may still have interpretable content.
The reported coefficient rows are not unit-length vectors. The printed rounded rows have squared lengths , and , consistent with their eigenvalues to the precision of the coefficient table. They are consistent with the scaled principal component loading convention . Such rows remain eigenvectors, but the score direction with unit length is , or more accurately the row divided by its actual Euclidean norm when using rounded entries. Under this convention is the correlation of standardized attribute with the variance-one score for component :
This explains both their sizes and why they must not be treated as the unit vectors from parts (i) and (ii).
The first principal component has positive coefficients on every attribute, strongest on friendliness, goodness, niceness, bravery and strength. With the favorable endpoints coded in the positive direction, it describes a broad favorable or impressive evaluation, with a potency contribution. The second contrasts movement and speed, with some size and strength, against the first three evaluative attributes; it is chiefly an activity dimension. The third is dominated by size, with smaller positive strength and negative movement/speed coefficients, distinguishing size or potency from activity. These are interpretations of directions of variation, not evidence of causal latent traits. Reversing a principal component's overall sign changes neither its meaning as an axis nor its explained variance; endpoint coding fixes only how its positive side is described.
Take the norm to be the Euclidean norm. The solution is , so optimal growth is the operator norm , equivalently the largest singular value of the matrix exponential. Let be the spectral abscissa and let be the numerical abscissa. The Euclidean semigroup growth bounds are
For the lower bound, the spectral radius of is and is bounded by its operator norm. For the upper bound, differentiating gives , and integration gives the result. A non-normal matrix can have , allowing transient amplification even when all its eigenvalues have negative real parts.
For the triangular matrix, . The eigenvalues of its Hermitian part are , so
The upper exponent becomes positive when , even though the long-time spectrum is stable.
The two equations are and . Solve the first, then use an integrating factor in the second. Writing , , and gives
The maximizing initial state is the unit eigenvector of belonging to its largest eigenvalue. Here
For , define
The optimal initial state for triangular stable shear is therefore
Multiplication by any nonzero complex scalar gives the same growth ratio; at , every nonzero initial state is optimal.
For , and . Thus the optimal initial state tends to , and . The initial first component excites the slower eigenmode and its amplified second component.
For , the exact expression gives . Accordingly the short-relative-time optimal state for triangular shear uses
This retains both the unequal damping rates and the shear. If , it reduces to , the maximizing direction for the shear matrix . If time also tends to zero at fixed , it instead tends to , the largest-eigenvalue direction of the Hermitian part of . Merely setting small does not justify setting small; the exact formula resolves both possibilities.
The gradient of is . On the upper cone, its Euclidean norm is . Thus the upward unit normal to an upper circular cone is
Put and . The hypotheses imply and . The Cauchy-Schwarz inequality therefore gives
This is also a direct instance of self-duality of a second-order cone: both and the chosen unit normal belong to the closed Lorentz cone.
For , the squared Euclidean norm of the orthogonal projection residual is nonnegative:
This proves the Cauchy-Schwarz inequality . Equality holds exactly when is a scalar multiple of . If , equality is automatic. Equivalently, equality means the two vectors are linearly dependent, including the cases with a zero vector.
For a point equidistant from the coordinate vertices,
must be independent of . Thus all are equal, and their sum is one. The centroid is therefore
For every in the base probability simplex, the Cauchy-Schwarz inequality gives . Equality forces the same coordinates as . Thus is the unique closest point of a probability simplex to the origin.
The angle between and any edge from the origin to satisfies
Consequently
False. Consider the real matrix
It is block upper triangular, so its characteristic polynomial is the same as that of and it has the required eigenvalues. Its second column, however, has squared Euclidean norm , whereas every column of an orthogonal matrix has norm one. Thus
Unit-modulus eigenvalues alone do not imply orthogonality; they do not control the geometry of the eigenvectors.
A full QR decomposition of a real by matrix with writes
where is an orthogonal by matrix and is upper triangular by . In the full-column-rank case is invertible. Equivalently the reduced factorization is with . Householder transformations can construct the full factorization.
Let with . Since orthogonal transformations preserve the Euclidean norm,
Therefore the linear least-squares problem has the full-rank solution
Back substitution solves this triangular system without forming . If the matrix is rank deficient, use a rank-revealing pivoted factorization and minimize over its independent columns; the minimizer need not be unique. The original PDF minimizes over ; the converted TeX's minimization over is a transcription error.
Uniqueness in law means that, for a fixed initial value, every two weak stochastic solutions of the stochastic differential equation have the same distribution as entire solution paths, even if their filtered probability spaces and driving Brownian motions differ. For an equation on , initially consider the stopped path and lifetime at the boundary.
We first justify that the boundary cannot intervene when . For any solution of the displayed Bessel equation, let be its first exit from , where . Applying Itô to gives
Thus the annulus exit has finite expectation and is almost surely finite. The one-dimensional generator is . Its harmonic scale functions are for and for , as direct differentiation verifies. They are bounded on the stopped annulus, so optional sampling gives
Both tend to zero as . A continuous path hitting zero before would hit every inner level first, so that event has probability zero. Exhausting the upper levels proves that zero is not hit at any finite time. Nor can an upper explosion occur: localization of gives . These are the Hitting-zero classification for a Bessel process arguments needed for the dimension-at-least-two case.
Now suppose is an integer and take a -dimensional Brownian motion from any deterministic vector with . For , differentiation of the Euclidean norm gives
Define the radial noise , filling the integrand by a fixed unit vector on the zero set, as in part (b). It has bracket and is a Brownian motion. the Itô formula, initially before a possible zero, gives
The boundary argument just given makes this a global positive weak stochastic solution. The assumed uniqueness in law therefore identifies every solution's path law with that of . Orthogonal invariance of Brownian motion makes this radial law independent of the selected point on the sphere. Consequently
This proves equality of process laws, not merely equality of one-time marginal distributions.
Differentiability at means there is a linear map such that
This is the Fréchet derivative definition; the same linear approximation must work in every direction, not merely along coordinate axes.
The chain rule says that if is differentiable at and is differentiable at , then is differentiable at and
For its proof, put , , and . Since a linear map between these finite-dimensional normed spaces is bounded, . Differentiability of gives with . Therefore
If , take ; otherwise . This proves the required full linear approximation.
For the Euclidean norm, at every the ordinary one-coordinate differentiation gives
At the origin its difference quotient in direction is , whose right and left limits are and . Thus none of its coordinate partial derivatives exists at the origin.
In the truncated tensor algebra, let be the linear span of all iterated Lie brackets of elements of of length at most , with bracket . Brackets of length greater than vanish. The free step-N nilpotent Lie group is
The exponential and logarithm are the finite series
Its multiplication is the tensor multiplication above, its identity is , and its inverse is
The truncated Baker--Campbell--Hausdorff formula shows that this multiplication stays in the exponential of the Lie algebra. This is the connected simply connected Lie group of the free step- nilpotent Lie algebra, rather than a discrete free nilpotent group.
Give the first layer its usual Euclidean norm. An absolutely continuous curve in is horizontal if
for an absolutely continuous control in . In the truncated tensor algebra this equation is , truncated at degree . Its horizontal length is . The Carnot-Carathéodory distance is
The first-layer Lie brackets span the full Lie algebra, so horizontal curves reach every endpoint. Thus this infimum is finite; it is a left-invariant distance inducing the usual manifold topology. Dilations give for . Equivalently is the least length of a bounded variation control whose step- path signature is .
For set . A weak geometric p-rough path is a continuous path , usually based at , with
Its increments obey . Equivalently their degree- tensor components have finite -variation and satisfy the path signature algebraic constraints. This is a group-valued definition; being a limit of smooth path signatures in the same -variation topology is the stronger definition of a geometric p-rough path.
For a real skew-symmetric matrix, . A scalar quadratic form satisfies , so it is zero. Therefore
The finite-dimensional linear system has the global solution . Equivalently, , so its exact flow is an orthogonal matrix and preserves the Euclidean norm.
The Runge-Kutta method has update . Expanding its squared Euclidean norm gives the exact identity
The stated per-step relation makes this difference zero. Induction from the initial vector then proves
For a positive step size the relation is also necessary for exact per-step norm conservation. This algebraic identity applies whenever the stage equations define a step; it does not silently assume solvability of arbitrary implicit stages.
Two norms are Lipschitz equivalent norms when constants satisfy for every vector . Applying these inequalities to shows that a sequence is a Cauchy sequence for one norm exactly when it is so for the other; applying them to likewise equates convergence. If one norm is complete, a Cauchy sequence for the other converges using the first norm and hence also the second. Interchanging the norms proves completeness is preserved in both directions.
Write and set . If , then , and the triangle inequality gives
Scaling a nonzero gives for every . The reverse triangle inequality now implies
so is continuous, indeed Lipschitz, in the Euclidean norm.
Suppose there were no positive lower bound on the Euclidean unit sphere. We could choose with but . The Bolzano-Weierstrass theorem supplies a subsequence converging in the Euclidean norm to . Continuity of both norms gives and , contradicting definiteness. Therefore some satisfies on the unit sphere. Scaling again proves the finite-dimensional equivalence of norms:
Use geometrized units . For a stationary asymptotically flat spacetime, normalize the timelike Killing vector field to have squared norm at infinity. The Komar mass is
Here the oriented binormal is chosen so that an ordinary positive-mass static solution gives a positive integral. Equivalently, on a static slice with lapse and outward spatial unit normal ,
This second expression fixes the orientation unambiguously and is convenient for the Majumdar–Papapetrou solution.
The spatial metric is and . On a large coordinate sphere, and . Thus
The original PDF has the Euclidean norm in each source denominator, which is missing in the TeX aid. With that norm, the harmonic function has asymptotics
Therefore
If are retained as length parameters while is restored, the physical mass is . This is the charge at infinity. A Komar integral is not generally surface-independent here, since Einstein-Maxwell theory has the electromagnetic stress-energy tensor between the surfaces; in particular it should not be confused with a sum of vacuum horizon Komar charges.
Write for the observed response and for column of the working design matrix . The usual LARS convention gives every covariate unit Euclidean norm. If an unpenalized intercept is fitted separately, first centre and the nonconstant covariates, and restore the intercept afterward. For an intercept-free model no centring is required. The algebra below also applies to an unscaled full-rank design; only the literal equal-angle interpretation uses unit-length columns. The penalty is defined on the regression coefficients of whichever working design is used, since rescaling covariates changes the units of an L1 penalty.
Initialize , and residual . At iteration , let
These are residual inner products, often called residual correlations. If , all normal equations are satisfied and the path has reached ordinary least squares. Otherwise the active set consists of the selected columns tied at the maximal absolute correlation. Initially select the maximizing column, or all such columns in a tie. Ordinary least angle regression retains previously selected columns and adds each new one when it ties the active correlations. Put for active .
To define the direction, form the signed active design and its Gram matrix . Full column rank makes this matrix positive-definite. Let denote the vector of ones of length , and set
Then and . This is the equiangular direction in least angle regression. Define for every covariate, and define the regression coefficient direction by on , zero otherwise. It satisfies .
Along the line , residual correlations are . For an active index these equal , so all active absolute correlations decrease together until level zero at . An inactive covariate first joins when its correlation equals either sign of the common level. Solving these two equalities gives
Here means the smallest finite strictly positive candidate; zero denominators do not produce a future entry, and an empty candidate set has minimum . Candidates beyond the zero-correlation endpoint are capped by that endpoint. Take
At an entry add the newly tied covariate, or all simultaneous ties, and recompute the direction. Once all covariates are active there is no inactive candidate: the final move is to correlation level zero and the full least-squares fit. These definitions specify every term in the stated step formula and the entry knot in least angle regression.
For definiteness use the following penalty normalization for the Lasso estimator:
Full column rank makes the criterion strictly convex, so the minimizer is unique. With the alternative squared-error normalization , the penalty parameter is divided by . The Karush-Kuhn-Tucker conditions for the Lasso in the chosen normalization are
Hence the zero vector is the solution for every . Along a sign-compatible least-angle segment the corresponding penalty is . Active correlation equalities and inactive bounds satisfy the KKT conditions exactly while each nonzero regression coefficient retains the sign . Ordinary LARS can let a regression coefficient cross zero while its correlation sign stays unchanged; continuing past that crossing would violate the KKT conditions.
The required modification is therefore to monitor regression coefficient zero crossings. Along , define the Lasso dropout knot
with ignored and the empty minimum again . Stop at
If a nonzero active regression coefficient reaches zero before the next entry, remove it from the active direction and recompute; the fitted value is continuous at this event. If entry comes first, add that covariate as before. A removed covariate is allowed to re-enter later, so the active set need not increase monotonically. The interior of a segment represents all penalty values through , rather than just the estimates at its knots.
For complete treatment of simultaneous events, full column rank alone does not imply that entries and dropouts occur singly. At a knot with positive level , let , be those correlation signs, and . The KKT-consistent resolution of tied Lasso knots chooses the next tangent by
This strictly convex quadratic program has a unique minimizer. For nonzero or newly entering coordinates its stationarity gives ; for tied zero coordinates kept out, . Thus for a small decrease of the penalty, has the correct regression coefficient signs, active residual scores , and inactive scores within . Strictly inactive coordinates remain feasible by continuity. Choose the resulting support for the next segment and normalize ; this reduces to the preceding equiangular formulas. It handles ties, including a newly tied zero regression coefficient whose unconstrained direction would point against its correlation sign, without perturbing the data.
At each successive event update the support in this manner and continue down to . Between knots the regression coefficients are linear in and satisfy the sufficient KKT conditions. For a fixed support and sign vector , the equalities give ; all sign and inactive-score constraints are linear inequalities in . Each support/sign pattern therefore has an interval of validity, and there are only finitely many such patterns, so the complete path has finitely many linear segments. Together with the initial zero solution for , these interpolated segments give
Use the Euclidean norm and its induced operator norm. The spectral theorem for real symmetric matrices gives and . If , then the direct inverse has error , so
For nonzero , the relation also gives
This is the spectral condition number of a positive-definite matrix. The worst relative amplification is attained by exact data along an eigenvector for and noise along one for . A large therefore makes the reconstruction sensitive to relative data errors. Absolute sensitivity additionally depends on itself: scaling every eigenvalue equally leaves unchanged but changes . Since the matrix is finite dimensional and positive definite, the inverse exists and is continuous; the issue is ill-conditioning rather than mathematical nonexistence or discontinuity.
An orthogonal matrix satisfies , so it preserves the Euclidean norm. For a nonzero real eigenvector ,
Therefore . Geometrically, eigenvalue fixes every vector on the linear span of ; eigenvalue reverses every vector on that line. In either case the line is preserved as a set.
For , solving gives , , . For , the equations are and , hence . For , let and , so that . Then is equivalent to . The resulting eigenspaces and their bases are
Solving all the equations shows that these lists contain the maximum possible numbers of independent eigenvectors with eigenvalue .
The columns of form an orthonormal basis, so is an orthogonal matrix. Also . Its fixed axis is the line through , and on the perpendicular plane it acts as a two-dimensional rotation. If denotes the rotation angle, its matrix trace is . Since , we obtain . To fix the orientation relative to , note that and
The component of perpendicular to has squared length , and this scalar triple product equals . Hence . Thus
Equivalently, its unsigned angle is , or its positive angle is about the opposite oriented axis.
For , the reflection in a hyperplane formula gives
It fixes the plane pointwise and maps to , so . These actions also show that is an orthogonal matrix. In contrast, the second column of has squared length , so is not orthogonal and cannot represent either of these Euclidean motions.
A diagonalizable matrix must have a basis of eigenvectors over the field in question. For , a direct determinant computation gives . Its eigenvalues are , where . Only one is real, with one-dimensional eigenspace, so is not diagonalizable over . Over the three eigenvalues are distinct, and the vectors for give an eigenbasis. The upper triangular matrix has only eigenvalue , of algebraic multiplicity , but its eigenspace has dimension over either field. Hence is not diagonalizable over either field. For , the two real plane vectors displayed above, together with , form an eigenbasis, with eigenvalues . They remain independent over . Therefore