Orient the axis towards and measure positive angles by the right-hand rule about . The vectors , and form a positively oriented orthonormal basis, since . Its change-of-basis matrix is
Relative to this basis, the rotation fixes the first coordinate and rotates the last two. Writing and , its matrix in the standard basis is therefore
In particular , , and , verifying the axis and the direction of rotation. Reversing the chosen orientation of the axis replaces by .
In an oriented orthonormal coordinate system, the dot product and cross product are
The scalar triple product is ; equivalently it is the determinant of the matrix whose columns are . The three vectors have linear independence when
Let and be column matrices. Since , we have . Multiplicativity of the determinant and its invariance under matrix transpose yield
A square matrix has maximal matrix rank exactly when its determinant is nonzero, equivalently when its columns have linear independence. A product of two real numbers is nonzero exactly when both factors are nonzero. Hence .
The same argument works in every dimension. Set and . Then
so .
For the last construction, choose two standard basis vectors in and take for . If with , its first two coordinates give and , hence . Every pair therefore has linear independence. Every triple lies in the two-dimensional linear span of and has linear dependence. More explicitly, for distinct ,
a nontrivial dependence. Thus .
If spans and has elements but is linearly dependent, a nontrivial linear combination equal to zero lets us remove one member without changing the span. This produces spanning vectors, whereas the standard basis contains linearly independent vectors, contradicting the Steinitz exchange lemma. Therefore . Together the three deductions establish that any two of the three properties imply the third. For , the only independent or zero-element family is the empty basis, and the same conclusions hold.
Relative to the given basis , the proposed vectors are the columns of
The determinant is nonzero exactly when the columns form a basis. Thus . At the vectors coincide, and at they are negatives of one another.
If is linearly independent and has elements, apply the Steinitz exchange lemma with as the independent family and the standard basis as the spanning family. All members of the standard basis are replaced, leaving itself spanning. Thus , so is a basis.
The Steinitz exchange lemma says that if span a vector space and are linearly independent, then , and after reordering the , the family still spans. Here is a proof. Suppose the first replacements have been made. Express in that spanning family. Some coefficient of a remaining must be nonzero, since otherwise belongs to the span of , contrary to linear independence. Solve for that and replace it by ; this preserves spanning. If , the first replacements leave a spanning family , contradicting linear independence of the first vectors. This proves both assertions.
Now suppose is linearly independent and spans . Express each member of the standard basis using finitely many members of , and let be the finite union of those members. Then spans. No element of can exist, since it would be a linear combination of and violate linear independence. Thus is finite. Applying the Steinitz exchange lemma in both directions to and the standard basis gives and . Hence .
Suppose in the capped simplex has a coordinate strictly between zero and one. Since is an integer, it cannot have exactly one such coordinate: the other coordinates would contribute an integer sum. Hence there are distinct with .
Choose and set , where are standard basis vectors. Both perturbed vectors satisfy the coordinate bounds and have the same coordinate sum. They are distinct and , so is not an extreme point.
Conversely, every zero-one vector in this convex polytope is an extreme point. If it were a nontrivial convex combination of two feasible vectors, each coordinate equal to zero would force both corresponding coordinates to be zero, and each coordinate equal to one would force both to be one. Thus the two vectors would equal the original one. The extreme points are therefore exactly the indicators of -element subsets.
For algebraic stability, the weights must be nonnegative and the real symmetric matrix , where , must be a positive semidefinite matrix.
The weights are positive, but and , so
A positive semidefinite matrix cannot have a negative diagonal entry, as its quadratic form at the first standard basis vector would be negative. Thus this Lobatto IIIA method is not algebraically stable, despite its A-stability.
Choose the rotation taking to , to and to itself. The columns of the matrix of a linear map are these images of the standard basis, so
This fixes the orientation used throughout this question.
The straight line has direction vector , so take the unit vector . A half-turn has and . The preceding rotation formula becomes
Thus the rotation matrix in the standard basis is
It fixes and negates every vector in its orthogonal complement, which also checks the half-turn geometrically.
For the specified standard basis vectors, , so
On the other hand, and hence
These results are unequal, proving that the cross product does not satisfy the associative property.
The integrand is positive, so the minimum-variance importance distribution is its target-weighted probability density function, normalized by :
By completing the square,
Thus is the multivariate normal distribution , where is the first standard basis vector. Its importance weight and weighted integrand are
A variance cannot be negative, and this proposal makes every summand constant, proving optimality directly. It is admissible under the arbitrary-proposal condition even though its mean vector is not zero. Although optimal proposals usually involve an unknown normalizing integral, here both that integral and the resulting normal distribution are explicit.
Associativity of matrix multiplication identifies . Thus each matrix has the required action and .
Consequently for every . Taking successively as the standard basis vectors shows that every column of this difference is zero. Hence . Equality on one selected vector would not suffice; here it holds on all vectors.
Left multiplication by interchanges rows three and four; applying it twice restores every row. Equivalently, it sends the standard basis vectors to each other and fixes , so its square fixes a basis. .
Write and , where are the standard basis vectors. Since ,
Thus the columns of form an eigenbasis, and the requested ordered basis is . Its basis matrix is , giving . More completely, for each distinct eigenvalue , its eigenspace is
All nonzero vectors in these eigenspaces are eigenvectors; when an eigenvalue repeats, they need not be individual columns of .
If , then the dot product satisfies
Conversely, the assumed dot product identity gives for every . Take and from the standard basis: every entry of is zero. Hence , proving the equivalence.
Proof. For a skew-symmetric matrix, the scalar equals its transpose , so it vanishes. Conversely, substituting standard basis vectors into the vanishing quadratic form gives . Substituting gives . Thus . In particular, a real quadratic form depends only on a matrix's symmetric part.
Row rank Created 2026-10-14 Updated 2026-10-18
The row rank of a matrix is the dimension of the vector space spanned by its rows. Elementary row operations preserve this row space; multiplication on the right by an invertible matrix preserves all linear relations among the rows.
To see why row rank equals column rank, write a reduced row echelon form as , where is a product of elementary matrices and is an invertible matrix. Reversibility of the row operations gives equal row spaces for and . Also if and only if , so the columns have exactly the same linear relations. If has nonzero rows, its pivot columns are the first standard basis vectors of and span its column space. Its nonzero rows are linearly independent, since their matrix entries in the pivot positions form an identity matrix. Both dimensions therefore equal , and both counts transfer back to .
Sherman–Morrison formula Created 2026-09-24 Updated 2026-10-14
The Sherman–Morrison formula computes the matrix inverse after a rank-one matrix update. If is an invertible matrix and , then
The inverse correction is itself an outer product, divided by the scalar . The matrix determinant lemma shows that the nonzero-denominator condition is exactly the condition that the updated matrix remains an invertible matrix.
For , , and , we have . Thus the computed inverse is
Multiplication in either order gives the identity matrix. The result reuses the original inverse and the same correction vectors, rather than solving independently for all four inverse entries.
Often only the solution of an updated linear system is needed. If and , then
provided . The two solves use the same LU decomposition of . This expresses the computational benefit without requiring an explicitly stored matrix inverse. Strang's Lecture 14, transcript pp. 9–10 explains this reuse of the original factorization.
To see why the inverse correction works, first consider and put . The rank-one matrix satisfies . Expanding
also works in the reverse order. The general case follows by factoring out and replacing by . A matrix identity has reduced to cancellation of scalar coefficients.
Historically, Jack Sherman and Winifred J. Morrison studied updating an inverse when a single matrix entry changes in their [ref]. Such an entry change is the special rank-one matrix update , with standard basis vectors . The reference and the earlier 1949 abstract on row or column changes are recorded in Henderson and Searle, On Deriving the Inverse of a Sum of Matrices (1981), references 40–41. This distinguishes the specific original setting from the more general formula used here.
Let and give each factor of the usual topology of the real line. The familiar standard basis vectors extend to unit sequences with when and zero otherwise. Their finite linear combinations are exactly the finitely supported sequences, rather than all of .
For every fixed coordinate , for all . Therefore in the product topology. More directly, any basic cylinder set containing zero contains every with : all of its tested coordinates are then zero. The moving unit entry escapes every fixed finite collection of observations.
Figure 1.
A moving unit entry escapes each fixed finite-coordinate cylinder
. Only coordinates 1 and 3 are tested in the displayed cylinder, with values required to lie between minus one-half and one-half. All later coordinates remain unrestricted. The finite display illustrates the pattern; the threshold argument in the text applies to every finite coordinate set. Details.
In the l-infinity sequence space of bounded real sequences, however,
Thus the same sequence does not converge to zero in the supremum norm. Here the comparison is between the subspace topology inherited from the product topology and the norm topology on . The supremum norm is not a finite-valued norm on all of , which also contains unbounded sequences. In the box topology on , the neighborhood of zero excludes every , so is not a convergent sequence with limit zero there either.
Trace and local volume change Created 2026-10-14 Updated 2026-10-20
For any fixed real -by- matrix , as the real parameter tends to zero,
The big O notation means the remainder is bounded in absolute value by for some constant near zero. The determinant stays positive for sufficiently small , so its oriented volume factor is also its ordinary volume factor. Thus the trace is the first-order fractional volume change, measured from the identity matrix.
A proof follows directly from multilinearity of the determinant. Each column of is . The constant term chooses all the standard basis columns and equals one. A term containing exactly one factor replaces just column by ; expanding that vector in the standard basis leaves only its component, , because every other choice repeats a column. Summing gives . Terms with two or more replacements have order or higher. This also proves the derivative of the determinant at the identity matrix.
This coefficient has a direct visual meaning. At the point , the linear map has component along direction . In a small step , these are the first-order changes of the square's or box's sides in their own directions. Summing them gives its fractional area or volume change; the off-diagonal entries initially change shape rather than contributing to this first-order total.
For the constant-coefficient linear system of differential equations , the exact linear flow is , using the matrix exponential. Its volume factor is
This is the matrix exponential determinant identity. One can derive it without diagonalization: set , whose matrix inverse is , and use in Jacobi's formula to get . The scalar differential equation with initial value one gives the displayed exponential function. Thus positive trace causes volume expansion, negative trace causes contraction, and zero trace preserves volume, even when individual directions behave differently.
In two dimensions, compare four generators at :
The first and third diagonal matrices expand or contract both directions. The second expands horizontally and contracts vertically by reciprocal factors, making a rectangle of unchanged area. For the last nilpotent matrix, , so its matrix exponential is exactly ; it sends to , a shear mapping. Zero trace allows substantial shape change and does not mean the flow map is stationary.
Figure 1.
Four examples of a linear system of differential equations: trace controls area change while a saddle and a shear mapping preserve area
. Details.
The first-order statement and the exact flow map should be distinguished. For , , whereas for all real . Zero trace eliminates the first-order change in the approximate step, and it preserves volume exactly in the matrix exponential flow. The examples use an abstract parameter and coordinate vectors; no physical units are assumed.