Matrix determinant lemma Created 2026-09-24 Updated 2026-10-14
For an invertible matrix and real vectors , the matrix determinant lemma states
The expression is a scalar, so a rank-one matrix update changes the determinant by a single multiplicative factor. One need not expand the updated determinant entry by entry.
For the preceding example with , the dot product is . Hence the updated determinant is . Direct evaluation confirms
More generally, let for a real scalar . The same calculation gives . The determinant is one at , two at , and zero at .
Figure 1.
A rank-one correction can preserve, stretch, or collapse the area of a square
. Each panel maps the unit square by with and . Blue and orange arrows are the images of the two standard basis vectors. At , the parallelogram has area two, despite its strong skew. At , the images are linearly dependent and the full square collapses onto a line. Panel scales differ; the stated areas come from the determinant, rather than from comparing pixel areas. Details.
A compact proof explains the scalar reduction. Put and factor . If , choose a basis starting with . In that basis, , while every other basis vector changes only by a multiple of . Its matrix is triangular with diagonal , giving the required determinant. If , the correction vanishes. This uses multiplicativity of the determinant to restore the factor .
The denominator in the Sherman–Morrison formula is exactly this factor. The rank-one update singularity criterion therefore identifies when the updated matrix inverse ceases to exist. Batson, Spielman and Srivastava use both identities for the symmetric update in Twice-Ramanujan Sparsifiers, section 2.3, Lemmas 2.1–2.2.
Rank-one matrix update 2026-10-14
A rank-one matrix update changes a matrix by an outer product . For real vectors , its action on an input vector is
The dot product reads one scalar from the input, and the correction moves the output along . All correction outputs therefore lie in one linear span. If either vector is zero, the update is zero; otherwise the correction is a rank-one matrix. The full updated matrix need not have rank one.
For example, choose
The update sends to the correction . Although all four entries change, there is only one direction of correction. Adding it to the identity matrix gives .
This special structure allows existing work to be reused. The matrix determinant lemma updates the determinant using one scalar, and the Sherman–Morrison formula updates the matrix inverse using an outer product. Such formulas are useful when a linear system changes slightly after a new observation or a parameter adjustment: the unchanged part can retain its LU decomposition. The term rank-one describes the rank of the correction, not the size of the entry changes. [ref].
For an invertible matrix , the rank-one matrix update is a singular matrix exactly when . This follows directly from the matrix determinant lemma. At that value, and the nonzero vector satisfies
Every vector in the kernel is a multiple of , since implies . The matrix rank therefore drops by exactly one.
For with and , the update becomes a singular matrix at , and . At , this direction is compressed by a factor and the inverse amplifies it by a factor 100. The actual spectral norm of the matrix inverse, which maximizes amplification over every direction, is about .
Figure 1.
An inverse grows large as the rank-one update approaches its singular denominator
. Here and uses the same example vectors. The left panel shows and its lower bound , obtained from the direction . The right panel shows the condition number . Both are computed from singular values; the missing point has no matrix inverse. Details.
The exact formula can expose a large condition number in the updated linear system even when the original one had a small condition number. It does not guarantee numerical stability merely because its evaluation uses fewer arithmetic operations. The denominator condition certifies existence; the condition number and floating-point behavior address different questions about using the resulting answer.
Sherman–Morrison formula Created 2026-09-24 Updated 2026-10-14
The Sherman–Morrison formula computes the matrix inverse after a rank-one matrix update. If is an invertible matrix and , then
The inverse correction is itself an outer product, divided by the scalar . The matrix determinant lemma shows that the nonzero-denominator condition is exactly the condition that the updated matrix remains an invertible matrix.
For , , and , we have . Thus the computed inverse is
Multiplication in either order gives the identity matrix. The result reuses the original inverse and the same correction vectors, rather than solving independently for all four inverse entries.
Often only the solution of an updated linear system is needed. If and , then
provided . The two solves use the same LU decomposition of . This expresses the computational benefit without requiring an explicitly stored matrix inverse. Strang's Lecture 14, transcript pp. 9–10 explains this reuse of the original factorization.
To see why the inverse correction works, first consider and put . The rank-one matrix satisfies . Expanding
also works in the reverse order. The general case follows by factoring out and replacing by . A matrix identity has reduced to cancellation of scalar coefficients.
Historically, Jack Sherman and Winifred J. Morrison studied updating an inverse when a single matrix entry changes in their [ref]. Such an entry change is the special rank-one matrix update , with standard basis vectors . The reference and the earlier 1949 abstract on row or column changes are recorded in Henderson and Searle, On Deriving the Inverse of a Sum of Matrices (1981), references 40–41. This distinguishes the specific original setting from the more general formula used here.