Matrix determinant lemma Created 2026-09-24 Updated 2026-10-14
For an invertible matrix and real vectors , the matrix determinant lemma statesThe expression is a scalar, so a rank-one matrix update changes the determinant by a single multiplicative factor. One need not expand the updated determinant entry by entry.
For the preceding example with , the dot product is . Hence the updated determinant is . Direct evaluation confirmsMore generally, let for a real scalar . The same calculation gives . The determinant is one at , two at , and zero at .
A compact proof explains the scalar reduction. Put and factor . If , choose a basis starting with . In that basis, , while every other basis vector changes only by a multiple of . Its matrix is triangular with diagonal , giving the required determinant. If , the correction vanishes. This uses multiplicativity of the determinant to restore the factor .
The denominator in the Sherman–Morrison formula is exactly this factor. The rank-one update singularity criterion therefore identifies when the updated matrix inverse ceases to exist. Batson, Spielman and Srivastava use both identities for the symmetric update in Twice-Ramanujan Sparsifiers, section 2.3, Lemmas 2.1–2.2.
Rank-one matrix update 2026-10-14
A rank-one matrix update changes a matrix by an outer product . For real vectors , its action on an input vector isThe dot product reads one scalar from the input, and the correction moves the output along . All correction outputs therefore lie in one linear span. If either vector is zero, the update is zero; otherwise the correction is a rank-one matrix. The full updated matrix need not have rank one.
For example, chooseThe update sends to the correction . Although all four entries change, there is only one direction of correction. Adding it to the identity matrix gives .
This special structure allows existing work to be reused. The matrix determinant lemma updates the determinant using one scalar, and the Sherman–Morrison formula updates the matrix inverse using an outer product. Such formulas are useful when a linear system changes slightly after a new observation or a parameter adjustment: the unchanged part can retain its LU decomposition. The term rank-one describes the rank of the correction, not the size of the entry changes. [ref]
https://ocw.mit.edu/courses/18-065-matrix-methods-in-data-analysis-signal-processing-and-machine-learning-spring-2018/988b4c05680f40a5a4b3be7004a32500_XhSk_Lw2X_U.pdf. Gilbert Strang, MIT 18.065, Lecture 14: Low Rank Changes in A and Its Inverse
. Rank-one update singularity criterion 2026-10-14
For an invertible matrix , the rank-one matrix update is a singular matrix exactly when . This follows directly from the matrix determinant lemma. At that value, and the nonzero vector satisfiesEvery vector in the kernel is a multiple of , since implies . The matrix rank therefore drops by exactly one.
For with and , the update becomes a singular matrix at , and . At , this direction is compressed by a factor and the inverse amplifies it by a factor 100. The actual spectral norm of the matrix inverse, which maximizes amplification over every direction, is about .
An inverse grows large as the rank-one update approaches its singular denominator
. Here and uses the same example vectors. The left panel shows and its lower bound , obtained from the direction . The right panel shows the condition number . Both are computed from singular values; the missing point has no matrix inverse. Details.The exact formula can expose a large condition number in the updated linear system even when the original one had a small condition number. It does not guarantee numerical stability merely because its evaluation uses fewer arithmetic operations. The denominator condition certifies existence; the condition number and floating-point behavior address different questions about using the resulting answer.
Sherman–Morrison formula Created 2026-09-24 Updated 2026-10-14
The Sherman–Morrison formula computes the matrix inverse after a rank-one matrix update. If is an invertible matrix and , thenThe inverse correction is itself an outer product, divided by the scalar . The matrix determinant lemma shows that the nonzero-denominator condition is exactly the condition that the updated matrix remains an invertible matrix.
For , , and , we have . Thus the computed inverse isMultiplication in either order gives the identity matrix. The result reuses the original inverse and the same correction vectors, rather than solving independently for all four inverse entries.
Often only the solution of an updated linear system is needed. If and , thenprovided . The two solves use the same LU decomposition of . This expresses the computational benefit without requiring an explicitly stored matrix inverse. Strang's Lecture 14, transcript pp. 9–10 explains this reuse of the original factorization.
To see why the inverse correction works, first consider and put . The rank-one matrix satisfies . Expandingalso works in the reverse order. The general case follows by factoring out and replacing by . A matrix identity has reduced to cancellation of scalar coefficients.
Historically, Jack Sherman and Winifred J. Morrison studied updating an inverse when a single matrix entry changes in their [ref]
https://doi.org/10.1214/aoms/1177729893. 1950 paper, Adjustment of an Inverse Matrix Corresponding to a Change in One Element of a Given Matrix
. Such an entry change is the special rank-one matrix update , with standard basis vectors . The reference and the earlier 1949 abstract on row or column changes are recorded in Henderson and Searle, On Deriving the Inverse of a Sum of Matrices (1981), references 40–41. This distinguishes the specific original setting from the more general formula used here.
