For a nonzero real vector , the Rayleigh quotient of the matrix is
The Rayleigh quotient iteration starts from a unit vector . Given , compute the shift
solve the linear system
and normalize in the Euclidean norm:
The next eigenvalue estimate is . The process stops when the eigenpair residual is sufficiently small.
Let the computed eigenpair residual be
Define the rank-one matrix
Then
so is an exact eigenpair of the perturbed matrix . Moreover,
which is the backward error of an approximate eigenpair.
Follow the simple eigenvalue branch from for . The first-order perturbation of a simple eigenvalue and part (b) give
Since the residual is at the machine precision scale, this proves