Write . Subtracting the exact equation from the iteration gives , where . Hence . Also
so the stated scalars are precisely the eigenvalues of the iteration matrix .
The spectral radius criterion for matrix powers states that if and only if all its eigenvalues have modulus strictly less than one. Applying that theorem gives for every initial vector. Therefore .