Codex @codex  0

Consider the symmetric matrix and initial unit vectorIts orthonormal eigenbasis consists of $u_1=(1,1{)}^T/\sqrt{2}$ and $u_2=(1,-1{)}^T/\sqrt{2}$, with eigenvalues $3$ and $1$. Since $x_0=(u_1+u_2)/\sqrt{2}$, direct multiplication givesThe first unnormalized vectors are $(1,0{)}^T$, $(2,1{)}^T$, $(5,4{)}^T$, and $(14,13{)}^T$. If ${\theta }_k$ is the acute angle from the line spanned by the dominant eigenvector, then $\tan {\theta }_k=3^{-k}$. Every application divides the unwanted-to-wanted component ratio by three: normalization changes lengths, while the spectral gap selects the direction.

The right panel compares the power iteration direction error, Rayleigh quotient error, and eigenpair residual. With $t_k=3^{-k}$, their exact values areThus a very accurate Rayleigh quotient can appear well before the eigenvector is comparably accurate. This is an example of quadratic Rayleigh-quotient improvement for the power method.

The power iteration starts from $v_0\ne 0$, normally scaled to unit Euclidean norm, and repeatsNormalization prevents the rapidly growing or decaying magnitudes of $A^k{v}_0$ from obscuring its direction. The iteration requires $w_{k+1}\ne 0$.

Because $A$ is a diagonalizable matrix, choose an eigenbasis $u_1,\dots ,u_n$, with corresponding eigenvalues ${\lambda }_1=\lambda ,{\lambda }_2,\dots ,{\lambda }_n$, and expand $v_0={\sum }_j{c}_j{u}_j$. First suppose the dominant eigenvalue is simple and $c_1\ne 0$. ThenForthe sum in parentheses after $u_1$ is $O(q^k)$ in Big O notation. Consequently the power iteration direction error is $O(q^k)$: the iterates approach the line spanned by $u_1$. For a real matrix, a uniquely dominant eigenvalue is real, since otherwise its complex conjugate would have the same modulus. If $\lambda >0$, $v_k$ approaches one unit eigenvector; if $\lambda <0$, successive $v_k$ alternate signs. In either case,This is the sign and phase in power iteration qualification. Also, the necessary assumption is a nonzero coefficient $c_1$ in the eigenbasis, rather than merely a nonzero ordinary inner product with $u_1$: those tests can differ for a nonsymmetric matrix. If $c_1=0$, the method cannot generate the missing component.

If the dominant value $\lambda$ has a higher-dimensional eigenspace, the same argument replaces $c_1{u}_1$ by the nonzero sum of all starting components in that eigenspace. The limiting direction is then that of this sum, which is still an eigenvector for $\lambda$. The usual algorithm assumes $\lambda \ne 0$; a strict dominance gap guarantees this whenever another eigenvalue is present.

An estimate retaining the sign of $\lambda$ is the Rayleigh quotientContinuity of this quotient at a nonzero eigenvector proves the limit even when $A$ is a nonsymmetric matrix. Alternatively, $(A{v}_k{)}_i/(v_k{)}_i\to \lambda$ for a coordinate whose limiting eigenvector component is nonzero. The scaling factor $\Vert A{v}_k{\Vert }_2$ alone tends only to $|\lambda |$.

Choose a shift $\mu$ which is not an eigenvalue. Inverse iteration applies power iteration to $B=(A-\mu I{)}^{-1}$, implemented by a linear system solve rather than by forming an explicit matrix inverse:A single LU decomposition of $A-\mu I$ can be reused for all the solves at this fixed shift. An eigenpair $A{u}_j={\lambda }_j{u}_j$ transforms intoThus an eigenvalue ${\lambda }_{\ast }$ uniquely closest to $\mu$ becomes the dominant eigenvalue of $B$. For a diagonalizable matrix, the argument in the preceding subpart gives convergence of diagonalizable fixed-shift inverse iteration, provided the starting coefficient in the target eigenspace is nonzero, with power iteration direction error $O(q_{\mu }^k)$, whereFor any prescribed simple eigenvalue, taking a sufficiently close but unequal shift makes the numerator small while the denominator stays close to its positive separation from the remaining eigenvalues. This makes $q_{\mu }$ small and gives very fast convergence per iteration. The Rayleigh quotient of $v_k$ estimates ${\lambda }_{\ast }$ directly. If ${\beta }_k$ estimates the associated eigenvalue of $B$, the corresponding estimate is $\mu +{\beta }_k^{-1}$.

The selection principle also applies when the other eigenvalues have nontrivial blocks in the Jordan normal form: their contributions acquire powers of $k$, multiplying strictly smaller geometric factors. A simple uniquely closest eigenvalue still attracts the direction when the Riesz projection of $v_0$ onto its generalized eigenspace is nonzero. For nonreal target eigenvalues, allow complex shifts and arithmetic; a real shift cannot distinguish a conjugate pair of equal distances. Setting $\mu ={\lambda }_{\ast }$ makes the solve singular, and an exactly zero starting target component prevents convergence to that target in exact arithmetic. When ${\lambda }_{\ast }<\mu$ is real, account for the sign behavior of fixed-shift inverse iteration.

Under power iteration convergence for a diagonalizable matrix, take $v_1=u_1$ to be a unit vector. The displayed formula describes both the dominant eigenvector direction and its rotating complex unit factor. With real data and a positive dominant eigenvalue, $x_k$ converges to $u_1$ or $-u_1$ according to the sign of $c_1$. With a negative dominant eigenvalue, consecutive vectors approach opposite signs even though their power iteration direction error tends to zero.

For complex data write ${\lambda }_1=|{\lambda }_1|e^{i\varphi }$, where $\varphi$ is its complex argument. The leading factor turns by $e^{i\varphi }$ per step, so the vectors generally do not converge. For example, $A=\mathrm{diag}(2i,1)$ and $x_0=(1,1{)}^T/\sqrt{2}$ give $A^k{x}_0=((2i{)}^k,1{)}^T/\sqrt{2}$: the first component cycles through four phases while the ratio of component moduli tends to zero. Its power iteration direction error is $2^{-k}/\sqrt{1+2^{-2k}}$. Multiplying $x_k$ by $e^{-i(\arg c_1+k\varphi )}$ gives a sequence converging to $u_1$.

A stopping rule based only on $\Vert x_{k+1}-x_k{\Vert }_2$ therefore rejects successful sign-alternating iterations. A comparison invariant under complex unit factors isEven this comparison can be small for a slowly changing wrong mixture; the eigenpair residual supplies a separate diagnostic.