 Power iteration failure cases

A tied largest modulus can prevent even direction convergence. With $D=\mathrm{diag}(2,-2)$ and $x_0=(1,1{)}^T/\sqrt{2}$,The two directions form a cycle; neither is an eigenvector. There is no dominant-modulus spectral gap. A tied modulus is not a universal failure: an initial eigenvector remains on its line, and $A=2I$ preserves every direction. Subspace iteration addresses a separated cluster by targeting a dominant invariant subspace instead of one eigenvector.

An orthogonal start can fail despite a strict spectral gap. For $A=\left(\begin{array}{cc}2& 1\\ 1& 2\end{array}\right)$ and $x_0=(1,-1{)}^T/\sqrt{2}$, the dominant component is zero, so $A{x}_0=x_0$ and every iterate equals $x_0$. The Rayleigh quotient is exactly $1$ and the eigenpair residual is zero, although the dominant eigenvalue is $3$. Exact arithmetic never creates a missing component.^[ref]

The third panel contrasts these failures with $N=\mathrm{diag}(-3,1)$, $x_0=(1,1{)}^T/\sqrt{2}$, for whichHere the horizontal eigenvector direction converges with a strict spectral gap, while the normalized vectors alternate signs. This is the successful direction convergence described under sign and phase in power iteration.

For a nonorthogonal eigenbasis, even the word “orthogonal” must be used carefully. The diagonalizable matrix $C=\left(\begin{array}{cc}3& 2\\ 0& 1\end{array}\right)$ has right eigenvectors $v_1=(1,0{)}^T$, $v_2=(-1,1{)}^T$, and dominant left eigenvector $w_1=(1,1{)}^T$. For $x_0=(a,b{)}^T$, the dominant coefficient is $c_1=w_1^T{x}_0=a+b$. The starting vector $v_2$ is nonorthogonal to $v_1$ but stays at the smaller eigenvalue $1$; $(0,1{)}^T$ is orthogonal to $v_1$ but has $c_1=1$ and converges to the dominant direction. The left eigenvector test, not the right-eigenvector inner product, controls the outcome.

A random vector drawn from a continuous probability distribution with a probability density function on the full real or complex vector space has $c_1\ne 0$ with probability one. This avoids the exact missing-component hyperplane, but does not guarantee a large component or fast convergence. Floating-point arithmetic may seed a missing component, yet a structurally preserved zero can remain zero, so accidental perturbations are not a convergence guarantee.