Suppose the compact operator acts on , and . The Uniform boundedness principle makes bounded, so its images form a relatively compact set. Bounded linearity gives : for every , . Every norm-convergent subsequence of must therefore converge to . If the whole sequence did not converge to in norm, a subsequence staying a fixed positive distance from would have a norm-convergent further subsequence, a contradiction. This proves that compact operators send weak convergence to norm convergence.
Conversely, assume the stated complete continuity property. Its strong limit necessarily equals , because bounded linearity still supplies the weak limit. Every bounded sequence in a Hilbert space has a weakly convergent subsequence by weak sequential compactness in a Hilbert space. Applying the assumption to that subsequence gives a norm-convergent subsequence of the images. Thus the image of the unit ball is relatively sequentially compact and hence relatively compact. Complete continuity and compactness are equivalent on a Hilbert space.
We prove compact perturbation invariance of Fredholm operators using a two-sided inverse modulo compact operators. If is Fredholm, decompose
The restriction of from to its closed range is a bounded bijection, so the bounded inverse theorem supplies a bounded inverse there. Extend that inverse by zero on to obtain a bounded operator . If are the orthogonal projections onto and , respectively, then
Both and have finite rank.
Set . Products of a compact operator and a bounded operator are compact: on one side compactness preserves compact images, and on the other the bounded operator maps the unit ball into a bounded ball. Hence
where are compact.
Here is why these identities force to be Fredholm. On , , so part (a) and compactness make finite-dimensional. There is a positive constant with
Otherwise unit vectors could satisfy . From and compactness, a subsequence would converge strongly to a unit vector with , which is impossible. The lower bound proves closed range: for a convergent sequence , first discard the kernel components, then the remaining are Cauchy and their limit maps to the desired range limit.
For finite codimension, take the adjoint operator of , giving . The operator is compact: the finite-rank approximation proved in part (e) gives finite-rank adjoints converging in operator norm to , and norm limits of compact operators are compact. On , , so this kernel is finite-dimensional. Finally,
Because the range is closed, its cokernel is isomorphic to this finite-dimensional orthogonal complement. This verifies all three Fredholm operator conditions for .
For the converse, start with and perturb by the compact operator . Therefore is Fredholm if and only if is Fredholm, with no self-adjointness assumption.
For a bounded linear operator between Hilbert spaces, let and . The Moore–Penrose inverse of an operator is defined on
For , with , define
This is independent of the chosen preimage , since two preimages differ by a vector in . Equivalently, it is the inverse of the restriction of to , applied to the component of the data in , and is zero on .
The generalized solution is the unique minimum-norm least-squares solution. Its residual is orthogonal to the range, giving the operator normal equation
The operator normal equation alone leaves an arbitrary null-space component; the second condition fixes the minimum-norm representative. The identities and hold on their appropriate domains.
For an infinite-rank compact operator, the range need not be closed, and is generally unbounded. Data outside need not have any least-squares solution at all, even though they can be approximated by range elements. This domain qualification is crucial in part (d); the Moore–Penrose notation does not turn an ill-posed inverse into an everywhere-defined bounded operator.
A singular value system of a compact operator consists of positive numbers and orthonormal families , satisfying
Thus are positive-eigenvalue eigenvectors of and of , with eigenvalue . The families are complete in and respectively. The singular values can be listed nonincreasingly with multiplicities, and tend to zero in the infinite-rank case. For finite rank there are only finitely many positive singular values; zero-kernel directions are handled separately.
Use the convention that is conjugate-linear in its first entry. Then the singular value system gives
The latter series converges precisely on the admissible range component specified by the Picard criterion:
with components annihilated by the inverse. Merely writing a formal singular expansion does not imply it converges in .
Suppose is a compact operator and . The Uniform boundedness principle makes bounded. If did not converge in norm to , some subsequence would stay a fixed positive distance away. Compactness provides a further norm-convergent subsequence, say to . On the other hand, for every , , so its norm limit must be , a contradiction.
Conversely, if sends every weakly convergent sequence to a norm-convergent sequence, take any sequence in the closed unit ball. Weak compactness of that ball supplies a weakly convergent subsequence, whose images converge in norm by hypothesis. Thus every sequence in the image has a convergent subsequence in . Its closure is also sequentially compact: approximate its th member by an image point within . Since is a metric space, that closure is compact. We conclude
This is the principle that compact operators send weak convergence to norm convergence.
For noisy data, exact equality may be impossible: the data can have a component outside the operator range. A least-squares solution of a linear inverse problem instead minimizes
For any variation , the adjoint operator gives
Thus statistical homogeneity in every direction is the normal equation for a linear inverse problem, . It is also sufficient for a global minimum: when it holds,
The residual is orthogonal to the closure of the range, since it lies in . A normal-equation solution therefore fits the component of the data representable by the forward map, while leaving the perpendicular component unfitted. If there is more than one such solution, select the minimum-norm least-squares solution, which lies in .
These facts explain the formulation, but do not make the inverse problem well posed. A compact operator of infinite rank typically has nonclosed operator range, so even the least-squares infimum need not be attained. A least-squares solution exists exactly when the orthogonal projection of onto belongs to . In a singular system of a compact operator, this becomes the Picard criterion. Also, the nonzero eigenvalues of are the squares of the singular values of : solving the operator normal equation directly can worsen numerical conditioning. The operator normal equation expresses least squares; it does not itself regularize the inverse problem. The subsequent finite Landweber iteration and its stopping rule provide the inverse-problem regularization.