Backward heat equation Created 2026-10-07 Updated 2026-11-05
The backward heat equation , , amplifies a spatial Fourier mode by . On a periodic domain, fix and take initial data . Their L2 norms tend to zero, while the corresponding solutions at have L2 norms growing without bound. Thus the solution map is not continuous in the ordinary L2 norm; this is an ill-posed problem.[ref]
Real analyticity alone does not resolve the issue. The periodic analytic function has exponentially decaying coefficients, but after any positive time the proposed coefficients are not square summable. The required data restriction must control growth on the Gaussian frequency scale. For example, a fixed-horizon norm
gives when the Fourier basis is normalized. This very strong data norm changes the stability question. In inverse heat reconstruction, an explicit regularization or frequency cutoff is needed when measured data carry ordinary small-scale noise.
Ill-posed inverse problem 2026-10-14
An inverse problem is an ill-posed problem if it fails any requirement of a well-posed problem: existence for every admissible datum, uniqueness, or continuity of the reconstructed object as the data change. These requirements depend on the chosen spaces and norms, not just the equation. Clason's regularization notes formulate this distinction explicitly.[ref]
Complete averaging illustrates lost information:
The difference mode belongs to the null space because . Even restricting both pixels to leaves infinitely many indistinguishable inputs. This is failure of uniqueness. Data such as also have no exact preimage under , illustrating failure of existence when arbitrary two-component observations are admissible.
The two-pixel matrix in the inverse problem example has a weakly observed difference mode, not a null space mode. Its inverse is continuous: this finite-dimensional problem is a well-posed problem with noise-sensitive conditioning. Small positive singular values alone do not imply mathematical ill-posedness. In infinite-dimensional problems, positive singular values approaching zero can make inversion unbounded: unit solution modes then produce data tending to zero. This destroys continuity even without a null space. Regularization of an inverse problem must distinguish missing information from information recoverable only at the cost of amplifying measurement noise.
Figure 1.
Two-pixel averaging compresses a square to a thin diamond or collapses it to a line
. Details.
Recovering a derivative from values controlled only in the uniform norm is an ill-posed problem: the differentiation map is not continuous in those norms. On , take . Then , while has uniform norm one for every . Arbitrarily small value perturbations can therefore conceal nonvanishing derivative changes.
Numerical differentiation can still be useful when additional smoothness bounds, a suitable sampling scale, or a regularization method control the admissible changes. The basic noise amplification by differentiation of a linear interpolant gives a finite-data version: endpoint uncertainty of size produces derivative uncertainty of order at spacing .