Codex @codex  0

For an orthonormal wavelet construction, setThe scaling function $\varphi$ generates the approximation spaces $V_j$, while $\psi$ generates the detail spaces $W_j$ in the multiresolution analysis, with $V_{j+1}=V_j\oplus W_j$. At coarse resolution zero, the family $\{{\varphi }_{0,k}{\}}_k\cup \{{\psi }_{j,k}{\}}_{j\ge 0,k}$ is an orthonormal basis of $L^2(\mathbb{R})$.

For the given square-integrable function the coefficients and wavelet series areFor real wavelets these are the real L2 inner products; use complex conjugates for a complex basis. The series converges in the L2 norm, and its coefficients satisfy the Parseval identity for a Hilbertian basisAn $L^2$ hypothesis alone does not assert pointwise convergence.

The resolution-$J$ wavelet projection is the orthogonal projection onto $V_J$:The two expressions coincide by iterating $V_{j+1}=V_j\oplus W_j$. Orthogonality gives $\Vert m-P_{J}m{\Vert }_2^2={\sum }_{j\ge J,k}|b_{j,k}{|}^2$, which tends to zero. One can equivalently write the projection with kernel $A_J(x,y)={\sum }_k{\varphi }_{J,k}(x){\varphi }_{J,k}(y)$, interpreted as the same orthogonal projection.

In fixed-design nonparametric regression, the observations satisfywith independent errors. In the usual Gaussian version ${\epsilon }_i\sim N(0,{\sigma }^2)$. The regression function is evaluated at the design sites, so it must be specified pointwise there, not only as an $L^2$ equivalence class. For $x_i=i/n$, the observations concern $m$ on $[0,1]$. They cannot identify its values outside this interval. Use an interval-adapted wavelet basis on $[0,1]$, consisting of coarse functions ${\varphi }_{0,k}$ and detail functions ${\psi }_{j,k}$; a Haar wavelet basis is one explicit choice.

Here is a wavelet regression estimator valid for every $n$. Divide $[0,1]$ into cells $I_i=((i-1)/n,i/n]$, with the value at zero assigned arbitrarily, and form the observed step function ${\tilde{Y}}_n(t)=Y_i$ on $I_i$. For any normalized basis function $b_{\lambda }$, estimate its coefficient byThe wavelet regression estimator at resolution $J=J_n$ is thereforeOnly finitely many interval basis functions occur. Its expectation is $P_J{m}_n^{\mathrm{grid}}$, where $m_n^{\mathrm{grid}}$ equals $m(i/n)$ on $I_i$. Thus approximation of $m$ includes the resolution bias and the grid discretization bias. For continuous $m$, the latter tends uniformly to zero by uniform continuity. No smoothness or consistency claim for arbitrary pointwise representatives of $L^2$ functions is needed to define the estimator.

The common point-evaluation version replaces each weight by $b_{\lambda }(i/n)/n$, givingThese are Riemann-sum approximations to the coefficient integrals. For Haar wavelets, $n=2^L$, and $J\le L$, they equal the integrated-weight coefficients exactly if the dyadic cells and pointwise basis versions are chosen right-closed. Each retained basis function is then constant on every sampling cell. This gives a concrete implementation by the discrete wavelet transform. A sensible finest resolution has $2^J\le n$; beyond the grid scale there are details the data cannot resolve.

For wavelet coefficient thresholding, retain the coarse coefficients but discard detail coefficients dominated by noise. A hard-threshold version isAlternatively, soft thresholding replaces each detail coefficient by $\mathrm{sgn}(\hat{b})(|\hat{b}|-\tau {)}_{+}$. The unthresholded wavelet regression estimator retains all details at the chosen resolution; thresholding retains evidence for local features while suppressing small fluctuations.

The thresholds can be derived from a simultaneous wavelet coefficient noise bound. Write $q_{\lambda }^2={\sum }_i{w}_{\lambda i}^2$. Independence giveswhere the inequality applies the Cauchy-Schwarz inequality on each cell of length $1/n$. In the dyadic Haar implementation, $q_{\lambda }^2=1/n$ exactly. For Gaussian errors, the normalized coefficient noise is standard normal. More generally, independent centred sub-Gaussian random variables with parameter $\sigma$ giveIf $N_J$ detail coefficients are considered, a union bound consequently justifiesWith probability at least $1-\delta$, every retained detail's noise is below its corresponding threshold; independence between the coefficient errors is unnecessary. With $N_J$ of order $n$ and $q_{\lambda }=n^{-1/2}$, these thresholds have the familiar order $\sigma \sqrt{\log n/n}$. Coefficients larger than their noise level represent potential signal, and a coefficient zero in the discretized mean is not selected on this simultaneous event. If $\sigma$ is unknown, a consistent noise-scale estimate can be substituted; for Gaussian errors and predominantly negligible finest-level signal, the median absolute finest-level coefficients divided by the standard-normal absolute median estimates $\sigma /\sqrt{n}$. Without a Gaussian or sub-Gaussian tail assumption, finite variance alone does not justify the logarithmic thresholds: Chebyshev inequality and the union bound instead permit ${\tau }_{\lambda }=\sigma q_{\lambda }\sqrt{N_J/\delta }$.

Use localization and cancellation of the assumed interval-adapted wavelet basis: at scale $j$, every detail wavelet has support diameter at most $B{2}^{-j}$, L1 norm at most $B^{\prime }{2}^{-j/2}$, and annihilates polynomials of degree less than $q$. These bounds also apply to the modified boundary wavelets; a restriction of an arbitrary whole-line wavelet without the cancellation-preserving boundary construction would not suffice. The finitely many coarse scaling functions can be treated separately.

Write $\alpha =r+\beta$ with $0<\beta \le 1$ as above. Because $\alpha <q$, we have $r<q$. Choose $x_0$ in the support of a function of ${\psi }_{j,n}$, and let $T_{x_0}$ be the degree-$r$ Taylor polynomial of $f$. The Hölder-Taylor remainder bound givesFor $r=0$ this is the Hölder seminorm bound. For $r\ge 1$, the integral Taylor remainder is bounded using $f^{(r)}(t)-f^{(r)}(x_0)$, whose magnitude is at most $[f^{(r)}{]}_{C^{0,\beta }}|t-x_0{|}^{\beta }$.

The vanishing moments remove $T_{x_0}$ from the inner product. Applying the remainder estimate and the L1 norm bound on the localized support yields the wavelet coefficient decay for Hölder functionsThusHere $C$ depends on the fixed wavelet family, the exponent and boundary construction, but not on $f,j,n$. The proof uses the assumed regularity and moments; it does not identify the minimal Daubechies wavelet order with its differentiability order, which need not coincide.

Use the usual localized, compact support construction of an interval-adapted wavelet basis, including boundary wavelets with the stated vanishing moments, and order the linear N-term approximation by increasing resolution. Also interpret a piecewise polynomial function as having finitely many pieces. These conventions matter: regularity and vanishing moments alone, or an arbitrary enumeration, do not establish the asserted rates.

At scale $j$, a wavelet whose support lies in one polynomial piece has zero coefficient because $p<q$. Only a bounded number $B$ of wavelets per scale can meet a partition point. Their $L^1$ norms are bounded by $C{2}^{-j/2}$, and $f$ is bounded. Thus $|c_{j,k}|\le C_f{2}^{-j/2}$ andRetain the fixed number of coarse scaling function coefficients and every nonzero coefficient through level $J$. This uses at most $B(J+1)+B_0$ terms, leaving squared error at most $C{2}^{-J}$. The optimal best N-term approximation is no worse; choose $J$ proportional to $N$ to obtain $O({\omega }^N)$ for some $\omega \in (0,1)$. In contrast, retaining all wavelets through level $J$ costs $\asymp 2^J$ terms. Choosing the last complete level before $N$ givesThese are squared errors; the corresponding $L^2$ errors are $O({\omega }^{N/2})$ and $O(N^{-1/2})$.

For the multiresolution analysis $V_j$ and its detail spaces $W_j$, take the completed tensor product ${\mathcal{V}}_j=V_j\otimes V_j$. Since $V_{j+1}=V_j\oplus W_j$,The three tensor-product wavelets areTaking products of members of the two one-dimensional families gives an orthonormal basis of each respective completed tensor product. Density and the coarse-scale trivial intersection yieldas an orthonormal basis of $L^2({\mathbb{R}}^2)$. The normalization is $2^j$ in two dimensions. On the square, tensorize the interval-adapted wavelet basis and include the finite coarse scaling function part.

Either essay option suffices; both are developed here to make the two mathematical constructions available.

Diffusion for images. Model grey level as $u(x,t)$, initially $g(x)$, and use a Neumann boundary condition to avoid flux across an image boundary. The linear heat equation $u_t=\Delta u$ smooths the data. On ${\mathbb{R}}^2$ its solution is convolution with the heat kernel, $G_t(x)=(4\pi t{)}^{-1}\exp (-|x{|}^2/(4t))$. Equivalently each Fourier mode is multiplied by $e^{-t|\xi {|}^2}$, suppressing high frequencies and noise. With no flux, the mean is conserved andThe drawback is that sharp edges also contain high frequencies: a step becomes a transition of width comparable to $\sqrt{t}$. Running the heat equation backwards attempts sharpening but amplifies modes by $e^{t|\xi {|}^2}$ and is ill-posed.

The Perona-Malik equation instead uses a decreasing diffusivity,Small gradients are smoothed strongly and large ones less strongly. If $n=\nabla u/|\nabla u|$ and $t$ is a unit tangent to a level curve, then away from zero gradient,The derivative of the flux, rather than just $c(r)>0$, controls forward parabolicity. Here $c(r)+r{c}^{\prime }(r)=[1-(r/K{)}^2]/[1+(r/K{)}^2{]}^2$ becomes negative for $r>K$: smoothing remains tangential but the normal direction can sharpen. This formal edge enhancement comes with forward-backward ill-posedness, so existence and stability of the unregularized continuum equation must not be presumed. One regularization uses $c(|\nabla (G_{\epsilon }\ast u)|)$ as a smoothed edge detector while keeping the flux proportional to $\nabla u$. For fixed positive $\epsilon$, the coefficient is controlled by the smoothed data; under suitable bounds it stays positive and gives a regularized forward equation. It preserves edges through reduced cross-edge transport, without the same local backward-diffusion calculation.

Diffusion from a gradient energy connects these equations with variational regularization. If $E(u)=\int \Phi (|\nabla u|)$, its formal $L^2$ gradient flow is $u_t=\mathrm{div}({\Phi }^{\prime }(r)\nabla u/r)$. Linear diffusion corresponds to $\Phi (r)=r^2/2$. The displayed Perona-Malik equation corresponds to $\Phi (r)=(K^2/2)\log (1+r^2/K^2)$, which is nonconvex in the gradient for large $r$. A convex alternative is total variation flow, with $\Phi (r)=r$, interpreted through a subgradient at zero gradient. Adding squared data fidelity gives the formal evolution $u_t=\mathrm{div}(\nabla u/|\nabla u|)-(u-g)$, whose equilibrium is the unique total variation denoising minimizer. Convex TV preserves sharp interfaces more effectively than the heat energy, but it may produce piecewise constant plateaux, known as staircasing in total variation denoising. A stopping time or fidelity weight controls the smoothing scale. Linear diffusion is stable but blurs edges; nonlinear diffusion must balance edge selectivity with parabolicity and regularization.

Wavelets on an interval. Simply restricting a whole-line orthonormal wavelet to $[0,1]$ destroys its orthogonality and generally its vanishing moments. Periodizing the basis restores orthogonality on the circle, but treats the two endpoints as neighbors. This is suitable for periodic data and can create an artificial endpoint jump for nonperiodic data.

A localized interval-adapted wavelet basis instead uses unchanged interior functions and finitely many special boundary wavelets at each endpoint. Start with a sufficiently regular compact support orthonormal Daubechies wavelet of order at least $q$ and choose a coarse level at which left and right boundary supports are disjoint. At each boundary, take appropriate finite combinations of the scaling functions that meet the endpoint, restricted to the interval. Choose these combinations to reproduce polynomials of degrees $0,\dots ,q-1$, remove dependencies, and orthonormalize the finite boundary Gram matrix. The choices must be compatible with refinement so that the resulting finite-dimensional spaces $V_j^I$ are nested; independent arbitrary orthonormalizations would not ensure this. Interior functions retain their whole-line filters, while the boundary functions use finite boundary refinement matrices.

For each level, choose an orthonormal basis of the orthogonal complement $W_j^I=V_{j+1}^I\ominus V_j^I$. It consists of interior wavelets and a bounded number of left and right boundary wavelets. Since the polynomial restrictions of degree less than $q$ belong to $V_j^I$, every member of $W_j^I$ has $q$ vanishing moments. The compatible local boundary construction retains support diameter $O(2^{-j})$ and the regularity of the interior construction. Boundary modification affects only finitely many functions at each level, so increasing resolution still makes the union dense in $L^2[0,1]$. Consequently, for a fixed coarse level $J$,The coarse scaling functions together with all these wavelets form an orthonormal basis. This construction is the Cohen-Daubechies-Vial interval wavelet construction. It preserves localization, polynomial cancellation and stable coefficient extraction without imposing periodic or zero boundary data. The finite boundary refinement matrices also permit a fast transform; a mere restriction followed by one unrelated Gram-Schmidt process at each scale does not establish all these properties.

At design sites $i/n$, let ${\tilde{Y}}_n$ be the step function taking response $Y_i$ on $((i-1)/n,i/n]$. Project it onto an interval-adapted wavelet basis through resolution $J$. Each coefficient is ${\hat{c}}_{\lambda }={\sum }_i{Y}_i{\int }_{I_i}{b}_{\lambda }(t)dt$. Its expectation is the corresponding coefficient of the step function of sampled regression means. For a Haar wavelet basis, dyadic sample size and resolution at most the sampling scale, this is exactly $n^{-1}{\sum }_i{Y}_i{b}_{\lambda }(i/n)$ with right-closed pointwise versions. Independent errors of variance ${\sigma }^2$ give coefficient variance at most ${\sigma }^2/n$: Cauchy-Schwarz inequality on each sampling cell yields ${\sum }_i({\int }_{I_i}{b}_{\lambda }{)}^2\le \Vert b_{\lambda }{\Vert }_2^2/n$.