For a bounded function on an interval with finitely many jumps and piecewise bounds, localized orthonormal wavelets with sufficient vanishing moments give squared best N-term approximation error . There are smooth-region coefficients of size , and only jump-crossing coefficients of size per level. Retain all coefficients through level and the jump-crossing coefficients through when . This costs and leaves squared tails . Choosing comparable to proves the rate by the Parseval identity.
Daubechies wavelet 2026-10-05
A Daubechies wavelet of order is a compact support orthonormal wavelet with vanishing moments and a minimal-length finite refinement filter. The minimal filter has taps, giving support length in the standard dyadic normalization. Its low-pass symbol has a zero of order at . Increasing order improves polynomial cancellation and, for sufficiently large order, regularity, at the price of a wider support.
Let be the scaling function and an orthonormal wavelet, with and . For , the wavelet series at a coarse level is
The series converges in the L2 norm. Its coarse part captures broad variation and successive wavelet levels add finer detail. Truncating at levels produces the orthogonal projection onto ; Parseval identity makes its squared approximation error the sum of the omitted squared coefficients. Merely square-integrable functions need not have pointwise convergence.
For the Haar wavelet, use the cell convention and let be the unique such interval containing . The Haar scaling functions are , so the Haar projection is
For a merely locally integrable function this cell-average formula remains defined, even if a global orthogonal projection is unavailable. If , the mean value theorem gives Lipschitz continuity and, since on the cell,
Thus the requested bound holds with , by the Haar projection error for a Lipschitz function.
To estimate a density, replace each scaling or wavelet coefficient or by the sample average of that basis function. The finite-resolution Haar density estimator is therefore
It is the histogram on the dyadic cells, is nonnegative, and integrates to one. Its expectation is . A density with bounded derivative is bounded: the Lipschitz density height bound gives by integrating the triangular lower envelope . The case cannot be a probability density on the whole real line. Hence .
The cell probability is . The sample count has a binomial distribution, so
The Cauchy-Schwarz inequality bounds the mean centered absolute deviation by the square root of this variance. Adding the projection bias gives
Choose , so . The two terms have the same order, and
This is a bias-variance tradeoff: refining the cells decreases the averaging bias but increases the sampling variance.
The Haar projection averages this normal distribution density on each cell; the finer cells follow its variation more closely. A Haar density estimator replaces these exact cell probabilities by empirical frequencies and therefore also introduces sampling noise.
For an orthonormal wavelet construction, set
The scaling function generates the approximation spaces , while generates the detail spaces in the multiresolution analysis, with . At coarse resolution zero, the family is an orthonormal basis of .
For the given square-integrable function the coefficients and wavelet series are
For real wavelets these are the real L2 inner products; use complex conjugates for a complex basis. The series converges in the L2 norm, and its coefficients satisfy the Parseval identity for a Hilbertian basis
An hypothesis alone does not assert pointwise convergence.
The resolution- wavelet projection is the orthogonal projection onto :
The two expressions coincide by iterating . Orthogonality gives , which tends to zero. One can equivalently write the projection with kernel , interpreted as the same orthogonal projection.
In fixed-design nonparametric regression, the observations satisfy
with independent errors. In the usual Gaussian version . The regression function is evaluated at the design sites, so it must be specified pointwise there, not only as an equivalence class. For , the observations concern on . They cannot identify its values outside this interval. Use an interval-adapted wavelet basis on , consisting of coarse functions and detail functions ; a Haar wavelet basis is one explicit choice.
Here is a wavelet regression estimator valid for every . Divide into cells , with the value at zero assigned arbitrarily, and form the observed step function on . For any normalized basis function , estimate its coefficient by
The wavelet regression estimator at resolution is therefore
Only finitely many interval basis functions occur. Its expectation is , where equals on . Thus approximation of includes the resolution bias and the grid discretization bias. For continuous , the latter tends uniformly to zero by uniform continuity. No smoothness or consistency claim for arbitrary pointwise representatives of functions is needed to define the estimator.
The common point-evaluation version replaces each weight by , giving
These are Riemann-sum approximations to the coefficient integrals. For Haar wavelets, , and , they equal the integrated-weight coefficients exactly if the dyadic cells and pointwise basis versions are chosen right-closed. Each retained basis function is then constant on every sampling cell. This gives a concrete implementation by the discrete wavelet transform. A sensible finest resolution has ; beyond the grid scale there are details the data cannot resolve.
For wavelet coefficient thresholding, retain the coarse coefficients but discard detail coefficients dominated by noise. A hard-threshold version is
Alternatively, soft thresholding replaces each detail coefficient by . The unthresholded wavelet regression estimator retains all details at the chosen resolution; thresholding retains evidence for local features while suppressing small fluctuations.
The thresholds can be derived from a simultaneous wavelet coefficient noise bound. Write . Independence gives
where the inequality applies the Cauchy-Schwarz inequality on each cell of length . In the dyadic Haar implementation, exactly. For Gaussian errors, the normalized coefficient noise is standard normal. More generally, independent centred sub-Gaussian random variables with parameter give
If detail coefficients are considered, a union bound consequently justifies
With probability at least , every retained detail's noise is below its corresponding threshold; independence between the coefficient errors is unnecessary. With of order and , these thresholds have the familiar order . Coefficients larger than their noise level represent potential signal, and a coefficient zero in the discretized mean is not selected on this simultaneous event. If is unknown, a consistent noise-scale estimate can be substituted; for Gaussian errors and predominantly negligible finest-level signal, the median absolute finest-level coefficients divided by the standard-normal absolute median estimates . Without a Gaussian or sub-Gaussian tail assumption, finite variance alone does not justify the logarithmic thresholds: Chebyshev inequality and the union bound instead permit .
An orthonormal multiresolution analysis consists of closed subspaces , , with , , , and the dilation equivalence . A scaling function has integer translates forming an orthonormal basis of . Hence
is an orthonormal basis of . Set , the orthogonal complement of inside . A function whose integer translates form an orthonormal basis of produces a complete orthonormal wavelet system : different are orthogonal, their sum contains every difference , and density together with the zero intersection exhausts .
Here is the filter construction that guarantees such a wavelet. Nesting puts in , so expansion in its orthonormal basis gives the scaling refinement equation , with . Define the MRA low-pass filter and its complementary quadrature mirror filter by
Splitting the orthonormal translates and Fourier periodization identity at , as in part (b), gives almost everywhere. Consequently the rows of
have length one and are orthogonal; the matrix is unitary. Put and , so .
To see completeness as well as orthogonality, identify with its fine-scale coefficient sequences and take their Fourier series. Group the frequencies and over a half-period. The two rows of the displayed matrix are the normalized coarse and complementary channels; their unitarity is exactly an onto isometry from these two channels to the fine-scale coefficient space. Translates of and correspond to the Fourier basis in the respective channels. They therefore jointly form an orthonormal basis of . The orthogonal complement channel gives the wavelet completion of a multiresolution filter, namely the integer translates of span . This proves the asserted relation with an orthonormal wavelet.
An orthonormal multiresolution analysis consists of closed subspaces of a Hilbert space of the Hilbert space such that
There is a scaling function whose integer function translations form an orthonormal basis of . Consequently form an orthonormal basis of ; in particular is invariant under integer function translations.
Let be the orthogonal complement of in . Nesting, density and the trivial intersection imply the orthogonal direct sum
For example, telescoping and letting , gives this decomposition; the corresponding orthogonal projections converge strongly to zero and the identity by the intersection and density properties.
To construct the orthonormal wavelet, use to write the scaling refinement equation , with and . Put . The orthonormal translates and Fourier periodization criterion proved in part (b), applied to the scaling refinement equation, yields
This is the quadrature mirror filter identity. Define
The Fourier series of is , and . The two rows and form a unitary matrix almost everywhere: both have squared norm one and their inner product is zero. This wavelet completion of a multiresolution filter proves not just orthogonality but completeness. Splitting a finer-scale coefficient Fourier series into its values at and , this invertible two-channel matrix resolves it into a coarse-scale channel and its complementary channel. Thus the integer function translations of form an orthonormal basis of .
The dilated functions therefore form an orthonormal basis of each . The orthogonal direct sum proves the conclusion: every orthonormal multiresolution analysis produces an orthonormal wavelet basis of .
An orthonormal multiresolution analysis consists of closed subspaces of the L2 space with , dense union, intersection , and the dilation rule . A scaling function has integer translates forming an orthonormal basis of . Equivalently,
form an orthonormal basis of . Let . Density and the trivial intersection imply .
Nesting gives the scaling refinement equation , with the coefficients in the normalized finer-scale basis. Orthogonality of the translates gives . Its Fourier form is the quadrature mirror filter identity , where .
Set and define in . Its high-pass symbol is . The matrix
is unitary almost everywhere. Under the identification of with its finer-scale coefficient space, this two-channel unitary transform splits that space into the translates of and the translates of . The latter are therefore an orthonormal basis of . Dilating gives an orthonormal wavelet basis
This wavelet completion of a multiresolution filter explains how the multiresolution analysis supplies a single orthonormal wavelet. The argument uses coefficient-space completeness, not just pairwise orthogonality.
Let denote the orthogonal complement of inside . The Meyer-Mallat theorem constructs a wavelet whose integer function translations form an orthonormal basis of . Dilation then gives the orthogonal decomposition into orthogonal complements , so its translates and dilates form an orthonormal wavelet basis.
Using the MRA low-pass filter, choose the high-pass symbol . The quadrature mirror filter identity makes the two analysis channels orthonormal. The resulting Fourier transform formula is
Equivalently, with the refinement coefficients from the scaling refinement equation, put and . This index choice gives precisely the displayed high-pass symbol. Changing all by one constant unit phase gives the same orthonormal wavelet construction. In particular the often-used convention differs only by a global minus sign. The basis is for .
An orthonormal wavelet is a function whose integer translates and dyadic dilates
form an orthonormal basis of the Hilbert space . Thus their pairwise inner products are , and their closed linear span is the whole space. Equivalently, every has the norm-convergent expansion
The factor preserves the norm under dilation.
Put , the detail space of the multiresolution analysis. The Meyer-Mallat theorem gives a function whose integer translates form an orthonormal basis of . Dilations then give an orthonormal basis of each , and the density and trivial-intersection axioms imply
For an explicit filter construction, write the scaling refinement equation . With a quadrature mirror filter one may take and . A harmless constant sign or integer translation gives an equivalent orthonormal wavelet.
Either essay option suffices; both are developed here to make the two mathematical constructions available.
Diffusion for images. Model grey level as , initially , and use a Neumann boundary condition to avoid flux across an image boundary. The linear heat equation smooths the data. On its solution is convolution with the heat kernel, . Equivalently each Fourier mode is multiplied by , suppressing high frequencies and noise. With no flux, the mean is conserved and
The drawback is that sharp edges also contain high frequencies: a step becomes a transition of width comparable to . Running the heat equation backwards attempts sharpening but amplifies modes by and is ill-posed.
The Perona-Malik equation instead uses a decreasing diffusivity,
Small gradients are smoothed strongly and large ones less strongly. If and is a unit tangent to a level curve, then away from zero gradient,
The derivative of the flux, rather than just , controls forward parabolicity. Here becomes negative for : smoothing remains tangential but the normal direction can sharpen. This formal edge enhancement comes with forward-backward ill-posedness, so existence and stability of the unregularized continuum equation must not be presumed. One regularization uses as a smoothed edge detector while keeping the flux proportional to . For fixed positive , the coefficient is controlled by the smoothed data; under suitable bounds it stays positive and gives a regularized forward equation. It preserves edges through reduced cross-edge transport, without the same local backward-diffusion calculation.
Diffusion from a gradient energy connects these equations with variational regularization. If , its formal gradient flow is . Linear diffusion corresponds to . The displayed Perona-Malik equation corresponds to , which is nonconvex in the gradient for large . A convex alternative is total variation flow, with , interpreted through a subgradient at zero gradient. Adding squared data fidelity gives the formal evolution , whose equilibrium is the unique total variation denoising minimizer. Convex TV preserves sharp interfaces more effectively than the heat energy, but it may produce piecewise constant plateaux, known as staircasing in total variation denoising. A stopping time or fidelity weight controls the smoothing scale. Linear diffusion is stable but blurs edges; nonlinear diffusion must balance edge selectivity with parabolicity and regularization.
Wavelets on an interval. Simply restricting a whole-line orthonormal wavelet to destroys its orthogonality and generally its vanishing moments. Periodizing the basis restores orthogonality on the circle, but treats the two endpoints as neighbors. This is suitable for periodic data and can create an artificial endpoint jump for nonperiodic data.
A localized interval-adapted wavelet basis instead uses unchanged interior functions and finitely many special boundary wavelets at each endpoint. Start with a sufficiently regular compact support orthonormal Daubechies wavelet of order at least and choose a coarse level at which left and right boundary supports are disjoint. At each boundary, take appropriate finite combinations of the scaling functions that meet the endpoint, restricted to the interval. Choose these combinations to reproduce polynomials of degrees , remove dependencies, and orthonormalize the finite boundary Gram matrix. The choices must be compatible with refinement so that the resulting finite-dimensional spaces are nested; independent arbitrary orthonormalizations would not ensure this. Interior functions retain their whole-line filters, while the boundary functions use finite boundary refinement matrices.
For each level, choose an orthonormal basis of the orthogonal complement . It consists of interior wavelets and a bounded number of left and right boundary wavelets. Since the polynomial restrictions of degree less than belong to , every member of has vanishing moments. The compatible local boundary construction retains support diameter and the regularity of the interior construction. Boundary modification affects only finitely many functions at each level, so increasing resolution still makes the union dense in . Consequently, for a fixed coarse level ,
The coarse scaling functions together with all these wavelets form an orthonormal basis. This construction is the Cohen-Daubechies-Vial interval wavelet construction. It preserves localization, polynomial cancellation and stable coefficient extraction without imposing periodic or zero boundary data. The finite boundary refinement matrices also permit a fast transform; a mere restriction followed by one unrelated Gram-Schmidt process at each scale does not establish all these properties.
An orthonormal wavelet is such that is an orthonormal basis. A multiresolution analysis is a nested family of closed spaces with trivial intersection, dense union, dyadic scaling, integer-translation invariance of , and a generator whose integer translates form an orthonormal basis of . The Meyer-Mallat theorem says every such analysis has an orthonormal wavelet whose translates span .
Wavelet Created 2026-09-24 Updated 2026-10-14
A wavelet is a localized analyzing function whose shifted and scaled copies examine a signal at different positions and resolutions. Its usefulness is to separate where a change occurs from how large a region that change spans. A brief feature can contribute to a few nearby wavelet coefficients instead of being described entirely through global oscillations.
The Haar wavelet is the simplest example: compare the first half of an interval with the second. A constant value contributes nothing to this contrast, while a difference between the halves survives. Moving the function changes which part of the signal is examined; shrinking it compares smaller neighbouring regions. In an orthonormal wavelet construction, these comparisons fit together without duplicating squared-norm contributions.
A scaling function retains the coarse information that such contrasts omit. The discrete wavelet transform computes both coarse values and details, and the wavelet series recombines them. This gives signal processing a representation that can expose local structure and support image compression. The transform itself is reversible in the complete orthonormal representation; discarding coefficients introduces approximation error. [ref]
For a scaling refinement equation , set . The quadrature mirror filter identity makes the two rows and a unitary matrix, where . The complementary coefficients yield . In a multiresolution analysis, coefficient-space completeness shows its translates form an orthonormal basis of , hence its dilations and translates form an orthonormal wavelet basis of the whole space.
For and , define the shifted, scaled analyzing function and its coefficient by
Assume the product is integrable; for example this holds for a locally integrable function and a bounded analyzing function with compact support. The bar is complex conjugation. This normalization preserves the L2 norm of the analyzing function. If is a polynomial of degree of a polynomial less than , then is a sum of monomials with . Linearity of integration and the vanishing moments give at every position and scale. Nonzero polynomials on the whole real line are not square-integrable, so this cancellation is an integral pairing; it is not a claim that these polynomials are vectors of .
Here is a quantitative reason that smooth regions yield small details. Let have compact support and vanishing moments, and suppose is times continuously differentiable on an interval containing and . Subtract its degree- Taylor polynomial at . If on that interval, the Taylor remainder bound gives
The factor comes from the Taylor remainder; comes from the coefficient normalization. Thus the analyzing function measures the departure from the local polynomial trend, rather than the height of itself. The wavelet coefficient decay for Hölder functions uses the same argument with a Hölder-Taylor remainder bound. These estimates concern regularity of on the analyzing function's entire support of a function; extra vanishing moments alone do not make smooth or establish an orthonormal wavelet construction.[ref]
Wavelet series 2026-10-14
For an orthonormal wavelet and its scaling function, set and similarly for . The coarse scaling functions together with nonnegative-resolution wavelets form an orthonormal basis of . The coefficients are the corresponding L2 inner products. The series converges in the L2 norm, and the Parseval identity for a Hilbertian basis equates squared norm with the sum of squared coefficients. Pointwise convergence requires additional hypotheses.