This construction adapts compactly supported orthonormal wavelets to an interval by finite changes near its endpoints. It preserves local support, polynomial reproduction, nested approximation spaces and orthogonal detail spaces. The resulting basis contains coarse scaling functions, unchanged interior wavelets, and finitely many boundary wavelets per endpoint and per scale, without forcing periodic or zero boundary values.
Assume the scaling function Fourier transform and the MRA low-pass filter are , and for . For every nonzero integer , write with odd. Iterating the scaling refinement equation at supplies a factor . All its derivatives of order less than vanish at , by periodicity. The product rule gives for .
An interval-adapted wavelet basis is an orthonormal basis of made of a finite coarse scaling function family and resolution-indexed wavelets. A localized construction modifies only a bounded number of functions near each endpoint at every level. Boundary modification must preserve nested refinement spaces and the required vanishing moments; simple restriction of a whole-line basis does not do so.
Let
The Fourier coefficients of are absolutely summable, so belongs to the Wiener algebra, as does . The identity implies . Starting with a compactly supported Daubechies wavelet having vanishing moments, the periodic phase change of a scaling function gives , while the canonical high-pass construction leaves unchanged.
At a dyadic point , the terms of the difference quotient with and each contribute . Their number tends to infinity, their total error is bounded, and the remaining tail contributes a bounded amount. Hence , so neither nor has a finite derivative there. These points are dense. Away from the isolated zero of near , multiplication by its nonzero smooth value cannot remove this nondifferentiability. Thus the new MRA low-pass filter is not differentiable throughout any neighborhood of , despite integrability of the scaling function and unchanged vanishing moments. Ordinary higher derivatives at cannot be inferred, although the corresponding Peano zero survives.
For an orthonormal scaling function satisfying , its low-pass Fourier series symbol is . The scaling refinement equation becomes . The symbol is initially an almost-everywhere defined periodic function; the assumption that the scaling function is Lebesgue integrable alone does not make it smooth. The orthonormal translates give the quadrature mirror filter identity.
Use and let be the orthogonal projection onto the closed span of the orthonormal translates and dilates of a scaling function. If is supported in and , then
Indeed, the Plancherel theorem writes the coefficient against as . With , these are times the Fourier series coefficients of on . The Parseval identity proves the formula. It shows that continuity and unit modulus at zero imply density of the refinement spaces, and conversely that density forces this unit modulus when the Fourier transform is continuous at zero.
Multiresolution analysis Created 2026-09-24 Updated 2026-10-14
A multiresolution analysis organizes a function into successively finer approximation spaces. In the usual orthonormal construction on , these are closed linear subspaces with
Rescaling relates the levels: if and only if . Integer translates of a scaling function form an orthonormal basis of . The detail space is the orthogonal complement of inside , giving . Coarse information and new details therefore fit together without overlap in squared L2 norm.
For the Haar wavelet, consists of square-integrable functions constant on cells of length . Splitting every cell into two halves creates one new contrast per old cell, the Haar refinement identity. On the bounded example , the first three spaces have dimensions : a whole-interval mean, two half-interval means, and four quarter-interval means. The Haar projection diagram displays those three resolutions. This bounded construction starts at level zero; the displayed intersection condition refers to the full family on the real line.
The usefulness is a controlled way to increase resolution. Earlier coarse information remains available while new wavelet coefficients identify what the finer description adds. The wavelet approximation complexity connects this extra resolution to both approximation error and the number of coefficients being estimated. [ref]
An orthonormal multiresolution analysis is a sequence of closed subspaces satisfying , , , and iff . A scaling function has integer translates forming an orthonormal basis of , and its scaled translates span . Thus contains information at resolution about .
The detail space is generated by the corresponding wavelet functions . The orthogonal splitting iterates to
Accordingly a square-integrable signal has a coarse-and-detail wavelet series,
and its wavelet projection onto keeps the coarse coefficients and details below level . Increasing adds finer-scale oscillations and localized features. On the real line there are infinitely many translates at each level; for a bounded observation interval, with an appropriate interval or periodic construction, the relevant approximation dimension satisfies . For the Haar wavelet on a unit interval this is exactly , corresponding to a separate mean on each dyadic subinterval.
This hierarchy gives a concrete meaning to wavelet approximation complexity. Coarse resolution uses few coefficients and can miss sharp features; fine resolution uses more coefficients and can fit noise. By orthogonality, projection bias is the energy of the omitted details,
For an orthonormal sequence model with independent coefficient noise of variance , estimating the retained coefficients without shrinkage gives
The first term decreases with resolution while the second increases, making the bias-variance tradeoff explicit. Equivalently, a fixed orthogonal regression projection of rank has effective degrees of freedom and prediction optimism under independent equal-variance errors.
Wavelets also permit local rather than only global complexity control. Thresholding small estimated detail coefficients, for example by soft thresholding, retains strong local structure while suppressing fine-scale noise elsewhere. A sparse retained coefficient set can represent localized features much more economically than keeping every coefficient through a high level. Its locations and scales matter as well as its count. If that set is selected using the same noisy responses, however, selection adds adaptivity: its raw coefficient count is not automatically its covariance-based degrees of freedom. Resolution or threshold tuning should therefore account for prediction error, using an appropriate risk estimate or cross-validation, rather than only decreasing training error.
Wavelet complexity is controlled by retained resolutions and coefficients; more detail reduces approximation bias while increasing estimation variance and sensitivity to noise.
Let be the scaling function and an orthonormal wavelet, with and . For , the wavelet series at a coarse level is
The series converges in the L2 norm. Its coarse part captures broad variation and successive wavelet levels add finer detail. Truncating at levels produces the orthogonal projection onto ; Parseval identity makes its squared approximation error the sum of the omitted squared coefficients. Merely square-integrable functions need not have pointwise convergence.
For the Haar wavelet, use the cell convention and let be the unique such interval containing . The Haar scaling functions are , so the Haar projection is
For a merely locally integrable function this cell-average formula remains defined, even if a global orthogonal projection is unavailable. If , the mean value theorem gives Lipschitz continuity and, since on the cell,
Thus the requested bound holds with , by the Haar projection error for a Lipschitz function.
To estimate a density, replace each scaling or wavelet coefficient or by the sample average of that basis function. The finite-resolution Haar density estimator is therefore
It is the histogram on the dyadic cells, is nonnegative, and integrates to one. Its expectation is . A density with bounded derivative is bounded: the Lipschitz density height bound gives by integrating the triangular lower envelope . The case cannot be a probability density on the whole real line. Hence .
The cell probability is . The sample count has a binomial distribution, so
The Cauchy-Schwarz inequality bounds the mean centered absolute deviation by the square root of this variance. Adding the projection bias gives
Choose , so . The two terms have the same order, and
This is a bias-variance tradeoff: refining the cells decreases the averaging bias but increases the sampling variance.
The Haar projection averages this normal distribution density on each cell; the finer cells follow its variation more closely. A Haar density estimator replaces these exact cell probabilities by empirical frequencies and therefore also introduces sampling noise.
For an orthonormal wavelet construction, set
The scaling function generates the approximation spaces , while generates the detail spaces in the multiresolution analysis, with . At coarse resolution zero, the family is an orthonormal basis of .
For the given square-integrable function the coefficients and wavelet series are
For real wavelets these are the real L2 inner products; use complex conjugates for a complex basis. The series converges in the L2 norm, and its coefficients satisfy the Parseval identity for a Hilbertian basis
An hypothesis alone does not assert pointwise convergence.
The resolution- wavelet projection is the orthogonal projection onto :
The two expressions coincide by iterating . Orthogonality gives , which tends to zero. One can equivalently write the projection with kernel , interpreted as the same orthogonal projection.
In fixed-design nonparametric regression, the observations satisfy
with independent errors. In the usual Gaussian version . The regression function is evaluated at the design sites, so it must be specified pointwise there, not only as an equivalence class. For , the observations concern on . They cannot identify its values outside this interval. Use an interval-adapted wavelet basis on , consisting of coarse functions and detail functions ; a Haar wavelet basis is one explicit choice.
Here is a wavelet regression estimator valid for every . Divide into cells , with the value at zero assigned arbitrarily, and form the observed step function on . For any normalized basis function , estimate its coefficient by
The wavelet regression estimator at resolution is therefore
Only finitely many interval basis functions occur. Its expectation is , where equals on . Thus approximation of includes the resolution bias and the grid discretization bias. For continuous , the latter tends uniformly to zero by uniform continuity. No smoothness or consistency claim for arbitrary pointwise representatives of functions is needed to define the estimator.
The common point-evaluation version replaces each weight by , giving
These are Riemann-sum approximations to the coefficient integrals. For Haar wavelets, , and , they equal the integrated-weight coefficients exactly if the dyadic cells and pointwise basis versions are chosen right-closed. Each retained basis function is then constant on every sampling cell. This gives a concrete implementation by the discrete wavelet transform. A sensible finest resolution has ; beyond the grid scale there are details the data cannot resolve.
For wavelet coefficient thresholding, retain the coarse coefficients but discard detail coefficients dominated by noise. A hard-threshold version is
Alternatively, soft thresholding replaces each detail coefficient by . The unthresholded wavelet regression estimator retains all details at the chosen resolution; thresholding retains evidence for local features while suppressing small fluctuations.
The thresholds can be derived from a simultaneous wavelet coefficient noise bound. Write . Independence gives
where the inequality applies the Cauchy-Schwarz inequality on each cell of length . In the dyadic Haar implementation, exactly. For Gaussian errors, the normalized coefficient noise is standard normal. More generally, independent centred sub-Gaussian random variables with parameter give
If detail coefficients are considered, a union bound consequently justifies
With probability at least , every retained detail's noise is below its corresponding threshold; independence between the coefficient errors is unnecessary. With of order and , these thresholds have the familiar order . Coefficients larger than their noise level represent potential signal, and a coefficient zero in the discretized mean is not selected on this simultaneous event. If is unknown, a consistent noise-scale estimate can be substituted; for Gaussian errors and predominantly negligible finest-level signal, the median absolute finest-level coefficients divided by the standard-normal absolute median estimates . Without a Gaussian or sub-Gaussian tail assumption, finite variance alone does not justify the logarithmic thresholds: Chebyshev inequality and the union bound instead permit .
An orthonormal multiresolution analysis consists of closed subspaces , , with , , , and the dilation equivalence . A scaling function has integer translates forming an orthonormal basis of . Hence
is an orthonormal basis of . Set , the orthogonal complement of inside . A function whose integer translates form an orthonormal basis of produces a complete orthonormal wavelet system : different are orthogonal, their sum contains every difference , and density together with the zero intersection exhausts .
Here is the filter construction that guarantees such a wavelet. Nesting puts in , so expansion in its orthonormal basis gives the scaling refinement equation , with . Define the MRA low-pass filter and its complementary quadrature mirror filter by
Splitting the orthonormal translates and Fourier periodization identity at , as in part (b), gives almost everywhere. Consequently the rows of
have length one and are orthogonal; the matrix is unitary. Put and , so .
To see completeness as well as orthogonality, identify with its fine-scale coefficient sequences and take their Fourier series. Group the frequencies and over a half-period. The two rows of the displayed matrix are the normalized coarse and complementary channels; their unitarity is exactly an onto isometry from these two channels to the fine-scale coefficient space. Translates of and correspond to the Fourier basis in the respective channels. They therefore jointly form an orthonormal basis of . The orthogonal complement channel gives the wavelet completion of a multiresolution filter, namely the integer translates of span . This proves the asserted relation with an orthonormal wavelet.
Use the Fourier transform convention and the Plancherel theorem normalization . For a general scaling function, the transform means its extension; an ordinary absolutely convergent integral is not required.
A change of variables gives . Thus the scaling refinement equation transforms to , or , with the -periodic MRA low-pass filter . The periodicity is necessary; allowing an arbitrary quotient would not express refinement by integer translates.
For orthonormality, let . This is a -periodic function, since . The Plancherel theorem gives
These inner products equal precisely when the Fourier coefficients of agree with those of one. The uniqueness of Fourier coefficients in L1 proves the equivalence
For completeness, the converse refinement implication is also valid with the natural series interpretation. Suppose this periodization identity and hold for a measurable -periodic . Splitting the periodization at into even and odd translates gives
Hence is bounded and belongs to of a period. Write in and let denote the symmetric partial sums. Since ,
After substituting , this proves convergence of the transformed refinement sums to in . Inverting the Fourier transform proves in . Thus the two spatial conditions and the two Fourier conditions are equivalent, with the periodic mask and convergence conventions made explicit.
An orthonormal multiresolution analysis consists of closed subspaces of a Hilbert space of the Hilbert space such that
There is a scaling function whose integer function translations form an orthonormal basis of . Consequently form an orthonormal basis of ; in particular is invariant under integer function translations.
Let be the orthogonal complement of in . Nesting, density and the trivial intersection imply the orthogonal direct sum
For example, telescoping and letting , gives this decomposition; the corresponding orthogonal projections converge strongly to zero and the identity by the intersection and density properties.
To construct the orthonormal wavelet, use to write the scaling refinement equation , with and . Put . The orthonormal translates and Fourier periodization criterion proved in part (b), applied to the scaling refinement equation, yields
This is the quadrature mirror filter identity. Define
The Fourier series of is , and . The two rows and form a unitary matrix almost everywhere: both have squared norm one and their inner product is zero. This wavelet completion of a multiresolution filter proves not just orthogonality but completeness. Splitting a finer-scale coefficient Fourier series into its values at and , this invertible two-channel matrix resolves it into a coarse-scale channel and its complementary channel. Thus the integer function translations of form an orthonormal basis of .
The dilated functions therefore form an orthonormal basis of each . The orthogonal direct sum proves the conclusion: every orthonormal multiresolution analysis produces an orthonormal wavelet basis of .
An orthonormal multiresolution analysis consists of closed subspaces of the L2 space with , dense union, intersection , and the dilation rule . A scaling function has integer translates forming an orthonormal basis of . Equivalently,
form an orthonormal basis of . Let . Density and the trivial intersection imply .
Nesting gives the scaling refinement equation , with the coefficients in the normalized finer-scale basis. Orthogonality of the translates gives . Its Fourier form is the quadrature mirror filter identity , where .
Set and define in . Its high-pass symbol is . The matrix
is unitary almost everywhere. Under the identification of with its finer-scale coefficient space, this two-channel unitary transform splits that space into the translates of and the translates of . The latter are therefore an orthonormal basis of . Dilating gives an orthonormal wavelet basis
This wavelet completion of a multiresolution filter explains how the multiresolution analysis supplies a single orthonormal wavelet. The argument uses coefficient-space completeness, not just pairwise orthogonality.
Use the unnormalized Fourier transform in the question and the Plancherel theorem, with inverse factor . For a general scaling function, the transform is interpreted in the sense; the printed integral need not be absolutely convergent. All frequency identities are almost-everywhere statements.
Changing variables in the Fourier transform gives
Thus taking the transform of the scaling refinement equation gives , or
Conversely the same calculation and injectivity of the Fourier transform recover refinement, with convergence understood in .
To justify both the orthogonality assertion and this convergence precisely, put . It belongs to by monotone integration. The Plancherel theorem gives
Hence orthonormality of all integer translates is equivalent, by uniqueness of Fourier coefficients in L1, to the periodized-energy condition
When this holds, the squared norm of is , so square-summable coefficient series converge in . In the converse direction the refinement identity and give, by splitting the periodization of into even and odd translates,
Thus is bounded and its Fourier coefficients are square summable. If are its Fourier partial sum, then
This verifies the transformed refinement series converges to , completing the equivalence of the two pairs of conditions without imposing an unnecessary assumption on .
Use the Fourier transform convention . An orthonormal multiresolution analysis is a family of closed vector subspaces , indexed by integers, with , , and . Its dilation condition is if and only if . The space is invariant under integer function translations and admits a scaling function whose integer function translations form an orthonormal basis. Consequently form an orthonormal basis of .
Since , expansion in that orthonormal basis gives the scaling refinement equation
The series converges in the L2 norm. The associated low-pass filter of a multiresolution analysis is the periodic Fourier series symbol
Initially the symbol is defined almost everywhere. Orthonormal integer function translations give the quadrature mirror filter identity almost everywhere. For a Lebesgue integrable scaling function, its Fourier transform is continuous and ; choosing a constant phase makes and the continuous representative near zero has . Different conventions absorb into the refinement coefficients; the displayed convention fixes that ambiguity.
A wavelet with vanishing moments satisfies and for . The moment differentiation of the Fourier transform theorem states that these weighted integrability hypotheses make , with . Hence . The MRA projection Fourier identity, together with density of the approximation spaces and continuity of at zero, gives . These are the two analytic theorems needed in addition to the quadrature mirror filter construction.
For the ordinary derivative conclusion, assume also that the MRA low-pass filter is near and is near zero. These hypotheses hold, for example, for a compactly supported scaling function with a finite refinement filter. The wavelet identity gives
The denominator is nonzero near zero. Its reciprocal and the exponential are , so the product rule and the zero Taylor polynomial of give the smooth-mask vanishing-moment criterion
The printed integrability hypothesis alone does not guarantee ordinary higher derivatives. It gives only a continuous . Without added smoothness, Taylor theorem for still gives for the representative defined by the quotient: a Peano zero. This establishes the value at , and for the first derivative there, but it does not automatically establish iterated derivatives.
Here is a lacunary scaling-phase regularity counterexample for . Start with a compactly supported Daubechies wavelet having vanishing moments, with scaling function and finite MRA low-pass filter . Define the periodic phase
The Fourier coefficients of are absolutely summable. The Wiener algebra is closed under multiplication and the exponential series, so and have absolutely summable Fourier coefficients. Thus is an absolutely summable combination of integer function translations of , belongs to , and generates the same . Unimodularity preserves orthogonality and unit norm of its integer function translations; the inverse phase preserves their complete span. The same approximation spaces therefore give a multiresolution analysis.
The identity gives , so the periodic phase change of a scaling function produces . In the high-pass formula the phases cancel:
The associated wavelet is therefore exactly the original one, with unchanged vanishing moments.
At any dyadic point , the difference quotient of the terms with is per term. The sum of these errors and the remaining tail divided by are bounded; the finitely many earlier terms have finite limits. Hence , which has no finite limit. The exponential has the same failure of differentiability. Dyadic points are dense, and is nonzero for sufficiently small . Thus is not differentiable on any neighborhood of , so an ordinary second derivative at , understood as the derivative of a locally defined first derivative, need not exist. The Peano zero remains valid. This separates the intended smooth-mask theorem from what the literal assumptions establish.
Use localization and cancellation of the assumed interval-adapted wavelet basis: at scale , every detail wavelet has support diameter at most , L1 norm at most , and annihilates polynomials of degree less than . These bounds also apply to the modified boundary wavelets; a restriction of an arbitrary whole-line wavelet without the cancellation-preserving boundary construction would not suffice. The finitely many coarse scaling functions can be treated separately.
Write with as above. Because , we have . Choose in the support of a function of , and let be the degree- Taylor polynomial of . The Hölder-Taylor remainder bound gives
For this is the Hölder seminorm bound. For , the integral Taylor remainder is bounded using , whose magnitude is at most .
The vanishing moments remove from the inner product. Applying the remainder estimate and the L1 norm bound on the localized support yields the wavelet coefficient decay for Hölder functions
Thus
Here depends on the fixed wavelet family, the exponent and boundary construction, but not on . The proof uses the assumed regularity and moments; it does not identify the minimal Daubechies wavelet order with its differentiability order, which need not coincide.
Let bound the piecewise Hölder norms, and let . At scale , classify a wavelet as bad when its localized support of a function meets a discontinuity, and as good otherwise. Compact support and bounded overlap imply at most bad wavelets per scale and at most total wavelets. A good support lies in a single smooth piece, so the preceding wavelet coefficient decay for Hölder functions gives . The permitted bounded-function estimate gives for bad coefficients.
Consider a specific N-term approximation: retain all coarse scaling functions and all wavelets through scale , and also retain the bad coefficients at scales , where . Since , for large . Its term count is bounded by
By the Parseval identity, its squared L2 norm error is the sum of omitted squared coefficients. The good tail satisfies
and the remaining bad tail satisfies
Choose with a fixed sufficiently large ; then the extra terms fit the remaining budget for all sufficiently large , while is comparable to . Padding to terms does not increase the error. The best N-term approximation is at least as accurate as this constructed selection, so
The constant may depend on the finite number of jumps, the piecewise Hölder norms, and the fixed wavelet family. Values exactly at the jumps are immaterial in . The improvement comes from retaining only a bounded number of jump-crossing coefficients at each finer scale, as in best N-term wavelet approximation of piecewise Hölder functions.
Let be the orthogonal projection onto . The dilation property and the orthonormal basis property give the orthonormal basis of . The periodized nonnegative function
has period one and , by Tonelli theorem. For a function with compact support contained in a bounded interval , Cauchy-Schwarz inequality and the Parseval identity give
as . The last step uses absolute continuity of the integral of a locally function, since the interval's length tends to zero. If , then
Functions with compact support are dense in , so . Consequently
This proof needs neither the density axiom nor any compact support assumption on the scaling function.