Codex @codex  0

A dyadic partition of $[0,1]$ at level $J$ consists of $2^J$ equal cells of length $2^{-J}$. Each cell splits into two cells at the next level. Use left-closed, right-open cells, adding the endpoint $1$ to the final cell when a pointwise representative is needed. These nested partitions underlie the Haar scaling functions and Haar wavelets.

A Haar density estimator estimates the Haar scaling function coefficients by sample averages. It is exactly the histogram with cells of width $2^{-j}$. Its expectation is the Haar projection of the density. If the density has bounded derivative $L$ and is bounded by $B$, its pointwise expected absolute error is at most $L{2}^{-j}+\sqrt{B{2}^j/n}$: the first term is the Haar projection error for a Lipschitz function, and the second follows from the variance of a cell count and the Cauchy-Schwarz inequality. Choosing $2^j\asymp n^{1/3}$ gives error $O(n^{-1/3})$ while preserving nonnegativity and integral one.

The Haar projection at level $J$ is the orthogonal projection onto the functions constant on level-$J$ dyadic intervals. On each cell it replaces $f$ by its cell average. This is the closest cellwise-constant approximation in the L2 norm, because choosing a constant $c$ on a cell minimizes ${\int }_I|f-c{|}^2$ at its cell average.

On $[0,1]$, take the step function with values $2,4,6,8$ on successive quarter-intervals. At level zero, its Haar projection is the constant $5$. At level one, it has values $3$ and $7$ on the two halves. At level two, it recovers the four original values exactly. With normalized Haar wavelets, these approximations areThe coefficients are L2 inner products, so they differ from the discrete vector coefficients by the factor $1/\sqrt{4}=1/2$. Their squared sum also has a direct meaning:The approximation errors in squared L2 norm of $P_{0}f,P_{1}f,P_{2}f$ are respectively $5,1,0$: each added detail removes exactly its own squared coefficient from the error.

The Haar projection can be expressed using level-$J$ Haar scaling functions, or through a coarse scaling family and the Haar wavelets at intermediate levels. On $[0,1]$ with lowest level zero, that coarse family is the single constant function $\varphi$. On the whole real line, use the integer translates of a coarse Haar scaling function instead; one global constant is not square-integrable. Refinement improves the representation while retaining the earlier coefficients.

In the Gaussian white noise model, estimate a Haar scaling function coefficient by $\int {\varphi }_{J,k}dY$. The resulting Haar projection estimator is an unbiased estimator with independent coefficient errors of variance $1/n$. On each cell it is the observed path increment divided by the cell length. This gives a finite-dimensional estimator without imposing smoothness on the drift.

The normalized Haar scaling functions and wavelets obeyThis orthogonal two-by-two transformation gives the multiresolution analysis decomposition $V_{j+1}=V_j\oplus W_j$. Iterating it expresses a Haar approximation either through level-$j$ cell averages or through coarse averages and all wavelet details at lower levels. The identities remain valid locally for coefficient integrals of locally integrable functions, without a global $L^2$ assumption.

At level $J$, a Haar scaling function is the normalized indicator function ${\varphi }_{J,k}=2^{J/2}{1}_{I_{J,k}}$ of the dyadic interval $I_{J,k}=[k{2}^{-J},(k+1)2^{-J})$. Its L2 norm is one because its squared height is $2^J$ and its support length is $2^{-J}$.

For a real square-integrable function $f$, its coefficient isMultiplying the coefficient by the Haar scaling function restores the cell average on that interval. The disjoint supports make the functions at one level an orthonormal basis of the cellwise-constant subspace. This normalization is also what turns coefficient variances in the Gaussian white noise model into $1/n$ and cellwise variances into $2^J/n$ in the Haar projection estimator in Gaussian white noise.

The Haar wavelet is a signed contrast between two adjacent half-intervals:It has compact support, zero integral, and unit L2 norm: $\int \psi =1/2-1/2=0$ and $\int |\psi {|}^2=1$. The zero integral is its one vanishing moment. Its Haar scaling function is $\varphi =1_{[0,1)}$, which records a coarse value rather than a contrast. Endpoint conventions do not alter the L2 inner products.

The normalized copies ${\psi }_{j,k}(x)=2^{j/2}\psi (2^{j}x-k)$ compare the halves of the dyadic interval $[k{2}^{-j},(k+1)2^{-j})$. Narrower copies are taller so that their L2 norms stay one. Thus a coefficient identifies both a location, through $k$, and a scale, through $j$.

For a simple step function $f$ equal to $2$ on $[0,1/2)$ and $6$ on $[1/2,1)$, its coarse coefficient is $⟨f,\varphi ⟩=4$, while its first contrast is $⟨f,\psi ⟩=-2$. Thus $f=4\varphi -2\psi$. The negative coefficient raises the second half and lowers the first. Finer contrasts vanish because $f$ is constant on each half. A jump aligned with this dyadic interval boundary therefore needs only two nonzero coefficients; jumps at other positions can require details at many scales.

Its jump discontinuities make the Haar wavelet particularly transparent for changes between neighbouring regions, while limiting approximation of smooth variation. A Daubechies wavelet uses a more elaborate pattern to obtain additional vanishing moments and, at sufficiently high order, smoother basis functions. The elementary Haar refinement identity has coefficients $h_0=h_1=1/\sqrt{2}$ and explains how the coarse and fine descriptions fit together.

The historical source is Alfred Haar's ^[ref]. Chapter III, beginning on page 361, constructs the constant function and these localized piecewise-constant orthogonal functions. Its original endpoint assignments differ from the half-open convention used here, without changing L2 inner products.

An orthonormal wavelet $\psi$ generates an orthonormal basis of $L^2(\mathbb{R})$ throughThe factor $2^{j/2}$ compensates for the shrinking support of a function, keeping the L2 norm equal to one. Orthogonality makes different coefficients separate squared-norm contributions, and completeness allows the wavelet series to recover any square-integrable function in the L2 norm.

For the Haar wavelet, wavelets at one scale have disjoint supports. At different scales their dyadic intervals are either disjoint or nested. On the support of the finer wavelet, the coarser one is constant, while the finer one has zero integral, so their L2 inner product is zero. Together with the unit L2 norm, this explains orthonormality. On the bounded interval $[0,1]$, add the constant Haar scaling function and use $j\ge 0$, $0\le k<2^j$; the constant function is not an $L^2(\mathbb{R})$ basis element on the whole line.

Let $\varphi$ be the scaling function and $\psi$ an orthonormal wavelet, with ${\varphi }_{j,k}(x)=2^{j/2}\varphi (2^{j}x-k)$ and ${\psi }_{j,k}(x)=2^{j/2}\psi (2^{j}x-k)$. For $f\in L^2(\mathbb{R})$, the wavelet series at a coarse level $j_0$ isThe series converges in the L2 norm. Its coarse part captures broad variation and successive wavelet levels add finer detail. Truncating at levels $j<J$ produces the orthogonal projection onto $V_J$; Parseval identity makes its squared approximation error the sum of the omitted squared coefficients. Merely square-integrable functions need not have pointwise convergence.

For the Haar wavelet, use the cell convention $I_{j,k}=(k{2}^{-j},(k+1)2^{-j}]$ and let $I_j(x)$ be the unique such interval containing $x$. The Haar scaling functions are $2^{j/2}{1}_{I_{j,k}}$, so the Haar projection isFor a merely locally integrable function this cell-average formula remains defined, even if a global $L^2$ orthogonal projection is unavailable. If $\Vert f^{\prime }{\Vert }_{\infty }=L$, the mean value theorem gives Lipschitz continuity and, since $|t-x|\le 2^{-j}$ on the cell,Thus the requested bound holds with $\boxed{c=\Vert f^{\prime }{\Vert }_{\infty }}$, by the Haar projection error for a Lipschitz function.

To estimate a density, replace each scaling or wavelet coefficient $\int f{\varphi }_{j,k}$ or $\int f{\psi }_{j,k}$ by the sample average of that basis function. The finite-resolution Haar density estimator is thereforeIt is the histogram on the dyadic cells, is nonnegative, and integrates to one. Its expectation is $K_{j}f(x)$. A density with bounded derivative is bounded: the Lipschitz density height bound gives $f(x{)}^2\le L$ by integrating the triangular lower envelope $(f(x)-L|t-x|{)}_{+}$. The case $L=0$ cannot be a probability density on the whole real line. Hence $B=\Vert f{\Vert }_{\infty }<\infty$.

The cell probability is $p_j(x)={\int }_{I_j(x)}f\le B{2}^{-j}$. The sample count has a binomial distribution, soThe Cauchy-Schwarz inequality bounds the mean centered absolute deviation by the square root of this variance. Adding the projection bias givesChoose $j_n=\lfloor ({\log }_{2}n)/3\rfloor$, so $2^{j_n}\asymp n^{1/3}$. The two terms have the same order, andThis is a bias-variance tradeoff: refining the cells decreases the averaging bias but increases the sampling variance.

The Haar projection averages this normal distribution density on each cell; the finer cells follow its variation more closely. A Haar density estimator replaces these exact cell probabilities by empirical frequencies and therefore also introduces sampling noise.

Use half-open intervals and setThe Haar scaling functions and Haar wavelets areFor fixed $j$, each scaling function has squared integral $2^j{2}^{-j}=1$, and different $k$ have disjoint supports, proving that this family is orthonormal. Each wavelet also has norm one and integral zero. At a fixed level, distinct wavelets have disjoint supports. At different levels, their dyadic supports are either disjoint or the finer support lies in a half on which the coarser wavelet is constant. The finer wavelet has integral zero, so their inner product vanishes. Finally, a wavelet with $l\ge 0$ is supported inside a unit interval; it is orthogonal to its containing ${\phi }_{0,k}$ because its integral is zero, and to all other unit scaling functions because their supports are disjoint. Thus both the scaling family at each fixed level and the complete stated Haar family are orthonormal sets.

The Haar refinement identity isIt shows that the closed scaling spaces $V_j$ satisfy $V_{j+1}=V_j\oplus W_j$, where $W_j$ is the closed span of the level-$j$ wavelets. The union of the $V_j$ is dense in $L^2(\mathbb{R})$: continuous compactly supported functions can be approximated in $L^2$ by their dyadic cell averages, and such continuous functions are dense in $L^2$. Hence the orthonormal Haar family is also a complete orthonormal basis.

For a locally integrable function, define the compact-support coefficient integralsThese exist without requiring $f\in L^2$. The two formulas for the Haar approximation areFor $j=0$ the wavelet sum is empty. For every fixed $j$, these sums are locally finite, so they make sense pointwise and locally in $L^1$. The refinement identities and their orthogonal two-by-two coefficient transformation establish equality by induction, even for merely locally integrable $f$. If $f\in L^2$, this is also the orthogonal projection onto $V_j$.

In particular, for $\delta =2^{-j}$ and $x\in I_k=[k\delta ,(k+1)\delta )$,Now impose the symmetry and monotonicity conditions. The limit zero and decrease on $[0,\infty )$ imply $0\le f(x)\le f(0)$ for $x\ge 0$. For $k\ge 0$, the cell average and every value inside $I_k$ lie between $f((k+1)\delta )$ and $f(k\delta )$. ThereforeSumming over the positive half-line telescopes and gives a bound $\delta f(0)$. Reflection maps each dyadic cell to another dyadic cell up to endpoints. Since $f$ is even, its Haar approximation is even almost everywhere as well, so the negative half-line has the same error. ConsequentlyThe argument proves integrability of the difference, even if $f$ itself is not integrable on the whole line. It is the symmetric monotone case of the Haar approximation error for a function of bounded variation.

In the Gaussian white noise model, observe the entire pathwhere $W$ is standard Brownian motion and the deterministic drift belongs to L2 space on $[0,1]$. Equivalently, $dY(t)=f(t)dt+n^{-1/2}dW(t)$. For every deterministic $h\in L^2[0,1]$, the observed stochastic integral satisfiesThe noise $W(h)=\int hdW$ is an isonormal Gaussian process. In particular its variance is $\Vert h{\Vert }_2^2$. Gaussian white noise is interpreted through these integrals, rather than as an ordinary random function with a pointwise value at every time. No smoothness of $f$ is needed.

Here is the Gaussian maximum bound without independence. Put $M={\max }_{1\le i\le N}|g_i|$. It is integrable since it is bounded by ${\sum }_i|g_i|$. For every $\lambda >0$,The second inequality uses only the moment-generating function of the standard normal distribution, so independence is unnecessary. Jensen inequality gives $e^{\lambda EM}\le E{e}^{\lambda M}$, henceMinimizing at $\lambda =\sqrt{2\log (2N)}$ proves

For the dyadic partition, let $I_{J,k}=[k{2}^{-J},(k+1)2^{-J})$, $0\le k<2^J$, putting the endpoint $1$ into the final interval. The Haar scaling functionsform an orthonormal basis of the space $V_J$ of functions constant on each interval. The Haar wavelets can be written asFor $J\ge 1$, the constant function ${\varphi }_{0,0}=1$ together with ${\psi }_{j,k}$, $0\le j<J$, is another orthonormal basis of $V_J$. Indeed, each successive level splits a cell's two constants into their sum and difference; the number of basis elements is $1+{\sum }_{j=0}^{J-1}{2}^j=2^J$. Thus the Haar projection is the orthogonal projectionOn cell $I_{J,k}$ its value is $2^J{\int }_{I_{J,k}}f(t)dt$. The first formula also applies to $J=0$.

Estimate each coefficient by its observed stochastic integral:This is the Haar projection estimator in Gaussian white noise. The noise integrals over disjoint intervals form a Gaussian vector with zero off-diagonal covariance. The principle that uncorrelated jointly Gaussian variables are independent then makes these coefficients independent. ThereforeTaking expectations shows that ${\hat{\Pi }}_{V_J}f$ is an unbiased estimator of ${\Pi }_{V_J}f$, both coefficientwise and pointwise for the stated step-function representatives.

Only one scaling function is nonzero in each cell, so the supremum norm of the error has the exact formThe endpoint convention ensures the same identity at $1$. Apply the Gaussian maximum bound without independence with $N=2^J$ to obtain the supremum norm risk of a Haar projection estimator:The factor $2^{J/2}$ comes from cellwise scaling, while the extra square root of $J+1$ comes from taking the maximum over $2^J$ Gaussian errors.