Coherent gain of a window 2026-11-05
The coherent gain of a discrete window function is its mean coefficient:
It describes the amplitude scaling of a coherent complex tone under the chosen DFT normalization. Window coefficients and their normalization must be specified; a window's name alone does not fix every finite-length convention.[ref]
For , multiply by and evaluate the unnormalized discrete Fourier transform at the exact tone bin:
Thus recovers when . This result is exact for this complex-tone model. A real cosine also has a negative-frequency component; the usual doubled one-sided amplitude requires that its contribution to the chosen positive-frequency bin be absent or separately accounted for.
A rectangular window has . The periodic Hann window has for . Its coherent bin therefore has half the unwindowed amplitude before correction. The symmetric endpoint convention , for , instead gives . At this is , so blindly multiplying by two is not the exact correction for that convention.
Coherent gain does not correct every amplitude error. An off-bin tone samples the window's frequency response away from its maximum, and a DC-removing window with zero sum has no usable gain correction at all. Coherent sampling, leakage and window normalization are distinct conditions.
Noise uses a different scaling. For independent equal-variance samples, a weighted DFT bin's noise variance is proportional to , not . This motivates equivalent noise bandwidth in bins,
which is for a periodic Hann window with . The manufacturer's table lists both coherent gain and noise bandwidth rather than treating one as a substitute for the other.[ref]
The equivalent noise bandwidth of a finite window is the width of an ideal rectangular frequency response that passes the same white-noise power when both responses have the same peak gain. It quantifies noise collected by a spectral amplitude estimate, rather than the separation needed to distinguish two tones. For real coefficients with nonzero sum and sampling frequency ,
is in hertz; is in bins of an -sample record. The primary software documentation gives as the exact conversion factor between its squared spectrum and power-spectral-density scalings.[ref]
An original variance derivation explains the formula. Let independent zero-mean sample noise have variance , and form the complex amplitude estimate at frequency ,
Cross terms vanish by the independence and zero means, so
The flat two-sided input noise spectral density is . Integrating it over the peak-normalized window response gives the same result by Parseval identity. A one-sided real-signal convention folds negative-frequency power into positive frequencies; factors of two must be handled consistently, rather than changing the window’s bandwidth ratio.
For a rectangular window, and , giving . For the periodic Hann window with , the cosine sums give and , hence . These agree with the instrument manual’s tabulated values.[ref]
For an original numerical comparison, take and , so the original frequency grid spacing is . Rectangular and periodic Hann bandwidths are respectively and . With independent sample noise of standard deviation , the RMS magnitude of the zero-mean complex noise estimate is for rectangular weighting and about for Hann weighting. The latter variance is 1.5 times greater, despite Hann’s lower distant sidelobes. It is the RMS complex-error magnitude, not automatically the standard deviation of a positive spectral-magnitude display.
Zero padding leaves , the actual window coefficients and unchanged. If a 256-sample Hann record is padded to 1024 points, the display spacing becomes and the same bandwidth spans six displayed bins. Replacing by the padded FFT length in a formula while leaving the coefficient sum unchanged confuses these two bin units.
The noise covariance between windowed Fourier bins also matters when combining several spectral values: a taper can correlate neighboring estimates. Bandwidth alone does not specify their joint statistics, and colored noise requires weighting its actual spectral density. A proposed check repeats the same estimator on independent synthetic noise records with known variance, then on measured noise with a characterized acquisition response, comparing empirical mean squared complex error with the formula. Report window convention, detrending, one-sided/two-sided scaling and record duration so the test can be reproduced.
The half-bin amplitude response of a window is the magnitude response to an isolated tone halfway between neighboring discrete Fourier transform frequencies, divided by the response to a bin-centered tone of the same amplitude. It quantifies a particular off-grid amplitude error after correcting the coherent gain of a window. For coefficients with nonzero sum, define
A loss convention reports in decibels. The primary instrument manual tabulates approximately for rectangular weighting and for Hanning weighting.[ref]
To derive the ratio, take a complex tone . Evaluating the windowed transform at bin gives . For real window coefficients, the responses at opposite offsets have equal magnitude. Dividing by removes the on-bin scaling and leaves . This calculation isolates the frequency-grid effect from noise and other spectral components.
For a rectangular window, summing the geometric series yields
For , the ratio is about . The large- value is about , explaining the familiar scalloping loss rather than an exact finite-record constant.
For the periodic Hann window, . Its finite response is
where is the rectangular response and for . Substitution gives about at . A useful limiting derivation replaces the normalized sum by its integral:
with continuous limiting values at . At its magnitude is . For a short periodic window, the coefficients instead give . The finite definition avoids treating the asymptotic value as exact.
The symmetric Hann window uses denominator , not ; it has a different finite response and coefficient sum. SciPy explicitly distinguishes the symmetric filter-design convention from the periodic spectral convention.[ref] The exact half-bin ratio should therefore use the coefficients actually applied.
For an original acquisition example, a -sample record at has bin spacing. A complex tone at lies halfway between bins 10 and 11. An amplitude-one tone gives a corrected nearest-bin magnitude about with rectangular weighting or with periodic Hann weighting. Zero padding changes the sampled grid of the same discrete-time Fourier transform; if the padded grid contains , its value there has no half-bin error relative to that tone.
The half-bin response is not automatically a universal worst-case bound for every conceivable window. Nor does the isolated-complex-tone calculation cover every real-sinusoid measurement: near zero frequency or the sampling limit, the mirrored spectral component can overlap and make the observed magnitude phase-dependent. A proposed test sweeps a constant-amplitude tone through a bin interval, varies phase for real signals, and compares the complete finite-sum response before quoting a single off-bin accuracy number.
Hann window 2026-11-05
A Hann window tapers a record with a raised cosine. For the endpoint-symmetric convention with ,
It vanishes at the two stored endpoints. A periodic convention instead uses denominator , corresponding to sampling one cosine period without storing its repeated endpoint. SciPy's primary documentation distinguishes these with sym=True and sym=False; the default is symmetric.[ref] The adjacent Hanning window alias also supports the terminology used in older instrument documentation.
An original short-array example makes the difference concrete. At , the symmetric coefficients are , while the periodic coefficients are . Their means are and . A symmetric even-length array need not contain a coefficient equal to one, despite the nominal raised-cosine peak.
The coherent gain of a window is . It equals for the periodic Hann convention with , and for the symmetric convention with . A coherent complex tone gives windowed DFT magnitude at its exact bin, so amplitude recovery must use the chosen coefficient sum.
For the periodic convention, its discrete-time Fourier transform is obtained from the rectangular window transform by modulation:
The first central zeros lie at for the usual case, twice as far from the center as the rectangular window's first zeros. Smooth tapering reduces distant sidelobes while widening the central feature. Nearby frequencies and a weak component far from a strong one can therefore favor different window choices.
Noise normalization is another distinction. For , the periodic Hann coefficients obey and , giving equivalent noise bandwidth
in DFT bins. The manufacturer's table lists both coherent gain and noise bandwidth.[ref] Correcting a coherent amplitude does not make noise behave as though the rectangular weights had been used.
The original comparison below evaluates the finite 64-sample periodic Hann and rectangular coefficients at a dense frequency grid, normalizing each response by its own coefficient sum. The extra frequency samples display the same finite-record transform more finely; they do not create a longer observation.
Figure 1.
Original 64-sample rectangular and periodic Hann windows: lower distant sidelobes accompany a wider central lobe
. Each spectral curve is normalized to its own coherent peak. The horizontal frequency axis is measured in DFT-bin offsets. The first positive zeros are at one bin for the rectangular window and two bins for the periodic Hann window. Details.
Rectangular window 2026-11-05
A rectangular window keeps all samples in a selected finite record with equal weight and sets the signal outside it to zero. For discrete samples, for and zero otherwise. Calling this no taper does not remove the effect of having a finite record. SciPy's primary implementation documentation identifies the boxcar and rectangular window as this same all-ones choice.[ref]
Its discrete-time Fourier transform at frequency in cycles per sample is a finite geometric sum:
At integer , the limiting value is . The first zeros surrounding the central maximum are at , so the central zero-to-zero width is . The phase factor depends on the record's time origin; the magnitude response does not.
For a continuous centered record of duration , on has transform
where the normalized sinc function is . Multiplication by the finite window spreads a sharp spectral component according to this response, producing spectral leakage.
An original finite-record example quantifies an off-bin amplitude error. A complex tone of amplitude lying half a DFT bin from the nearest sampled frequency has normalized response
At the ratio is about , or relative to the coherent peak. The coherent gain of a window is still one; it does not correct this scalloping loss. Zero-padding samples the same frequency response more densely rather than lengthening the measured record.
For independent equal-variance sample noise, rectangular weighting has equivalent noise bandwidth of one DFT bin under the usual coherent-amplitude normalization. A Hann window suppresses distant sidelobes but changes the central width and noise scaling. The primary analysis manual reports these separate window properties rather than one universal best window.[ref]
A proposed test records a known sinusoidal input with an integer and then a non-integer number of cycles in the same record length, holding the sampling rate and amplitude fixed. Compare the raw DFT bins and the continuous window response. This separates finite-record leakage and bin placement from aliasing, which involves a different sampling ambiguity.
Scalloping loss 2026-11-05
Scalloping loss is the underestimate of an isolated sinusoidal amplitude caused by measuring it only at the nearest sampled discrete Fourier transform frequency, after correcting the window’s coherent amplitude scale. An off-grid tone is evaluated away from the maximum of the window response. This differs from the coherent gain of a window, which describes the response at the correctly centered frequency. The instrument manual treats amplitude scaling and off-bin errors separately.[ref]
Let be a finite real window with positive sum, and let , where is the nearest unpadded DFT bin and . Write . The coherent-gain-corrected bin magnitude relative to is
Here is a positive loss when . The half-bin amplitude response of a window evaluates this ratio at the largest nearest-bin offset. Other tones, noise and the negative-frequency image of a real sinusoid can also affect a measured peak; the derivation isolates one complex tone.
For a rectangular window, its geometric-sum transform gives
For , the half-bin ratio is about and the loss about . An amplitude-one tone exactly centered on a bin is recovered as one, while the same tone shifted by half a bin gives only about at either nearest bin. Dividing by coherent gain cannot remove this offset dependence.
For the periodic Hann window, use
where is the rectangular response. At , this gives a half-bin ratio about , or loss. The smaller nearest-bin error comes with a wider main lobe and a larger equivalent noise bandwidth; window choice affects several measurement properties at once.
Zero padding reduces the nearest-grid offset without changing the measured record. Padding to points makes the nearest offset at most in original-bin units. With and , the rectangular response at that worst offset is about , a loss of only . This is denser sampling of the same discrete-time Fourier transform, not extra physical frequency resolution. A fitted peak can reduce a grid error too, but its signal model and noise sensitivity must be stated.
A proposed analyzer test holds tone amplitude fixed while sweeping frequency through one bin interval, retaining record length, sampling rate and window. Divide out coherent gain, plot the measured peak versus fractional-bin offset, and compare with the exact response above. Include phase and nearby-tone checks for a real signal. Summing spectral powers instead answers an energy question and requires its own bandwidth normalization; it should not silently replace this single-bin amplitude definition.