The half-bin amplitude response of a window is the magnitude response to an isolated tone halfway between neighboring discrete Fourier transform frequencies, divided by the response to a bin-centered tone of the same amplitude. It quantifies a particular off-grid amplitude error after correcting the coherent gain of a window. For coefficients with nonzero sum, define
A loss convention reports in decibels. The primary instrument manual tabulates approximately for rectangular weighting and for Hanning weighting.[ref]
To derive the ratio, take a complex tone . Evaluating the windowed transform at bin gives . For real window coefficients, the responses at opposite offsets have equal magnitude. Dividing by removes the on-bin scaling and leaves . This calculation isolates the frequency-grid effect from noise and other spectral components.
For a rectangular window, summing the geometric series yields
For , the ratio is about . The large- value is about , explaining the familiar scalloping loss rather than an exact finite-record constant.
For the periodic Hann window, . Its finite response is
where is the rectangular response and for . Substitution gives about at . A useful limiting derivation replaces the normalized sum by its integral:
with continuous limiting values at . At its magnitude is . For a short periodic window, the coefficients instead give . The finite definition avoids treating the asymptotic value as exact.
The symmetric Hann window uses denominator , not ; it has a different finite response and coefficient sum. SciPy explicitly distinguishes the symmetric filter-design convention from the periodic spectral convention.[ref] The exact half-bin ratio should therefore use the coefficients actually applied.
For an original acquisition example, a -sample record at has bin spacing. A complex tone at lies halfway between bins 10 and 11. An amplitude-one tone gives a corrected nearest-bin magnitude about with rectangular weighting or with periodic Hann weighting. Zero padding changes the sampled grid of the same discrete-time Fourier transform; if the padded grid contains , its value there has no half-bin error relative to that tone.
The half-bin response is not automatically a universal worst-case bound for every conceivable window. Nor does the isolated-complex-tone calculation cover every real-sinusoid measurement: near zero frequency or the sampling limit, the mirrored spectral component can overlap and make the observed magnitude phase-dependent. A proposed test sweeps a constant-amplitude tone through a bin interval, varies phase for real signals, and compares the complete finite-sum response before quoting a single off-bin accuracy number.
Rectangular window 2026-11-05
A rectangular window keeps all samples in a selected finite record with equal weight and sets the signal outside it to zero. For discrete samples, for and zero otherwise. Calling this no taper does not remove the effect of having a finite record. SciPy's primary implementation documentation identifies the boxcar and rectangular window as this same all-ones choice.[ref]
Its discrete-time Fourier transform at frequency in cycles per sample is a finite geometric sum:
At integer , the limiting value is . The first zeros surrounding the central maximum are at , so the central zero-to-zero width is . The phase factor depends on the record's time origin; the magnitude response does not.
For a continuous centered record of duration , on has transform
where the normalized sinc function is . Multiplication by the finite window spreads a sharp spectral component according to this response, producing spectral leakage.
An original finite-record example quantifies an off-bin amplitude error. A complex tone of amplitude lying half a DFT bin from the nearest sampled frequency has normalized response
At the ratio is about , or relative to the coherent peak. The coherent gain of a window is still one; it does not correct this scalloping loss. Zero-padding samples the same frequency response more densely rather than lengthening the measured record.
For independent equal-variance sample noise, rectangular weighting has equivalent noise bandwidth of one DFT bin under the usual coherent-amplitude normalization. A Hann window suppresses distant sidelobes but changes the central width and noise scaling. The primary analysis manual reports these separate window properties rather than one universal best window.[ref]
A proposed test records a known sinusoidal input with an integer and then a non-integer number of cycles in the same record length, holding the sampling rate and amplitude fixed. Compare the raw DFT bins and the continuous window response. This separates finite-record leakage and bin placement from aliasing, which involves a different sampling ambiguity.
Scalloping loss 2026-11-05
Scalloping loss is the underestimate of an isolated sinusoidal amplitude caused by measuring it only at the nearest sampled discrete Fourier transform frequency, after correcting the window’s coherent amplitude scale. An off-grid tone is evaluated away from the maximum of the window response. This differs from the coherent gain of a window, which describes the response at the correctly centered frequency. The instrument manual treats amplitude scaling and off-bin errors separately.[ref]
Let be a finite real window with positive sum, and let , where is the nearest unpadded DFT bin and . Write . The coherent-gain-corrected bin magnitude relative to is
Here is a positive loss when . The half-bin amplitude response of a window evaluates this ratio at the largest nearest-bin offset. Other tones, noise and the negative-frequency image of a real sinusoid can also affect a measured peak; the derivation isolates one complex tone.
For a rectangular window, its geometric-sum transform gives
For , the half-bin ratio is about and the loss about . An amplitude-one tone exactly centered on a bin is recovered as one, while the same tone shifted by half a bin gives only about at either nearest bin. Dividing by coherent gain cannot remove this offset dependence.
For the periodic Hann window, use
where is the rectangular response. At , this gives a half-bin ratio about , or loss. The smaller nearest-bin error comes with a wider main lobe and a larger equivalent noise bandwidth; window choice affects several measurement properties at once.
Zero padding reduces the nearest-grid offset without changing the measured record. Padding to points makes the nearest offset at most in original-bin units. With and , the rectangular response at that worst offset is about , a loss of only . This is denser sampling of the same discrete-time Fourier transform, not extra physical frequency resolution. A fitted peak can reduce a grid error too, but its signal model and noise sensitivity must be stated.
A proposed analyzer test holds tone amplitude fixed while sweeping frequency through one bin interval, retaining record length, sampling rate and window. Divide out coherent gain, plot the measured peak versus fractional-bin offset, and compare with the exact response above. Include phase and nearby-tone checks for a real signal. Summing spectral powers instead answers an energy question and requires its own bandwidth normalization; it should not silently replace this single-bin amplitude definition.