Nyquist–Shannon sampling theorem
ID: nyquist-shannon-sampling-theorem
The Nyquist–Shannon sampling theorem says that a bandlimited function can be recovered exactly from equally spaced samples, provided the sampling rate is high enough. It is the bridge between a continuous waveform and a sequence of numbers: the missing values between samples are determined by the restriction on its frequencies.
Here is a precise finite-energy version. Let , meaning , and suppose its Fourier transform, defined through the Plancherel theorem, is zero outside . Thus is the largest allowed ordinary frequency, in cycles per second, rather than an angular frequency. Set , where is the number of samples per second. If , the continuous representative of is recovered byThe quotient is the normalized sinc function, with value one when its argument is zero. Each shifted sinc function is one at its own sampling time and zero at every other sampling time. Its coefficient is therefore exactly the required sample value. For this L2 space formulation, the reconstruction converges in the L2 space norm and uniformly in . The critical rate is allowed for this class; choosing leaves a gap between the occupied frequencies and the sampling boundary.
For a numerical example, a bandlimited function with no frequencies above cycles per second can be reconstructed from its samples every seconds: . Exact reconstruction uses the whole sequence indexed by . A finite recording and a finite sum of sinc functions introduce truncation error; joining adjacent samples by straight lines is generally a different reconstruction.
The obstruction is aliasing. At sampling rate , the two distinct waveformshave identical samples at , becauseThe samples alone cannot tell whether the waveform oscillates twice or eight times per second. If we know in advance that all frequencies are below , the -cycle waveform is excluded and the ambiguity disappears. These pure cosines are an illustrative aliasing example, rather than members of the finite-energy L2 space class in the stated theorem.
Exactly at a sampling boundary, the function class matters. At rate , the sine has zero values at every . It is a nonzero waveform indistinguishable from zero on that grid, but has infinite energy and is excluded by the finite-energy hypothesis above. This explains why a rule intended to cover arbitrary pure sinusoids should demand a strict inequality. For spatial data, replace seconds by distance: the Nyquist spatial frequency is for sample pitch .
The proof idea is short: the samples are Fourier coefficients of the Fourier transform restricted to a sampling-sized frequency interval. Because a bandlimited function has no contribution outside that interval, its Fourier series determines the whole Fourier transform; Fourier inversion then gives the sinc function expansion. See sampling expansion by periodic Fourier projection for this connection.
Claude E. Shannon's Communication in the Presence of Noise (1949), Section II, Theorem 1 and equation (7), gives the sampling statement and reconstruction using shifted sinc functions in a communication setting. Shannon explicitly notes earlier mathematical forms and credits Nyquist with emphasizing the sampling interval in telegraphy.[ref]
https://fab.cba.mit.edu/classes/S62.12/docs/Shannon_noise.pdf. Shannon 1949, Proceedings of the IRE 37(1), pp. 10–21; sampling theorem on pp. 11–12
The Nyquist-Shannon sampling theorem, also known as the Nyquist theorem, is a fundamental principle in the field of signal processing and information theory. It provides a criterion for how often an analog signal must be sampled to be accurately reconstructed from its samples without losing any information.
New to topics? Read the docs here!
