Correlated spectral residuals from a shared subtraction scale
ID: correlated-spectral-residuals-from-a-shared-subtraction-scale
Correlated spectral residuals from a shared subtraction scale arise when one uncertain coefficient multiplies many spectral channels. Let a fixed reference profile be x and let the estimated scale differ from its mean by δk, with variance σk2. Its contribution to the subtracted spectrum is δz=−xδk, givingThis covariance has rank one when x=0. It describes a coherent spectral pattern, not independent noise added separately at each wavelength. The parent noise remaining after scaled Raman subtraction treats a single channel and an uncertain scale.
Cscale=E[δzδzT]=σk2xxT.
For an original reference vector x=(100,200,100)T and σk=0.02, the covariance isThe sum of the three residuals has standard uncertainty 0.02(100+200+100)=8 in the chosen count units. Incorrectly treating the channel errors as independent gives 4+16+4≈4.90 and understates the uncertainty of that sum.
Cscale=4848168484.
A weighted spectral contrast aTz receives scale-error varianceFor a=(1,−1,1)T this contribution vanishes in the example. This projection of shared-scale uncertainty onto a spectral contrast also warns that a contrast insensitive to the reference shape can suppress a genuine signal with that same shape. Removing one error direction is not universal denoising.
uscale2=σk2(aTx)2.
Independent detector noise adds its own covariance matrix. If the reference profile is itself noisy or the scale is estimated from the same spectra, their correlations must be included too. The measurement propagation rule keeps common influences rather than discarding off-diagonal terms.[ref]
Guidelines for Evaluating and Expressing the Uncertainty of NIST Measurement Results by Barry N. Taylor and Chris E. Kuyatt. Appendix A, equation A-3
Matching a reference spectrum's mean therefore does not establish independent residuals or a reliable weak-band detection limit. New to topics? Read the docs here!