Range restriction in singular-covariance spectral fitting

ID: range-restriction-in-singular-covariance-spectral-fitting

Range restriction in singular-covariance spectral fitting requires a residual to lie in the subspace where the measurement model allows random error. Let with zero-mean error covariance . Every vector in the kernel of satisfies
so almost surely. Thus a permissible residual obeys
where is the Moore-Penrose inverse. The matrix is the orthogonal projector onto the range of the covariance.
Only after enforcing this condition should a generalized least squares objective use . The quadratic form alone assigns zero penalty to the forbidden directions and therefore cannot impose the condition. Rank deficiency from deterministic spectral upsampling gives its physical spectral-grid origin through . Covariance propagation preserves those exact dependencies.[ref]
For an original idealized two-channel example, take , mean and observation . The second channel has no random error in this stipulated model, so the range condition forces . The remaining squared residual is one. Minimizing only the pseudoinverse quadratic would instead choose and objective zero, while predicting the impossible second-channel value six.
Real measurements need not contain a perfect channel: deterministic rebinning produces exact noise-free combinations of otherwise noisy channels. Additional physical noise in such a combination must be modelled if present. If covariance ranges change with the parameters, pseudoinverse fitting with a parameter-dependent covariance range requires enforcing the appropriate support for each candidate; a single fixed projection need not apply.
Raman detector-array spectra are recorded before numerical redistribution onto another spectral grid.[ref] Fitting the original independent measurement coordinates often makes these support restrictions explicit and avoids treating interpolation points as new observations.

New to topics? Read the docs here!