Spatially offset Raman spectroscopy

Spatially offset Raman spectroscopy, or SORS, collects Raman scattering from a surface region laterally displaced from the illumination spot. In a diffusely scattering material, changing the offset changes the mixture of photon paths and the relative contributions of surface and buried layers. It is not simply a tightly focused measurement at a selected depth.

The2005 experiment of P. Matousek and colleagues used trans-Stilbene powder beneath a $1\mathrm{mm}$ layer of PMMA powder. Its primary report describes a19-fold improvement in buried-layer contrast before numerical separation.^[ref] The physical point is that an opaque-looking scattering overlayer need not contribute the same spectral proportion at every collection offset.

An original two-component linear combination illustrates scaled subtraction of two spatially offset Raman spectra. Let $S(\nu )$ and $B(\nu )$ be fixed surface and buried Raman spectra, and suppose dark-corrected measurements giveIf a surface-specific band determines the scale $3/8$, thenThe surface contribution cancels while a scaled buried spectrum remains. These coefficients are chosen examples, not the paper's measured mixing fractions.

A practical arrangement fixes an excitation spot, moves the collection region laterally, rejects the excitation line with an optical filter, and sends the collected light to a spectrograph. Record comparable exposure, incident radiant power, backgrounds and spectral response at each offset. If the offset changes each component's shape, rather than only its scale, the simple subtraction model fails. Strong absorption, fluorescence, overlapping bands and measurement noise also limit inference. Offset-dependent enrichment provides evidence for depth-dependent contributions; it is not an unqualified depth calibration or unique chemical identification.

Scaled subtraction of two spatially offset Raman spectra suppresses a common surface contribution by matching its amplitude between two measurements. The spatially offset Raman spectroscopy experiment establishes that collection offset can change surface and buried-layer proportions; numerical separation then needs a model of those contributions.^[ref] The following two-component subtraction is an original simplified case, not a claim that it reproduces the paper's full analysis.

Let fixed Raman spectra $S(\nu )$ and $B(\nu )$ describe the surface and buried material. Writewith $a_0\ne 0$. ThenIf the two mixing proportions are identical, so $a_0{b}_1-a_1{b}_0=0$, this cancels the buried component too. Offset diversity must supply different mixtures, not merely a weaker copy of the same spectrum.

For an original example, take $Y_0=10S+B$ and $Y_1=4S+3B$. The correct scale $k=0.40$ gives $Z=2.6B$. Using $k=0.42$ instead gives $Z=-0.2S+2.58B$: an incorrectly subtracted surface band can produce a negative residual even when both true spectra are nonnegative. A surface-specific reference band can estimate the scale only if the assumed common shape and response are adequate.

Noise remaining after scaled Raman subtraction is distinct from the cancelled mean signal. At a surface-only channel, suppose two independent acquisitions have Poisson photoelectron counts with means $10000$ and $4000$. For fixed $k=0.40$, the expected residual is zero, butgiving a standard deviation of about $74.8$ in the scaled count units. Subtraction has not erased shot noise. Correlated acquisitions and uncertainty in $k$ add further terms. Varying shape, wavelength-dependent attenuation or an unmatched fluorescence background can invalidate this simple linear separation.

Noise remaining after scaled Raman subtraction is the random uncertainty left when a surface contribution's mean has been cancelled. For two measured spectral channels $X,Y$ and fixed scale $k$, scaled subtraction of two spatially offset Raman spectra uses $Z=Y-kX$. Its exact variance isThe covariance term describes the actual acquisition relationship; numerical subtraction does not itself make the inputs correlated or independent. General measurement propagation retains such terms.^[ref]

A focused extension allows an uncertain subtraction scale $K$, independent of the pair $(X,Y)$, with mean $k$ and variance ${\sigma }_k^2$. Expanding the product's moments givesThe final term includes uncertainty in the reference scale, not just shot noise in the two spectra.

For an original surface-only example, let independent Poisson photoelectron counts have means ${\mu }_X=20000$ and ${\mu }_Y=6000$, with $k=0.30$. The mean residual is zero. A perfectly known scale gives variance $6000+0.30^2(20000)=7800$ and standard deviation $88.3$. If instead ${\sigma }_k=0.005$, the variance becomes $7800+0.005^2(20000^2+20000)=17800.5$, giving standard deviation $133.4$ in the scaled count units.

If $K$ is estimated from these same counts, the independence assumption needs replacement by the appropriate joint model. A scale shared across wavelengths can also produce correlated spectral residuals from a shared subtraction scale, leaving a structured band-like error rather than independent noise in each bin. The original SORS study demonstrates changing layer contributions with collection offset; the moment calculation here is an independent noise model for a simplified subtraction.^[ref]

Correlated spectral residuals from a shared subtraction scale arise when one uncertain coefficient multiplies many spectral channels. Let a fixed reference profile be $\mathbf{x}$ and let the estimated scale differ from its mean by $\delta k$, with variance ${\sigma }_k^2$. Its contribution to the subtracted spectrum is $\delta \mathbf{z}=-\mathbf{x}\delta k$, givingThis covariance has rank one when $\mathbf{x}\ne 0$. It describes a coherent spectral pattern, not independent noise added separately at each wavelength. The parent noise remaining after scaled Raman subtraction treats a single channel and an uncertain scale.

For an original reference vector $\mathbf{x}=(100,200,100{)}^T$ and ${\sigma }_k=0.02$, the covariance isThe sum of the three residuals has standard uncertainty $0.02(100+200+100)=8$ in the chosen count units. Incorrectly treating the channel errors as independent gives $\sqrt{4+16+4}\approx 4.90$ and understates the uncertainty of that sum.

A weighted spectral contrast ${\mathbf{a}}^T\mathbf{z}$ receives scale-error varianceFor $\mathbf{a}=(1,-1,1{)}^T$ this contribution vanishes in the example. This projection of shared-scale uncertainty onto a spectral contrast also warns that a contrast insensitive to the reference shape can suppress a genuine signal with that same shape. Removing one error direction is not universal denoising.

Independent detector noise adds its own covariance matrix. If the reference profile is itself noisy or the scale is estimated from the same spectra, their correlations must be included too. The measurement propagation rule keeps common influences rather than discarding off-diagonal terms.^[ref] Matching a reference spectrum's mean therefore does not establish independent residuals or a reliable weak-band detection limit.

Projection of shared-scale uncertainty onto a spectral contrast determines which measured spectral features are sensitive to an uncertain common subtraction coefficient. In correlated spectral residuals from a shared subtraction scale, a fixed reference shape $\mathbf{x}$ and scale error $\delta k$ contribute $-\mathbf{x}\delta k$ to the spectrum. For a linear contrast $c={\mathbf{a}}^T\mathbf{z}$,The contrast is insensitive to this particular error when ${\mathbf{a}}^T\mathbf{x}=0$. This is an exact cancellation for a fixed reference shape; it does not require the scale error to have a Gaussian distribution.

Suppose the desired spectral signal has known shape $\mathbf{s}$ and unknown amplitude $\theta$, so that $\mathbf{z}=\theta \mathbf{s}-\delta k\mathbf{x}+\mathbf{ϵ}$. To retain its amplitude while rejecting the scale error, requireFor an original two-channel example, take $\mathbf{x}=(1,1{)}^T$ and $\mathbf{s}=(1,0{)}^T$. The difference $c=z_1-z_2$ has unit signal response and cancels any common scale error. If the two independent reading noises each have standard deviation $3$ in the chosen units, the difference has standard deviation $\sqrt{18}\approx 4.24$. Using channel 1 alone would have reading-noise standard deviation $3$ but would retain the unknown common contribution. Rejection has a noise cost even when the nuisance cancellation is exact.

If $\mathbf{s}$ is proportional to $\mathbf{x}$, the two requirements are incompatible: cancelling that reference direction also cancels the signal. In more channels, a minimum-variance spectral contrast orthogonal to a reference shape can balance detector noise among the remaining directions. The relevant variance is ${\mathbf{a}}^{T}C\mathbf{a}$, including correlations.^[ref] Uncertain reference shape or scale estimates correlated with the measured spectra require their own covariance contributions.

A minimum-variance spectral contrast orthogonal to a reference shape estimates a desired signal amplitude while exactly rejecting one fixed nuisance shape. Let $\mathbf{z}=\theta \mathbf{s}+\beta \mathbf{x}+\mathbf{ϵ}$, with known shapes $\mathbf{s},\mathbf{x}$ and a positive-definite noise covariance matrix $C$. Choose $\hat{\theta }={\mathbf{a}}^T\mathbf{z}$ to minimize ${\mathbf{a}}^{T}C\mathbf{a}$, subject toThe constraints retain unit signal response and reject the reference amplitude, as in projection of shared-scale uncertainty onto a spectral contrast. The quadratic variance includes the full noise covariance.^[ref]

Remove the reference component in the inverse-covariance geometry:For nonzero $\mathbf{x}$ and $D>0$, the minimizing contrast and its variance areFor a short proof, every other feasible contrast is $\mathbf{a}+\mathbf{v}$ with ${\mathbf{v}}^T\mathbf{s}={\mathbf{v}}^T\mathbf{x}=0$. Since $C\mathbf{a}$ is a linear combination of those shapes, the cross term vanishes, leaving the added nonnegative variance ${\mathbf{v}}^{T}C\mathbf{v}$. This is a constrained best linear unbiased estimator.

In an original three-channel example, take $\mathbf{s}=(1,0,0{)}^T$, $\mathbf{x}=(1,1,1{)}^T$ and $C=\mathrm{diag}(1,4,1)$. The optimum is $\mathbf{a}=(1,-1/5,-4/5{)}^T$, with variance $1.8$. Equal subtraction of the two reference channels, $(1,-1/2,-1/2{)}^T$, has variance $2.25$. The quieter third channel receives more of the subtraction.

If the desired and reference shapes are proportional, $D=0$ and no unit-response rejecting contrast exists. The noise penalty from nearly parallel signal and reference shapes already becomes large as $D$ approaches zero. This construction assumes fixed known shapes and covariance; estimating them from the same noisy spectra requires additional uncertainty terms.

The noise penalty from nearly parallel signal and reference shapes is the precision lost when a spectral estimator must reject a nuisance pattern resembling its desired signal. For nonzero shapes $\mathbf{s},\mathbf{x}$ and positive-definite noise covariance $C$, define their inverse-covariance correlationThe Cauchy-Schwarz inequality gives $|r|\le 1$. The minimum-variance spectral contrast orthogonal to a reference shape has varianceIf the nuisance amplitude were known and subtracted without uncertainty, the corresponding optimum variance would be $V_{\mathrm{known}}=1/({\mathbf{s}}^T{C}^{-1}\mathbf{s})$. Exact nuisance rejection therefore multiplies variance by $1/(1-r^2)$ and standard uncertainty by $1/\sqrt{1-r^2}$.

The relevant angle is the noise-whitened angle between spectral signal and nuisance shapes: it is measured after a whitening transformation, not generally from the raw plotted spectra. A channel with large noise contributes little to separating the shapes even if their plotted curves differ there.

For an original example, let $C={\sigma }^{2}I$, $\mathbf{x}=(1,0{)}^T$ and $\mathbf{s}=(1,0.1{)}^T$. Rejecting the reference forces the contrast to $(0,10{)}^T$, with variance $100{\sigma }^2$. With known nuisance amplitude, its variance would be ${\sigma }^2/1.01$. The rejection penalty is therefore $101$ in variance, about $10.05$ in standard uncertainty. Only the weak second-channel component distinguishes signal from nuisance.

The primary stimulated-Raman experiment reported systematic spectral noise above its calculated shot-noise limit and described pure-solvent subtraction of a common pattern.^[ref] A reference can remove that shared pattern while also making an overlapping desired signal hard to estimate. Retain full covariance in the variance calculation.^[ref] At exact proportionality, no unit-response rejecting contrast exists; a low-noise result obtained by suppressing the signal as well is not a valid amplitude estimate.

The noise-whitened angle between spectral signal and nuisance shapes measures their separation in units of measurement noise rather than raw plotting units. For nonzero shapes $\mathbf{s},\mathbf{x}$ and a positive-definite covariance $C$, choose a square whitening transformation $W$ with $WC{W}^T=I$. The angle isIt is the ordinary Euclidean angle after whitening. Both parallel and antiparallel shapes are indistinguishable up to an unknown nuisance amplitude; the precision penalty depends on ${\sin }^2\varphi$, as in noise penalty from nearly parallel signal and reference shapes.

For an original example, take raw shapes $\mathbf{s}=(1,1{)}^T$, $\mathbf{x}=(1,-1{)}^T$ and $C=\mathrm{diag}(1,100)$. The plotted shapes are orthogonal, but whitening gives $(1,0.1{)}^T$ and $(1,-0.1{)}^T$. Thus $\cos \varphi =0.99/1.01\approx 0.98020$ and $\varphi \approx 11.42^{\circ }$. The second channel, which separates their signs, is noisy. Rejecting the nuisance multiplies the optimum variance by $1/{\sin }^2\varphi =25.5025$, or standard uncertainty by $5.05$.

The invariance of noise-whitened spectral angles to the whitening factor follows from $W^{T}W=C^{-1}$. Different valid square whitening factors can rotate the whitened coordinates without changing the angle. Likewise an invertible change of measurement units transforms both shapes and covariance, leaving the inverse-covariance expression unchanged. Rescaling only the displayed curves while leaving their noise model fixed is a different operation.

The covariance must describe the actual measured channels and shared errors, using the full propagation rule.^[ref] If $C$ is singular, first restrict to its physically allowed range; an unrestricted inverse whitening factor does not exist.

The primary stimulated-Raman experiment described systematic spectral noise and subtraction of a pure-solvent reference.^[ref] The angle above assesses which desired patterns remain distinguishable after such nuisance rejection under a stated covariance. It does not establish that an estimated reference shape or noise model is itself accurate.

Invariance of noise-whitened spectral angles to the whitening factor means that any two complete whitening transformations for the same positive-definite covariance give the same angles between transformed shapes. Suppose square invertible matrices satisfy $W_{i}C{W}_i^T=I$. Put $Q=W_2{W}_1^{-1}$. Since $C=W_1^{-1}{W}_1^{-T}$,Thus $Q$ is orthogonal. It may rotate or reflect the whitened coordinates, but preserves their inner products, norms and angles. The noise-whitened angle between spectral signal and nuisance shapes is consequently a property of the shapes and covariance, not a particular whitening algorithm.

For an original example, chooseDirect multiplication gives $W_{1}C{W}_1^T=I$. With $\mathbf{s}=(2,1{)}^T$ and $\mathbf{x}=(2,2{)}^T$, the whitened shapes are $(1,0{)}^T$ and $(1,1{)}^T$, meeting at $45^{\circ }$. Using $W_2=Q{W}_1$ instead gives $(0,1{)}^T$ and $(-1,1{)}^T$, again at $45^{\circ }$, although the coordinate components differ.

SciPy describes covariance whitening as transforming variables to unit covariance and illustrates it with a precision-matrix construction.^[ref] The matrix proof above establishes the invariance independently of an implementation's chosen factor.

The same principle requires covariance-consistent rescaling of whitened spectral coordinates. If raw measurement units change by an invertible matrix $D$, transform both shapes by $D$ and covariance by $C^{\prime }=DC{D}^T$; then $W^{\prime }=W_1{D}^{-1}$ reproduces the same whitened shapes. Changing a plotted channel's scale without transforming its noise model is not this invariant operation.

The claim assumes a full whitening of a positive-definite covariance. Truncating modes can remove information and change angles, while a singular covariance requires restriction to its supported range. Uncertainty in an estimated covariance is also separate from this exact algebraic invariance.

Covariance-consistent rescaling of whitened spectral coordinates changes measurement units or mixes coordinates while transforming their noise model at the same time. If an invertible matrix $D$ maps a spectral vector to ${\mathbf{y}}^{\prime }=D\mathbf{y}$, thenThe covariance follows directly from the expectation of the transformed error outer product. For positive-definite $C$,Thus the inverse-covariance inner product, its norms and the resulting whitened angle are invariant. Invariance of noise-whitened spectral angles to the whitening factor establishes the related freedom to rotate the fully whitened coordinates.

For an original example, let $C=\mathrm{diag}(1,9)$, $\mathbf{s}=(1,1{)}^T$ and $\mathbf{x}=(1,-1{)}^T$. Their noise-whitened angle has cosine $0.8$, or angle about $36.87^{\circ }$. Converting only the first raw coordinate's numerical units by a factor of 1000 gives $D=\mathrm{diag}(1000,1)$ and $C^{\prime }=\mathrm{diag}(10^6,9)$. Using that transformed covariance keeps the cosine exactly $0.8$.

If the shapes are rescaled but the old covariance is mistakenly retained, the calculated cosine becomes approximately $0.99999978$, suggesting an angle only about $0.0382^{\circ }$. A unit conversion would then appear to destroy the separation between signal and nuisance. That apparent change comes from inconsistent uncertainty accounting.

For any full whitening factor $W$, the transformed factor $W^{\prime }=W{D}^{-1}$ satisfies $W^{\prime }{C}^{\prime }(W^{\prime }{)}^T=I$ and gives $W^{\prime }{\mathbf{s}}^{\prime }=W\mathbf{s}$. The pinned SciPy documentation describes whitening and demonstrates a near-identity covariance after transformation.^[ref] Measurement propagation likewise retains all covariance terms under a linear transformation.^[ref]

The invertibility condition matters. Noninvertible spectral compression versus a coordinate change can discard information and need not preserve these angles. A transformation estimated from the same noisy observations also brings estimation uncertainty beyond the fixed-matrix identity proved here.

Noninvertible spectral compression versus a coordinate change distinguishes discarding spectral coordinates from expressing the same measurements in different units. The covariance-consistent rescaling of whitened spectral coordinates article assumes an invertible transformation. A compression $\mathbf{z}=B\mathbf{y}$ with fewer independent rows than input coordinates instead has covariance $C_z=BC{B}^T$ and may lose information even when this covariance is propagated correctly.^[ref]

For positive-definite $C$ and a known signal shape $\mathbf{s}$, compare the squared noise-weighted signal sizesassuming $B$ has independent rows. Put $\mathbf{t}=C^{-1/2}\mathbf{s}$ and $M=B{C}^{1/2}$. ThenThe matrix $P$ is an orthogonal projector. This proves that compression cannot increase this signal measure under the stated covariance model. The condition for preserving a spectral signal under linear compression is that its whitened shape lie entirely in the retained subspace.

For an original example, let $C=I_2$, desired shape $\mathbf{s}=(1,1{)}^T$ and nuisance shape $\mathbf{x}=(1,-1{)}^T$. Keeping only the first channel, $B=(1,0)$, reduces $J$ from two to one and makes both shapes the same scalar. An unknown nuisance amplitude can then imitate the desired signal exactly.

Summing instead, $B=(1,1)$, gives desired response two, nuisance response zero and noise variance two. It retains $J_B=2$ for this particular signal while rejecting that nuisance. Thus a noninvertible map can preserve a chosen estimation task, but cannot in general be reversed to recover every original spectral component.

The primary Raman apparatus records array spectra before subsequent spectral processing.^[ref] Choose compression against the scientific signal and nuisance model, and propagate the full covariance. Correct uncertainty accounting does not restore a spectral distinction removed by the map.

The condition for preserving a spectral signal under linear compression specifies when compression retains the covariance-weighted signal measure of a known shape. Let the mean be $\theta \mathbf{s}$, with fixed positive-definite noise covariance $C$, and compress by a full-row-rank matrix $B$. The measures in noninvertible spectral compression versus a coordinate change obeyThus the rows of the compression must retain the noise-weighted signal direction, not necessarily the unweighted plotted shape.

For a short proof, whiten the shape as $\mathbf{t}=C^{-1/2}\mathbf{s}$ and put $M=B{C}^{1/2}$. The parent's orthogonal projection formula givesEquality holds exactly when $\mathbf{t}$ lies in the row space of $M$. Multiplying that subspace relation by $C^{-1/2}$ yields the stated condition. Linear covariance propagation gives the compressed covariance $BC{B}^T$.^[ref]

One useful construction is the scalar matched filter statistic $z={\mathbf{s}}^T{C}^{-1}\mathbf{y}$. Its mean is $\theta J$ and variance $J$, so $z/J$ has variance $1/J$, the original optimal linear amplitude precision. In the Gaussian known-covariance model, this statistic also retains the likelihood's dependence on that single amplitude.

For an original example, choose $C=\mathrm{diag}(1,4)$ and $\mathbf{s}=(1,2{)}^T$. Then $J=2$ and the retaining row is $B=(1,1/2)$. Its signal response is two and noise variance two, giving $J_B=4/2=2$. An unweighted sum $B=(1,1)$ instead has response three and variance five, giving $J_B=9/5=1.8$: ten percent of this signal measure is lost.

Signal-subspace preservation for several spectral amplitudes requires retaining the corresponding family of weighted mean directions when all those amplitudes are to be preserved. Unknown nuisance shapes can also change the relevant estimation problem. A compression designed for one known shape does not automatically preserve every spectral question or uncertainty component.

Signal-subspace preservation for several spectral amplitudes requires a compression to retain every noise-weighted mean direction relevant to those amplitudes. Let $\mathbf{y}$ have mean $A\mathbf{\theta }$, fixed positive-definite noise covariance $C$, and a full-column-rank shape matrix $A$. Compress it as $B\mathbf{y}$, with $B$ full row rank. The original and compressed amplitude-information matrices areFor Gaussian noise these are Fisher information matrices. Without that distributional assumption, they still describe the corresponding known-covariance linear estimation problem.

Whiten the shapes as $T=C^{-1/2}A$ and put $M=B{C}^{1/2}$. The orthogonal projection onto the row space of $M$ is $P=M^T(M{M}^T{)}^{-1}M$, givingThis difference is positive semidefinite. It vanishes exactly when every column of $T$ lies in that row space, equivalentlyThus preserving one selected shape does not establish preservation of the whole signal subspace. Linear covariance propagation supplies $BC{B}^T$ for the compressed observations.^[ref]

For an original example, take $C=\mathrm{diag}(1,4,9)$ and shape columns $(1,2,0{)}^T$ and $(0,0,3{)}^T$. Then $J=\mathrm{diag}(2,1)$. Choosinggives $BA=\mathrm{diag}(2,1)$ and $BC{B}^T=\mathrm{diag}(2,1)$, hence $J_B=J$. Keeping only the first compressed row retains information2 for the first amplitude but destroys sensitivity to the second. An unweighted first row $(1,1,0)$ would instead reduce the first information entry to1.8.

At least $p$ independent compressed directions are needed to preserve $p$ independent shape amplitudes. One construction is $B=A^T{C}^{-1}$, whose compressed signal has mean $J\mathbf{\theta }$ and covariance $J$. When $J$ is invertible, $J^{-1}B\mathbf{y}$ has mean $\mathbf{\theta }$ and covariance $J^{-1}$. In the fixed-covariance Gaussian model, expanding the likelihood function shows that its parameter dependence is retained through $A^T{C}^{-1}\mathbf{y}$.

Unknown nuisance shapes, changing covariance or additional spectral parameters can alter the subspace that needs preservation. The proof concerns the specified family of mean shapes and fixed noise model, rather than guaranteeing that one compression preserves every future spectral question.