Brownian sheet Created 2026-10-14 Updated 2026-11-05
A centered Gaussian random field with the displayed covariance. It has independent increments over disjoint rectangles. At fixed positive , is standard Brownian motion in . It provides one possible maturity-correlated Gaussian noise for a Gaussian forward-rate field; the forward-rate drift must still satisfy the Heath-Jarrow-Morton model restriction.
Debiased-Lasso asymptotic normality Created 2026-09-24 Updated 2026-11-05
In , put and choose a matrix from alone. The corrected Lasso estimate
has the exact decomposition
If , every remainder coordinate is bounded by . Thus a sufficiently accurate approximate inverse of a Gram matrix and a small coefficient L1 norm error make the remainder negligible.[ref]
Given , Gaussian noise makes the first term exactly normal with covariance matrix . For coordinate , let . If the remainder divided by tends to zero in probability, then converges to a standard normal distribution. Replacing requires a consistent estimator; non-Gaussian errors require a corresponding central limit theorem.
A discrete wavelet transform computes multiscale approximation and detail coefficients from sampled data. For the Haar wavelet, replace each adjacent pair by
The approximation coefficient is times the pair's arithmetic mean; it is not the ordinary mean. The detail coefficient records their signed contrast. Repeat on the approximation coefficients until only one remains, keeping every detail coefficient.
For a worked example, start with the vector . The first pass gives approximation coefficients and detail coefficients . Transforming the remaining pair gives the coarse coefficient and the half-to-half detail . In the order coarse value, coarse detail, then fine details, the transform is
This is an orthogonal matrix transformation. Each pair preserves , so the full transform preserves the squared Euclidean norm:
The inverse function for each pair is , . Reversing the passes therefore recovers every original value. This squared-norm bookkeeping is often called signal energy; it need not represent physical energy. [ref]
Continuous and discrete normalizations differ. If data values are interpreted as the heights of a step function on equal cells of , its normalized L2 inner product coefficients are the discrete coefficients divided by . For our four values they are , as the Haar projection example shows. The same normalization is used by the wavelet regression estimator on .
Under independent Gaussian noise with a common variance, orthogonality preserves that coefficient noise variance and independence. It does not make every arbitrary correlated signal independent: this statistical conclusion uses the Gaussian model and its equal-variance independent inputs.
Exponential covariance function Created 2026-09-24 Updated 2026-11-05
The exponential covariance function on the real line is
Here is the marginal variance and the correlation time. For , the centered stationary Gaussian process with this covariance function is the Ornstein-Uhlenbeck process solving
with the initial value independent of future Brownian motion increments. The explicit stochastic-integral solution gives . Its conditional future equals the exponentially decayed present plus independent Gaussian noise, giving the Markov property.
The cusp at zero determines its roughness. For ,
which diverges. Thus a continuous version exists, but it has no mean-square derivative of a Gaussian process. A smooth-looking covariance away from the diagonal does not imply differentiable paths.[ref]
Gaussian linear mixed model Created 2026-10-06 Updated 2026-10-14
A Gaussian linear mixed model combines fixed effects, random effects with a normal distribution, and independent Gaussian noise. For and independently, its marginal distribution is with . The random effects induce dependence among observations sharing their design columns. A random-intercept linear mixed model and a random-slope linear mixed model are special cases.
Gaussian noise Created 2026-09-24 Updated 2026-11-05
Gaussian noise is an additive random error with a normal distribution, often assumed independent across observations and centered at zero.
Gaussian-process marginal likelihood Created 2026-10-03 Updated 2026-11-05
Let latent values have a multivariate normal distribution , and observe with independent Gaussian noise . Integrating over gives , where . If is positive-definite, its log-marginal likelihood is
The first term measures the residual under the proposed covariance matrix; the determinant term accounts for the volume of the proposed observation law. Both matter when comparing covariance function parameters. With a single observation, and , this reduces to .[ref]
A positive-definite observation-noise covariance matrix makes positive-definite even when is singular; mutually independent errors with strictly positive variances are one sufficient case. If is singular, a Gaussian observation law still exists but has no ordinary density on the full observation space; the inverse-and-determinant formula above is then not valid. This is a likelihood for kernel and mean parameters after latent-value integration, rather than an assertion that estimated parameters have no further uncertainty.
Gaussian process regression Created 2026-10-14 Updated 2026-11-05
Gaussian process regression estimates an unknown function by assigning its values a Gaussian process law, then conditioning on observed values, often with independent Gaussian noise. The covariance function expresses the proposed relation between nearby inputs; the conditional multivariate normal distribution gives the resulting Gaussian process regression posterior. Its conditional mean provides a prediction and its conditional variance quantifies uncertainty under the chosen model. The index set can represent spatial locations or other inputs as well as time.
Let internal evidence be with zero-mean Gaussian noise of standard deviation , and respond yes when . Taking a distribution tail gives , which equals the displayed expression by symmetry. Its derivative is . Thus sensory gain, variability and criterion all influence the observed relation, and a sigmoid in one stimulus coordinate need not remain symmetric in another.
Consider an original illustrative resonance model, with all numerical settings chosen here. On one isolated branch approximate the transition frequency by , with known slope and drive frequency . Choose , hence resonance field . This local linear model omits hyperfine structure and nonlinear level mixing; it is not the historical hydrogen Zeeman splitting calculation.
Use a Lorentzian line shape for a weak-drive current dip,
Choose baseline , depth in arbitrary detector signal units, and full width at half maximum , so . The half-depth points are ; this checks the factor of four. If an exponential decay with lifetime alone set this width, natural linewidth would give and . The chosen width is an explanatory input, not a measurement of a historical lifetime.
Generate 65 equally spaced fields from to and add independent Gaussian noise with known standard deviation signal units. A simultaneous nonlinear regression fit of gives , and . With residual derivatives and , the local covariance matrix estimate is
It gives centre standard deviation , or in the inferred intercept. This uses the stipulated noise variance and a local linear approximation, rather than treating the width as the centre error. Repeated noisy samples can locate a broad line's centre much more closely than its width.
Figure 1.
Chosen resonance line fit and zero-field intercept
. Original synthetic data and fitted Lorentzian current dip, with a separate linear field-to-frequency construction. All frequencies, fields, widths, signal units and noise are chosen for this example. The zero-field intercept is not a measured Lamb splitting. The displayed uncertainties are standard deviations under the stated model. Details.
Include a common magnetic calibration offset with standard deviation , a fractional gain error , and independent drive-frequency error . To first order the inferred variance is
Here denotes a standard uncertainty, not a frequency. The four contributions in are , , , and ; adding their squares gives . The calibration offset shifts all sampled fields together, so increasing the sample count cannot average it away. Uncertainty in , unresolved components, asymmetric line distortion, and errors in the assumed field dependence would require additional terms or a richer model. The historical inference requires the appropriate Zeeman splitting branches, rather than simply drawing a straight line through one resonance.
Lévy–Itô decomposition Created 2026-09-28 Updated 2026-11-05
The Lévy-Itô decomposition builds a real Lévy process from drift, continuous Gaussian noise and Poisson jumps. For the triplet in the Lévy-Khintchine formula with small-jump cutoff one, take independent standard Brownian motion and Poisson random measure of intensity . Then
Here , is a Lévy measure and denotes compensation. The large-jump term has finitely many jumps on each bounded time interval because .
The small-jump integral is defined by limits, rather than by subtracting two potentially infinite sums. For , let . These are square-integrable martingales. The compensated Poisson isometry gives
as . Doob's L2 maximal inequality also controls the supremum on , so the limit exists locally uniformly in probability, indeed in the L2 norm of that supremum. This uses exactly the small-jump second-moment condition of a Lévy measure.[ref]
The components have independent increments; multiplying their characteristic functions recovers the Lévy-Khintchine exponent. The decomposition separates continuous fluctuations from large jumps and possibly infinitely many small jumps. A finite small-jump Second moment does not require a finite first absolute jump moment, which explains why compensation and its limiting construction are essential.
Condition throughout on the training inputs and . Interpret here as the fixed covariance function and noise hyperparameters. Assume observation errors are independent standard normal random variables, independent of the Gaussian process , and write
The independent-error assumption is the standard Gaussian process regression interpretation of the observation model; the single-observation marginal noise law alone would not specify cross-observation noise correlations. We take so that is a positive-definite matrix. More generally the inverse formulas below apply whenever the indicated noisy covariance matrices are invertible.
The Gaussian process prior makes a Gaussian random vector. Adding the independent Gaussian noise vector to preserves a multivariate normal distribution. Its mean is zero, its observation covariance matrix is , and because the noise is independent of . Therefore
A degenerate latent variance is allowed; the displayed multivariate normal distribution then denotes a Gaussian law even if it has no full-dimensional probability density.
Set and . Multiplying the Langevin equation by and integrating gives
The expected value of is zero. For the printed dot-product force covariance, write , so . Without any white-noise approximation the trace variance is
The intended short-correlation approximation replaces by , where is the Dirac delta. It requires the force correlation time to be much shorter than and the observation time. Then
At thermal equilibrium, the equipartition theorem gives . Taking the long-time limit determines the vector noise normalization in inertial Langevin dynamics:
This factor six corresponds to the dot-product covariance across three components. If were defined for one component instead, its integrated strength would be before dividing by , and the acceleration strength would be .
Finite rapid correlation is not literally a Dirac delta. For a stationary force and local drag, its exact limiting velocity trace is
This follows by splitting the double convolution into and . Thus equipartition fixes the weighted integral, not just , unless the short-correlation approximation is made. For example, gives . The remaining explicit formulae use the intended continuous-time Gaussian white noise limit.
Assume isotropic jointly Gaussian noise, as appropriate to an isotropic bath. The component covariance is
The scalar moment identities in the question must now be applied to a fixed Cartesian component , not to the magnitude of the vector. Its variance is
In the -fold integral for , the Isserlis theorem replaces the force product by a sum of complete pairings. Each pairing yields identical two-time integrals, hence . Pair the first labelled factor in ways, then the first unpaired factor in ways, and continue. The Gaussian even-moment pairing count is
Odd force products vanish, so
For completeness, summing the scalar moment-generating function gives
The same Gaussian process argument for every linear combination of components gives the vector characteristic function . Inverting this Fourier transform yields the normalized multivariate Gaussian distribution
The initial condition is a velocity Dirac delta as , and the long-time limit is the thermal velocity density. The converted TeX's exponent is damaged; the PDF has the squared norm displayed here. The scalar pairing formula cannot be interpreted as a vector-norm formula: the radial moments of an isotropic Gaussian vector instead give in three dimensions.
Integrate the velocity once more. Interchanging the time integrals gives the integrated Ornstein-Uhlenbeck displacement
For the stated fixed initial position and velocity,
Let and . Its component covariance comes from integrating the squared noise kernel:
Therefore the total centered variance is
The mean-square displacement from additionally contains . Confusing this deterministic drift contribution with centered variance changes the short-time conclusion.
For times longer than the force correlation time but , the mean motion is and the centered trace is . Thus a nonzero fixed initial velocity produces a leading ballistic mean-square displacement ; conditioned on , the white-noise displacement variance instead starts as . If one averages over an independent equilibrium initial velocity, its covariance adds , giving
This is the usual thermal ballistic regime, before velocity memory has relaxed. At , the conditional mean approaches , while the centered trace is . Its leading behavior is diffusion with and , as successive displacement increments lose inertial memory. At times below a finite force correlation time the white-noise short-time expansion is not applicable; for a regular force covariance and fixed initial velocity the leading noise-induced displacement variance is of order .
The orthogonal projections of the Gaussian noise onto the column space of and its orthogonal complement are independent. Consequently and the residual sum of squares are independent, and
Thus under the alternative,
This is the noncentral t-distribution. The rejection region is fixed by the design, and the chosen level, while this probability distribution depends on only through . Therefore the statistical power does not depend on the other regression coefficients, with the design and fixed.
Use the periodic covariance function
Its positive semidefiniteness follows by pulling back a Gaussian kernel to the circle . A zero Gaussian process mean is an ensemble statement, whereas an exactly zero long-term average for every periodic light curve is stronger. To impose the latter literally, use a periodic Gaussian process with zero period average, replacing the kernel by
Here is a modified Bessel function, and is the period average of the kernel. Subtracting each process's random period average produces this covariance, so it remains positive semidefinite. We use to enforce the stated mean subtraction; using gives the usual ensemble-zero-mean formulation and the same likelihood derivation.
Let and . The prior latent vector is and the independent Gaussian noise is , so with . The Gaussian-process marginal likelihood is
Positive measurement variances make positive definite even if is singular. Maximize over all three hyperparameters, using a broad search in to find competing aliases, followed by joint optimization. Cholesky decomposition evaluates the likelihood without explicitly forming an inverse.
For a well-resolved interior maximum, let be the observed Fisher information in the coordinates . Then . Equivalently, the profile-likelihood curvature in gives the same local nuisance-adjusted variance; keeping the other hyperparameters fixed would generally underestimate it. A profile interval with is a local approximation. If the period likelihood is multimodal or poorly constrained, fit the complete posterior with proper hyperparameter priors and report its modes and marginal credible intervals rather than a single Hessian error bar. The sampling pattern can create period aliases that a single local search misses.
Stack the observations as and set
Let and denote matrices obtained by evaluating the two Gaussian process covariance kernels. Independence of the quasar light curve, gravitational microlensing, and Gaussian noise processes gives
where . Thus is a multivariate normal distribution and its Gaussian-process marginal likelihood is
The off-diagonal blocks are essential: both images contain the same delayed Ornstein-Uhlenbeck process.
The conditional mean estimator is the posterior mean
provided the first moment is finite. A maximum a posteriori estimate is any maximizer of the posterior density relative to Lebesgue measure:
Existence of the posterior density alone does not guarantee a finite posterior mean or existence of a maximizing point.
For the stated multivariate normal distribution and independent standard Gaussian noise, the negative log of the posterior density, up to a constant, is
Its precision matrix is a positive-definite matrix, so Gaussian conjugacy for a normal linear model gives
The two forms agree because
The covariance matrix is , and the maximum a posteriori estimate equals the posterior mean for this multivariate normal distribution.
Let have entries , let have entries , and let . The Gaussian process prior and independent Gaussian noise imply
Applying the conditional multivariate normal distribution gives the Gaussian process regression posterior
where
Spatial and chemical multisensory processing share problems of binding, uncertainty, learning and common-cause attribution. They often differ in what their inputs represent: spatial cues can estimate the same location, whereas taste and odor frequently supply complementary attributes of a food. The comparison concerns particular computations and tasks, not a rigid separation between two kinds of brain.
In spatial localization, vision, audition and touch can each provide information about position, although they begin in different coordinates. Visual information is initially related to the retina, auditory location depends on binaural and spectral cues, and touch is related to a body surface. Combining them requires accounting for eye, head and body position. Spatial coincidence supports a common event, but is not sufficient: unrelated events can occur nearby, and one moving object can produce cues at different times.
A simple reliability-weighted cue integration model makes a precise prediction. Suppose are unbiased, independent estimates of one position, with variances . An unbiased linear estimate is , with
Differentiating and setting the derivative to zero yields
The second derivative is positive. The minimum-variance two-cue estimate assigns greater weight to the more precise cue, and independent information reduces variance below either individual variance. With independent Gaussian noise and a flat prior, minimizing the negative log-likelihood gives the same weighted mean. Correlated errors, bias, a nonflat prior or separate causes change this benchmark.
Marc O. Ernst and Martin S. Banks measured visual and haptic estimates of object height and compared combined judgments with predictions based on unisensory variability. Manipulating visual uncertainty and cue conflict supported reliability-dependent weighting and improved combined precision in that task.[ref] The conclusion is conditional optimality for measured inputs and task, not that every multisensory judgment or neuron always computes an optimum.
Figure 1.
Original independent-Gaussian cue model: likelihood multiplication and variance-minimizing weights; curves are theoretical examples, not experimental results
. Details.
Development supplies a useful qualification. Monica Gori and colleagues measured visual, haptic and combined judgments of block size and orientation in children. Younger children did not always obtain the adult-like precision gain; the dominant modality differed between size and orientation, and adult-like combination emerged around eight to ten years in those tests.[ref] The authors proposed a role for cross-sensory calibration. The result does not establish one universal maturation age for all multisensory tasks. It shows why adult cue-combination rules should not simply be assigned to every developing observer.
The chemical senses pose a different representational problem. Gustation responds to dissolved chemicals at taste receptors, while olfaction responds to volatile molecules; oral touch, temperature and irritation also contribute to a food percept. Retronasal odor can be attributed to the mouth through olfactory referral, even though its receptors remain in the nose. A sweet taste and a fruit odor are not necessarily two noisy measurements of one physical sweetness coordinate. They can jointly identify a food or predict nutritional and hedonic properties. Adding them with inverse-variance weights is therefore not automatically meaningful.
Nevertheless, the same inferential questions arise: do signals belong to the same food, how should prior experience affect interpretation, and which component is responsible for a judged quality? Richard J. Stevenson and colleagues' odor–taste conditioning results show that pairing an odor with sweet or sour tastes can alter later odor judgments.[ref] Learned co-occurrence can thus influence flavor qualities. Verbal confusion or a rating change alone does not establish full sensory fusion; separate taste, odor and pleasantness scales help test response dumping.
Neural convergence is also shared without implying identical architectures. Ivan E. T. de Araujo and colleagues delivered tastes and retronasal odors separately and together during human functional magnetic resonance imaging. They identified overlapping responses in several regions and interactions in orbitofrontal cortex; some responses also covaried with consonance or pleasantness ratings.[ref] A mixture interaction is stronger evidence than overlap alone, but an imaging voxel does not prove that every responding neuron receives both inputs. A neural correlation with pleasantness also differs from a causal explanation of food preference.
Temporal and spatial structure further distinguish typical tasks. Spatial audiovisual cues can be brief, externally localized events; food perception unfolds with sniffing, chewing, dissolution and swallowing. Taste and retronasal odor may be bound despite unlike onset profiles because their sequence is expected within eating. Chemical signals can adapt and interact at peripheral as well as central stages, while vision and audition face their own receptor and pathway nonlinearities. Neither class is exclusively early or late, automatic or attention-dependent. Attention, task instructions, hunger and learned expectations can change what is selected or reported; these influences must be measured rather than inferred from a unitary percept alone.
A decisive comparison therefore uses matched inferential questions: estimate a common property, identify a common object, or judge whether two signals share a cause. Measure unisensory performance, test cue conflict and temporal or semantic congruence, and distinguish changes in quality, uncertainty and response. Both domains integrate evidence about events; spatial averaging is a useful special case, while complementary chemical information often requires object, quality and value representations beyond a shared coordinate.
A psychometric function specifies the probability of a measured response as a physical stimulus variable changes. The response might be “present,” “clockwise,” or correct in a two-alternative forced-choice task. These are different dependent variables. Understanding the function's shape is necessary to distinguish sensory changes from decision, attention and measurement effects. A reported threshold without its task, response definition and performance criterion is incomplete. For example, a visual experiment could use calibrated display visual contrasts, timed two-interval presentations, fixation control and button choices; the observer’s choice supplies the dependent variable.
A smooth curve need not mean that a receptor has a smoothly varying conscious threshold. Consider a noisy internal response , with “yes” reported when . Here is a decision criterion, not necessarily a biological detection limit. If is the noise cumulative distribution function,
With Gaussian noise of standard deviation , symmetry of the normal distribution gives a Gaussian psychometric function
The sigmoid is therefore a distribution tail swept by a changing mean response. At low means, few responses exceed the criterion; near it, many trials switch category; at high means, almost all do. The derivative is , so slope depends on both sensory gain and variability. Moving shifts the curve without necessarily improving sensitivity. If noise vanished and the mean crossed the criterion sharply, this simple model would approach a step rather than a graded transition.
There is no universal sigmoid in every stimulus coordinate. A nonlinear transduction function changes the curve, and a logarithmic intensity axis changes its appearance. As a counterexample, a toy detector responding whenever at least one event occurs in a Poisson distribution with mean has . This is concave on a linear positive-intensity axis. It follows immediately by subtracting the zero-event probability from one. It is a mathematical example, not evidence that human detection universally uses a one-event rule. Variation in attention or decision criterion across trials can broaden a measured curve even if the within-state sensory noise is unchanged.
Task conventions determine the endpoints. A useful psychometric function with guessing and lapses is
Here is the lower asymptote and the upper error asymptote. In balanced two-alternative forced-choice performance, is commonly fixed at . A yes/no response probability does not automatically have this lower bound. In this particular cumulative-Gaussian parameterization, ; thus gives 75% correct only for and . Other function families use different scale parameters. Nor is automatically the fraction of inattentive trials: if a fraction of trials involves random two-choice guessing, those trials contribute an upper error probability .
Figure 1.
Original theoretical noisy-decision and psychometric-curve examples; the right panel is a phenomenological family, not observed participant data
. Details.
The relation to signal detection theory is equally important. Under independent equal-variance Gaussian signal and noise samples, define sensitivity index . In an ideal two-interval comparison, the response difference has mean and variance , giving
This Gaussian forced-choice sensitivity relation follows by standardizing the Gaussian difference. It is a specified decision model, not an identity for every forced-choice experiment. In a yes/no task, hits and false alarms are both needed: under the corresponding equal-variance model, . A criterion change can increase both rates while leaving unchanged. The phenomenological fit above need not have parameters identical to these internal-response parameters.
These distinctions affect experiments. Felix A. Wichmann and N. Jeremy Hill used simulation and statistical modeling to show that unmodeled stimulus-independent errors can bias threshold and slope estimates, even when lapses are uncommon.[ref] Ignoring high-intensity errors can make a function appear shallower and falsely suggest worse sensory precision. A broad group-average curve can likewise reflect a mixture of individually sharp functions with different locations.
At predetermined stimulus levels, independent trials give counts . The parameter-dependent log-likelihood is . Fitting this binomial likelihood, checking goodness of fit and quantifying uncertainty are preferable to drawing a curve through noisy proportions. Easy trials help constrain lapses; levels near the transition constrain location and slope. Randomization, stable calibration and checks for learning or fatigue help distinguish a stationary sensory relation from drift. Adaptive procedures require inference appropriate to their sampling design.
Thus the function is both a description and a testable model. Its shape determines what a threshold means, how an experiment should sample, and which claims about sensory mechanisms are warranted.