Write for rats and for repeated observations. With diet 1 as the reference level in a regression factor, the random-intercept linear mixed model is
with the two families of normal distributions independent and the covariates treated as fixed. The reported estimates are
The corresponding estimated standard deviations are and grams. Individual realized random intercepts are not parameters in this marginal model, and their predictions are not supplied by this summary. For distinct measurements on the same rat, , while the marginal variance is ; different rats are independent.
The estimated mean weight rises by grams per day, adjusting for diet and the rat's random intercept. This common slope is imposed across all diets: there is no time-by-diet interaction term, so these estimates do not compare diet-specific growth slopes. The intercept refers to time zero for diet 1 and a zero rat effect.
The same one-dimensional normal distribution has
Because , the frequency variance and standard deviation are
Write , where has the standard normal distribution. Apply Gaussian integration by parts to :
Since ,
The polynomial growth assumption and decay of the normal distribution density justify the integration by parts.
For observations , the log-likelihood of the normal distribution model is
Differentiating first with respect to gives . Substituting this value and differentiating with respect to gives the normal mean and variance maximum-likelihood estimators
For one object, the probabilistic graphical model factorization is
Each factor is the normal distribution density specified by the model. This factorization displays the conditional independences of the latent variables and the noisy observations .
Use the imaginary-axis contour of the inverse transform of the moment-generating function, , so the Gaussian part gives the normal distribution
Because , the first non-Gaussian term is
Differentiating the Gaussian three times gives
Hence the Edgeworth expansion is
Equivalently its correction is , with , a Probabilists' Hermite polynomial. It integrates to zero and reproduces the third moment . The expansion is intended for weak non-Gaussianity in the bulk, rather than the far tails.
Use the Hellinger distance convention in the original PDF:
The TeX transcription incorrectly places the integral outside the outer square root in the definition; the displayed formula for the squared distance and the original PDF both use the convention above. Although Lebesgue measure is not a probability measure, we may use it as the common dominating measure: the integral is unchanged by replacing it with any equivalent dominating probability measure.
For unit-variance normal distributions, put and . The product of the square roots of their probability density functions is
The final factor integrates to one, so
For the bound at arbitrary , use the given formula for the Hellinger distance between normal distributions and write
Since for ,
Therefore one valid choice is . In particular this bound is uniform when the two standard deviations stay bounded away from zero.
A simple choice is an independent Laplace distribution at each pixel, giving a Laplace prior for sparse images:
Its negative log density penalizes the L1 norm. Relative to a normal distribution, it combines a sharp peak at zero with heavier tails, allowing most pixels to lie near the background level while a few have appreciable intensity. Quantitatively, , so the expected number of appreciable pixels is . Choosing large makes this small. This is a simple sparsity model: it does not enforce that nearby active pixels form connected objects, nor does its continuous density give exact zero pixels positive probability. Additional spatial modelling would be needed to insist on contiguous shapes.
To sample, draw independent and use inverse transform sampling:
The endpoint events have probability zero and can be assigned arbitrary finite values. To justify the rule, the cumulative distribution function of a centered Laplace distribution is
The displayed rule is , so . Independence of random variables then gives the stated product prior distribution.
The notation denotes generalized Gaussian white noise over , not a Gaussian measure supported on : the identity is not a trace-class operator there. For example, realize the observation on a suitable space of tempered distributions. Its Cameron-Martin space of a Gaussian measure is . For deterministic , the stochastic pairing has normal distribution under and is the isonormal Gaussian process indexed by .
Interpret the stated maps between Sobolev spaces as bounded linear operators, as usual. In particular is bounded, so its adjoint operator is bounded on . Hence maps into , which is the property needed here. The stronger smoothing follows by Sobolev duality: boundedness of gives , and therefore . As , the shift belongs to the noise Cameron-Martin space of a Gaussian measure for -almost every .
The white-noise likelihood for a square-integrable shift, obtained from the Cameron-Martin theorem for a Gaussian measure in its white-noise form, is
Here is the law of . In an orthonormal basis of , with white-noise coordinates , the pairing under is
For fixed this has mean-square convergence and converges almost surely, since . The stipulated joint measurability allows the likelihood to be used under . One must not replace this expression by a finite , because white noise is not -valued. On the unbounded domain , membership of white noise in a global unweighted negative Sobolev space must not be assumed either; the stochastic pairing avoids that issue.
Let be the actual joint law. The shift formula gives with Radon-Nikodym derivative . Define
For each fixed admissible , the moment-generating function of a normal distribution gives
By Tonelli theorem, , so for -almost every . The likelihood is finite and strictly positive for -almost every ; Fubini's theorem then gives for -almost every . The marginal observation law is and is an equivalent probability measure to .
The Bayes formula for a dominated observation model therefore defines
To verify that it is the conditional distribution, for measurable sets of unknowns and of data,
Thus the posterior distribution is well defined for almost every observation under the actual data law. This is the appropriate almost-everywhere assertion supplied by Bayes theorem; the stated assumptions do not prescribe a canonical posterior at every exceptional generalized datum.
A real-valued process is a standard Brownian motion if:
Write and let be its score function. A second-order Taylor expansion around gives, for fixed ,
where every lies between and . The mean-zero score identity, the Fisher information matrix, and the multivariate central limit theorem give
The assumed regularity and a uniform law of large numbers give
Consequently, by the Slutsky theorem,
For the stated Gaussian shift model, direct expansion of the two normal distribution densities gives
Since , this has exactly the limiting distribution above. Equivalently, both limits are normal with mean and variance . This is the local asymptotic normality of the model at .
The head of the Brownian snake driven by is the centered Gaussian process with covariance function . Part i shows that these finite-dimensional distributions exist consistently. Moreover,
If has Hölder constant , then . The absolute moment formula for a centered normal distribution consequently gives, for every ,
The Kolmogorov continuity theorem, with arbitrarily large, produces a modification that is -Hölder continuous for every . Taking proves the claim whenever ; for larger the assertion is vacuous.
A Gaussian measure on a real separable Banach space is a Borel probability measure such that is a one-dimensional normal distribution for every continuous linear functional . Its mean and covariance operator of a Gaussian measure are characterized by
and
for all .
For every , the continuous linear functional induced by the inner product gives
This is a normal random variable because it is a linear combination of independent normal random variables. Hence the law of is a Gaussian measure. Its mean is zero, and independence together with gives
Thus its covariance operator of a Gaussian measure is
The first part of is the change of the quadratic energy associated with the active Ornstein–Uhlenbeck force. The second is minus the change in the particle's potential energy, measured in thermal-noise units. The time integral is the work done by active propulsion, again divided by its noise scale; the full log ratio is the trajectory's time-reversal asymmetry or entropy production.
In a stationary confining state the two endpoint terms remain as and have zero mean, while the mean active work and the mean log ratio grow proportionally to . Endpoint-term distributions approach time-independent distributions with positive and negative fluctuations. Under mixing assumptions, the time-integrated work has a large-deviation distribution: its central part becomes approximately Gaussian with mean and variance proportional to , while its far tails scale exponentially in . The log-ratio distribution obeys the corresponding fluctuation theorem symmetry.
Put . Then
and . The Poisson central limit theorem gives
Since ,
Equivalently, the characteristic function of the left-hand side is
which is the characteristic function of that centered normal distribution.
The model factors into the normal distribution densities
and, conditionally on ,
Ignoring constants independent of , the log likelihood is
Its score is
In terms of the independent innovations,
Variance additivity for independent random variables therefore yields
Since , the equality holds for all exactly when
namely when
Thus the information tensorizes only in the independent case.
Finally, the Cramer-Rao bound gives every unbiased estimator the lower bound
This is the Fisher information in a stationary Gaussian autoregressive location model.
Because the centered normal distribution density is nonnegative and has integral one, Fubini's theorem and translation invariance give
Thus .
Use the angular-frequency convention
The convolution theorem and the Gaussian transform give
Since , this product is integrable. Moreover, absolute integrability justifies exchanging the integrals:
This proves the Fourier inversion theorem for the convolution directly.
Now additionally suppose . For every , the dominated convergence theorem gives
Fourier inversion identifies the right-hand side with for Lebesgue almost everywhere . Therefore the Gaussian approximate identity satisfies
Both alternatives have larger , so use upper-tail rejection regions. Let be the 95th quantile of the standard normal distribution.
For the likelihood estimator,
When is large, the normal approximation to the Poisson distribution gives, under ,
An approximate size- test therefore rejects when
When every is large, independently. A linear combination of independent normal variables is normal, so under ,
The corresponding approximate size- test rejects when
In both cases the null rejection probability is approximately , while values near the alternative mean increasingly fall in the rejection region as the total exposure grows. These are the normal-approximation tests for a Poisson exposure model.
The Brownian reflection principle reflects a path after its first hit of and gives
Symmetry of the centered normal distribution gives . Both random variables are nonnegative, so their tail distributions agree for every , proving the Brownian running maximum identity .