Moment equation 2026-10-05
For a Markov jump-process generator , differentiating an integrable observable gives , when the generator identity and interchange are justified. Choosing powers gives equations for moments. These need not form a closed finite system.
For a compound Poisson distribution of count parameter and severity moments , the expected value is and the variance is . As with the severity law fixed and , the standardized aggregate converges in distribution to the standard normal distribution. Indeed, the logarithm of its characteristic function is ; the second-order expansion of makes this tend to . The approximation loses the zero atom and assigns positive probability to negative losses.
Pareto moment threshold 2026-10-18
A Pareto distribution is a proper probability distribution for every , even when its mean is infinite. To see both facts, integrate the probability density function against . For real ,
The improper integral converges exactly when . At it diverges logarithmically; above that it diverges as a positive power of the upper endpoint. Setting gives one, proving normalization regardless of whether higher moments exist.
Taking and using when both terms are finite gives
For , the nonnegative random variable has expected value ; a centered variance about a finite mean is unavailable. For , the mean is finite and the variance is infinite.[ref] A finite total probability and a finite expected value answer different questions.
At the chosen minimum , gives , and variance , but an infinite third moment. At , the mean is 30 and the variance is infinite; at , even the mean is infinite, while the median remains the finite number . At the boundary , the earlier example has mean 20 but infinite variance. A finite sample contains finite values almost surely; that fact cannot establish that the underlying mean or variance is finite.
For a nonnegative random variable with finite positive mean, the share of its total amount carried by the largest fraction of outcomes can be defined by dividing their contribution to the expected value by the whole expected value. For a Pareto distribution, let and choose , so that . If , direct integration gives
This is a share of amount, distinct from the fraction of outcomes. It depends on , but not on the unit of measurement .[ref]
For the chosen , the top 20% starts at and carries of the amount. To make the top 20% carry exactly 80%, solve
The resulting Pareto distribution has a finite mean and infinite variance. The 80/20 rule selects one shape parameter; it is not a universal law, or even a property of every Pareto distribution. For , the population-share definition above is unavailable because its denominator is infinite; substituting such an into the finite-mean formula is invalid.
Figure 1.
Changing Pareto alpha changes quantiles, moment existence and the top 20 percent share
. Details.
The left panel compares three quantiles in units of the minimum. The right panel shows only where the mean is finite, and marks the chosen 80/20 value. The thresholds and separate the moment regimes; they do not separate valid and invalid probability distributions.
A straight-looking empirical log-log plot does not by itself establish a Pareto distribution or a reliable tail exponent; estimating an exponent and assessing goodness of fit are separate tasks.[ref] If a Pareto distribution is used only above a fitted lower threshold, describes that conditional tail population, not automatically the whole population. A genuine finite upper cutoff gives a truncated distribution with finite nonnegative moments; its survival function, quantiles and top shares must be recalculated. Truncation is a modelling change, distinct from merely observing a finite sample. None of the chosen numbers here estimates an actual wealth distribution.
The parity construction of pairwise independent bits turns two independent fair bits into three pairwise independent random variables. With , , and , their allowed triples are , each of probability . Every coordinate has the Bernoulli distribution with parameter . Every pair has the same joint probability mass function:
All twelve pair cells equal the product of the corresponding probabilities in their marginal distributions. This establishes pairwise independent random variables, a requirement involving every pair of value-events, rather than merely one chosen event per coordinate. For general real-valued random variables , the requirement is
for every pair of Borel sets . For these binary random variables, checking all four cells of each pair suffices: any value-event is a union of the checked cells. In fact, for binary random variables, independence of their one-value events also gives the other cells by taking complements. Siegrist gives the all-set definition and its connection to indicator random variables in Random Services: independence of random variables.
The full joint probability mass function tells a different story:
The integer parity of is always even. Any two bits determine the third: , , and . Each coordinate is independent of either other coordinate individually, but is dependent on the pair together. For example, the conditional probabilities satisfy and . See also pairwise independence does not imply joint independence for the general distinction.
The constraint changes the sum's probability distribution without changing its expected value or variance. Let . Only gives ; each other allowed triple gives . Direct calculation gives
The same variance follows from the variance of a sum: each Bernoulli distribution has variance , and pairwise independent random variables have zero cross covariances. Linearity of expectation gives the expected value even without independence.
For comparison, the sum of three mutually independent fair bits has the binomial distribution :
Both sums have identical expected values and variances, but never takes the values one or three. Even their third moments differ: , whereas . Pairwise independence preserves these first two sum summaries while allowing a different joint probability distribution and a different sum law. The calculation is an exact finite example.
Figure 1.
Pairwise independence preserves the mean and variance but changes the sum distribution
. The parity construction of pairwise independent bits gives sum probabilities ; three mutually independent fair bits give the binomial distribution probabilities . Both expected values are and both variances are . Details.
For a moment of order with , integration of the probability density function gives
Thus the expected value and variance are
The cumulative distribution function on is . Its unique median satisfies , giving
Let be the displacement in step , so the random walk position is . The single-step expected value and second moment are
By linearity of expected value, . The steps are independent random variables, so for , . Expanding the square gives the mean squared displacement
These are ensemble expected values; the empirical average over a finite number of independent cells fluctuates about them. The expected mean squared displacement itself does not depend on .
A transformation model consists of a group acting on the sample space and on the set of statistical parameters, with the compatibility property
In words, transforming a sample from produces a sample from . A transitive transformation model is generated from one reference distribution by the group action. For densities, the compatibility property includes the Jacobian determinant of the sample transformation; it is not merely equality of density values at transformed points.
A maximal invariant is constant on orbits of a group action and separates them: , and implies for some . An equivariant estimator of the parameter satisfies . Equivariance means the estimate follows the transformed parameter, whereas invariance means the reported value stays unchanged.
First suppose the set of statistical parameters can be identified with the group, as happens for a simply transitive action. An equivariant estimator then provides a group-valued fit with . Normalize the sample by this fit:
Indeed . Conversely, if , then , placing in the same orbit of a group action. This establishes maximality, rather than only invariance.
For a transitive action with a nontrivial stabilizer of a reference parameter , a parameter-valued equivariant estimator does not specify a unique normalizing transformation. Choose a section with and form . Under ,
Thus the -orbit of is invariant. It is maximal: if with , then . Appropriate measurable sections and orbit of a group action coordinates are assumed when treating this as a statistic. This qualification explains why an arbitrary equivariant statistic alone is not automatically a complete set of invariant coordinates.
For the location-scale family, write with and a fixed joint distribution of . The group consists of maps with , acting on parameters by . For a nonconstant sample of size , take the equivariant estimator
It gives the maximal invariant
Its coordinates satisfy and . They stay unchanged under location and positive-scale transformations. If two samples have the same standardized vector, then
so a single group transformation maps the first sample onto the second. The vector retains the observation labels: sorting it would discard information not removed by this location-scale group. The construction is algebraic and does not require the underlying distribution to have finite moments. Constant samples can be assigned a separate invariant value; they form a single exceptional orbit of a group action and have probability zero under an independent continuous base distribution.
Finally, in a transitive transformation model every invariant statistic is ancillary. Choose taking to and use ; invariance gives . Thus the standardized residual configuration provides a natural conditioning variable, while the equivariant fit contains the location and scale information.
Partition a regular parameter as , with interest and nuisance . Orthogonal statistical parameters have zero cross-block of expected Fisher information,
This may hold at one parameter value or throughout a parametrization. It is expected-information orthogonality, and does not generally force the observed information cross-block to vanish in each sample.
First, the asymptotic covariance of the joint maximum-likelihood estimator is the inverse information. Orthogonality makes this matrix block diagonal, giving first-order asymptotic independence of interest and nuisance fits. The efficient information with unknown nuisance is
For orthogonal parameters it equals . Thus estimating the nuisance creates no first-order information loss relative to knowing it, at the orthogonal point. This is a local asymptotic statement, not a general finite-sample independence theorem.
Second, orthogonality stabilizes constrained nuisance estimates. Differentiating gives
When the expected cross-information vanishes, regular sampling fluctuations give and . The derivative is therefore locally. Changing the interest parameter by changes its constrained nuisance fit by only , smaller than the ordinary nuisance estimation error. This reduces sensitivity to how the nuisance is fitted and simplifies higher-order likelihood adjustments.
For scalar interest, local orthogonal nuisance reparametrization can often be constructed explicitly. Keep and write the original nuisance as . The transformed interest score is . Its covariance with the new nuisance score vanishes when
With smooth nonsingular nuisance information, this ordinary differential equation has a local solution for suitable initial nuisance coordinates. For several interest coordinates the corresponding equations need compatibility conditions; global orthogonality is not automatic.
The normal model gives a transparent example. For independent observations with mean and variance , direct score expectations give
The cross-information is zero because the centered normal third moment is zero. When fitting at fixed ,
so the change is indeed quadratic in a local change of the mean.
Orthogonality is also useful for removing nuisance effects beyond first order. Take variance as interest and mean as nuisance. Put . The profile log-likelihood is up to a constant. The constrained mean is for all , so its sample-coordinate Jacobian determinant is one, and . The information adjustment gives
This agrees with the exact likelihood based on : estimating the mean has used one degree of freedom. In this setting the Cox-Reid adjusted profile likelihood has the same form. The exact distribution follows by projecting the centered normal vector onto the -dimensional subspace orthogonal to the constant vector; an orthonormal basis there supplies independent standard normal coordinates whose squares sum to .
The example shows both the benefit and the limits. Orthogonality organizes first-order precision and nuisance stability; it does not eliminate all higher-order nuisance effects. Nor does it identify an ancillary statistic or justify dropping the sample-coordinate factor in every modified profile likelihood. In the exponential regression calculation that factor cancels the information adjustment, so an information-only correction would give a different answer.
A large molecular Schmidt number separates the velocity's smallest smooth length scale from the scalar's smaller diffusive length scale. Follow a Lagrangian trajectory and measure displacement from it. Within a sufficiently small scalar packet, Taylor expansion of the smooth velocity field gives
The moving frame removes uniform sweeping, leaving a linear random velocity gradient tensor. Thus the local scalar equation is the advection-diffusion equation with velocity , and averaging over realizations of gives the corresponding ensemble average. The approximation requires the packet to lie within the velocity's locally smooth region. Its thin, diffusive direction can satisfy this condition even when its long direction eventually becomes too large for one global linearization; applications to a spatially varying flow then use local packet descriptions. The statistical conclusions below refer to the linear-flow model and the usual mixing assumptions, not to every conceivable trace-free random matrix process.
Write and assume sufficiently rapid decay to discard boundary terms. Integration by parts gives
For , integrate the advective term once and the diffusive term twice. Since and , one obtains
These are mass conservation and the evolution of the unnormalized second moment tensor. The first moment obeys , so a centered packet stays centered.
For a positive Gaussian scalar packet in a linear incompressible flow, must be a positive-definite matrix. Diagonalizing its symmetric matrix and applying the Gaussian integral gives
The factor in the last identity matters because has not been divided by the scalar mass. Substitution into the advection-diffusion equation also gives
These identities agree with the second moment equation and prove that the Gaussian family is preserved. For an initially negative packet the same analysis applies after replacing by and taking its positive mass.
To see the roles of stretching and diffusion explicitly, let the deformation gradient solve , . Incompressibility gives . Differentiating integrates the moment equation:
Without diffusion, and is constant. In a statistically stationary, mixing flow with positive Lyapunov exponent , the two stretching exponents are and . Writing the ordered eigenvalues of as , their typical initially nondiffusive evolution is
The fluctuation scale presumes the usual central limit theorem for accumulated strain; it is not implied by incompressibility alone. During this stage the packet becomes long and thin but keeps its area and peak concentration.
In the instantaneous principal-axis basis, write for the rotated velocity gradient tensor. Differentiation of an eigenvalue gives
The formulas hold through a repeated eigenvalue by continuity of their sum. The compressed physical variance is . Its contraction is arrested when it is of order , the square of the Batchelor scalar microscale . If its initial length is , the crossover occurs at
Thereafter has stationary fluctuations associated with the strain and the diffusive floor, while continues to grow typically at rate . Under sufficiently fast mixing, the central part of the distribution of is approximately Gaussian with mean and variance for a strain-dependent coefficient . This central approximation does not determine far tails, which control high concentration moments; those require a full large deviation principle. The two logarithmic widths need not be independent. The area now increases and decreases typically as . This is diffusion arrest of Gaussian packet compression.
For example, a constant principal strain gives the exact physical variances
The thin variance approaches its diffusive floor, the long variance grows exponentially, and the mass-to-area relation gives the quoted typical amplitude decay. A random strain additionally makes rare histories important for concentration moments.
For a precise statistical formulation define the logarithmic area increase
The Gaussian identities give the exact relation ; hence
Assume the long-time strain statistics give a large deviation principle for on , with convex good rate function , . At exponential accuracy the probability of near is . Combining that cost with the amplitude factor and applying the Laplace principle for probability measures gives the large-deviation decay rates of a Gaussian scalar packet
The initial amplitude only changes a time-independent prefactor. One can see the minimization directly by dividing the possible area-growth rates into small intervals: each contributes its probability cost times , and the interval with least total exponential cost dominates. An interval around a minimizing gives the matching lower bound. The nonnegative area increase bounds the exponential weight by one, so unusually large positive growth cannot produce a divergent weighted tail. Using the area rather than only also avoids discarding possibly important fluctuations of the compressed direction.
Suppose is strictly convex and differentiable, with its minimum at and finite negative right derivative at zero. Define
For the minimizing rate is positive and uniquely solves
For , convexity puts the minimum at the endpoint , giving
High moments are dominated by rare histories with little net area growth, in which a packet keeps a substantial concentration. Their probability cost is , independent of the moment order. A finite threshold is conditional: if , the minimizer can approach zero without reaching it at any finite .
Below the threshold, differentiation of the minimizing expression cancels the terms involving because . Thus , and
Strict negativity uses a nondegenerate rate function with a unique zero at : for positive , and . For deterministic strain the ratio can instead be constant. Near the typical rate, if with , then for small . If this quadratic expression holds all the way to zero, it gives the illustrative full result
The quadratic form is an example, not a universal law of turbulent strain.
A thin scalar packet is stretched until molecular diffusion broadens its compressed direction; conservation of its scalar mass then converts area growth into dilution. Ensemble averages sample different stretching histories, producing different decay rates for different moments and saturation when weakly stretched histories dominate. The present moment calculation is specifically for the centered Gaussian packet and averaging over the flow; signed random initial fields with overlapping packets can also have cancellations and require their initial-field statistics.
Finally, positive exponential decay is a statistical conclusion requiring the strain assumptions above, not a consequence of the local differential equation by itself. For and initially isotropic physical variance , the exact solution has and . Its moments decay algebraically as . Thus the general equations for the exponential rates are the rate-function minimization above; numerical rates and a finite saturation threshold require the long-time statistics of the flow.
The covariance is symmetric, because multiplication of real random variables is commutative. Expanding with the bilinearity just proved gives
Identical probability distributions imply equal second moments and equal means, hence equal variances. Therefore the assertion is true, with
The cancellation shows exactly why no assumption of independence is needed.
For random variables with finite second moments, their covariance is
The Cauchy-Schwarz inequality ensures the product is integrable under this hypothesis. More generally the definition works whenever the displayed expectations exist. Assertions about arbitrary random variables below are understood on this domain: without suitable moments a covariance need not be defined at all.
A probability density function must integrate to one. Therefore
The first two moments are
Consequently the mean and variance are
For fixed , use the Lyapunov condition for the independent centered epoch counts . Their total variance is .
Write . Differentiating the geometric distribution probability generating function gives . Since , the sum of the centered absolute third moments is . Consequently
The Lindeberg-Feller central limit theorem applies through the Lyapunov condition, giving . Now , so the Slutsky theorem proves the asymptotic normality of the Watterson estimator:
The limiting variance is . When , every count vanishes and the limiting law is the point mass at zero.
Let . Conditioning on gives
Where the moment-generating function is finite around zero, differentiating the cumulant-generating function gives
In particular and . These compound Poisson cumulants use raw claim moments. The first two formulas also follow by conditioning: and , so
This is the law of total variance. They therefore remain valid with finite first two moments even when no positive exponential moment exists.
Under per-claim excess of loss reinsurance, put and let be the positive part of the excess. The insurer and reinsurer totals are sums of these payments over the same Poisson distribution count. Write . Using the tail integral formula for moments on the tail probabilities of and gives
For example, after , and shifting by gives the reinsurer formula. The moment formulas are finite whenever the corresponding claim moments are finite.
For the specified Pareto distribution, with shape three and minimum ,
If , every claim exceeds the reinsurance retention. Therefore
If , the tail integrals instead give
Consequently the requested sum of variances is
On the first branch, ; it decreases until and then increases. On the second branch . For the minimum is unique; if , all variances are zero and every reinsurance retention minimizes them. Thus
The curve starts at , reaches this minimum, passes through with matching slope on both branches, and then increases concavely toward the horizontal asymptote . The variance-minimizing retention for shape-three Pareto claims is shown below.
Figure 1.
Sum of insurer and reinsurer aggregate variances for shape-three Pareto claims, minimized at retention three quarters of the minimum claim size
. Details.
The two aggregate payouts are dependent. Conditioning on the common count gives covariance , so for every reinsurance retention, as required by . The covariance of two components of a compound Poisson sum accounts for this distinction between a sum of variances and the variance of a sum.
There is a moment domain qualification for this heavy-tailed example. For every , , and moments of order also diverge. Thus its positive moment-generating function is not finite and higher finite cumulants cannot be obtained by differentiating around zero. Its mean and variance calculations above are valid by conditioning or by the first two right derivatives at zero of the Laplace transform of a nonnegative random variable.
Write , with , and differentiate :
Using and gives
Thus the first three cumulants are the mean, variance and third central moment. A finite moment-generating function near zero justifies these differentiations. For positive claims with only three finite ordinary moments, the same calculations are valid as left derivatives at zero of the logarithm of the Laplace transform of a nonnegative random variable; positive exponential moments are not needed for the resulting moment identities.
For the independent Poisson distribution count, the random-sum transform identity gives
Consequently the compound Poisson distribution has
These are raw severity moments, not severity cumulants.
The printed gamma density uses rate , not scale. Direct integration against gives
Therefore the required matching equations for the shifted gamma distribution are
For and nonzero positive claims with finite , these equations give positive and the unique solution
This is the three-cumulant shifted gamma approximation. In particular, its skewness equals , the skewness of .
The competing normal approximation to a compound Poisson aggregate is
To justify its large-count limit, let be the claim characteristic function. For fixed severity law with , its expansion is . The characteristic function of is
Thus it converges in distribution to a standard normal distribution as .
The normal approximation is simple, uses only , and works well in the centre when the count is large and standardized skewness is small. It imposes symmetry, whereas positive compound-Poisson claims have positive third cumulant. The shifted-gamma approximation reproduces that third cumulant and can better describe moderate right skewness. It requires a finite and reliably known third moment, and matching three cumulants alone does not guarantee accurate extreme tails.
Neither continuous approximation reproduces the genuine atom , which matters at small . The normal distribution also assigns probability to negative losses. The gamma approximation is bounded below by , but its fitted shift need not be nonnegative: exponential claims of mean give , so it too can assign mass to negative losses. If , it instead excludes some genuinely possible small losses. These support and atom discrepancies prevent either approximation from being a universal replacement for the exact aggregate law.
For the Poisson process of claims and relative safety loading , the premium rate in the classical risk model is . Dividing the adjustment coefficient equation by explains why the arrival rate cancels. Interpret as the upper endpoint of the finite moment-generating function domain, so for and its stated divergence occurs at that endpoint.
Set . Then
Differentiation is valid inside the finite-transform domain, and its positive neighbourhood gives finite moments of every order. Thus is strictly convex and negative just to the right of zero. If , divergence of makes at the endpoint. If , choose with ; then , which eventually exceeds every linear function. Again . The intermediate value theorem gives a positive zero.
There is at most one positive zero: strict convexity and make the secant slope strictly increasing for . It starts at and crosses zero exactly once. Hence
This proves the secant-slope existence criterion for an adjustment coefficient in the present setting.
Put . For , the positive remainder of the exponential series gives . Apply it to and take expectations:
Dividing by yields
Keeping the cubic term similarly gives
The polynomial is strictly increasing for , is negative at zero and tends to infinity. Let be its unique positive zero. The last inequality says , so
Finally, , whence . Monotonicity gives . Thus the requested upper bounds can in fact be sharpened to the strict ordering . The bounds themselves need not lie in the finite-transform domain; the argument only evaluates the actual transform at and polynomial moments elsewhere. These are polynomial moment bounds for the adjustment coefficient.
For rate- exponential distribution claims,
The positive root satisfies after dividing out , so
The cubic-bound equation reduces to , selecting the displayed positive root. In particular , as required by the transform domain, for every .
Let be the total exposure, and define the prior distribution expected value, prior variance and average binomial noise by
Since the prior distribution has a probability density function on , and . All relevant moments exist because the parameter and observations are bounded. The binomial distribution gives
The law of total expectation, law of total variance and law of total covariance consequently yield
In particular, conditional independence of the annual observations does not imply unconditional independence: they share the uncertain parameter.
To derive the optimal credibility estimate among affine functions of the observations, put and write . The conditional errors have zero conditional expectation, conditional variance , and zero pairwise conditional covariances. They are also uncorrelated with every integrable function of . Therefore the joint mean squared error is
For fixed slopes, the first term is uniquely minimized by . For fixed sum , the Cauchy-Schwarz inequality gives
with equality exactly when . Thus the remaining optimization is the strictly convex quadratic
Its derivative vanishes at . Consequently the Bühlmann–Straub credibility estimate is
The individual coefficients are and . The strict quadratic minimizations establish global optimality and uniqueness, not just necessary equations. Here is the variance of hypothetical means, is the expected process variance, and is the Bühlmann–Straub credibility factor. More exposure gives more weight to the observed claim fraction. Since , the estimate remains between the observed pooled fraction and the prior expected value. If one separately permits a degenerate prior, leads to the constant estimate , interpreted as .
For the uniform distribution prior on ,
With two years, put and . Then and
To compare with the Bayes estimator under squared error loss, use conditional independence to multiply the two binomial likelihood functions. Terms independent of cancel on normalization, and the uniform prior makes the posterior density proportional to . Hence Beta-binomial conjugacy gives
Finally, for an arbitrary reported value , conditional quadratic loss decomposes as
The unique minimum is the posterior mean. Therefore the affine credibility estimate and the exact Bayesian estimate coincide in this case. The agreement illustrates exact beta-binomial credibility with unequal exposures; for a general prior distribution, minimizing over affine functions of the observations need not recover the unrestricted posterior mean.
Multiply the Fokker-Planck equation by and integrate over and all , assuming the required boundary terms vanish. Integration by parts gives
The mixed moment is not determined by : the current strain and the accumulated magnetic field are correlated. Zero mean strain does not imply , so this is an unclosed moment equation.
Keep the strain dependence by defining . The magnetic drift term satisfies
The strain derivatives commute with the integral. Hence
This weighted density obeys a tilted Ornstein-Uhlenbeck Fokker-Planck equation. Its integral over is the desired moment, while retaining makes the evolution closed.
External intermittency is the alternation of turbulent and non-turbulent fluid at a point as a fluctuating interface passes it. Internal intermittency in the equilibrium range instead describes uneven, bursty concentrations of small-scale velocity gradients and viscous dissipation within turbulent fluid. Integral-scale intermittency is modulation of the energy-containing motions and their energy supply. It is non-universal because it retains information about forcing, boundary conditions and the history of the large-scale flow.
The Landau intermittency counterexample challenges the unconditional universality asserted by Kolmogorov 1941 theory. Suppose turbulent populations have different conditional mean viscous dissipation rates . Even if each obeys the same conditional scaling, averaging over populations gives
which generally differs from . Thus a coefficient normalized by the global mean depends on the large-scale intensity distribution. The third-order case escapes this particular objection because the power of is one.
The Kolmogorov refined similarity hypothesis replaces global mean viscous dissipation by coarse-grained energy dissipation . It assumes that
has universal conditional statistics at sufficiently large local Reynolds number. If the conditional th moment is , the law of total expectation gives
The refined similarity hypothesis does not itself prescribe the distribution of coarse-grained energy dissipation. Scale dependence of those moments can change the predicted exponents. As before, noninteger orders require absolute velocity increments.