Random-effects meta-analysis 2026-10-05
For independent study estimates with within-study variances , a usual approximate model is and . Its marginal distribution is , so for fixed heterogeneity the inverse-variance weighted mean uses weights . Here describes the mean effect across comparable studies; represents between-study variation. Estimation and uncertainty for heterogeneity are essential, especially with few studies.
Randomized response Created 2026-10-31 Updated 2026-11-05
Randomized response masks which of two complementary binary questions a person answered. Suppose the sensitive property has probability , and independently the direct question is selected with known probability , while the complementary question is selected otherwise. Truthful answers then have yes probability . The investigator observes only the answer, preserving uncertainty about an individual's status while permitting population statistical estimation when .
For independent responses, , and the affine estimator is an unbiased estimator. Its variance is , by the mean and variance of a binomial distribution. Equivalently the variance is , exposing the extra sampling uncertainty caused by the masking. At , all produce and identifiability fails. At or , there is no masking and the extra variance vanishes.
Because , maximum likelihood estimation gives . This follows by maximizing the binomial likelihood over the interval and then inverting its monotone affine parametrization. Clipping can introduce bias: for , and , the clipped estimate has mean .
Randomized symmetric finite-difference derivative estimator Created 2026-10-03 Updated 2026-11-05
Let be independent Rademacher random variables and observe , where the noises are independent of the and of one another, with zero mean and variance . Assume the baseline is known exactly and on the sampled interval. The estimatoruses function values on both sides of . A first-order Taylor expansion givesThe average remainder therefore has squared magnitude at most , while the independent zero-mean noise contribution has variance . Their cross term vanishes after conditioning on the sample directions, provingThe noise assumptions and exact baseline belong to this bound. Correlated or biased errors, or an independently estimated baseline, require their own error calculation.
Randomly shifted lattice point process 2026-10-14
Let have the uniform distribution on and place a point at every , . This is a simple point process, locally finite, and a stationary point process: a translation only changes the phase modulo one, preserving its uniform distribution. For every Borel set , the Tonelli theorem givesIts consecutive points are exactly one unit apart, despite having the same intensity measure as a unit-rate Poisson point process. This is the one-dimensional translated-grid construction.[ref]
Spatial Point Processes and their Applications. Section 2.1, Example 2.3, printed pp. 26-27: randomly translated grids have constant intensity
Every half-open interval of length one contains exactly one point. For and , , each count has the Bernoulli distribution with parameter , andMore generally, an interval of length , with a nonnegative integer and , contains or points with probabilities and . Its count variance is , while a unit-rate Poisson point process has count variance .
Random measurement error Created 2026-10-20 Updated 2026-11-05
A component of measurement error fluctuating between repetitions under specified conditions, as distinguished from a shared systematic error. Independent zero-mean fluctuations of variance give a sample-mean variance ; correlated fluctuations need not follow this averaging law.
In an 1880 paper, John William Strutt, known as Lord Rayleigh, studied the resultant of many oscillations with a common frequency and arbitrary oscillation phases. His large-number calculation distinguished a mean intensity from a definite resultant amplitude and used planar coordinates followed by a polar integral. The resulting amplitude density is the Rayleigh distribution in a different scale convention. This is a large-number description, not an exact law for every finite collection of oscillations.[ref]
On the resultant of a large number of vibrations of the same pitch and of arbitrary phase by John William Strutt, 3rd Baron Rayleigh. Philosophical Magazine, Series 5, volume 10 (August 1880), pp. 73–74: expected intensity versus definite resultant; pp. 75–77: planar construction and polar integration; primary-paper transcription inspected on Scribd
To see the connection in a chosen model, take independent oscillation phases with uniform distribution on and equal component amplitude . The phasor sum has coordinatesBoth have mean zero, variance and zero covariance. The multivariate central limit theorem gives an approximately circular Gaussian random vector for large , with . Its amplitude is therefore approximately Rayleigh. For every finite , that amplitude is bounded by , whereas a Rayleigh distribution has an unbounded tail. At it is exactly . This simple endpoint check prevents the approximation from becoming a false exact identity.
Random sum of independent claims Created 2026-10-06 Updated 2026-11-05
For independent claim sizes with common expected value and variance , independent of the nonnegative integer count , the aggregate satisfies and . Its moment-generating function is wherever finite. These identities follow from the law of total expectation and law of total variance.
Random variable Created 2026-09-24 Updated 2026-10-14
A real-valued random variable is a measurable function from a probability space to the real numbers with their Borel sigma-algebra. More general targets give random elements. For every Borel set , measurability ensures that is an event, so the question "does the observed value lie in ?" has a defined probability.
The function is fixed; its input outcome is uncertain. This separates what we measure from how the uncertainty is modeled. A probability distribution is the resulting pushforward measure, . A cumulative distribution function, probability mass function, or probability density function describes that measure in an appropriate setting. The random variable and its probability distribution are different objects: the former also retains its relationship to other measurements on the same sample space.
For two independent uniform dice, let record their results and define and . The 36 ordered pairs are equally likely, but the resulting probability mass functions differ:For the sum, count the diagonal of the outcome grid having total . For the maximum, subtract the pairs with both results below from the pairs with both results at most . These examples show how a deterministic function transforms a simple input probability distribution into a nonuniform output one.
The corresponding expected values are and . The first follows immediately from linearity of expectation; the second follows from . Neither number must be an attainable result. An expected value describes an average under the probability measure, not a prediction that the next observation will equal it.
The distinction between a random variable and its probability distribution matters for dependence. and have the same discrete uniform distribution and are independent random variables. and a second copy of also have that same marginal probability distribution, but they always agree. Their joint probability distribution is concentrated on the diagonal; the marginals alone cannot say which relationship holds. This is why a model for several measurements must specify their joint law or an appropriate independence assumption.
Indicator random variables turn events into numbers: equals one on and zero elsewhere, and . This connects event counting with expected value and variance, and lets tools for random variables answer questions about probabilities. More complicated functions of observations can describe totals, waiting times, or estimation errors using the same framework.
Random-walk derivation of stellar relaxation Created 2026-10-06 Updated 2026-11-05
Small-angle gravitational encounters occur at rate and supply kicks . Independent kick variances add to . Setting the accumulated variance to and using virial scaling gives a stellar relaxation time of order stellar crossing times, with the coefficient dependent on profile and crossing convention.
Random-walk maximum limit from Donsker invariance Created 2026-10-07 Updated 2026-11-05
For a random walk with centered independent identically distributed increments of variance one, the maximum of its polygonal interpolation is the maximum at its grid vertices. The maximum functional is Lipschitz for the supremum norm, so the continuous mapping theorem applied to the Donsker invariance principle proves the displayed convergence in distribution. The Brownian reflection principle then gives upper-tail limits at all , since the limiting maximum has no atom there.
Range of a semivariogram 2026-10-05
The exact range is a separation beyond which the semivariogram reaches its sill. A Gaussian semivariogram with nonzero structured variance approaches its sill asymptotically and therefore has infinite exact range. Software range parameters may instead specify a scale.
Rank deficiency from deterministic spectral upsampling occurs because a deterministic map cannot manufacture independent measurements. For and input covariance matrix ,When the output has more channels than the input, its covariance matrix is necessarily singular. Covariance of count-conserving rebinned Raman channels gives the conserved-count example and its full propagated uncertainty.[ref]
Using that parent's two-to-three channel map, the output always satisfies . If the input readings are and , the rebinned vector is . Recovering the original readings as and shows that the third displayed number is not a third independent observation.
For an original fitting example, suppose both input means equal an unknown and their independent measurement-error variances are known to be . Fitting in the original channels gives , with variance . A correct generalized least squares fit after rebinning gives the same result and uncertainty. It must use the singular covariance on its supported range, for example through the Moore-Penrose inverse, together with the exact linear constraints.
The range restriction in singular-covariance spectral fitting matters if a proposed output model fails those constraints. A residual along cannot arise from this rebinning model at all. Merely inserting a pseudoinverse into a quadratic objective would assign zero penalty to that impossible direction. Either enforce the range condition or supply a physically justified additional noise model; adding a small diagonal term solely to make the matrix invertible changes the statistical assumptions.
The motivating Raman apparatus measures detector-array spectra before any subsequent numerical grid change.[ref]
Femtosecond Broadband Stimulated Raman: A New Approach for High-Performance Vibrational Spectroscopy by David W. McCamant and others. Instrumentation, array detection and spectral calibration; Data Collection, equation 4
Working on the original grid often avoids this singular fitting problem while retaining the actual measurement information. Rank-one update of pressure-map information 2026-11-05
A rank-one update of pressure-map information describes the extra constraint supplied by one independent scalar pressure measurement. Suppose the existing pressure-map information matrix is , and a new sensor reports with known variance , independent of the existing errors. Adding its squared residual to the weighted least squares objective givesThe added matrix has rank one when . It is positive semidefinite because its quadratic form is . Thus the new observation cannot reduce information in any direction under this fixed linear map and noise model. The noise normalization is the same whitening transformation used to express a correlated residual metric as an ordinary squared norm.[ref]
The update can remove a missing direction only if the new channel actually sees it. More precisely,This follows because a sum of two nonnegative quadratic forms is zero exactly when both are zero. Repeating an existing mixture improves its precision but cannot identify a pressure contrast that all mixtures annihilate.
When is positive definite, write . The Sherman–Morrison formula yields the updated estimator covariance matrixMultiplication by verifies the identity directly. For a particular quantity , its variance falls by . A small noise level is valuable only together with a useful sensitivity direction.
For an original calculation in kilopascal coordinates, let , and . ThenThe variance of the sum drops from to . The negative off-diagonal entry means the two inferred coefficients now have negatively correlated errors; it does not mean either individual variance is negative.
A correlated-channel update of pressure-map information needs the new channel's residual after predicting it from old channel noise. Simply adding double-counts information when a common amplifier or reference contributes correlated errors. A proposed array experiment uses repeated known loads to estimate sensitivity and noise separately, adds one channel, and compares withheld-load errors with . Agreement tests the full assumed model, including independence and unchanged sensor response, rather than the matrix identity alone.
Rao-Blackwell estimator for a uniform scale interval Created 2026-10-14 Updated 2026-11-05
For independent uniform random variables on with , the sample minimum and maximum form a sufficient statistic. Conditional on these endpoints, exchangeability and the uniform law of the remaining observations give . Applying the Rao-Blackwell theorem to gives the displayed unbiased estimator. Its variance is , compared with for .
Rao-Blackwellization Created 2026-10-06 Updated 2026-11-05
Replace an estimator by its conditional expectation given selected information. The mean is unchanged and the variance cannot increase, by the law of total variance. In simulation this produces conditional Monte Carlo estimators. Sufficiency is needed for the classical inferential strengthening, but not for the elementary variance reduction identity.
Rao-Blackwellization of a multinomial probability product Created 2026-10-07 Updated 2026-11-05
For independent labels with three type probabilities, conditioning the indicator of an ordered initial triple on the multinomial distribution type counts gives the displayed unbiased estimator. The Rao-Blackwell theorem reduces its variance strictly when all three probabilities are positive. At a boundary parameter with a missing type, both variances vanish.
Rao-Blackwell theorem Created 2026-09-24 Updated 2026-11-05
If is a sufficient statistic and is an estimator with finite variance, then has the same expectation and no greater variance. Sufficiency allows the conditional law, and hence this improved estimator, to be chosen without dependence on the unknown parameter. Indeed, the tower property of conditional expectation preserves the mean and the law of total variance gives
Rare-event discovery versus inverse-moment precision separates seeing an influential thin region from estimating its contribution to inferred density. In a two-point thickness model, let a rare thickness occur with probability , with reciprocal thickness , while common regions have reciprocal thickness . For independent observations, the rare count has a binomial distribution. The chance of at least one rare observation isTo make this at least , choose . For stipulated and , the smallest integer is 29,956. This planning statement assumes the specified rare-event probability; it does not estimate that probability from a sample that missed the event.[ref]
The sampling distribution of the estimated inverse moment answers another question. With the observed rare count,Thus a target relative standard uncertainty for the inverse moment requiresThis is a contribution-weighted precision target for inverse moments: the required count depends on both rarity and the leverage of the rare value.
Use the original model , and . Here and . ConsequentlyAt the 95%-discovery count, this relative standard uncertainty is still about 28.9%. Reaching 10% for the inverse moment needs 249,975 observations in this model, while reaching 10% for the rare fraction itself needs 999,900. The factor of four arises because the rare excess accounts for half the total inverse moment, so its relative fluctuation is diluted in the total.
These are exact variance calculations under a stipulated distribution, not confidence-coverage guarantees or measured material properties. Spatially clustered thin regions reduce the effective independent sample count. A credible physical lower-thickness bound or better resolved imaging can change the model more substantially than merely extending a simulation with an unsupported tail.
Rare-outlier three-point distribution 2026-10-14
For , put probability mass at zero and at each of and . This symmetric probability distribution has mean zero. Its second and fourth moments are both , because the nonzero outcomes have square and fourth power equal to one:For the kurtosis is ; for it is . In the latter case of the probability mass is at zero, yet all of the fourth central moment comes from the remaining . The standard score takes values and , with variance one. Each nonzero outcome contributesto kurtosis. At , the two rare outcomes are ten standard deviations from the mean, and their contributions are .
Every member has finite support of a probability distribution, so all its moments are finite. Nevertheless, kurtosis becomes arbitrarily large as approaches zero: high kurtosis does not require an unbounded support of a probability distribution or a heavy-tailed distribution. At the variance vanishes and kurtosis is undefined. At this discrete probability distribution even has the normal distribution value and excess kurtosis zero, so those values do not establish a normal distribution.
Rare-thickness leverage on inverse moments 2026-11-05
Rare-thickness leverage on inverse moments is the disproportionate contribution of uncommon, very thin layers to inferred density when . Its sampling consequence is especially revealing: a sample can miss the influential component and report very little apparent variability.
Consider an original two-point thickness model. Let the rare thickness be with probability , and the common thickness be otherwise. Define and . Among independent measurements the rare count has a binomial distribution, and the estimated mean reciprocal thickness isConsequently,Multiplication by converts these into the mean and variance of the sample mean inferred density. The formulas are exact for this constructed model.
Take , micrometres and micrometres. The true mean reciprocal thickness is approximately . With , zero rare observations has probability about 0.905 and gives . Exactly one rare observation instead gives . The sampling distribution is highly asymmetric despite the large-looking sample count. When every sampled value is the same common thickness, the ordinary sample variance is even zero; it has not revealed the missing component.
Rare-event discovery versus inverse-moment precision distinguishes two experimental objectives. To have at least 95% probability of seeing one rare event requiresor 29,956 observations for this . Estimating the rare fraction to relative standard uncertainty about 10% instead needs roughly one million independent observations, since . Seeing one event is not precise quantification of its contribution.
A distributional assumption therefore needs physical support near zero thickness, not just a fit to the sample centre. NIST's gamma distribution and lognormal distribution entries specify distinct lower-tail models; choosing either is a modeling decision.[ref] Dimensional resolution and independent geometric bounds can be more informative than extending a simulation that never challenges its assumed tail.

