Sign-sensitive measurements that resolve a covariance-axis ambiguity add an observable whose distribution changes when the fitted axis direction is reversed. In the global orientation ambiguity in a rank-one covariance fit, and give the same covariance. An independently calibrated signed projection can distinguish them.
Consider two candidates with an additional observation , where is known, has known positive sign and . Assume this calibration reading is independent of the covariance data conditional on the candidate. The Gaussian densities giveThe normal density and cumulative distribution function used here are documented in the pinned numerical reference.[ref] The likelihood-ratio expression follows by expanding the two squared residuals.
For an original example, let , and observe . The log likelihood ratio is 16, strongly favoring the positive candidate under this stated model. With equal prior probabilities and equal decision costs, the sign-threshold decision has repeated-measurement error probability . This decision-error probability is different from assigning a posterior error probability to that one observed value.
A practical calibration applies a known signed perturbation and records the signed detector-response component. Reversing the applied perturbation checks readout polarity. A calibrated phase-sensitive readout can provide such a projection; measuring only noise covariance does not supply its sign.
The failure of sign recovery from magnitude-only calibration data is important. For symmetric Gaussian noise, has the same distribution under means and . If is orthogonal to the axis, then and even the signed reading adds no separation. If the amplitude sign itself is unknown, reversing both amplitude and axis preserves the mean. The additional measurement resolves the ambiguity only when its reference sign and response model are independently established.
Choose one of two regimes once, with equal probability: a source of independent and identically distributed random variables with one-bit probability , or one with one-bit probability . Keep the chosen regime forever. The resulting source is a strictly stationary process, because shifting a block does not change either component law. It is not an ergodic stationary process: its limiting empirical frequency identifies the regime.
The source's information rate isConditioning on the single regime bit changes any block's information entropy by at most one bit, so dividing by the block length proves this rate. However, the limiting realized information content per symbol is approximately in the first regime and one in the second. The alternative component's likelihood ratio decays exponentially along a typical path from the chosen component, at a rate given by the positive relative entropy between the two Bernoulli distributions. The mixture therefore has two possible pathwise limits, not one limit equal to the averaged information rate.
A sufficient statistic allows the observed likelihood function to be stored through a shorter record, up to a parameter-independent factor. For the Bernoulli sample sum as a sufficient statistic, writeThe second likelihood function belongs to the observed count; the first belongs to the observed sequence. Their absolute values differ by the binomial coefficient, but their likelihood ratios between any two interior parameter values agree. A maximum-likelihood estimator can therefore use just .
Sequence to count: sufficient compression preserves likelihood comparisons
. For , three example sequences share . Recording produces the count likelihood . Normalizing each curve by its maximum makes the two curves coincide. A reverse random draw from the six arrangements restores the full-data probability distribution, using no unknown . Details.This compression discards which arrangement actually occurred. To reproduce the original experiment's probability distribution, first draw from its binomial distribution and then draw uniformly from the arrangements with that sum. The second step is independent of , so it supplies no additional evidence about . It does not recover the particular discarded sequence. If the scientific question changes to time trends or statistical dependence between observations, the common- independent and identically distributed Bernoulli model may no longer apply, and the ordering can become informative.
Statistical test Created 2026-10-05 Updated 2026-11-05
A statistical test is a measurable rule for deciding whether to reject a null hypothesis. Allowing randomisation, it is represented by a function giving the conditional rejection probability after observing . A deterministic test takes only values zero and one. Under a simple null, is its size of a statistical test; under an alternative, is its statistical power. Randomisation on a likelihood ratio equality set allows a Neyman-Pearson lemma threshold test to attain a prescribed size even for discrete data.
Uniform-alternative binomial Bayes factor Created 2026-10-14 Updated 2026-10-25
For a binomial distribution count, compare a point null with the uniform alternative prior distribution on . The alternative Bayesian model evidence isso the exact Bayes factor favouring the point null is . With standardized deviation , the local normal distribution approximation is . At fixed the frequentist p-value remains approximately constant, while the factor grows like . This demonstrates the prior-width mechanism behind the Jeffreys-Lindley paradox for a Gaussian point null in a discrete sampling model.
For a separate original example, change the point null to and take to have a uniform prior , fixed before the ten Bernoulli trials. Here is drawn once under and shared by all ten trials: they are independent conditional on . For one particular ordered sequence with eight heads and two tails, the Euler beta function givesThus the Bayes factor for the uniform alternative against the point null isThe binomial distribution count formulation gives and . Their ratio is again ; these count masses must not be combined with the ordered-sequence masses above. The general formula at the start of this article puts the point null in the numerator, so it equals here.
In contrast, maximum likelihood estimation gives : differentiating the log-likelihood yields , and the endpoints have zero likelihood. Its peak-to-null likelihood ratio isThis peak is chosen after seeing the data, so it is not the Bayes factor of the prespecified . The Bayesian model evidence for averages over its entire uniform prior; it is smaller than the peak. It is also smaller than . Against the same null, a point alternative fixed at would give a Bayes factor about , greater than . An integrated alternative need not outperform a point alternative.
For a general proper beta distribution prior distribution with , the same ordered-sequence marginal likelihood is . This follows by substituting the normalized prior density into the integral, and shows exactly where the parameter prior distribution changes the Bayes factor. Holding the parameter prior distributions fixed while changing model prior odds leaves that Bayes factor unchanged.
Uniformly most powerful test for a gamma rate Created 2026-10-25 Updated 2026-10-31
For an independent statistical sample from a gamma distribution with known shape and unknown rate , test against . The alternative-to-null likelihood ratio for any larger rate is , where . This decreases in , so the Neyman-Pearson lemma gives one common lower-tail ordering for all alternatives.
Let be the unit-rate gamma distribution cumulative distribution function with shape . The uniformly most powerful test of exact test size rejects when , where . Its power function is displayed above. If , the sum has an exponential distribution, so and . Monotonicity of also makes this test valid and uniformly most powerful for the larger null hypothesis .
Uniformly most powerful test for an exponential rate Created 2026-10-06 Updated 2026-11-05
For independent samples from an exponential distribution, a test of rate at most against rate greater than rejects for small sample sums. All simple-alternative likelihood ratios against decrease with that sum; its gamma distribution calibrates the size at . Monotonicity of the rejection probability in the rate proves that this is a uniformly most powerful test for the composite hypotheses.

