Chernoff information Created 2026-09-24 Updated 2026-10-14
Chernoff information measures how quickly repeated independent evidence can distinguish two fixed probability distributions. Suppose a statistical hypothesis test observes independent and identically distributed random variables, with common law under one simple hypothesis and under the other. Give the two hypotheses fixed positive prior probabilities, and let be the smallest achievable average error probability. For distinct positive probability mass functions on a common finite alphabet,
Here is the natural logarithm, so the error exponent is measured in nats per observation. This optimal rate is unchanged by choosing different fixed positive prior probabilities; the best decision rule and finite-sample error can still change.[ref]
The interpretation is : a larger Chernoff information means fewer observations are needed at the leading exponential scale. It does not assert the exact finite-sample identity . The finite-sample Chernoff error bound and the explicit Chernoff information for complementary Bernoulli distributions make this distinction concrete. This is useful when designing repeated measurements or comparing sensors whose output probability distributions differ under two candidate conditions.
For probability mass functions with zero entries, define the affinity for and use , taking endpoint limits when needed. This avoids an ambiguous convention. Identical laws give ; disjoint probability supports give , because one observation separates them perfectly. The displayed finite-rate theorem concerns fixed laws with common positive support, not laws that change with or arbitrarily dependent repeated observations.
The 1–15 fragment has a slightly lower mean degradation signal and perhaps lower invadopodium formation than the longer N-terminal fragment. It may be the stronger inhibitor, but the displayed comparisons do not establish that difference. The asterisks compare groups with control, not necessarily the two active fragments with one another. Their error bars overlap, and overlap alone is neither a definitive test of equality nor a calibrated significance test.
A direct comparison needs replicate-level data and a suitable statistical hypothesis test, with an effect size and confidence interval. Comparable fragment abundance, cell viability and cell number are also needed before interpreting a phenotypic difference as greater molecular potency.
Let and be the population means of the newspaper trust score for the unvaccinated and vaccinated groups. A two-sided hypothesis test compares
The observed difference of sample means is : the vaccinated group has a one-unit higher average trust score. The negative test statistic agrees with subtraction in this order. A Student's t-test scales the estimated difference by its estimated standard error; means that the observed difference is 3.6 estimated standard errors below the equal-mean null hypothesis.
Using the reported reference Student t-distribution with 747 statistical degrees of freedom,
Thus the equal-mean null hypothesis is rejected at a prespecified 5%, 1% or 0.1% significance level, subject to the test's assumptions. A p-value is a probability of a result at least this extreme under the specified null hypothesis and sampling model. It is neither the probability that the null hypothesis is true nor the probability that this particular conclusion is mistaken. A chosen significance level controls the procedure's type I error probability under that model.
The estimated difference is more informative than statistical significance alone. If the reported statistic uses this one-unit contrast, its estimated standard error is . The corresponding approximate 95% confidence interval is
This interval concerns a population mean difference under repeated sampling; it is not a range containing 95% of individual trust scores. Its practical interpretation also depends on the trust scale and the importance of a one-unit difference.
The groups are disjoint, so an independent-samples comparison is appropriate if the sampled observations are independent. The exact pooled Student's t-test additionally assumes common population variance and normal distributions; Welch's t-test permits unequal variances and uses an approximate reference distribution. A bounded or ordinal rating need not be exactly normal, so treating it numerically and using a large-sample approximation also requires judgment about group sizes and the score's meaning.
There is a bookkeeping qualification. The later outputs use 748 observations. If these are also the complete observations for this two-group comparison, the pooled test has statistical degrees of freedom, and the Welch degrees of freedom upper bound is also 746. The printed 747 therefore needs the original test call or a different sample count to reconcile it. The reported-calibration calculation above answers the stated test; it does not invent group sizes or silently change the reference distribution.
The evidence supports an association between higher newspaper trust and recorded vaccination, rather than a causal effect of trust. An observational study does not rule out confounding, selection bias or reverse causation. A statistical hypothesis test cannot supply those missing causal assumptions.
For a CUSUM threshold , define the first signalling time
The average run length is under a specified distribution of the observations and specified initial state, here . The in-control value is computed under the null hypothesis; a large value means false signals occur infrequently. The out-of-control value is computed under a specified alternative hypothesis; a small value means rapid detection when that alternative holds from monitoring's start. If a change occurs later, its detection delay depends also on the chart state at change time, so the zero-state alternative average run length is not every possible delay.
A fixed-horizon statistical hypothesis test is characterized by Type I error probability under its null and Type II error probability under a specified alternative. Continuous monitoring repeatedly offers opportunities to signal: over an indefinitely long run its probability of eventually signalling can be one even under the null. The average run length quantifies waiting time rather than that eventual probability. It replaces the single-test emphasis on a false-rejection probability with a false-signal timescale, and compares detection speed rather than only a fixed-horizon miss probability. However, a mean run length alone does not determine either finite-horizon error probability; those require the run-length distribution.
Let and be the underlying full-recovery probabilities. The two-sided statistical hypothesis test is
Use the Pearson chi-squared test of homogeneity for the two independent groups. Under , the pooled recovery estimate is , so each row has expected counts 28 recovered and 22 not recovered. All expected counts comfortably exceed five. The Pearson chi-squared statistic for contingency tables is
The asymptotic reference distribution is a chi-squared distribution with degree of freedom. Since , do not reject equal recovery probabilities at the 5% level. The observed recovery proportions, 0.50 and 0.62, do not provide statistically significant evidence of a difference in this trial. This conclusion does not prove that the procedures have identical recovery probabilities.
The log likelihood ratio statistic comparing the unrestricted fit with the independence fit is
The unrestricted model has free parameters. Independence has , so the difference is . By Wilks theorem, under the null hypothesis the statistic has asymptotically a chi-squared distribution with degrees of freedom, rather than , , or .
For the supplied statistic, the approximate p-value is . Thus reject independence at the 5% level, but not at the 1% level: the data provide evidence of an association. The approximation is reasonable here; the smallest fitted cell count is , so all fitted counts exceed . The statistical hypothesis test concerns association, not a causal effect of personality.
Falsificationism captures an important asymmetry between universal claims and counterexamples, but it is an incomplete account of scientific appraisal. It works best as a demand for serious testing within fallible theoretical packages, rather than as a mechanical rule for discarding a theory after any anomalous observation.
For an unrestricted universal claim, finitely many successful cases do not deductively establish every unobserved instance. One genuine contrary case can contradict the universal claim, provided the predicates and circumstances are correctly identified. Karl Popper's emphasis on attempts at refutation consequently highlights something that mere accumulation of agreeable examples can miss: a test is informative partly because plausible alternative outcomes would have counted against the proposal.[ref]
Real predictions nevertheless involve a conjunction. If and , then
Here includes an apparatus model and initial conditions. The conclusion does not identify as the failed component. Independent calibration, varied experimental arrangements and agreement across instruments help distinguish the possibilities; they do not eliminate the logical structure of the Duhem problem. Insisting that every auxiliary assumption remain unrevisable would obstruct ordinary experimental repair.
Probabilistic theories create another difficulty for simple deductive falsification. If an ideal Bernoulli distribution model assigns a probability to success, every finite binary sequence has positive probability. An unusual sequence does not literally contradict the model. A statistical hypothesis test can instead use a predeclared rejection region with a controlled type I error. Its possible mistaken rejection is part of the method, not a contradiction to be ignored. Comparing alternatives also requires likelihoods or other explicit criteria, rather than a binary division into refuted and unrefuted proposals.
Finally, survival alone is not enough. A vague conjecture and a quantitatively successful theory might both be unrefuted; they need not be equally supported. Scientific decisions also concern approximation error, independent explanatory connections and whether a proposed modification predicts anything new. These considerations need not restore conclusive verification, but they require more than deductive refutation.
The plausible core is therefore methodological: specify what could count against a claim, expose it to demanding tests and resist changes made only to accommodate failure. The stronger thesis that this principle supplies a complete logic of discovery, theory choice and confirmation is not established. Critical testing remains valuable precisely when its assumptions and statistical limitations are stated honestly.
Falsificationism is more plausible than a requirement of conclusive verification, but a fallible theory of testing should retain positive evidential support as well as criticism. The comparison changes if verificationism is weakened to mean empirical confirmability rather than proof.
First separate a methodological thesis from a thesis about meaning. Methodological verificationism says that scientific theories should be established by verifying observations. A stronger semantic version treats verifiability as a criterion of meaningful factual assertion. These positions are not identical. A theory might be meaningful and empirically significant even though no finite test can establish its unrestricted truth.
The central asymmetry is logical. For a universal claim , observing leaves unexamined cases open. A genuine counterinstance contradicts that universal claim. A finite sequence of favourable tests of an unrestricted physical law therefore differs from a conclusive deduction of it. This gives falsificationism a substantial advantage over strong verificationism: it makes scientific risk possible without demanding an unattainable final proof.
Karl Popper's methodological proposal is not to invent theories that are false, but to formulate conjectures with empirical content and subject them to severe tests. Surviving such tests amounts to corroboration, not conclusive verification.[ref] A theory that prohibits nothing cannot gain comparable credit simply by retelling whatever happens.
However, the logical asymmetry does not make scientific decisions automatic. The alleged counterinstance depends on identifying the object, measuring the relevant quantity and applying the theory in an appropriate domain. In , failure of refutes the conjunction, not uniquely . The Duhem problem therefore defeats a naive rule that every discrepant reading immediately falsifies the central theory. Independent tests of the auxiliary hypotheses can make rejection well justified, but that is additional evidential work.
Statistical models create another difficulty. For mutually independent trials, each governed by a Bernoulli distribution with success probability , a specified sequence with successes has probability . An unusual sequence is therefore not a logical counterexample to this model. An appropriate statistical hypothesis test instead asks how surprising a specified discrepancy would be under the model, allowing controlled but nonzero error. The decision depends on the test protocol, sample size and alternatives. Recasting such testing as literal contradiction would erase the distinction between impossible and improbable outcomes.
The universal-claim argument also has a converse. An existential claim can sometimes be established by one well-authenticated instance, although no finite failed search proves that there are no instances anywhere. Therefore the logical asymmetry concerns forms of claims; it is not a proof that every scientific statement must have exactly the same testing structure.
A defender of weak verificationism can accept all this and require only that observations can increase support. Bayesian confirmation, for example, compares a theory's likelihood with those of alternatives. That avoids treating favourable evidence as a proof. It does inherit questions about prior probabilities and the problem of induction, but criticism does not eliminate those questions either. Scientists still need reasons to use one surviving theory rather than another when planning further work.
Thus falsificationism wins against conclusive verificationism by recognizing the openness of empirical theory and the importance of possible failure. It does not win a monopoly on rational scientific reasoning. A stronger account combines demanding tests, scrutiny of auxiliary hypotheses, appropriate statistical treatment and defeasible positive support. The main achievement is disciplined error correction, rather than replacing one promise of certainty with another.