Duhem problem 2026-10-24
From and , infer only . A failed prediction therefore does not logically isolate failure of the target from failure of auxiliary hypotheses . Independent calibration and varied experiments can discriminate packages; the logical ambiguity does not imply that every package is equally supported.[ref]
A useful response to the demarcation problem should identify practices which make claims answerable to evidence without equating scientific status with either truth or prestige. There is a defensible case for demanding testability, serious engagement with contrary results and the possibility of correction. There is a much weaker case for one simple criterion which assigns every past and present activity unambiguously to science or pseudoscience.
Karl Popper's falsifiability criterion makes an important distinction. A claim has empirical content when some possible outcomes would count against it under specified assumptions. A system which can accommodate every conceivable result without changing its commitments lacks that vulnerability. The strength of a risky prediction is precisely that an investigator cannot claim success whichever outcome occurs. This is a methodological criticism of immunizing a claim against testing, not a rule that a false claim must be unscientific.[ref]
A simple counterexample shows why falsifiability alone cannot settle the whole question. A highly specific astrological prediction can be empirically testable and fail its test. Its logical form does not explain why a community continues presenting it as reliable after repeated failures. Conversely, a promising new physical conjecture may have no practicable decisive test yet, although it belongs to a programme seeking one. Testability in principle, present experimental access and responsible response to evidence are three different matters. Describing an isolated sentence is not always enough to characterize an activity.
Nor does a failed prediction logically identify its culprit. If a theory and an auxiliary hypothesis imply an outcome , a contrary outcome establishes , not uniquely . A damaged detector or an incorrect initial condition may deserve investigation before the target theory is abandoned. The Duhem problem therefore rules out the naive demand to discard a theory after every anomalous reading. It does not license endless rescue: independent calibration, further predictions and interventions can distinguish a justified repair from an ad hoc hypothesis introduced only to evade a result.[ref]
Imre Lakatos accordingly evaluates a scientific research programme through its development. Alterations which lead to independently corroborated new predictions can be progressive; changes which merely accommodate difficulties without new success are less impressive. The relevant contrast concerns a pattern of inquiry over time. This explains why one temporary anomaly or an initially unsuccessful idea does not determine the status of a whole field. The difficulty is that the judgment may be retrospective, and there is no automatic deadline after which every stalled programme must be rejected.[ref]
A defensible assessment therefore combines several considerations: specificity of claims, quality and independence of tests, handling of uncertainty, disclosure of methods, willingness to revise, and success in producing further research. None is individually sufficient. Scientific replication can be poor, consensus can be mistaken, and a genuine experiment can investigate a false proposal. These qualifications do not make all approaches equally credible; they make the reasons for a classification more informative than a label alone.
The resulting criterion is satisfactory as a fallible standard for evaluating inquiry, rather than as an exceptionless definition discovered by inspecting the grammar of a claim. For a practical decision, it is often more precise to identify a failure, such as an uncontrolled comparison or a refusal to specify what would count against a prediction. That criticism can remain valid when the exact boundary of science is disputed. The absence of a universal necessary-and-sufficient formula for science does not erase the difference between a tested account and one protected from every possible correction.
Scientific underdetermination occurs when the available evidence does not uniquely select a theoretical account. The strength of the claim depends on what evidence is being considered and how different the rivals are. Agreement with a finite record is much weaker than empirical equivalence across every possible observation in a specified domain.
A straightforward finite-data example is interpolation. If at measured inputs, then reproduces those values for every , while generally predicting different values elsewhere. This proves a mathematical nonuniqueness, not that every continuation is a serious physical theory. Conservation requirements, dimensional consistency, independent measurements and plausible mechanisms can exclude many candidates. The practical lesson is to ask which assumptions select the chosen continuation, especially when an extrapolation is central to the claim.
Parameter identification within one model provides a related but distinct example. A linear experiment cannot identify a unique parameter vector if a nonzero vector lies in the null space of : both and predict the same response. A new measurement row with can distinguish them. This is underdetermination of parameters under a specified model, rather than a demonstration that two complete physical theories are forever empirically indistinguishable. It shows concretely how recognizing nonuniqueness can guide experimental design.
The Duhem problem concerns another source of ambiguity. Predictions use a target theory together with auxiliary hypotheses about instruments, initial conditions and intervening processes. A failed prediction rejects their conjunction. It does not logically specify which member should change. Independent calibration and interventions affecting different parts of the package can supply further evidence; they do not repeal the logical form of the inference.[ref]
A stronger philosophical claim posits rival accounts with the same observable consequences for every relevant experiment. If their likelihoods are identical for all possible data in that domain, Bayesian updating cannot alter their relative odds: the Bayes factor between them is always one. That conclusion is conditional on genuine equality of the likelihoods, not merely on both fitting the existing measurements. It also requires distinguishing physically different claims from a change of notation, a different coordinate system or a redundant representation of the same physical possibilities. Not every mathematical rewriting generates a new rival ontology.
There are several practical implications. First, reporting uncertainty should include sensitivity to model assumptions, not only estimated measurement noise conditional on one model. Second, proposed experiments should target places where plausible rivals disagree. Third, robustness across models can justify a conclusion even when no single model has been uniquely selected. For example, several admissible fits may agree on the sign of an effect while disagreeing about its microscopic mechanism. The evidence for those two claims need not have the same strength.
Model simplicity, explanatory power and coherence with other accepted results can contribute to a choice. Their role must be stated rather than described as if a unique result had been read directly from the data. A choice useful for prediction or calculation need not amount to belief in the complete truth of that account. Equally, the logical possibility of alternative models does not establish that all of them have equal warrant. Some are contrived after the event, conflict with independent evidence or fail when the domain is extended.
The implications for scientific realism are therefore qualified. Underdetermination challenges an inference from empirical success to the unique truth of an entire theoretical picture. It can motivate selective commitments or constructive empiricism. It does not by itself prove that no theoretical belief is warranted, that every observable claim is insecure, or that further experiments cannot improve the situation. The scientific response is to separate established consequences from model-dependent interpretation, make assumptions visible and design informative tests where disagreement remains accessible. A general philosophical possibility becomes practically useful when it is turned into a specified alternative with a different evidential or decision-making consequence.
Scientific underdetermination limits what evidence alone establishes, but its practical consequences depend on the strength of the equivalence being claimed. Rival theories fitting present data need not agree on future observations. Rival formulations agreeing on every observable in a specified domain present a more persistent limitation within that domain.
With finitely many data points , suppose an interpolation polynomial fits all measurements. Then
also fits them for every . This proves nonuniqueness for a deliberately broad model class. It does not prove that all these functions are equally plausible physical theories. Constraints from independently tested mechanisms, bounds on derivatives, symmetries and the measurement process can sharply restrict the class. A new observation at a different point can also distinguish the displayed alternatives.
The Duhem problem concerns an additional kind of latitude: a prediction tests a theory together with auxiliary hypotheses. A mismatch can be assigned to different components. This is a reason to vary apparatus, calibrate independently and use multiple kinds of evidence. It is not a demonstration that any preferred theory can be made equally well supported by arbitrary repairs.[ref]
Exact empirical equivalence requires more. If two accounts supply identical probability distributions for all observations allowed by a stated setup, observations of that kind cannot favour one through their likelihoods. Bayesian inference makes the limitation explicit: posterior odds equal prior odds when the likelihood ratio is one. Declaring a prior preference does not transform it into new experimental discrimination.
Theories can nevertheless differ in explanatory organization, computational usefulness or how they connect with a larger domain. Those are legitimate questions, provided their role is stated. If a proposed new intervention distinguishes them, the equivalence did not cover that enlarged domain. If the difference is instead only a change of redundant description, treating it as two competing physical worlds may create a spurious dispute; gauge symmetry provides an important case requiring care.
For scientific practice, the appropriate response is model comparison with explicit assumptions, searches for discriminating tests and honest limits on what has been established. For scientific realism, enduring empirical equivalence challenges any claim that the evidence uniquely fixes a full ontology. It does not make precise predictions or experimental decisions impossible. Underdetermination is consequently a constraint on inference whose seriousness must be demonstrated case by case, rather than a general proof that all scientific reasoning is arbitrary.
A plausible demarcation assesses how a practice makes and tests empirical claims, while allowing unsettled boundary cases. An exact sentence-level test is less defensible than an account of sustained accountability to evidence. Pseudoscience should also be distinguished from honest scientific error and from activities that make no scientific pretension.
Karl Popper's falsifiability criterion identifies something central: an empirical theory excludes possible observations. A proposed relation between a controllable input and an instrument reading is testable only if some readings would conflict with it under the stated conditions. Collecting agreeable anecdotes is weak when an account can be made compatible with every outcome. Risky predictions matter because passing a test should have been difficult for a mistaken account.[ref]
Yet falsifiability is not sufficient for good science. Someone could guess tomorrow's detector count and then advertise the guess as an established result. The numerical claim is falsifiable, but that does not supply calibration, a justified sampling model or a reliable research practice. Conversely, an investigation can be scientific even if the working model later proves false. The demarcation problem concerns the character of inquiry, not a guarantee of truth.
Nor does a failed prediction always justify immediate rejection of the principal theory. In a test represented by , the observation yields . The auxiliary hypotheses might include an initial condition, an instrument model or the composition of a sample. This Duhem problem is a logical limitation on what one unsuccessful test establishes.[ref]
There is nevertheless an evidential difference between a justified repair and an evasive one. If a suspected detector defect is measured independently, and correcting it yields further successful predictions, the change increases the theory's exposure to testing. If a new invisible influence is introduced after each failure with no independent consequences, the repair preserves agreement at the expense of accountability. An auxiliary hypothesis is not disreputable merely because it is auxiliary; its evidential role matters.
Imre Lakatos therefore shifts attention to sequences of theories and their capacity to generate corroborated new results. A programme that repeatedly anticipates discoveries differs from one that continually explains away known failures.[ref] This improves on judging an isolated claim, but it does not provide a timetable stating exactly how long an initially unsuccessful programme deserves support. New research may need time, and a previously fruitful programme can stagnate.
A workable standard consequently asks whether investigators specify discriminating predictions or comparisons, expose their methods and data to appropriate scrutiny, respond to contrary findings, and seek independent checks. These demands should fit the field. An astronomical claim can be tested by predicted observations and independent instruments even when the investigator cannot manipulate a star. A laboratory science can often use controlled interventions. Requiring all inquiry to copy one laboratory format would exclude legitimate evidence.
An objection is that these standards describe good scientific conduct rather than draw an exact boundary. That is partly right. But a usable demarcation need not be a mechanical classifier for every new idea. Persistent evasion of the standards while claiming scientific authority supports a judgement of pseudoscience; mixed or immature cases can remain unresolved. A single statistical mistake need not condemn an entire field, while a consistent refusal to acknowledge tests can.
The resulting distinction is plausible because it explains what the boundary is for: identifying practices that can correct error through public evidence. It permits criticism of established institutions as well as marginal claimants. Its price is contextual judgement, which is preferable to pretending that one syntactic feature settles every case.
Scientific confirmation is evidential support rather than deductive proof. Two distinct problems concern, first, what counts as relevant positive evidence and, second, which part of a tested theoretical package that evidence supports. A defensible response makes background information and the production of evidence explicit. The following two problems are independent: resolving the logical puzzle about positive instances does not eliminate ambiguity about auxiliary hypotheses.
Problem one: the raven paradox. Write the hypothesis as
where means “is a raven” and “is black”. Its contrapositive is
The hypotheses are logically equivalent. A plausible equivalence principle says that identical information must support them equally. A plausible instance principle says that an observed that is confirms “every is ”. Combining the principles makes a nonblack nonraven, such as a white shoe, support the raven hypothesis. That conflicts with the intuition that inspecting shoes tells us nothing about ravens. Hempel develops the puzzle in his analysis of instance-based scientific confirmation.[ref]
My preferred response retains logical equivalence while rejecting an unconditional instance rule. By Bayes' theorem, for evidence , background and positive relevant probabilities,
An instance's bearing depends on how likely it was under the competing possibilities, including how the object was selected. No rule depending only on the grammatical form of an instance can settle that comparison. Branden Fitelson and James Hawthorne analyse the role of background assumptions and Bayesian confirmation in this puzzle.[ref]
Here is an explicit illustrative model. There are 100 labelled objects: ten known ravens and ninety known nonravens. Under all ten ravens are black; under the sole alternative , exactly one of the ten is nonblack, with its identity uniformly distributed. Nonraven colours are already known and identical under both possibilities, and the prior probabilities of are equal. Selecting a known white shoe according to a rule independent of has the same likelihood under each, so the posterior probability of stays . A uniformly selected raven, however, is black with probability under and under . After observing it to be black,
If sampling is instead from known nonblack objects whose membership is uncertain, discovering a nonraven can rule out a possible counterexample and provide support. There is no context-independent prohibition on support from a nonraven. The response explains both the familiar irrelevance intuition and why it is not universally correct. Its limit is that the prior probabilities and sampling assumptions need independent defence; the calculation is a transparent model, not a theorem that all shoes are irrelevant.
Problem two: the Duhem problem of testing a package. Suppose the target hypothesis and auxiliary hypotheses jointly imply an outcome :
A failure gives , equivalently , rather than alone. Success also does not establish either premise: that would affirm the consequent. Pierre Duhem's point is especially pressing for physical experiments whose predictions require theories of the apparatus as well as the target system.[ref]
My preferred response combines independent calibration, deliberately varied tests and explicit comparison of packages. For a simple model, suppose a detector has independently calibrated false-positive probability and detection efficiency . A target predicts a signal on each trial with probability . Then the positive-output probability is
Under a no-signal rival it is . If , , and , then . One positive reading supplies a Bayes factor of for the specified target package against the specified no-signal package. But an uncalibrated faulty detector with false-positive probability fits the same positive-reading rate. Target data alone do not distinguish those packages.
Signal-absent calibration trials test the false-positive assumption directly. If ten independent such trials are all negative, their likelihood ratio in favour of against is
This does not magically isolate : the calibration relies on its own assumptions, and correlated trials would invalidate the power calculation. It shows concretely how additional evidence can discriminate explanations that the initial data leave unresolved. Repeating the target measurement with apparatus based on different physical processes further reduces dependence on one shared failure mode.
Thus the Duhem problem defeats automatic attribution of support or failure, not rational experimental comparison. Where rivals remain empirically equivalent, suspension of judgement about their difference is appropriate. Together, the two responses defend scientific confirmation as a structured, fallible comparison using background information, rather than either pure instance counting or a mechanical verdict on an isolated hypothesis.