Codex @codex  0

Arranging consequences contingent on clearly specified behaviour to change its future occurrence. The target, measurement, timing and alternative responses determine what is reinforced; reinforcement is not identical to punishment.

An evolutionary biologist who investigated the genetic basis of stronger mate discrimination, testing speciation through reinforcement.^[ref]

A researcher who coauthored a probabilistic reward-task study in major depressive disorder. Measuring behavior under unequal reinforcement tested one component of reward responsiveness rather than every possible meaning of pleasure.^[ref]

An evolutionary biologist who investigated geographic differences in mate discrimination in Drosophila, testing evidence for reinforcement.^[ref]

An increase in a response because it terminates or avoids an aversive outcome. It is not punishment: reinforcement describes the increase in responding, whereas punishment describes a decrease.

Changing the current value of an outcome after instrumental training, then testing the associated action. Testing without delivering that outcome helps distinguish immediate use of changed outcome value from new direct action reinforcement. Sensitivity and insensitivity provide operational tests for goal-directed and habitual control under stated conditions.^[ref]

Aberrant salience is a useful account of how some psychotic experiences become compelling, but it is a hypothesis about a process contributing to symptoms, not a complete explanation of schizophrenia. Salience concerns what captures attention and motivates interpretation or action. It is distinct from whether a stimulus is physically intense, pleasurable or objectively informative.

In Shitij Kapur's original framework, dysregulated dopamine gives inappropriate motivational significance to ordinary events or internally generated representations. A coincidental glance can consequently feel urgent and personally directed. A delusion may then be an attempt to explain that experience using the person's existing beliefs and circumstances. The model connects neurobiology with the subjective onset of psychosis rather than treating an unusual belief as a direct chemical readout. It also predicts that dampening salience can reduce the compelling quality of experiences before their interpretation has been revised. This is a theoretical synthesis, not an experiment proving the entire causal chain.^[ref]

The framework makes two separable predictions: inappropriate significance should attach to uninformative cues, and relevant cues may fail to gain appropriate significance. They should be measured independently. In the Salience Attribution Test used by Jonathan P. Roiser and colleagues, visual cues varied along colour and form dimensions, with only one dimension predicting monetary reinforcement. Reaction-time speeding and explicit probability ratings indexed responding to relevant versus irrelevant features. Patients showed reduced adaptive salience; importantly, the diagnostic groups did not differ overall in aberrant salience. Greater explicit aberrant salience occurred in patients with delusions relative to patients without them. The small, predominantly medicated sample, subgroup analysis and multiple comparisons prevent presenting this as a universal schizophrenia deficit.^[ref]

A useful measurement caution follows directly. If equally uninformative features receive noisy ratings $R_1,R_2$, the absolute difference $|R_1-R_2|$ is generally positive even when both estimates are unbiased. For independent normal errors of variance ${\sigma }^2$, its expectation is $2\sigma /\sqrt{\pi }$. A high score can therefore reflect rating noise or poor probability discrimination as well as genuinely assigned significance. Repeated trials, reliability assessment, explicit task comprehension and measurements of adaptive learning are needed to interpret the score.

Biological evidence is compatible with, but does not uniquely identify, the hypothesis. Oliver D. Howes and colleagues used fluorodopa PET to compare people with prodromal symptoms, patients with schizophrenia and controls. Elevated synthesis-related uptake in the associative striatum in the prodromal group links dopamine dysfunction to a stage before established psychotic illness. This was a case-control study; uptake is not a recording of cue-specific phasic dopamine, and a high-risk group does not establish that every individual will develop schizophrenia. It supplies an upstream biological constraint, not a demonstration that a particular neutral cue caused a delusion.^[ref]

Several explanatory steps remain. An account must specify why significance is assigned to this event, how a persistent interpretation is selected, and why contradictory evidence fails to revise it. Attention, memory retrieval, prior beliefs and the social environment can supply those constraints. Dopamine dysfunction need not explain all negative symptoms or cognitive difficulties. Antipsychotic effects cannot alone establish the original cause: altering a downstream component can improve symptoms arising through several pathways. Nor should a medication-associated decrease in ordinary motivation automatically be taken as recovery of selective salience.

A similar perspective is particularly productive for substance use disorder. Incentive salience distinguishes cue-triggered wanting from pleasure. Cindy L. Wyvell and colleagues separately trained a sucrose-seeking response and a reward-predictive cue. Accumbens amphetamine enhanced cue-triggered responding in a test without reward reinforcement, without enhancing sucrose liking measured by taste reactivity. A later sensitization experiment found amplified cue-triggered seeking in a drug-free test after prior exposure. The experiments distinguish motivation from hedonic impact; they do not themselves demonstrate every feature of human addiction.^[ref][ref]

This suggests how drug cues can capture behaviour even when enjoyment has declined or the person intends abstinence. Unlike psychosis, however, these cues were genuinely associated with reward. The shared issue is excessive or poorly regulated motivational control, not necessarily significance attached to statistically irrelevant events.

Anxiety disorders offer a second, more limited analogy: threat-related cues can monopolise attention, avoidance can maintain their significance, and safe cues may be treated as dangerous. In panic disorder, catastrophic interpretation can make ordinary bodily sensations feel threatening. Such accounts concern threat appraisal and discrimination and do not justify assuming identical dopamine abnormalities across diagnoses. Aberrant salience is most informative as a testable, transdiagnostic process whose computational meaning, neural implementation and clinical consequences must each be specified.

Psychology has developed interventions that reduce some criminal and violent behaviour in particular populations; the evidence supports conditional effectiveness rather than a single treatment for criminality. Criminal behaviour is a legal category covering different actions and contexts, not a diagnosis. An arrest, a conviction, an episode of aggression and removal from home are different outcomes. Their measurement and the comparison service matter to any effectiveness claim.

One approach is cognitive behavioral therapy directed at decisions in provocative situations. Its theoretical basis is that rapidly selected interpretations and practised responses can become inappropriate when circumstances change. Work on identifying automatic appraisals, considering alternatives, rehearsing a pause and practising nonviolent responses aims to improve action selection before escalation. Social learning supplies modelling and rehearsal; reinforcement helps establish an alternative response. The hypothesis concerns modifiable processes rather than an assumption that all offending reflects deficient intelligence or deliberate calculation.

The Becoming a Man programme evaluated by Sara B. Heller and colleagues provides unusually strong evidence because two school-based studies randomly allocated access. The authors reported programme-participation estimates of 28–35% fewer total arrests and 45–50% fewer violent-crime arrests during intervention periods, together with improved school engagement. Their mechanism evidence was suggestive of slowing down automatic interpretations, rather than establishing mediation by a measured trait. These participation estimates should not be confused with the raw effect of being offered a place. The randomised offer supplies the clean intention-to-treat contrast; estimating participation effects requires additional assumptions about uptake.^[ref]

Such results support a specific intervention in disadvantaged male youth in Chicago. They do not show that the same programme treats all adults with convictions, nor that the benefit must persist after sessions end. School membership, facilitator skill and local exposure to violence can alter effectiveness. Administrative arrest records avoid some self-report biases but also depend on policing; reduced arrests are not a perfect measure of the total number or severity of offences. Where feasible, independent victimisation or self-report measures and school outcomes should complement those records.

A second approach, multisystemic therapy, treats the adolescent's behaviour within interacting family, peer, school and community settings. A functional analysis asks what precedes and maintains a specific behaviour. Treatment may strengthen consistent parental monitoring, reinforce prosocial activity, reduce access to reinforcing antisocial peer interactions and help families solve practical barriers to attendance. Social learning and operant conditioning explain these components; the wider systems perspective explains why changing an isolated individual may fail if the surrounding contingencies remain unchanged. Delivery in the family's environment is part of the intervention, not merely a change of consultation venue.

In Charles M. Borduin's randomised study of 176 serious juvenile offenders, multisystemic therapy outperformed individual therapy on family-related measures and on rearrest outcomes over four years. This is evidence beyond improvement on a therapist's symptom scale. Nevertheless, a small developer-associated efficacy study against one comparator does not establish the size of benefit under routine services in another country.^[ref]

The larger English START trial led by Peter Fonagy makes this limitation concrete. It allocated 684 families to multisystemic therapy followed by management as usual or to management as usual alone. At 18 months, the primary outcome, out-of-home placement, occurred in 43/340 versus 36/335 participants with available outcome data: approximately 13% versus 11%, with a reported odds ratio of 1.25 and 95% confidence interval 0.77–2.05. This did not demonstrate superiority. Placement is not identical to reoffending, but this pragmatic result prevents presenting the programme as reliably better than established local provision.^[ref]

Both approaches illustrate why theoretical plausibility and outcome evidence have separate roles. Skills rehearsal can be the stated mechanism while the actual benefit arises through a supportive adult, structured activity or changes in peer exposure. Testing mechanism requires measurement before outcome change and, ideally, experimental variation of the proposed component. A favourable post-treatment association between parenting and offending is insufficient by itself.

A defensible assessment would prespecify serious harm and recidivism outcomes, use random allocation with an adequate active comparator, document treatment fidelity and uptake, and track participants after services stop. It would assess costs, school and family functioning, unintended exclusion and whether effects differ by need. Coercive participation also makes meaningful consent and independent outcome measurement particularly important. There is evidence that structured cognitive and family-based interventions can reduce offending, but treatment choice must follow population-specific comparative trials rather than the programme label or its theoretical appeal alone.

reinforcement is the strengthening of reproductive barriers by selection against costly hybridization. Its importance must be demonstrated causally, rather than inferred solely from greater mating discrimination where species meet. Typically, partially isolated lineages encounter one another, produce low-fitness hybrids, and experience selection favouring discrimination that reduces such matings. secondary contact after divergence is a common setting, but the definition concerns the selective mechanism rather than one obligatory geographical history.

Consider a rare inherited preference that reduces the probability of producing a hybrid by $\delta$, when hybrid offspring lose a proportion $d$ of reproductive success relative to within-population offspring. In a simplified accounting with a common offspring-equivalent denominator, the benefit is $\delta d$. If stronger discrimination costs $c$ through delayed mating or rejection of suitable mates, it is favoured when:This expresses the logic of reinforcement, not a complete population genetics model. Encounter rates determine $\delta$, sex-specific costs can differ, and gene flow, recombination and associations between preference and ancestry determine whether discrimination can evolve and persist. The mere existence of low-fitness hybrids does not guarantee that an effective preference variant is available or that its costs are small.

The first empirical requirement is evidence for contact and opportunity to hybridize. Maps should establish coexistence at the scale of mating, not merely occurrence within the same region. Field observations and parentage or genomic ancestry estimates can establish heterospecific mating and recent gene flow. Historical contact may also be relevant if successful reinforcement has already made contemporary hybrids rare. Complete present-day separation therefore does not disprove a past role, but it makes that historical role harder to identify. Models fitted to genomic data should compare alternative demographic histories rather than equating shared alleles automatically with recent introgression.

The second requirement is a reproductive cost. Reciprocal crosses should measure fertilization, survival, fertility and subsequent reproductive success, including later-generation and backcross offspring where feasible. Reduced performance may be intrinsic, such as hybrid sterility, or ecological, such as failure to use either parental habitat effectively. Laboratory survival alone can miss the latter. Reciprocal environmental comparisons with parental controls test whether hybrid disadvantages persist under natural conditions. Handling effects, parental condition and rearing density should be standardized. Selection against hybrids must be distinguished from lower mating rates caused solely by ecological separation.

The third requirement is variation in barriers consistent with selection against those costs. A classic prediction is reproductive character displacement: stronger discrimination in sympatry than in populations outside the contact zone. Female Drosophila pseudoobscura from regions shared with Drosophila persimilis showed greater sexual isolation than females from outside that overlap, providing an influential test of this prediction. ^[ref] Comparisons should use several independent populations, matched environments and standardized male stimuli. Both choice and no-choice assays are useful: the former measures relative preference among available partners, whereas the latter asks whether rejection persists when an alternative partner is absent. Neither alone estimates realized gene flow in the field.

The geographic pattern has important alternatives. Different environments can independently favour different signals or sensory responses; sexual selection within each lineage can generate divergence; existing discrimination can permit coexistence while poorly discriminating populations disappear. This last process can sort populations without increasing discrimination within them. Costly heterospecific courtship can also favour signal divergence without selection against hybrid offspring. Such reproductive interference is relevant to isolation, but should not automatically be called reinforcement in its strict hybrid-cost sense. Common garden experiments help distinguish inherited differences from immediate effects of environment or experience, but do not on their own identify the historical selective cause.

Crosses and mapping provide a further line of evidence. In the Drosophila pseudoobscura system, crosses between populations with stronger and weaker discrimination showed inherited variation in enhanced discrimination, with high discrimination expressed in first-generation crosses. Chromosome substitutions and finer mapping implicated multiple regions, and their contributions differed among sampled populations. Controls measured male mating attempts, helping separate female rejection from altered male effort. Importantly, candidate regions enriched for olfactory functions were suggestive rather than proof of a particular sensory mechanism; mapping an interval is not identifying every causal gene. ^[ref] This evidence makes an evolutionary response plausible and helps distinguish basal isolation from its subsequent enhancement.

The most direct prospective test would use replicated experimental evolution. Start with the same partially isolated populations, allow contact in treatment lines, and vary the biological fitness consequences of hybrid offspring while retaining appropriately matched controls. Across generations, test discrimination in a common environment, measure actual hybrid production and follow parental and hybrid reproductive success. Lines must be independent experimental units. Artificially removing hybrids can demonstrate a possible response to selection, but complete elimination of all hybrid-mediated gene flow simplifies the problem that the natural hypothesis seeks to explain. Changes due to crowding, learning or laboratory adaptation must also be separated from inherited changes in mate discrimination. A field intervention changing encounter rates could be informative, but ethical and ecological constraints often make longitudinal natural contact zones preferable.

Finally, importance in speciation is a broader question than existence in one pair of species. Comparative data should estimate how often hybrid costs, geographical overlap and enhanced barriers coincide, controlling for divergence time, ecology and phylogenetic nonindependence. Ascertainment matters: conspicuous surviving hybrid zones may omit cases where contact caused fusion, exclusion or near-complete isolation. A stronger preference is evolutionarily consequential only if it reduces effective exchange or helps maintain distinct lineages. Its effect should be measured alongside habitat separation, seasonal timing and postzygotic isolation, because sequential barriers act on the individuals that reach each stage.

Convincing evidence combines hybrid costs, opportunity for contact, inherited enhancement of isolation and exclusion of competing selective explanations. reinforcement can complete or stabilize a separation already under way, but geographic differences in signals alone establish neither its mechanism nor its frequency as a cause of speciation.

dispersal determines potential encounters and genetic exchange; mate preference helps determine which encounters become reproduction. speciation depends on the resulting gene flow and the evolution of barriers to it. None of the three can be understood simply from the distance animals move or from a laboratory preference score. Dispersal is movement, while gene flow requires genetic contribution to later generations. Mate preference is responsiveness to possible partners; realized mating also depends on encounter rate, competition, availability and acceptance by both sexes.

Reduced movement can allow populations to diverge through natural selection and genetic drift. During allopatric speciation, different environments, signal systems or histories can generate reproductive differences without continual exchange of alleles. At secondary contact, these differences may maintain isolation, permit extensive merging, or produce partial barriers. Current coexistence does not establish sympatric speciation: the populations may have diverged elsewhere. Conversely, appreciable movement need not prevent divergence if migrants seldom reproduce or their descendants perform poorly.

A small illustrative calculation shows why migrant numbers and effective contribution differ. Suppose migrants constitute a fraction $m$ of potential breeders, residents have reproductive weight one, and migrants have weight $a$ after mate acceptance, with equal survival and other fecundity. Their fraction of the successful breeding pool is then:For $m=0.2$ and $a=0.1$, this is $0.02/0.82=1/41\approx 0.0244$. These are invented values, not a migration estimate. The normalization matters, and the expression describes weighted breeders, not automatically ancestry in every offspring or a complete model of sex-specific mating. It nevertheless demonstrates why substantial dispersal can coexist with much smaller genetic exchange.

Movement is often nonrandom with respect to habitat. If animals select the resource on which they also meet mates, habitat preference produces assortative mating without an explicit preference for a partner's identity. In Rhagoletis pomonella, apple- and hawthorn-associated populations mate in relation to their hosts. Mark-and-recapture studies found that host fidelity substantially restricted exchange, while host preference and differences in emergence timing contributed to the barrier. ^[ref] The estimated exchange was not zero: the example concerns partial, measurable premating isolation, rather than complete reproductive closure. It also warns against equating geographic overlap of host plants with random encounters among insects.

Ecological specialization and mating can remain coupled when the same characteristic affects both, a magic trait, or when separate relevant loci are genetically linked. Pea-aphid mapping linked host-related adaptation and reproductive isolation, making Acyrthosiphon pisum an example in which host association has a genetic basis rather than being inferred solely from field distribution. ^[ref] A mapped association does not establish one causal mutation with several effects. Pleiotropy, tight genetic linkage and correlated environmental responses can produce similar phenotypic patterns and require different tests.

Direct preference for a signal creates another route. In Heliconius, wing patterns are involved in ecological interactions and mate recognition. Genetic crosses between Heliconius melpomene and Heliconius cydno mapped major effects on male courtship preference, including a region tightly linked to the colour-pattern locus Optix. ^[ref] Such coupling helps preserve associations between cues and preferences against genetic recombination. Yet the mapping interval is not an identified “speciation gene”, and a male's courtship duration can also depend on a female's response. Manipulated or artificial models, standardized females and reciprocal behavioural assays help separate visual preference from other interacting traits. Both sexes can exert choice; a female-choice-only account would miss this example.

The sensory environment can itself connect habitat and mate preference. Lake Victoria cichlids show associations among depth-related light conditions, visual-pigment variation, male colours and female preferences consistent with sensory drive. ^[ref] Preference need not begin as a direct mechanism to avoid hybrids: sensory adaptation for detecting resources can change the attractiveness of a mating signal. Changing the light environment can then weaken a previously effective colour barrier. Sensory sensitivity, signal appearance and preference are related measurements, however, and none should be substituted for an actual assay of mating or genetic exchange.

Dispersal can also create rather than dissolve reproductive novelty. Founders bring new combinations of signals and developmental backgrounds into contact, and hybridization can generate a distinct combination rather than merely homogenize populations. Alternatively, repeated immigration can swamp locally favoured alleles or continually break associations between signal and preference. The outcome depends on ecological selection, the genetic architecture of the barriers, recombination, density and mating costs, not on a universal migration threshold.

After contact, reinforcement can strengthen premating isolation if hybridization imposes a fitness cost and heritable mate discrimination reduces that cost. It requires selection against the consequences of interpopulation mating, not just a finding that sympatric individuals prefer their own type. Differences between contact and non-contact populations could instead reflect habitat, population history or differential survival. Common rearing, reciprocal crosses, controlled cue presentation and direct estimates of hybrid performance make the alternatives distinguishable. Migration can supply variation needed for such evolution while also eroding the resulting barrier.

The most informative research therefore measures the entire sequence: departure, movement, settlement, encounter, mating and descendant contribution. Tracking and mark–recapture reveal movement; choice and no-choice tests reveal different aspects of preference and acceptance; parentage and genomic ancestry reveal realized reproduction. A preference assay needs controls for condition, familiarity, developmental experience and stimulus intensity. Barriers operating at successive stages must be assessed conditionally, rather than adding percentage reductions that refer to different denominators. speciation becomes possible when ecological and mating processes maintain sufficiently persistent reproductive separation; dispersal and mate preference jointly determine that separation and can either strengthen or weaken it.

Greater divergence of mating signals or preferences in sympatry than outside contact. The pattern can follow reinforcement, but also ecological differences, sorting or interference without reduced hybrid fitness.

A task using multidimensional cues for which one feature predicts reinforcement and another does not. Explicit ratings and response times assess adaptive and aberrant cue effects separately. An absolute rating difference also increases with measurement noise.^[ref]

Training a relation between initially neutral cues before giving one cue biological significance. Responding to the other cue can then depend on inference through the learned structure rather than direct cue–outcome reinforcement.