Visible divergence and reproductive incompatibility measure different outcomes of evolution. A few changes in a gene regulatory network can transform a conspicuous phenotype, whereas differences in the machinery of meiosis or biological development can prevent reproduction without greatly changing adult appearance. Neither membership of the same genus nor morphological similarity specifies divergence time or the extent of reproductive isolation.
First separate barriers. premating isolation can arise through differences in courtship, habitat or breeding season even when a forced cross produces fertile offspring. postzygotic isolation concerns the survival or fertility of the offspring themselves. Thus fertile captive hybrids do not refute substantial reproductive isolation in nature: they may never encounter suitable mates, may have intermediate ecological requirements, or may be unattractive to both parental biological populations. Under the biological species concept, the relevant issue is effective gene flow among natural biological populations, not the success of one laboratory mating. Conversely, a laboratory failure can reflect husbandry rather than an intrinsic incompatibility.
Rapid visible divergence is especially plausible when sexual selection changes plumage or other signals, or natural selection changes a feeding structure. Such changes can involve a small part of the genome, leaving most interactions required for fertility compatible. In Darwin's finches, genome comparisons associated an ALX1 region with beak shape and also revealed interspecific gene flow. This is an example of conspicuous adaptive differentiation coexisting with exchange of alleles, rather than evidence that all avian hybrids are fertile.[ref]
Evolution of Darwin's finches and their beaks revealed by genome sequencing by Sangeet Lamichhaney and others. Results on interspecific gene flow and the ALX1 haplotype association with beak shape
Continued gene flow can itself help maintain compatibility through much of the genome while divergent natural selection preserves differences at selected genetic loci.For cryptic incompatibility, consider a Dobzhansky-Muller incompatibility. Two lineages start with compatible alleles . One evolves in the presence of , while the other evolves in the presence of . Each change is tolerable in its own genetic background, but the combination disrupts function in hybrids. This requires neither lineage to pass through a low-fertility intermediate. Such epistasis can affect spermatogenesis, chromosome pairing, or interactions between nuclear and mitochondrial genomes, while leaving the adult body plan nearly unchanged. The relevant changes can arise through natural selection, genetic drift, or conflict over inheritance; adaptive divergence in external form is not required.
A particularly informative mammalian experiment concerns PRDM9, which helps specify recombination hotspots. In a particular house-mouse cross, changing its DNA-binding region to the corresponding human sequence restored chromosome pairing and male fertility. The experiment implicates compatibility between a genetic recombination regulator and its binding sites, rather than visible morphological divergence. Crucially, this was a rescue in a specified cross and genetic background, not a demonstration that PRDM9 explains all mammalian speciation.[ref]
Re-engineering the zinc fingers of PRDM9 reverses hybrid sterility in mice by Benjamin Davies and others. Figure 1 and section “Humanizing Prdm9 restores hybrid fertility”; parental-background and engineered-allele comparisons
Comparative work on birds lacking PRDM9 found relatively stable recombination hotspots associated with functional genomic features.[ref]
Stable recombination hotspots in birds by Sonal Singhal and others. Science 350, pp. 928–932; maps inferred from two finch species and comparisons of hotspot conservation
This suggests a possible difference in the routes to incompatibility: turnover of PRDM9 and its targets is unavailable in those lineages. The inference is mechanistic, however; hotspot stability by itself does not demonstrate that avian hybrids will be fertile.Differences in karyotypes provide another mechanism. A balanced chromosomal rearrangement can have little visible effect in either parent yet cause faulty pairing or unbalanced gametes in a heterozygous hybrid. However, a different chromosome count alone does not prove sterility: the arrangement and segregation behavior matter. Differences in genomic imprinting may also disturb placental development or embryonic growth in mammalian crosses, sometimes producing direction-dependent outcomes. Parent-of-origin growth abnormalities and disrupted genomic imprinting in particular rodent hybrids provide evidence that this mechanism can matter.[ref]
Genomic imprinting is disrupted in interspecific Peromyscus hybrids by Paul B. Vrana and others. Nature Genetics 20, pp. 362–365; reciprocal-cross growth abnormalities and allelic expression
These are hypotheses to test in the relevant lineages, not a universal explanation for the bird–mammal comparison.The sex of the offspring matters. Haldane's rule predicts that, when one sex of first-generation hybrids is absent, rare or sterile, it tends to be the heterogametic sex: typically XY males in mammals and ZW females in birds.[ref]
Sex ratio and unisexual sterility in hybrid animals by J. B. S. Haldane. Journal of Genetics 12, pp. 101–109; formulation of the heterogametic-sex pattern
Recessive incompatibilities on a sex chromosome can be exposed when there is no corresponding second copy; rapid evolution of reproductive functions can contribute too. Therefore a report of fertile avian males is insufficient without testing females. The rule predicts a sex bias in a given cross, not that birds as a class have weaker reproductive isolation.To discriminate these mechanisms, compare multiple independently diverged pairs, match their estimated divergence times using phylogenetics, and avoid treating taxonomic rank as a clock. Perform reciprocal crosses with parental within-lineage controls; measure fertilization, embryonic survival, both sexes' fertility, and second-generation and backcross success. A fertile first generation can conceal hybrid breakdown after genetic recombination disrupts coadapted combinations. Pair karyotype analysis and observations of meiosis with genome mapping and carefully controlled rescue experiments. Field measurements of mating and ancestry then determine whether compatibility translates into gene flow. The contrast is explained by different rates and genetic targets of visible divergence and reproductive divergence, with sex, cross direction, ancestry and assay conditions determining the observed outcome.
reinforcement is the strengthening of reproductive barriers by selection against costly hybridization. Its importance must be demonstrated causally, rather than inferred solely from greater mating discrimination where species meet. Typically, partially isolated lineages encounter one another, produce low-fitness hybrids, and experience selection favouring discrimination that reduces such matings. secondary contact after divergence is a common setting, but the definition concerns the selective mechanism rather than one obligatory geographical history.
Consider a rare inherited preference that reduces the probability of producing a hybrid by , when hybrid offspring lose a proportion of reproductive success relative to within-population offspring. In a simplified accounting with a common offspring-equivalent denominator, the benefit is . If stronger discrimination costs through delayed mating or rejection of suitable mates, it is favoured when:This expresses the logic of reinforcement, not a complete population genetics model. Encounter rates determine , sex-specific costs can differ, and gene flow, recombination and associations between preference and ancestry determine whether discrimination can evolve and persist. The mere existence of low-fitness hybrids does not guarantee that an effective preference variant is available or that its costs are small.
The first empirical requirement is evidence for contact and opportunity to hybridize. Maps should establish coexistence at the scale of mating, not merely occurrence within the same region. Field observations and parentage or genomic ancestry estimates can establish heterospecific mating and recent gene flow. Historical contact may also be relevant if successful reinforcement has already made contemporary hybrids rare. Complete present-day separation therefore does not disprove a past role, but it makes that historical role harder to identify. Models fitted to genomic data should compare alternative demographic histories rather than equating shared alleles automatically with recent introgression.
The second requirement is a reproductive cost. Reciprocal crosses should measure fertilization, survival, fertility and subsequent reproductive success, including later-generation and backcross offspring where feasible. Reduced performance may be intrinsic, such as hybrid sterility, or ecological, such as failure to use either parental habitat effectively. Laboratory survival alone can miss the latter. Reciprocal environmental comparisons with parental controls test whether hybrid disadvantages persist under natural conditions. Handling effects, parental condition and rearing density should be standardized. Selection against hybrids must be distinguished from lower mating rates caused solely by ecological separation.
The third requirement is variation in barriers consistent with selection against those costs. A classic prediction is reproductive character displacement: stronger discrimination in sympatry than in populations outside the contact zone. Female Drosophila pseudoobscura from regions shared with Drosophila persimilis showed greater sexual isolation than females from outside that overlap, providing an influential test of this prediction. [ref]
Speciation driven by natural selection in Drosophila by Mohamed A. Noor. Nature 375, pp. 674–675; geographic variation in female discrimination against D. persimilis
Comparisons should use several independent populations, matched environments and standardized male stimuli. Both choice and no-choice assays are useful: the former measures relative preference among available partners, whereas the latter asks whether rejection persists when an alternative partner is absent. Neither alone estimates realized gene flow in the field.The geographic pattern has important alternatives. Different environments can independently favour different signals or sensory responses; sexual selection within each lineage can generate divergence; existing discrimination can permit coexistence while poorly discriminating populations disappear. This last process can sort populations without increasing discrimination within them. Costly heterospecific courtship can also favour signal divergence without selection against hybrid offspring. Such reproductive interference is relevant to isolation, but should not automatically be called reinforcement in its strict hybrid-cost sense. Common garden experiments help distinguish inherited differences from immediate effects of environment or experience, but do not on their own identify the historical selective cause.
Crosses and mapping provide a further line of evidence. In the Drosophila pseudoobscura system, crosses between populations with stronger and weaker discrimination showed inherited variation in enhanced discrimination, with high discrimination expressed in first-generation crosses. Chromosome substitutions and finer mapping implicated multiple regions, and their contributions differed among sampled populations. Controls measured male mating attempts, helping separate female rejection from altered male effort. Importantly, candidate regions enriched for olfactory functions were suggestive rather than proof of a particular sensory mechanism; mapping an interval is not identifying every causal gene. [ref]
The Genetics of Speciation by Reinforcement by Daniel Ortiz-Barrientos and others. PLoS Biology 2, e416; crosses, mate discrimination and the genetic basis of enhanced isolation
This evidence makes an evolutionary response plausible and helps distinguish basal isolation from its subsequent enhancement.The most direct prospective test would use replicated experimental evolution. Start with the same partially isolated populations, allow contact in treatment lines, and vary the biological fitness consequences of hybrid offspring while retaining appropriately matched controls. Across generations, test discrimination in a common environment, measure actual hybrid production and follow parental and hybrid reproductive success. Lines must be independent experimental units. Artificially removing hybrids can demonstrate a possible response to selection, but complete elimination of all hybrid-mediated gene flow simplifies the problem that the natural hypothesis seeks to explain. Changes due to crowding, learning or laboratory adaptation must also be separated from inherited changes in mate discrimination. A field intervention changing encounter rates could be informative, but ethical and ecological constraints often make longitudinal natural contact zones preferable.
Finally, importance in speciation is a broader question than existence in one pair of species. Comparative data should estimate how often hybrid costs, geographical overlap and enhanced barriers coincide, controlling for divergence time, ecology and phylogenetic nonindependence. Ascertainment matters: conspicuous surviving hybrid zones may omit cases where contact caused fusion, exclusion or near-complete isolation. A stronger preference is evolutionarily consequential only if it reduces effective exchange or helps maintain distinct lineages. Its effect should be measured alongside habitat separation, seasonal timing and postzygotic isolation, because sequential barriers act on the individuals that reach each stage.
Convincing evidence combines hybrid costs, opportunity for contact, inherited enhancement of isolation and exclusion of competing selective explanations. reinforcement can complete or stabilize a separation already under way, but geographic differences in signals alone establish neither its mechanism nor its frequency as a cause of speciation.