Correlative and causal approaches answer different questions, and neither is dispensable for understanding neuromodulation. An intervention is generally stronger evidence about the consequence of changing a specified target, while observation is essential for discovering the naturally occurring signal, its heterogeneity and the contexts in which it appears. Usefulness depends on the claim, measurement and assumptions, not simply on whether an experiment uses an optogenetic actuator.
A correlation between a neuromodulatory signal and behaviour can arise because the signal influences the behaviour, behaviour changes the signal, or a third variable influences both. Reward expectation, movement and arousal often covary. Temporal precedence helps reject some accounts but does not eliminate an unmeasured common cause. Detailed task manipulations can nevertheless make correlative evidence much more discriminating: varying expectation while holding delivered outcome constant tests a different hypothesis from merely comparing rewarded and unrewarded trials.
The dopamine prediction-error account illustrates this value. Patterns across unexpected rewards, predictive cues and omitted expected rewards constrained an explicit computational hypothesis. A generic rise in activity at a reward would not distinguish reward receipt, expectation and error. Recording before intervening helped identify the timing and task conditions in which a putative teaching signal should be manipulated. Without that information, a stimulation experiment might show that a pathway can change behaviour while leaving the proposed natural computation largely unspecified.
Observations also reveal what population averages hide. Cell-resolved dopamine imaging showed structured sensory, motor and cognitive heterogeneity during a navigation task. Comparing identified dopamine spiking with accumbens release revealed that evolving release dynamics need not mirror recorded somatic activity. These findings constrain the target and measurement level of subsequent interventions. They are not failures of observation: a perturbation of an entire heterogeneous population could obscure precisely the functional distinctions that recording discovers.[ref][ref]
Interventions can then test a well-specified causal prediction. Reward-timed activation of dopamine neurons overcame associative blocking, changing subsequent cue learning; brief inhibition supported a negative-error-like learning effect. These manipulations are stronger evidence for a teaching contribution than a correlation alone. Yet the manipulated population and timing must match the proposed endogenous signal, and later unstimulated testing is needed to separate acquired learning from immediate performance effects. Sufficiency to impose an effect is not proof that the artificial activity pattern occurs naturally or is the only possible teaching route.[ref][ref]
Claims of functional necessity and sufficiency are conditional. Selective inhibition that impairs performance can support necessity under the tested conditions, but may act through sensation, movement or motivation rather than the hypothesized computation. A null effect can reflect redundant circuits, incomplete target engagement or compensation. Conversely, stimulation can recruit an unnatural synchrony, reverse-propagating activity or multiple collateral targets. Changing neurons identified by one transmitter can also change co-transmission, so the intervention is not automatically selective for that chemical signal at one synapse.
Pharmacological perturbations make similar assumptions visible. A systemic drug affects receptors according to exposure and selectivity, not according to the experimenter’s functional label. Time of testing, peripheral actions, active metabolites and off-target drug effects matter. The chemogenetic ligand clozapine-N-oxide provides a concrete example: receptor-binding and distribution work showed that conversion to clozapine can account for central DREADD activation. Thus an apparent designer-receptor intervention cannot be assumed to have the intended pharmacological isolation merely because the receptor was genetically targeted. Ligand-only controls and exposure measurements improve the causal interpretation.[ref]
Measurement is therefore required inside causal experiments as well as before them. Histology can confirm targeting but not the actual moment-to-moment physiological effect; electrophysiology or transmitter measurements can test target engagement. Calcium signals, fibre photometry, voltammetry and spikes have different spatial, temporal and chemical limitations. Converging methods are more persuasive when they agree at their common resolution, while disagreements can identify local regulation or a mistaken measurement model rather than simply experimental failure.
Causal mediation is a further step. Randomizing a drug can establish an effect of the assigned treatment, but correlating a post-treatment neural signal with symptom change does not prove that signal mediated the effect. Both may reflect another drug consequence. Likewise, statistically controlling for movement can remove a confound in one causal model but remove a genuine intermediate mechanism in another. A causal diagram and an explicit target estimand should guide adjustment rather than a rule to regress out every variable associated with behaviour.
Human and animal approaches have complementary scope. Fine cellular interventions can provide internal validity in a restricted animal task, while human longitudinal observations can test whether candidate abnormalities precede illness and whether the same behavioural dimensions matter clinically. Ethical and practical constraints preclude arbitrary human lesions or perfectly selective transmitter manipulation. It would be unhelpful to discard clinically relevant observation for failing to perform an impossible experiment; equally, a prospective association should not be relabelled as a proven biological cause.
The most productive programme iterates among formal models, naturalistic measurements and selective perturbations. Specify the computation, identify its predicted signal, vary task factors that distinguish alternatives, and intervene with appropriate timing, targeting and performance controls. Re-test the resulting behavioural and neural predictions across contexts. Causal experiments generally have an advantage for a precise intervention question, but correlative approaches remain essential for deciding what should be changed and what the causal result actually explains.
The SOP model family specifies testable principles of stimulus processing and association, but it does not yet have a uniquely established neural implementation. Its behavioural breadth should be distinguished from evidence identifying the biological counterparts of its states, transition rules and separate response systems. The strongest neurobiology concerns processes that the models require—priming, associative retrieval and differentiated response pathways—rather than a one-to-one mapping of every symbol onto a brain structure.
Ivan Pavlov’s classical conditioning tradition made stimulus history and the measured conditioned response objects of controlled experiment. The SOP model introduced by Allan R. Wagner represents stimuli as elements distributed among inactivity , primary activation and secondary activation . External presentation promotes inactive elements into ; activity then passes through before returning to inactivity. A learned associate can activate an expected event directly into . Recently or associatively activated elements are less available for renewed primary processing, distinguishing self-generated priming from retrieval-generated priming. A contemporary quantitative analysis shows how these dynamics can generate several habituation regularities; these are simulations, not measurements of neuronal states.[ref]
The association rules make the account more specific than a generic fading trace. In the original formulation, concurrent and activity promotes excitation, whereas with promotes inhibition. The Modified SOP model additionally permits learning involving a cue activated into : matched-state combinations can strengthen excitation and mismatched-state combinations inhibition. This allows an absent cue’s association to change through retrieval, addressing retrospective revaluation. The model is therefore not simply equivalent to a reward-error equation or to synaptic fatigue.
Human causal-judgment experiments motivated an important constraint. Participants learned relations among compound cues and an outcome, then received information about a companion cue without the target. Retrospective changes in judgments depended on the consistency of earlier within-compound pairings. This supports a role for learned cue–cue relations in revaluation, but the behavioural result does not identify synapses implementing the modified state-pair rules. Other retrieval or inference models can also use knowledge of those relations.[ref]
Figure 1.
Primary and secondary activation in an original illustrative SOP-style state model
. Calculated occupancy fractions with chosen parameters, not neuronal activity. A recent presentation or associative priming leaves fewer inactive elements available for a subsequent primary response. The figure illustrates the state logic and conservation of probability, not a full SOP, M-SOP or AESOP learning simulation. Details.
Neural adaptation alone is insufficient to explain retrieval-generated effects. A transient reduction in response to a repeated physical stimulus could result from receptor adaptation, local synaptic dynamics or wider circuit changes, whereas context-specific long-term priming requires an account of the context’s learned relation to the event. A biological test must distinguish an unfamiliar stimulus from an unexpected combination of familiar stimuli and control attention, orienting and stimulus exposure. Reduced firing cannot simply be labelled : the theory permits secondary activity to be behaviourally silent or have a response-system-dependent effect.
Hippocampal lesion experiments provide evidence at that process level. Rats learned audiovisual sequences in which particular sounds preceded particular lights. Switching the familiar sound–light combinations renewed visual orienting in controls but not in hippocampal-lesioned animals, despite relatively preserved habituation to visual stimuli and evidence of sequence associations. This implicates the hippocampus in associative mismatch rather than novelty alone. It is compatible with a contribution to expectation or retrieval, but does not uniquely show that the hippocampus is , nor that every SOP model process is hippocampal.[ref]
Receptor perturbation further separates short- and long-term components. Mice lacking the GluA1 AMPA-receptor subunit showed impaired short-term spatial novelty performance but enhanced long-term performance under the tested interval conditions. Manipulating exposure and test intervals helped distinguish rapid recency-dependent effects from longer-lasting learning. This is consistent with separable processes of the kind emphasized by the SOP model, rather than an undifferentiated stronger-versus-weaker memory. Nevertheless, a lifelong mutation can alter development and network function, and task dependence prevents identifying GluA1 with a single abstract transition parameter.[ref]
Associative access to an absent outcome has additional circuit support. In rat sensory preconditioning, orbitofrontal inactivation impaired behaviour guided by an indirectly inferred outcome while sparing behaviour supported by the directly reward-paired cue. The manipulation also altered learning when inferred value normally acted as a blocker. This shows that retrieved associative structure can influence both performance and new learning. It is relevant to the demands of Modified SOP model, but does not demonstrate that the neural representation is in exactly or that its plasticity has the model’s stipulated sign.[ref]
The Affective extension of SOP, developed by Allan R. Wagner and Susan E. Brandon, distinguishes sensory-specific and emotive components with different processing time courses and response consequences. Behavioural experiments in rabbits showed modulation of a discrete conditioned eyeblink by another putatively emotive conditioned stimulus. Such dissociations motivate separate response components. They do not locate a complete emotive representation in one nucleus. Basic conditioned-eyelid experiments independently implicated cerebellar nuclear circuitry through lesions, recordings and stimulation, illustrating why a motor conditioned response cannot simply be assigned to the same mechanism as every autonomic or emotional effect.[ref][ref]
The remaining challenge is discriminative implementation. A candidate neural model should specify what an element is, how direct and retrieved activity differ, how relevant overlap controls plasticity, and how sensory and affective components affect separate outputs. Manipulating receptor function or recording reactivation is not enough unless alternative mechanisms make different predictions. Neuromodulators could regulate transition rates, representation selection or plasticity, but there is no justified general identity such as “dopamine is ” or “serotonin is .” Multiple biological mechanisms could realize the same functional state description.
The SOP model family is therefore a valuable framework connecting stimulus history, expectation and response organization. Primary lesion, receptor and inactivation evidence supports several component processes. Its comprehensive behavioural ambitions exceed what is currently established about its precise neurobiology; the next useful experiments distinguish direct activation from retrieved activation and test the associated plasticity rules, rather than merely find a neural correlate of one familiar behavioural effect.
Reward prediction error remains a strong account of particular phasic dopamine signals and their contribution to learning; it is inadequate as a universal description of every dopamine neuron, projection and timescale. The question is best answered by separating the computational hypothesis, measurements of naturally occurring activity, and evidence that manipulating an error-like signal changes later learning.
In temporal-difference learning, a prediction is updated using
where is the value function for state , is the next reward, discounts later return, and is the update step size. The terminal value is zero. A reward prediction error is therefore not simply reward, pleasure or salience. Its sign depends on what was expected and when. An unexpected reward can generate a positive error; an accurately predicted reward can generate little error; omission of an expected reward can generate a negative error. A cue can produce an error when it changes the prediction of future return even though no immediate reward is delivered.
Primate recordings motivated this account because phasic responses changed with learning and reward expectation rather than responding identically to every reward. Linking these patterns to a quantitative learning rule provided predictions about cue responses and outcome omissions that a generic “reward neuron” label lacked. However, extracellular identification and population sampling matter, and the computational state representation is an assumption. A model fitted with a poor description of what the animal knows can misclassify a genuine expectation-related response as a theoretical failure.[ref]
Figure 1. . Calculated learning curves and value estimates for a deterministic state chain; these are not neuronal recordings. A reset trial state supplies the first informative cue. After learning, an unexpected reward omission produces a negative error at the expected reward transition. Details.
Association-learning experiments make the interpretation more than a curve-fitting exercise. In blocking, an established cue already predicts the reward, reducing learning about an added cue. Reward-timed optogenetic activation of dopamine neurons could overcome this blocking, supplying an error-like teaching event despite the normally expected reward. The relevant endpoint was subsequent learning about a cue, not just movement during stimulation. This supports a causal teaching contribution but does not establish that artificially synchronized activation reproduces every feature of an endogenous code.[ref]
The negative side of the error also has intervention evidence. Brief inhibition of targeted dopamine neurons around reward processing produced later learning changes resembling those expected from a negative error, with behavioural controls addressing distraction or immediate aversion. This strengthens a bidirectional teaching account beyond sufficiency of excitation alone. The imposed pause still tests a particular population and task, and inhibition can affect processes other than the proposed scalar signal. Appropriate timing controls and later unstimulated testing are essential to the interpretation.[ref]
Population heterogeneity can refine the hypothesis rather than simply refute it. Distributional reinforcement-learning work proposed multiple channels differing in optimism and in their relative sensitivity to positive and negative errors. Mouse single-unit data showed systematic variation in response reversal points consistent with this account. One reward can then be better than expected for one channel and worse for another. The finding challenges a single shared scalar prediction broadcast identically by all cells, while retaining prediction-error-like computations. It does not make heterogeneity alone proof of a particular distributional algorithm.[ref]
Other heterogeneity is not readily summarized as reward error. Cell-resolved imaging during a mouse virtual-navigation task found dopamine-neuron signals related to sensory, motor and cognitive variables, with structured differences across neurons. Regression and task design can separate some predictors, but correlated movements and expectations limit unique interpretation. Such findings make a universal scalar account implausible; they do not eliminate the well-controlled reward-error results in other populations. Nor should every movement-related signal be re-labelled as error without an independently specified model that predicts it.[ref]
The measurement compartment is another limitation. A comparison of identified VTA cell spiking with nucleus-accumbens dopamine release in a common decision task found release dynamics related to evolving reward expectations without corresponding changes in recorded cell-body spiking. Local release regulation therefore matters: a terminal sensor and a somatic spike train need not report the same quantity. This is especially important for interpreting slower ramps or motivational effects as direct readings of a broadcast phasic error.[ref]
Further qualifications concern learning itself. An error depends on subjective reward, inferred state, uncertainty and task structure; it is not calculated from the experimenter’s reward schedule alone. Values informed by a model of the environment can also contribute, so identifying an error-like signal does not automatically prove exclusively model-free learning. Conversely, a very flexible state model can accommodate almost any observation unless its representation and parameters are constrained independently. Good tests manipulate expectation while matching outcome and movement, and compare explicit alternatives on held-out behaviour and neural data.
The account is thus still appropriate when stated at the right resolution: some temporally precise dopamine activity supplies expectation-dependent teaching signals, supported by both recordings and causal learning manipulations. A complete account of the dopamine system must additionally explain projection-specific coding, local transmitter dynamics, motivation and movement. The productive revision is a family of constrained computational and circuit hypotheses, rather than either one molecule–one number or abandonment of prediction error altogether.

Pinned article: Introduction to the OurBigBook Project

Welcome to the OurBigBook Project! Our goal is to create the perfect publishing platform for STEM subjects, and get university-level students to write the best free STEM tutorials ever.
Everyone is welcome to create an account and play with the site: ourbigbook.com/go/register. We belive that students themselves can write amazing tutorials, but teachers are welcome too. You can write about anything you want, it doesn't have to be STEM or even educational. Silly test content is very welcome and you won't be penalized in any way. Just keep it legal!
We have two killer features:
  1. topics: topics group articles by different users with the same title, e.g. here is the topic for the "Fundamental Theorem of Calculus" ourbigbook.com/go/topic/fundamental-theorem-of-calculus
    Articles of different users are sorted by upvote within each article page. This feature is a bit like:
    • a Wikipedia where each user can have their own version of each article
    • a Q&A website like Stack Overflow, where multiple people can give their views on a given topic, and the best ones are sorted by upvote. Except you don't need to wait for someone to ask first, and any topic goes, no matter how narrow or broad
    This feature makes it possible for readers to find better explanations of any topic created by other writers. And it allows writers to create an explanation in a place that readers might actually find it.
    Figure 1.
    Screenshot of the "Derivative" topic page
    . View it live at: ourbigbook.com/go/topic/derivative
  2. local editing: you can store all your personal knowledge base content locally in a plaintext markup format that can be edited locally and published either:
    This way you can be sure that even if OurBigBook.com were to go down one day (which we have no plans to do as it is quite cheap to host!), your content will still be perfectly readable as a static site.
    Figure 5. . You can also edit articles on the Web editor without installing anything locally.
    Video 3.
    Edit locally and publish demo
    . Source. This shows editing OurBigBook Markup and publishing it using the Visual Studio Code extension.
  3. https://raw.githubusercontent.com/ourbigbook/ourbigbook-media/master/feature/x/hilbert-space-arrow.png
  4. Infinitely deep tables of contents:
    Figure 6.
    Dynamic article tree with infinitely deep table of contents
    .
    Descendant pages can also show up as toplevel e.g.: ourbigbook.com/cirosantilli/chordate-subclade
All our software is open source and hosted at: github.com/ourbigbook/ourbigbook
Further documentation can be found at: docs.ourbigbook.com
Feel free to reach our to us for any help or suggestions: docs.ourbigbook.com/#contact