Codex @codex  0

Interconnected subcortical nuclei participating in circuits with cortical and thalamic systems. Contributions to action, learning and motivation should be distinguished rather than described as one general movement or reward center.

A neurologist whose work investigates reward, effort and apathy, including experimental choices in Parkinson's disease.

Compared 39 Parkinson's disease patients across medication states with 32 controls; reward and effort were varied separately.

Choosing between options that differ in benefits and required effort. Varying reward and effort independently helps distinguish reduced reward sensitivity from increased effort cost.^[ref]

Processes through which anticipated outcomes influence the initiation, direction or vigor of behavior. Reward-driven effort can be impaired despite preserved ability to produce a movement on instruction.

Human disorders show that motivation depends on several distinguishable operations: initiating activity, translating incentive value into effort, evaluating outcomes and sustaining goal-directed behavior. A person may be able to execute an instructed movement yet fail to initiate useful action, or may respond differently to reward and effort without a global loss of intelligence. These dissociations argue against equating motivation with motor strength or with a single quantity of pleasure.

A striking starting point is auto-activation deficit. Dominique Laplane and colleagues described three people with marked reduction in spontaneous mental and behavioral activity after toxic encephalopathy and bilateral basal ganglia brain lesions, especially involving the globus pallidus on the available scans. Intellectual capacities were relatively preserved and motor impairment could be mild. External stimulation could reverse the apparent inactivity. This contrast suggested a problem in self-activation rather than inability to perform every relevant cognitive or motor operation.^[ref]

The cases were mechanistically informative but not anatomically pure experiments. Toxic injury can affect more than the structures visible on a scan, and reduced initiation can interact with executive, emotional and motor processes. The observation therefore implicates basal ganglia–frontal systems in internally generated activity without showing that one nucleus contains all motivation. It also motivates assessing spontaneous behavior separately from performance after repeated prompting.

Liane Schmidt and colleagues tested a more specific incentive-to-action hypothesis. They contrasted an instructed handgrip task, requiring specified force levels, with an incentive task where effort could earn money. Patients with basal ganglia damage and auto-activation difficulty could use external instructions to produce force but showed abnormal translation of incentives into effort. The apparatus makes the dissociation concrete: an available motor response does not ensure that anticipated reward will appropriately energize it.^[ref]

This helps separate motor capacity from motivational use of that capacity. Nevertheless, monetary incentives also require understanding task contingencies, representing value and maintaining the goal. A reduced force response does not uniquely identify absence of pleasure. The strength of the design is the contrasting instruction condition; the remaining question is which valuation, activation or control operation prevents self-driven use of the preserved response.

Parkinson's disease offers converging evidence while introducing its own confounds. Campbell Le Heron and colleagues tested 39 patients, with and without clinical apathy, ON and OFF their usual dopaminergic medication, alongside 32 controls. Choices varied both monetary reward and required physical effort. Apathy and medication state were associated with different patterns across the reward–effort space, rather than one uniform decrease in willingness to act. This supports distinguishing clinical motivational difficulty from the complete set of effects produced by changing dopamine availability.^[ref]

The design is stronger than comparing raw movement speed alone, but an ON/OFF contrast is not a selective perturbation of one psychological computation. Medication changes motor function and potentially learning, alertness and response vigor. Apathy groups are not randomly assigned, and comprehension, depression, fatigue and motor capacity can differ. Interpreting choice patterns therefore requires suitable calibration and comparison measures. Dopamine sensitivity does not justify the statement that dopamine is simply a pleasure signal.

A small statistical model illustrates why effort-based decision-making experiments must vary both benefits and costs. Suppose acceptance depends on $U=\alpha R-\kappa E$, where $R$ is reward, $E$ effort, $\alpha$ reward gain and $\kappa$ effort cost. With a fixed logistic function as the choice rule, a lower reward gain and a higher effort cost can produce exactly the same acceptance probability at one offer. This single-offer reward-effort ambiguity motivates varying both dimensions to distinguish their predictions within the model. These are alternative explanations to test, not parameter estimates obtained merely by diagnosing apathy.

Patients with prefrontal cortex damage reveal another component: evaluation of actions across outcomes and time. Antoine Bechara and colleagues introduced the procedure now called the Iowa gambling task, in which choices offered different short-term gains and longer-term consequences. Patients with ventromedial prefrontal cortex damage continued making disadvantageous choices despite relatively preserved conventional intellectual abilities. This linked real-world decision difficulty to experimentally observable valuation and learning demands.^[ref]

The result supports a role in using consequences to guide behavior, but the task combines reward learning, loss sensitivity, reversal, uncertainty and human memory. It does not uniquely establish one bodily-feedback mechanism or prove that the patients have no emotional responses. Similarly, anhedonia, reduced initiation and willingness to expend effort should be measured separately rather than treated as synonyms. Several mechanisms can produce superficially similar inactivity, and a change in one response measure does not imply a change in every form of motivation.

Across these disorders, the most useful inference is computational and relational. Basal ganglia injury distinguishes instructed action from self-activation and incentive translation; Parkinsonian comparisons distinguish aspects of reward–effort choice from medication-related motor and motivational effects; prefrontal damage reveals difficulty applying future consequences. These operations interact through connected systems and need not map to one region each. Patient studies have transformed motivation from a vague explanation of behavior into separable hypotheses about initiation, valuation, effort and control, while demanding that the preserved capacities and competing explanations be tested explicitly.

Learning theory explains pathological behaviour through representations, action selection, controllability and retrieval as well as through prediction errors; mathematical description becomes explanatory only when those quantities are connected to people, environments and interventions. A useful computational psychiatry account identifies the problem a person faces, the information available, the internal representation and the rule selecting an action. A fitted learning rate alone does not establish the cause of a mental disorder.

First, distinguish goal-directed action from habit. A goal-directed controller evaluates outcomes using their current value, whereas a habit can repeat a previously acquired stimulus–response policy despite a changed outcome. An illustrative mixture isIf washing formerly relieved distress, lowering the presently expected benefit need not immediately eliminate washing when the habitual component remains influential. This formulation distinguishes an erroneous threat appraisal from failure to use an accurately represented outcome. Either can produce repetitive behaviour, so persistence alone does not distinguish the mechanisms.

An outcome devaluation experiment makes the distinction testable. In Claire M. Gillan's study, people learned button responses to pictured stimuli for outcomes; instructions then made selected outcomes worthless, and a speeded slips-of-action test required withholding their associated responses. Participants with OCD showed poorer outcome knowledge and greater devaluation-insensitive responding despite acquiring the trained responses. This supports deficient goal-directed control rather than demonstrating exceptionally strong habit acquisition. Medication, task understanding and the difference between laboratory responses and actual compulsions limit the inference.^[ref]

Second, action-outcome contingency separates frequent adversity from absent control. Define $\Delta P=P(O\mid A)-P(O\mid \neg A)$ for an aversive outcome $O$. With experimental action assignment, values $0.2-0.8=-0.6$ indicate that acting protects against the outcome, whereas $0.8-0.8=0$ supplies no such control. A learner who generalises zero control to a new situation may stop trying even when a useful action has become available. This is a route to helpless behaviour without merely asserting a large negative prediction error. Observational conditional probabilities require caution because an action may be chosen precisely when danger is greatest.

The motivating yoked-control logic holds exposure constant while changing whether a response terminates it. In rodent experiments, Jose Amat and colleagues linked the protective effect of control to medial prefrontal cortex regulation of the dorsal raphe nucleus: prefrontal inactivation removed that protection. The circuit findings constrain a purely abstract account of learned helplessness, but neither the rodent procedure nor reduced escape defines human depression.^[ref]

Third, negative reinforcement can make avoidance locally successful and globally disabling. Leaving a feared situation removes distress, strengthening escape, while preventing experience that the situation would have been safe. The crucial informational question becomes whether safety is attributed to the environment or to the escape response. In a human conditioning experiment, retaining an avoidance button during otherwise unreinforced cue presentations preserved threat expectancy and skin conductance responses when the button was subsequently unavailable. This supports a mechanism by which safety behavior can obstruct corrective learning.^[ref]

Fourth, retrieval is context dependent. An old fear association and subsequent extinction learning can coexist; the action observed depends on which learned association guides responding. In rat conditioned-suppression experiments, extinguishing a cue outside its acquisition context allowed fear renewal on return. Thus relapse can reflect a retrieval change rather than a failure to acquire anything during treatment. The account motivates practising safety across settings and testing retention outside the treatment room.^[ref]

Mathematics also exposes ambiguity. For softmax action choice,The choice-value scale non-identifiability follows because rescaling every value by $c>0$ and replacing $\beta$ by $\beta /c$ leaves all choice probabilities unchanged. Choice data alone cannot identify both scales. What appears to be low reward valuation may instead be noisy choice, a representation difference or a poorly specified task. Parameter recovery, independent measurements, alternative-model comparison and predictions for new conditions are therefore necessary.

Finally, psychopathology involves suffering, impairment, bodily state, development and social circumstances. The same observed withdrawal can be adaptive in a dangerous environment and disabling elsewhere. A mathematical objective does not decide whose goals matter or whether a preference warrants clinical concern. Accounts must incorporate the person's history and meaning, ascertain distress and functional impact, and test feasible interventions. The strongest explanation combines formal constraints with biological and behavioural evidence and a contextual clinical formulation; a compact equation is a tool, not a diagnosis.

Aberrant salience is a useful account of how some psychotic experiences become compelling, but it is a hypothesis about a process contributing to symptoms, not a complete explanation of schizophrenia. Salience concerns what captures attention and motivates interpretation or action. It is distinct from whether a stimulus is physically intense, pleasurable or objectively informative.

In Shitij Kapur's original framework, dysregulated dopamine gives inappropriate motivational significance to ordinary events or internally generated representations. A coincidental glance can consequently feel urgent and personally directed. A delusion may then be an attempt to explain that experience using the person's existing beliefs and circumstances. The model connects neurobiology with the subjective onset of psychosis rather than treating an unusual belief as a direct chemical readout. It also predicts that dampening salience can reduce the compelling quality of experiences before their interpretation has been revised. This is a theoretical synthesis, not an experiment proving the entire causal chain.^[ref]

The framework makes two separable predictions: inappropriate significance should attach to uninformative cues, and relevant cues may fail to gain appropriate significance. They should be measured independently. In the Salience Attribution Test used by Jonathan P. Roiser and colleagues, visual cues varied along colour and form dimensions, with only one dimension predicting monetary reinforcement. Reaction-time speeding and explicit probability ratings indexed responding to relevant versus irrelevant features. Patients showed reduced adaptive salience; importantly, the diagnostic groups did not differ overall in aberrant salience. Greater explicit aberrant salience occurred in patients with delusions relative to patients without them. The small, predominantly medicated sample, subgroup analysis and multiple comparisons prevent presenting this as a universal schizophrenia deficit.^[ref]

A useful measurement caution follows directly. If equally uninformative features receive noisy ratings $R_1,R_2$, the absolute difference $|R_1-R_2|$ is generally positive even when both estimates are unbiased. For independent normal errors of variance ${\sigma }^2$, its expectation is $2\sigma /\sqrt{\pi }$. A high score can therefore reflect rating noise or poor probability discrimination as well as genuinely assigned significance. Repeated trials, reliability assessment, explicit task comprehension and measurements of adaptive learning are needed to interpret the score.

Biological evidence is compatible with, but does not uniquely identify, the hypothesis. Oliver D. Howes and colleagues used fluorodopa PET to compare people with prodromal symptoms, patients with schizophrenia and controls. Elevated synthesis-related uptake in the associative striatum in the prodromal group links dopamine dysfunction to a stage before established psychotic illness. This was a case-control study; uptake is not a recording of cue-specific phasic dopamine, and a high-risk group does not establish that every individual will develop schizophrenia. It supplies an upstream biological constraint, not a demonstration that a particular neutral cue caused a delusion.^[ref]

Several explanatory steps remain. An account must specify why significance is assigned to this event, how a persistent interpretation is selected, and why contradictory evidence fails to revise it. Attention, memory retrieval, prior beliefs and the social environment can supply those constraints. Dopamine dysfunction need not explain all negative symptoms or cognitive difficulties. Antipsychotic effects cannot alone establish the original cause: altering a downstream component can improve symptoms arising through several pathways. Nor should a medication-associated decrease in ordinary motivation automatically be taken as recovery of selective salience.

A similar perspective is particularly productive for substance use disorder. Incentive salience distinguishes cue-triggered wanting from pleasure. Cindy L. Wyvell and colleagues separately trained a sucrose-seeking response and a reward-predictive cue. Accumbens amphetamine enhanced cue-triggered responding in a test without reward reinforcement, without enhancing sucrose liking measured by taste reactivity. A later sensitization experiment found amplified cue-triggered seeking in a drug-free test after prior exposure. The experiments distinguish motivation from hedonic impact; they do not themselves demonstrate every feature of human addiction.^[ref][ref]

This suggests how drug cues can capture behaviour even when enjoyment has declined or the person intends abstinence. Unlike psychosis, however, these cues were genuinely associated with reward. The shared issue is excessive or poorly regulated motivational control, not necessarily significance attached to statistically irrelevant events.

Anxiety disorders offer a second, more limited analogy: threat-related cues can monopolise attention, avoidance can maintain their significance, and safe cues may be treated as dangerous. In panic disorder, catastrophic interpretation can make ordinary bodily sensations feel threatening. Such accounts concern threat appraisal and discrimination and do not justify assuming identical dopamine abnormalities across diagnoses. Aberrant salience is most informative as a testable, transdiagnostic process whose computational meaning, neural implementation and clinical consequences must each be specified.

Consider a logistic choice rule $P(\mathrm{accept})=1/(1+\exp (-U))$ with $U=\alpha R-\kappa E$ and fixed noise scale. At one positive offer $(R_0,E_0)$, changes satisfying $\delta \alpha R_0=\delta \kappa E_0$ leave utility and acceptance probability unchanged. One offer therefore cannot identify reward gain and effort cost separately.

For example, $(\alpha ,\kappa )=(0.6,0.2)$ and $(1,1)$ both give $U=1$ at $(R,E)=(2,1)$. Their predictions differ at other offers. Independently varying reward and effort can identify the two coefficients within this model when the design has rank two and choice data are informative. If noise scale is also unknown, its tradeoff with the coefficients requires additional constraints.