Past exam of the learning theory: memory, cognition and psychopathology course of the University of Oxford / 2022 (A10979W1, Part II)

Solutions to all six options in the undergraduate Part II paper. The printed title and code identify the paper; the cover does not separately print the part designation.

Source: Released original paper, archive member a10979w1.pdf.

Learning theory explains pathological behaviour through representations, action selection, controllability and retrieval as well as through prediction errors; mathematical description becomes explanatory only when those quantities are connected to people, environments and interventions. A useful computational psychiatry account identifies the problem a person faces, the information available, the internal representation and the rule selecting an action. A fitted learning rate alone does not establish the cause of a mental disorder.

First, distinguish goal-directed action from habit. A goal-directed controller evaluates outcomes using their current value, whereas a habit can repeat a previously acquired stimulus–response policy despite a changed outcome. An illustrative mixture isIf washing formerly relieved distress, lowering the presently expected benefit need not immediately eliminate washing when the habitual component remains influential. This formulation distinguishes an erroneous threat appraisal from failure to use an accurately represented outcome. Either can produce repetitive behaviour, so persistence alone does not distinguish the mechanisms.

An outcome devaluation experiment makes the distinction testable. In Claire M. Gillan's study, people learned button responses to pictured stimuli for outcomes; instructions then made selected outcomes worthless, and a speeded slips-of-action test required withholding their associated responses. Participants with OCD showed poorer outcome knowledge and greater devaluation-insensitive responding despite acquiring the trained responses. This supports deficient goal-directed control rather than demonstrating exceptionally strong habit acquisition. Medication, task understanding and the difference between laboratory responses and actual compulsions limit the inference.^[ref]

Second, action-outcome contingency separates frequent adversity from absent control. Define $\Delta P=P(O\mid A)-P(O\mid \neg A)$ for an aversive outcome $O$. With experimental action assignment, values $0.2-0.8=-0.6$ indicate that acting protects against the outcome, whereas $0.8-0.8=0$ supplies no such control. A learner who generalises zero control to a new situation may stop trying even when a useful action has become available. This is a route to helpless behaviour without merely asserting a large negative prediction error. Observational conditional probabilities require caution because an action may be chosen precisely when danger is greatest.

The motivating yoked-control logic holds exposure constant while changing whether a response terminates it. In rodent experiments, Jose Amat and colleagues linked the protective effect of control to medial prefrontal cortex regulation of the dorsal raphe nucleus: prefrontal inactivation removed that protection. The circuit findings constrain a purely abstract account of learned helplessness, but neither the rodent procedure nor reduced escape defines human depression.^[ref]

Third, negative reinforcement can make avoidance locally successful and globally disabling. Leaving a feared situation removes distress, strengthening escape, while preventing experience that the situation would have been safe. The crucial informational question becomes whether safety is attributed to the environment or to the escape response. In a human conditioning experiment, retaining an avoidance button during otherwise unreinforced cue presentations preserved threat expectancy and skin conductance responses when the button was subsequently unavailable. This supports a mechanism by which safety behavior can obstruct corrective learning.^[ref]

Fourth, retrieval is context dependent. An old fear association and subsequent extinction learning can coexist; the action observed depends on which learned association guides responding. In rat conditioned-suppression experiments, extinguishing a cue outside its acquisition context allowed fear renewal on return. Thus relapse can reflect a retrieval change rather than a failure to acquire anything during treatment. The account motivates practising safety across settings and testing retention outside the treatment room.^[ref]

Mathematics also exposes ambiguity. For softmax action choice,The choice-value scale non-identifiability follows because rescaling every value by $c>0$ and replacing $\beta$ by $\beta /c$ leaves all choice probabilities unchanged. Choice data alone cannot identify both scales. What appears to be low reward valuation may instead be noisy choice, a representation difference or a poorly specified task. Parameter recovery, independent measurements, alternative-model comparison and predictions for new conditions are therefore necessary.

Finally, psychopathology involves suffering, impairment, bodily state, development and social circumstances. The same observed withdrawal can be adaptive in a dangerous environment and disabling elsewhere. A mathematical objective does not decide whose goals matter or whether a preference warrants clinical concern. Accounts must incorporate the person's history and meaning, ascertain distress and functional impact, and test feasible interventions. The strongest explanation combines formal constraints with biological and behavioural evidence and a contextual clinical formulation; a compact equation is a tool, not a diagnosis.

Aberrant salience is a useful account of how some psychotic experiences become compelling, but it is a hypothesis about a process contributing to symptoms, not a complete explanation of schizophrenia. Salience concerns what captures attention and motivates interpretation or action. It is distinct from whether a stimulus is physically intense, pleasurable or objectively informative.

In Shitij Kapur's original framework, dysregulated dopamine gives inappropriate motivational significance to ordinary events or internally generated representations. A coincidental glance can consequently feel urgent and personally directed. A delusion may then be an attempt to explain that experience using the person's existing beliefs and circumstances. The model connects neurobiology with the subjective onset of psychosis rather than treating an unusual belief as a direct chemical readout. It also predicts that dampening salience can reduce the compelling quality of experiences before their interpretation has been revised. This is a theoretical synthesis, not an experiment proving the entire causal chain.^[ref]

The framework makes two separable predictions: inappropriate significance should attach to uninformative cues, and relevant cues may fail to gain appropriate significance. They should be measured independently. In the Salience Attribution Test used by Jonathan P. Roiser and colleagues, visual cues varied along colour and form dimensions, with only one dimension predicting monetary reinforcement. Reaction-time speeding and explicit probability ratings indexed responding to relevant versus irrelevant features. Patients showed reduced adaptive salience; importantly, the diagnostic groups did not differ overall in aberrant salience. Greater explicit aberrant salience occurred in patients with delusions relative to patients without them. The small, predominantly medicated sample, subgroup analysis and multiple comparisons prevent presenting this as a universal schizophrenia deficit.^[ref]

A useful measurement caution follows directly. If equally uninformative features receive noisy ratings $R_1,R_2$, the absolute difference $|R_1-R_2|$ is generally positive even when both estimates are unbiased. For independent normal errors of variance ${\sigma }^2$, its expectation is $2\sigma /\sqrt{\pi }$. A high score can therefore reflect rating noise or poor probability discrimination as well as genuinely assigned significance. Repeated trials, reliability assessment, explicit task comprehension and measurements of adaptive learning are needed to interpret the score.

Biological evidence is compatible with, but does not uniquely identify, the hypothesis. Oliver D. Howes and colleagues used fluorodopa PET to compare people with prodromal symptoms, patients with schizophrenia and controls. Elevated synthesis-related uptake in the associative striatum in the prodromal group links dopamine dysfunction to a stage before established psychotic illness. This was a case-control study; uptake is not a recording of cue-specific phasic dopamine, and a high-risk group does not establish that every individual will develop schizophrenia. It supplies an upstream biological constraint, not a demonstration that a particular neutral cue caused a delusion.^[ref]

Several explanatory steps remain. An account must specify why significance is assigned to this event, how a persistent interpretation is selected, and why contradictory evidence fails to revise it. Attention, memory retrieval, prior beliefs and the social environment can supply those constraints. Dopamine dysfunction need not explain all negative symptoms or cognitive difficulties. Antipsychotic effects cannot alone establish the original cause: altering a downstream component can improve symptoms arising through several pathways. Nor should a medication-associated decrease in ordinary motivation automatically be taken as recovery of selective salience.

A similar perspective is particularly productive for substance use disorder. Incentive salience distinguishes cue-triggered wanting from pleasure. Cindy L. Wyvell and colleagues separately trained a sucrose-seeking response and a reward-predictive cue. Accumbens amphetamine enhanced cue-triggered responding in a test without reward reinforcement, without enhancing sucrose liking measured by taste reactivity. A later sensitization experiment found amplified cue-triggered seeking in a drug-free test after prior exposure. The experiments distinguish motivation from hedonic impact; they do not themselves demonstrate every feature of human addiction.^[ref][ref]

This suggests how drug cues can capture behaviour even when enjoyment has declined or the person intends abstinence. Unlike psychosis, however, these cues were genuinely associated with reward. The shared issue is excessive or poorly regulated motivational control, not necessarily significance attached to statistically irrelevant events.

Anxiety disorders offer a second, more limited analogy: threat-related cues can monopolise attention, avoidance can maintain their significance, and safe cues may be treated as dangerous. In panic disorder, catastrophic interpretation can make ordinary bodily sensations feel threatening. Such accounts concern threat appraisal and discrimination and do not justify assuming identical dopamine abnormalities across diagnoses. Aberrant salience is most informative as a testable, transdiagnostic process whose computational meaning, neural implementation and clinical consequences must each be specified.

Disrupted control of fear and biased perception of threat can both contribute to psychopathology, but feeling afraid, identifying another person's fear and judging whether an action provides safety are different processes. An experiment should separate them rather than use one response as a general fear measure.

Avoidance learning provides one control mechanism. An action that removes an aversive event is negatively reinforced; if escape is unavailable, distress can persist. Yet protective control and avoidance that maintains fear are not contradictory. An effective escape action during a genuinely dangerous event can be beneficial, while repeated safety behavior in a safe situation can prevent correction of a false threat belief. A clinical panic experiment manipulated whether safety-seeking behaviours were maintained or dropped during brief exposure, with improved subsequent outcomes when they were dropped. The account predicts that what a person attributes safety to matters, beyond simple within-session fear reduction.^[ref]

Circuit interventions offer a different level of evidence. In Jose Amat's yoked rat experiments, control over otherwise matched stress exposure recruited medial prefrontal regulation of dorsal raphe responses; inactivating that prefrontal contribution eliminated the protective effect. This gives causal evidence about a circuit contribution under that preparation. It does not establish that every clinical fear problem results from deficient prefrontal inhibition, or that apparent lack of effort means the individual has learned helplessness.^[ref]

Perception provides another route. In Ralph Adolphs's study, patient SM's impaired recognition of fearful faces followed unusually little spontaneous sampling of the eyes; explicit instructions to look at the eyes normalised recognition. The finding separates access to diagnostic information from an irreversible inability to represent fear. It is a lesion case, not evidence that psychiatric groups generally have the same deficit.^[ref]

Further, Justin S. Feinstein and colleagues observed panic after carbon-dioxide inhalation in three people with bilateral amygdala damage, despite impaired anticipatory responses. External threat processing and internally induced fear can therefore dissociate. The small rare-lesion sample and possible residual circuitry limit a general necessity claim. These results motivate separate measures of external threat identification, internal arousal and learned control.^[ref]

A proposed study would recruit adults with a diagnosed anxiety disorder and a matched comparison group, measuring medication, symptom severity and relevant comorbidity. Diagnosis is observed, not randomised. Independently randomise participants within each group to controllable or yoked uncontrollable exposure and to an attention-to-diagnostic-features intervention or a matched viewing task. This gives a two-by-two experimental design within each clinical group and tests whether the interventions affect separable processes. Sample size would follow simulation-based statistical power analysis for the prespecified group-by-intervention interactions; there is no empirical variance estimate in the paper from which to invent a defensible exact number.

For controllability, a button can terminate a mildly unpleasant, individually calibrated sound; a yoked participant receives the same sequence of sound onsets and terminations, but their own button has no effect. Match available motor responses and give both groups an unequivocal, independent stop option for withdrawal. Record action-outcome beliefs and timing as manipulation checks, since matching sound exposure does not automatically match predictability or experienced agency. Use a new transfer task to assess whether learned control changes willingness to act when action efficacy is now identical for everyone.

For perception, use graded fearful-versus-neutral facial displays, with the attention intervention directing viewing towards diagnostic information. Eye tracking tests whether sampling changed. Estimate perceptual sensitivity and decision criterion separately: more fear responses can reflect a lower reporting threshold without better discrimination. Include other emotions to test specificity and a delayed generalisation set to distinguish learning from memorising the training photographs.

Outcomes would include voluntary approach and avoidance, threat expectancy, subjective fear, skin conductance and heart rate. None alone measures the whole construct: autonomic arousal is not fear-specific, and self-report can change with demand. Assessors should be masked where possible; hypotheses, primary outcomes, exclusions and the repeated-measure mixed model should be preregistered. Account for dependence within yoked pairs and randomise pair membership. Retain allocated groups in an intention-to-treat analysis and report uncertainty and adverse experiences.

If controllability selectively improves transfer behaviour despite matched exposure and unchanged facial discrimination, that supports a control pathway. If altered visual sampling improves fear recognition and independently changes social-threat judgments, that supports a perceptual contribution. A clinical-group interaction would locate vulnerability, while a correlation between questionnaire scores and task behaviour alone would not prove causation. A combined effect could indicate interacting pathways. Improvement in a laboratory outcome would still require a later treatment trial with functioning and sustained symptoms as endpoints.

Consent must state the unpleasant stimulation and withdrawal right; any withholding of contingency details requires proportionate research-ethics approval and debriefing. The decisive test manipulates control and information sampling independently, checks that each manipulation worked, and measures functional behaviour alongside fear perception and physiology.

Psychology has developed interventions that reduce some criminal and violent behaviour in particular populations; the evidence supports conditional effectiveness rather than a single treatment for criminality. Criminal behaviour is a legal category covering different actions and contexts, not a diagnosis. An arrest, a conviction, an episode of aggression and removal from home are different outcomes. Their measurement and the comparison service matter to any effectiveness claim.

One approach is cognitive behavioral therapy directed at decisions in provocative situations. Its theoretical basis is that rapidly selected interpretations and practised responses can become inappropriate when circumstances change. Work on identifying automatic appraisals, considering alternatives, rehearsing a pause and practising nonviolent responses aims to improve action selection before escalation. Social learning supplies modelling and rehearsal; reinforcement helps establish an alternative response. The hypothesis concerns modifiable processes rather than an assumption that all offending reflects deficient intelligence or deliberate calculation.

The Becoming a Man programme evaluated by Sara B. Heller and colleagues provides unusually strong evidence because two school-based studies randomly allocated access. The authors reported programme-participation estimates of 28–35% fewer total arrests and 45–50% fewer violent-crime arrests during intervention periods, together with improved school engagement. Their mechanism evidence was suggestive of slowing down automatic interpretations, rather than establishing mediation by a measured trait. These participation estimates should not be confused with the raw effect of being offered a place. The randomised offer supplies the clean intention-to-treat contrast; estimating participation effects requires additional assumptions about uptake.^[ref]

Such results support a specific intervention in disadvantaged male youth in Chicago. They do not show that the same programme treats all adults with convictions, nor that the benefit must persist after sessions end. School membership, facilitator skill and local exposure to violence can alter effectiveness. Administrative arrest records avoid some self-report biases but also depend on policing; reduced arrests are not a perfect measure of the total number or severity of offences. Where feasible, independent victimisation or self-report measures and school outcomes should complement those records.

A second approach, multisystemic therapy, treats the adolescent's behaviour within interacting family, peer, school and community settings. A functional analysis asks what precedes and maintains a specific behaviour. Treatment may strengthen consistent parental monitoring, reinforce prosocial activity, reduce access to reinforcing antisocial peer interactions and help families solve practical barriers to attendance. Social learning and operant conditioning explain these components; the wider systems perspective explains why changing an isolated individual may fail if the surrounding contingencies remain unchanged. Delivery in the family's environment is part of the intervention, not merely a change of consultation venue.

In Charles M. Borduin's randomised study of 176 serious juvenile offenders, multisystemic therapy outperformed individual therapy on family-related measures and on rearrest outcomes over four years. This is evidence beyond improvement on a therapist's symptom scale. Nevertheless, a small developer-associated efficacy study against one comparator does not establish the size of benefit under routine services in another country.^[ref]

The larger English START trial led by Peter Fonagy makes this limitation concrete. It allocated 684 families to multisystemic therapy followed by management as usual or to management as usual alone. At 18 months, the primary outcome, out-of-home placement, occurred in 43/340 versus 36/335 participants with available outcome data: approximately 13% versus 11%, with a reported odds ratio of 1.25 and 95% confidence interval 0.77–2.05. This did not demonstrate superiority. Placement is not identical to reoffending, but this pragmatic result prevents presenting the programme as reliably better than established local provision.^[ref]

Both approaches illustrate why theoretical plausibility and outcome evidence have separate roles. Skills rehearsal can be the stated mechanism while the actual benefit arises through a supportive adult, structured activity or changes in peer exposure. Testing mechanism requires measurement before outcome change and, ideally, experimental variation of the proposed component. A favourable post-treatment association between parenting and offending is insufficient by itself.

A defensible assessment would prespecify serious harm and recidivism outcomes, use random allocation with an adequate active comparator, document treatment fidelity and uptake, and track participants after services stop. It would assess costs, school and family functioning, unintended exclusion and whether effects differ by need. Coercive participation also makes meaningful consent and independent outcome measurement particularly important. There is evidence that structured cognitive and family-based interventions can reduce offending, but treatment choice must follow population-specific comparative trials rather than the programme label or its theoretical appeal alone.

Behavioural outcome evidence can establish that a treatment helps without a complete account of its mechanism. It is sufficient for some practical decisions, but studying behaviour without asking how change occurs limits treatment development, transfer and relapse prevention. The distinction is between requiring exhaustive mechanistic knowledge before helping anyone and refusing to investigate mechanism at all.

Suppose a randomized controlled trial compares two clearly specified interventions and finds a sustained difference in symptoms and everyday functioning. With sound randomization, follow-up and assessment, this estimates a causal treatment contrast in that setting. It need not identify a neurotransmitter pathway or a unique learning algorithm. A clinician may therefore have good grounds to use the better-supported treatment while its explanation remains contested. Waiting for complete neural explanation would impose an unnecessary standard that many effective interventions could not satisfy.

Exposure and response prevention provides a concrete case. A person approaches an obsession-related situation while refraining from the ritual that would normally follow. In Helen Blair Simpson's trial, 100 adults with persisting OCD despite a stable serotonin reuptake inhibitor were randomised to eight weeks of exposure and response prevention, risperidone or pill placebo augmentation. Exposure produced greater improvement than either pill condition. The result supports an effective augmentation strategy in that population; it does not establish that a single learning mechanism explains every improvement, nor compare treatment in medication-naive patients.^[ref]

An earlier trial led by Edna B. Foa compared intensive exposure and ritual prevention, clomipramine, their combination and pill placebo. Its design separates clinically important treatment packages. It cannot completely equate therapist contact, participant masking and expectations across psychotherapy and pills. Randomised outcome evidence is still useful, but naming the package is not the same as identifying its active ingredient.^[ref]

Behavioural evidence becomes more informative when designed to discriminate mechanisms. Consider two patients who both show less avoidance after an exposure session. One may have learned that the feared outcome is unlikely without a ritual; the other may believe it was prevented by a covert safety behavior. The immediate behaviour can look identical while predictions after that aid is removed differ. Treating momentary compliance or reduced arousal as the sole success criterion would miss this difference.

The experiment by Peter F. Lovibond and collaborators illustrates the point: permitting an avoidance response during unreinforced cue presentations protected threat beliefs and conditioned autonomic responses from extinction when the response was later absent. It identifies a condition under which the same nominal exposure has a different result.^[ref] In a clinical panic experiment, Paul Salkovskis and collaborators manipulated whether safety-seeking behaviours were maintained or dropped during brief exposure. Dropping them improved the subsequent test outcomes, supporting the importance of how a patient interprets the exposure experience.^[ref]

These are mechanistic investigations even though their main measurements are behavioural. Mechanism need not mean a brain scan. Manipulating a contingency, testing outcome devaluation or checking whether a learned response transfers to a new context can distinguish information-processing accounts. Conversely, a neural correlate is not automatically a mechanism: a brain response can be an effect, a compensatory process or a correlate of an unmeasured cause.

Return of fear illustrates why a single endpoint is insufficient. In context-shift experiments, fear renewed outside the extinction context despite successful response reduction during extinction. Such results motivate testing a treatment across settings, delays and new cues. They constrain an erasure interpretation and explain why learning that is acquired in the clinic may not be retrieved at home.^[ref]

Mechanism claims nevertheless require stricter tests than observing that a proposed mediator and symptoms both improve. Therapist alliance, expectations and initial severity can influence both. Measuring the candidate mediator before symptom change, controlling baseline values and experimentally manipulating that component improves causal inference. Measurement error and unmeasured mediator–outcome confounding remain problems even in a trial where treatment itself was randomised.

The best programme alternates pragmatic comparisons with targeted experiments. First establish meaningful benefit and harms, then isolate components with dismantling or factorial designs, measure proposed processes and test predicted boundary conditions. Mechanistic insight should earn its place by improving prediction, personalisation or durable treatment effects, not by supplying attractive terminology. Outcomes justify the claim that an intervention works; experiments on mechanism explain when it works, what to preserve and what to change when it fails.

Descriptions of side effects can increase adverse experiences through a nocebo effect, but the appropriate response is accurate, supportive risk communication rather than withholding material information. Placebo mechanisms can complement effective treatment without deception or exaggerated promises. An expectation-dependent symptom is real; it need not be either fabricated or caused solely by the medicine's pharmacology.

A warning can focus attention on ordinary bodily sensations, raise anxiety and encourage attribution of those sensations to the drug. The resulting arousal may itself worsen discomfort, prompting further monitoring and avoidance. Previous adverse experiences can condition responses to the treatment setting, and observing others can transmit expectations. These routes predict effects on experience, reporting and adherence; they do not imply that every adverse drug reaction is psychological.

An illustrative study by Antonello Silvestri and colleagues gave the same beta-blocker to 96 men without pre-existing erectile dysfunction. Three groups of 32 differed in information: blinded to drug identity, informed of identity, or informed additionally of the sexual side effect. Reported dysfunction after three months was 3.1%, 15.6% and 31.2%, respectively. Because the pharmacological exposure was held constant, the contrast supports an information-dependent component. Small groups, self-report and the narrow population limit generalisation; it does not establish that the drug has no direct effect or that disclosure should be suppressed.^[ref]

Expectancy can also alter an active drug's experienced benefit. Ulrike Bingel and colleagues manipulated positive, neutral and negative expectations during a fixed-concentration remifentanil infusion and constant heat-pain stimulation. Positive expectation increased analgesia, whereas negative expectation counteracted the reported analgesic benefit; fMRI changes accompanied the subjective effects. Since drug concentration was held constant, a contextual influence cannot be explained simply by different administered amounts. Nevertheless, altered ratings and associated brain activity do not show that all pharmacological actions were reversed or that every illness responds similarly.^[ref]

Learning offers another route. In Luana Colloca's observational experiment, participants watched a demonstrator apparently benefit when a visual cue accompanied painful stimulation. Subsequent responses were compared with direct conditioning and verbal-suggestion conditions. The experiment shows that another person's apparent experience can establish an analgesic expectation without the observer first receiving effective treatment. It motivates attention to clinical demonstration and social information; it is not justification for staging deceptive testimonials in ordinary care.^[ref]

Practical communication should preserve informed consent while avoiding deterministic language. State absolute frequencies with a clear denominator and time interval, distinguish common transient symptoms from serious signs requiring action, and explain how symptoms will be assessed and managed. Giving both the event and non-event frequency can improve clarity: a hypothetical 10-in-100 risk also means 90-in-100 do not experience it. The two expressions describe the same probability, not a method for hiding risk. Ask about prior experiences, acknowledge uncertainty and agree on follow-up. Honest reassurance can reduce threat without suggesting that a patient's symptoms are imaginary.

The placebo effect must be separated from the placebo response. Improvement in a placebo group can include spontaneous change, regression to the mean, concurrent care and reporting effects. A credible estimate of the contextual intervention therefore needs a suitable comparison, often no treatment or matched usual care as well as an active-drug condition. Within-person experimental manipulations offer complementary evidence about expectancy. A symptomatic benefit does not by itself show alteration of the underlying disease process.

Open-label placebo tests whether concealment is necessary in at least some circumstances. Ted J. Kaptchuk's three-week randomized trial allocated 80 people with irritable bowel syndrome to openly described inert pills or no treatment with matched provider interaction. The open-label group reported greater improvement on the primary global scale, with endpoint means 5.0 versus 3.9. This is a proof of principle for a transparent contextual intervention, not evidence that placebo universally replaces effective medication. The trial was small, short, unblinded and reliant on subjective outcomes; reporting differences and the explanatory rationale remained possible contributors.^[ref]

Therapeutically, use a consistent supportive encounter, realistic positive expectations, a comprehensible rationale and effective care delivered with clear feedback. Learned treatment cues might eventually support carefully tested adjunctive regimens, but benefit cannot be assumed from conditioning theory alone. In routine communication, an adverse symptom should prompt assessment of drug effects, illness and contextual influences rather than automatic dismissal as nocebo. The goal is truthful disclosure with minimal avoidable expectation-induced harm, monitored benefits and harms, and evidence-based use of contextual effects as adjuncts.