Noninferiority trial 2026-10-24
A trial testing whether an intervention is no worse than a comparator by more than a prespecified clinically justified margin. For a higher-is-better outcome and difference , a lower confidence bound above supports the stated margin. Failure of a superiority test is not sufficient; fidelity, attrition and intention-to-treat and sensitivity analyses affect interpretation.
Parents should have a negotiated, formulation-led role that helps an adolescent undertake effective treatment while supporting increasing autonomy. Three roles must be distinguished: facilitating access and practice, changing parental responses that maintain avoidance, and receiving treatment for the parent's own difficulties. A parent being present in more sessions is not a mechanism in itself. The relevant question is which parental action changes which maintaining process, for which adolescent, beyond the effects of adolescent treatment alone.
Initial assessment should obtain both the young person's and caregiver's perspectives on feared situations, avoidance, impairment and family responses. Separate discussion with the adolescent can reveal difficulties they would not disclose in a joint meeting. A shared formulation can then identify whether parents provide repeated reassurance, take over social interactions or organise routines around avoidance. Accommodation can bring immediate relief while reducing opportunities for the adolescent to learn that uncertainty and distress are manageable. Support can instead combine recognition of distress with confidence in the young person's capacity to approach an agreed activity. These descriptions concern potentially modifiable interactions, rather than assigning parental blame for the disorder's origin.
The role should fit developmental circumstances. A thirteen-year-old dependent on a caregiver for transport may need different practical support from a seventeen-year-old arranging appointments. Parents can help implement between-session practice, notice approach rather than merely the disappearance of distress, and support school coordination. The adolescent should help decide what information is shared and which sessions are joint, within clearly explained confidentiality and safeguarding arrangements. Parent involvement can undermine treatment if it becomes surveillance, coercion or another route for excessive reassurance. Fathers, other caregivers and relevant family relationships should be considered rather than assuming that the mother is always the appropriate participant.
Adolescent-specific evidence does not support mandatory additional parent sessions for everyone. Polly Waite and colleagues randomised sixty thirteen- to eighteen-year-olds in routine services to immediate or delayed Internet CBT, with an additional random allocation of parent sessions. The parent addition did not significantly improve remission, either immediately or at follow-up, and the online programme itself did not clearly outperform waiting list on the primary remission endpoint. Confidence intervals were wide. This is evidence against assuming a reliable benefit from that particular addition, rather than proof that parental involvement is useless or that a modest targeted effect is impossible.[ref]
A randomized controlled trial of internet-delivered cognitive behaviour therapy for adolescent anxiety disorders in a routine clinical care setting with and without parent sessions by Polly Waite and others. Child and Adolescent Mental Health 24, 242–250; randomised parent-session allocation, primary remission and follow-up
Evidence from younger samples suggests hypotheses about selection. Vanessa E. Cobham and colleagues stratified families by parental anxiety before randomising sixty-seven seven- to fourteen-year-olds to child CBT with or without parental anxiety management. Their findings suggested greater benefit of the addition when a parent was anxious, but results varied across measures. The study motivates a moderator hypothesis; its small subgroups and younger participants limit a general rule for adolescent treatment.[ref]
The role of parental anxiety in the treatment of childhood anxiety by Vanessa E. Cobham and others. Journal of Consulting and Clinical Psychology 66, 893–905; parental-anxiety strata and parent anxiety-management addition
A larger test cautions against treating a plausible family risk factor as an established augmentation target. Cathy Creswell and colleagues studied 211 children whose mothers also had anxiety disorders. All received child CBT; additions targeted either maternal anxiety or mother–child interaction, with nonspecific contact balanced. The additions changed some maternal outcomes but did not clearly improve the primary child diagnostic outcome. Treating a parent's anxiety may be worthwhile for that parent without necessarily producing an incremental child-treatment effect. Family-risk association, target engagement and improvement in the child's disorder are separate evidential steps.[ref]
Treatment of childhood anxiety disorder in the context of maternal anxiety disorder: a randomised controlled trial and economic analysis by Cathy Creswell and others. Health Technology Assessment 19(38); 211-family trial, maternal CBT and mother–child interaction arms
An alternative is parent-based treatment rather than parental augmentation of child therapy. Eli R. Lebowitz and colleagues randomised 124 seven- to fourteen-year-olds to child CBT or SPACE treatment, a parent intervention reducing accommodation without direct child–therapist sessions. SPACE treatment met prespecified noninferiority criteria for anxiety outcomes and reduced accommodation. This supports the possibility that changing caregiver responses can be an effective delivery route. It does not establish that replacing adolescent-focused therapy with parent work is appropriate across the older teenage years, or that the same approach is preferred by every young person.[ref]
Parent-Based Treatment as Efficacious as Cognitive-Behavioral Therapy for Childhood Anxiety: A Randomized Noninferiority Study of Supportive Parenting for Anxious Childhood Emotions by Eli R. Lebowitz and others. Journal of the American Academy of Child and Adolescent Psychiatry 59, 362–372; SPACE treatment noninferiority trial, ages 7–14 and accommodation outcomes
Together, these studies favour flexible involvement. A useful clinical formulation can identify practical support needs, accommodation that interferes with learning, and parental anxiety requiring its own assessment. However, personalised selection rules remain hypotheses unless prospectively tested. Neither a null augmentation trial nor a successful parent-only trial settles the optimal dose of parent contact alongside a given adolescent therapy. Treatment fidelity also matters: a nominally parent-inclusive programme may differ greatly in whether it rehearses supportive responses, changes accommodation or merely provides information.
A future study should therefore recruit adolescents with diagnosed anxiety across routine services and deliver the same adequate adolescent CBT in every arm. Randomise caregivers to a brief accommodation-focused module or a credible contact-matched education condition; an additional prespecified stratum could examine parents with their own anxiety disorder. Measure accommodation and parental anxiety before allocation, and power the study for the specific treatment-by-baseline-characteristic interactions rather than searching retrospectively for successful subgroups. Include age, caregiver availability and adolescent preference in recruitment and reporting without treating chronological age as a complete measure of autonomy.
Masked diagnostic interviews, young-person-rated impairment and school or social functioning should be assessed after treatment and at six and twelve months. Parent reports should be retained as a separate perspective, not substituted for adolescent outcomes. Record what parents actually do through agreed observations or structured practice tasks, alongside session attendance and treatment fidelity. Measure changes in accommodation repeatedly before the proposed downstream improvement. Temporal mediation would constrain a mechanism, although additional mediator–outcome assumptions would still be needed for a causal mediation claim.
The trial should also measure family burden, acceptability and any deterioration in relationships, and examine families unable to attend conventional sessions. An approach that improves completer outcomes while excluding caregivers with work or language barriers may reduce practical access. Qualitative interviews can explain why a module helps or fails, while the randomised contrast estimates its incremental effect. The 2022 evidence supports parents as potential partners, change agents and recipients of care, but supports a collaboratively chosen and testable role more strongly than indiscriminate intensification of parental attendance.
Exposure should optimise durable approach and new learning about feared outcomes, rather than merely maximise distress or make anxiety disappear within a session. A child who approaches a dog, attends class or speaks to an unfamiliar person has an opportunity to test a prediction. The relevant outcome is whether learning transfers to everyday situations and reduces impairment. What counts as an informative exposure therefore depends on the individual formulation, developmental understanding and actual safety of the situation.
There is direct evidence that exposure can help young people. Thomas H. Ollendick and colleagues randomised 196 seven- to sixteen-year-olds with specific phobias to a concentrated one-session exposure treatment, education-support or waiting list. Exposure produced better diagnostic and behavioural outcomes than the comparison conditions, with follow-up beyond the immediate treatment session. Its behavioural assessment brought the feared situation into the evaluation rather than relying exclusively on a questionnaire. This supports exposure for specific phobias, but neither the single-session format nor its optimal ingredients can automatically be generalised to every adolescent anxiety disorder.[ref]
One-session treatment of specific phobias in youth: a randomized clinical trial in the United States and Sweden by Thomas H. Ollendick and others. Journal of Consulting and Clinical Psychology 77, 504–516; 196 youths, exposure, education-support and waiting-list conditions
A useful theoretical distinction is between habituation and inhibitory learning. Habituation accounts emphasise reductions in fear with repeated contact. An inhibitory learning account instead proposes that exposure creates a competing association: the cue need not predict the feared consequence. The original association may remain available, helping explain why fear returns after time or a change of context. Michelle G. Craske and colleagues developed strategies intended to strengthen the alternative learning and its retrieval, including testing explicit threat expectancies and varying exposure contexts. Their 2014 account is a theoretical and translational framework, rather than a definitive randomised comparison of these strategies in anxious children.[ref]
Maximizing exposure therapy: An inhibitory learning approach by Michelle G. Craske and others. Behaviour Research and Therapy 58, 10–23; theoretical framework and illustrative implementation strategies
This distinction changes what a therapist measures. Suppose a young person predicts that briefly speaking in class will reliably cause visible ridicule. Completing the agreed contribution, observing the actual response and reviewing what was learned directly address that prediction. A reduction from high to low distress during rehearsal is less decisive if the young person attributes safety entirely to reading a perfectly memorised script. Conversely, meaningful expectancy change can occur while some distress remains. Necessary protections against genuine harm should be retained: a behavioral experiment is not a reason to expose a pupil to ongoing bullying or to remove a medically necessary precaution.
Clinical process data question a rigid requirement for within-session fear reduction. Jeremy S. Peterman and colleagues examined exposure-related distress ratings in 72 treated youths, with a mean age of about ten and a half. Most hypothesised habituation indices did not predict outcomes after treatment or at one year. These observational findings weaken the assumption that a particular distress-reduction trajectory is a necessary marker of success. They do not randomly compare learning strategies, prove that habituation never matters, or establish inhibitory learning as the only explanation.[ref]
Testing the habituation-based model of exposures for child and adolescent anxiety by Jeremy S. Peterman and others. Journal of Clinical Child and Adolescent Psychology 48, supplement 1, S34–S44; online 2016; exposure-process predictors in 72 treated youths
Development provides another reason to test rather than simply import adult optimisation rules. Siobhan S. Pattwell and colleagues studied conditioned fear learning and extinction across human age groups and conducted parallel mouse experiments. Human participants encountered conditioned cues and extinction trials, with physiological fear indexed by skin conductance; adolescents showed attenuated extinction relative to children and adults under the experimental conditions. The parallel animal work examined developmental differences in fear-related circuitry and plasticity. These are important motivating experiments, but an age-group difference in laboratory extinction is not a clinical trial of exposure, nor a reason to withhold effective treatment from teenagers.[ref]
Altered fear learning across development in both mouse and human by Siobhan S. Pattwell and others. PNAS 109, 16318–16323; human conditioned-fear/extinction experiment and parallel mouse work
Practical optimisation should therefore begin with an understandable, testable prediction. Use concrete language, pictures or behavioural examples when abstract probability questions exceed the child's understanding. Agree a feasible approach task and identify what evidence would count against the prediction. Record what happened, including ambiguous outcomes, without demanding a predetermined reassuring conclusion. Exposure can be graded to make participation possible, but progression should depend on meaningful learning and functioning rather than an inflexible rule that fear must halve before moving on.
safety behaviors require functional assessment. A caregiver repeatedly speaking for a child may prevent the child from discovering that they can manage an interaction. A gradual reduction in that accommodation may improve the experiment. However, a communication aid or accessibility adjustment may make participation possible rather than maintain an irrational threat belief. The same outward action can have different functions. Adolescents should help choose targets and evaluate outcomes; parents can support practice without becoming an additional source of checking or coercion.
Variation across people, settings and occasions is a plausible way to strengthen transfer. Practising a classroom contribution only in a quiet consulting room leaves context-specific learning untested. Follow-up tasks in ordinary settings can assess whether an alternative expectation is retrieved when anxiety returns. Spacing, varied contexts and retrieval prompts are reasonable candidates for investigation, but the 2022 youth evidence does not establish a universal optimum for their timing or combination. Treatment time is also finite: an elaborate preparation routine can displace opportunities for actual approach.
A future factorial trial could compare prediction-focused exposure with a credible standard exposure protocol, and separately compare practice across several contexts with practice concentrated in one setting. Both conditions should receive adequate treatment, comparable therapist time and the same planned number of approach opportunities. The comparison must specify actual therapist behaviour rather than merely relabel identical exercises. Stratify recruitment by developmental stage and presenting disorder, and power the prespecified interactions instead of interpreting an underpowered subgroup null as equivalence.
The primary outcomes should be masked diagnostic status and functional impairment after treatment and at six months. A novel-context behavioral approach task would test transfer; repeated expectancy and distress ratings would examine proposed processes. Record fidelity, completed practice, adverse experiences, acceptability and dropout. If prediction-focused treatment improves outcome without greater within-session distress reduction, this would challenge a strict habituation-success rule. If varying context improves transfer but not immediate fear, that pattern would support the proposed retrieval rationale. Repeated mediator measurements help establish temporal order, while causal mediation still requires assumptions beyond treatment randomisation.
Exposure optimisation in 2022 consequently had a strong clinical foundation and several promising mechanistic hypotheses, but fewer decisive youth component trials. The most defensible approach combines effective, collaborative approach practice with explicit learning goals and tests long-term functioning. Developmental neuroscience, distress trajectories and adult learning theory inform the research questions; they do not by themselves establish the best clinical protocol for every child.
Anxiety management techniques cover several different activities: recognising emotions and bodily sensations, providing psychoeducation, practising relaxation or controlled breathing, and teaching coping or problem solving routines. Their proposed functions also differ. A technique may make treatment understandable, help a young person engage with exposure, or be claimed to reduce anxiety as an active treatment ingredient. Evidence that a multicomponent CBT programme works does not establish that every included management technique is necessary or independently effective.
Historically, child CBT combined coping skills with practice approaching feared situations. Philip C. Kendall's 1994 trial randomised 47 nine- to thirteen-year-olds to a sixteen-session programme or waiting list and found clinical benefits, assessed across several informants and maintained at follow-up. This was important evidence that a structured psychological intervention could help childhood anxiety. Because skills and exposure were delivered together, and the comparator did not match active treatment, the trial did not isolate relaxation, coping statements or emotion identification as causal ingredients.[ref]
Treating anxiety disorders in children: results of a randomized clinical trial by Philip C. Kendall. Journal of Consulting and Clinical Psychology 62, 100–110; 47 children aged 9–13, sixteen-session CBT and waiting list
The larger Child/Adolescent Anxiety Multimodal Study provides stronger evidence for the broader treatment package. John T. Walkup and colleagues randomised 488 seven- to seventeen-year-olds with separation, generalised or social anxiety to CBT, sertraline, their combination or pill placebo. At twelve weeks, 59.7% receiving CBT were rated much or very much improved, compared with 23.7% on placebo; combination treatment had an 80.7% response rate. These are global improvement rates, not percentages free of an anxiety diagnosis. The CBT arm included more than anxiety management skills, and pill placebo did not match every aspect of psychotherapy contact.[ref]
Component research offers a more specific but less causally secure picture. Stephen P. H. Whiteside and colleagues analysed 75 studies containing 111 CBT conditions. Greater in-session exposure was associated with larger treatment effects, whereas relaxation was associated with smaller effects. The comparison was across differently constituted programmes rather than a random allocation of relaxation within the same exposure treatment. Differences in participants, treatment quality or the amount of exposure could therefore explain some of the association. It motivates dismantling trials; it does not establish that relaxation harms all anxious children.[ref]
A meta-analysis to guide the enhancement of CBT for childhood anxiety: exposure over anxiety management by Stephen P. H. Whiteside and others. Clinical Child and Family Psychology Review 23, 102–121; 75 studies, 111 CBT conditions and component meta-regressions
The conceptual issue is what learning the technique permits or prevents. Consider an adolescent who believes that an ordinary racing heart means an imminent catastrophe. Using a breathing exercise may reduce unpleasant arousal. If the adolescent concludes that catastrophe was avoided only because the exercise was performed perfectly, the original threat interpretation may remain intact. A different use of the same exercise, as an optional way to settle before continuing an agreed activity, need not imply that ordinary arousal is dangerous. Its function and the young person's explanation matter more than its label.
Similarly, identifying feelings can support communication and enable a child to describe what they predict. It is not evidence of improvement merely that they can correctly label a worksheet. Coping statements can function as predictions to test, or as reassurance repeated until the young person feels certain. Problem solving is appropriate when a realistic difficulty can be changed; repeatedly solving hypothetical worries can instead become another avoidance routine. These distinctions imply that engagement, immediate arousal and durable change in anxiety disorder should be measured separately.
Process evidence also cautions against using immediate calm as the sole success criterion. Peterman and colleagues found that most exposure-habituation indices did not predict subsequent outcome in their youth treatment sample. Although not a randomised component test, this challenges the assumption that a treatment exercise is ineffective whenever distress remains elevated. It supports assessing what a young person learns and subsequently does, alongside how they feel during the session.[ref]
Testing the habituation-based model of exposures for child and adolescent anxiety by Jeremy S. Peterman and others. Journal of Clinical Child and Adolescent Psychology 48, supplement 1, S34–S44; online 2016; exposure-process predictors in 72 treated youths
Developmental adaptation may still justify selected management elements. A younger child may need concrete examples of bodily sensations and a caregiver's help remembering a practice plan. An adolescent may prefer a collaborative explanation and private monitoring. Comprehension and participation should be checked directly rather than presumed from age. These potential benefits are reasons to study accessible delivery, not to infer that a long preparatory skills phase is essential for everyone. If preparation consumes most of the available sessions, it may reduce the opportunity to practise the behaviour that treatment is intended to change.
A decisive study would hold a competent exposure programme constant and randomise an additional clearly specified management module against contact-matched neutral material. Different modules should be distinguished, because a bundle of breathing, relaxation and cognitive work cannot identify the contribution of each. A factorial design could test an early psychoeducation or coping module separately from whether it is required during exposure. Fidelity assessment should record the actual use and meaning of skills, including whether they become perceived safety signals.
There are two relevant service questions. Adding a module while preserving exposure estimates its incremental benefit at an additional resource cost. Replacing exposure time with that module estimates its value under a fixed session budget. These comparisons should not be conflated. To justify removing a standard module as unnecessary, a sufficiently powered noninferiority design with a clinically justified margin would be more informative than a small superiority trial that simply fails to find a difference.
Outcomes should include masked diagnosis, everyday impairment, approach behaviour and longer-term return of fear, not only session distress. Early engagement, dropout, family burden and acceptability could reveal a helpful preparatory effect even without an independent symptom benefit. Repeated ratings of threat expectancy and arousal would test competing pathways, although mediator–outcome confounding remains possible. Prespecified developmental and diagnostic comparisons would indicate whether a module helps a particular subgroup without encouraging retrospective selection of favourable results.
By 2022, the strongest evidence supported CBT packages containing exposure, with substantially less certainty about the necessity or independent efficacy of generic anxiety management routines. Selected techniques can have a coherent role when they improve understanding or participation. Their use should be evaluated by whether they support effective learning and functioning, rather than by an assumption that successful treatment requires eliminating anxiety before a young person approaches a feared situation.
The case for disorder-specific adolescent CBT was promising by 2022, particularly for social anxiety, but a universal claim of established superiority would exceed the evidence. A disorder-specific approach identifies a maintaining mechanism and targets it with a tailored protocol. A generic or transdiagnostic programme can also be individually formulated and include effective exposure. The relevant comparison is therefore between well-delivered, credible alternatives, rather than specialised treatment and an inadequately implemented generic programme.
Social anxiety provides a strong theoretical example. The Clark–Wells account focuses on internally directed attention, negative self-imagery and safety behaviors that distort learning from social encounters. A protocol can directly test these processes through attention shifts, behavioral experiments and feedback. Leigh and colleagues' adolescent conversation experiment supports a role for combined self-focus and safety behaviors, but experimentally affecting a process is distinct from proving that a complete specialised therapy is superior to competent generic CBT.[ref]
Self-focused attention and safety behaviours maintain social anxiety in adolescents: An experimental study by Eleanor Leigh and others. PLOS ONE 16, e0247703; counterbalanced conversations, 57 participants, partner and independent ratings
Jo Magne Ingul and colleagues supplied relevant clinical evidence: 57 adolescents aged thirteen to sixteen were randomised to individual cognitive therapy, group CBT or an attentional placebo. The individual treatment had better outcomes, including at follow-up. However, individual versus group format, opportunities for personalised experiments and other delivery differences accompanied the contrast in therapeutic model. The study supports that particular intervention package, while leaving uncertainty about how much benefit specifically required a disorder-specific formulation.[ref]
A randomized controlled trial of individual cognitive therapy, group cognitive behaviour therapy and attentional placebo for adolescent social phobia by Jo Magne Ingul and others. Psychotherapy and Psychosomatics 83, 54–61; 57 adolescents aged 13–16, randomised treatments and twelve-month follow-up
Martina Nordh and colleagues subsequently randomised 103 ten- to seventeen-year-olds with social anxiety disorder to Internet-delivered CBT or internet supportive therapy. Both included ten youth modules, five parent modules and three video calls. Masked clinician-rated severity at three months favoured CBT, with a between-group effect size of 0.67. Matching the delivery mode and substantial contact makes this more informative than a waiting-list comparison. Yet the comparator was supportive therapy, not equally intensive generic anxiety CBT, and the sample included children as well as adolescents.[ref]
Therapist-Guided Internet-Delivered Cognitive Behavioral Therapy vs Internet-Delivered Supportive Therapy for Children and Adolescents With Social Anxiety Disorder: A Randomized Clinical Trial by Martina Nordh and others. JAMA Psychiatry 78, 705–713; 103 participants aged 10–17, active comparator and masked severity ratings
Other disorders offer a thinner adolescent-specific basis for a broad conclusion. Donna B. Pincus and colleagues' panic-treatment trial involved 26 fourteen- to seventeen-year-olds and compared a specialised CBT package with self-monitoring. It supported feasibility and benefit, with maintained gains, but was too small and used too limited a comparator to establish superiority over a competent generic programme. A plausible mechanism and a successful small trial justify further study rather than treating the comparative question as closed.[ref]
Cognitive-behavioral treatment of panic disorder in adolescence by Donna B. Pincus and others. Journal of Clinical Child and Adolescent Psychology 39, 638–649; PCT-A versus self-monitoring, 26 adolescents aged 14–17
Conversely, broad anxiety CBT has substantial evidence. The Child/Adolescent Anxiety Multimodal Study found benefit across a sample recruited for generalised, separation or social anxiety. Its predominantly younger sample limits adolescent-specific inference, and it was not a head-to-head test of disorder-specific versus generic CBT. Nonetheless, its results prevent assuming that a shared treatment approach is ineffective merely because diagnoses have distinguishable features.[ref]
Several mechanisms could explain an advantage from specialisation. A generic protocol might provide insufficient social exposure or fail to address the attribution that success depended on a safety behavior. Alternatively, the advantage might arise from more individual therapist time, higher treatment competence or better engagement. These explanations imply different improvements to routine care. If better exposure delivery explains the difference, a flexible generic programme might be improved without creating a wholly separate treatment pathway for every diagnosis.
Diagnostic boundaries also complicate the claim. Adolescents often have more than one anxiety problem, and avoidance, threat appraisal and family accommodation can operate across diagnoses. Selecting one principal diagnosis may underrepresent what matters most to the young person. A narrowly applied protocol could overlook depression, developmental needs or realistic peer adversity. However, a transdiagnostic label should not become a reason to ignore a clearly identified maintaining process. An integrated formulation can combine shared treatment principles with disorder-relevant experiments and monitor both primary and secondary difficulties.
Developmental specificity must be distinguished from diagnostic specificity. An adult social anxiety protocol with altered vocabulary is not necessarily adapted to school relationships, caregiver dependence, confidentiality and adolescents' developing self-representations. Likewise, evidence from a ten- to seventeen-year-old sample does not establish identical effects at ten and seventeen. Trials should report age distributions and recruitment contexts, and avoid treating a nonsignificant, underpowered age interaction as proof of equal applicability.
A strong future trial would compare a specialised protocol with a credible, individually formulated generic CBT protocol within the same delivery format. Match therapist time, supervision, opportunities for exposure, outcome-assessment schedules and treatment credibility. Ensure therapists are competent in both approaches, and assess allegiance and fidelity without making one comparator deliberately weak. Recruitment should include prespecified diagnostic strata, especially social anxiety and panic, with enough participants to estimate clinically meaningful differences rather than pool away the very specificity being tested.
Masked diagnostic assessment and functional impairment should be primary outcomes, with youth reports, school or social participation, adverse effects and family burden included. Follow-up should extend beyond immediate symptom change. Analyse participants according to randomised allocation, report attrition transparently and examine the consequences of missing data. Record resource use because a modest benefit may or may not justify a more complex training and referral system. If the policy aim is to justify a simpler generic pathway, a prespecified noninferiority margin is needed rather than interpreting a null superiority test as equivalence.
Mechanistic measures should be taken before the outcome they are proposed to explain. If the specialised protocol changes self-focused attention earlier and improves later functioning, that supports its rationale but does not remove all mediator–outcome confounding. A complementary component experiment could vary the specific technique while holding the surrounding treatment constant. Converging experimental and clinical evidence would strengthen the conclusion more than a therapy's success alone.
The defensible 2022 conclusion is therefore conditional: specialised adolescent social anxiety treatment had encouraging model-based, experimental and clinical support, while other diagnostic and developmental comparisons remained incomplete. Routine treatment should identify and address specific maintaining processes, but the evidence did not make a universal case that every adolescent anxiety disorder required a separate protocol superior to well-delivered, flexible CBT.
Routine outcome monitoring has made the results of IAPT services unusually visible and has created opportunities to improve care. Its benefits should be separated into three claims: measurement is more complete, the resulting information supports clinical and organisational decisions, and acting on that information improves patient outcomes. The first two do not automatically prove the third. A service can record a recovery accurately without the act of recording being its cause.
The historical IAPT programme expanded psychological treatment for depression and anxiety, using evidence-based interventions and stepped care where appropriate. Repeated measures allow a trajectory to be examined instead of relying on a clinician's general impression at discharge. Depression, general anxiety and disorder-relevant symptoms can be monitored alongside functioning and the person's own goals. A symptom questionnaire is a useful indicator, but a cutoff-based service definition of recovery is not identical to a blinded diagnostic interview or to complete restoration of everyday life.
David M. Clark and colleagues' evaluation of the Doncaster and Newham demonstration sites showed that session-by-session collection could achieve unusually complete before-and-after information in routine care. Reported recovery was about 55–56% among patients seen at least twice, and a follow-up examined maintenance beyond the last session. These prospective service cohorts demonstrated feasibility and informed implementation, but were not randomised tests of monitoring itself. Their denominator also excluded people who never progressed beyond an initial contact.[ref]
Improving access to psychological therapy: Initial evaluation of two UK demonstration sites by David M. Clark and others. Behaviour Research and Therapy 47, 910–920; Doncaster and Newham prospective service cohorts, sessional monitoring and ten-month follow-up
Completeness matters because selective follow-up can substantially distort apparent success. Consider a purely hypothetical cohort of one hundred baseline cases: fifty have an endpoint recorded and thirty of those meet the chosen recovery criterion. The observed-case recovery rate is 60%. If none of the fifty missing cases recovered, the whole-cohort rate is 30%; if all recovered, it is 80%. The missing-outcome bounds for a binary endpoint are sharp: both extremes fit exactly the observed data. Without assumptions or additional measurements, the observations alone cannot identify where within those bounds the cohort lies. This example is not an estimate of any IAPT service.
Sessional collection reduces dependence on a separate final questionnaire: a last available observation often exists even when a planned final appointment is missed. It does not make all missingness harmless. A last attended session can occur earlier for someone who disengages, and is not automatically equivalent to a common long-term endpoint. Outcomes should therefore be reported with clear eligibility, timing, completion and missing data definitions. Monitoring treated patients very thoroughly still does not describe those who were referred but never entered treatment.
David M. Clark and colleagues' 2018 analysis reported approximately 98% before-and-after symptom coverage among treated IAPT patients. It related public service outcomes to organisational characteristics and examined whether those characteristics also predicted changes between years. Waiting, missed appointments and the organisation of treatment were associated with outcomes; deprivation remained relevant. This made variation actionable and generated specific implementation hypotheses. Nevertheless, service-level associations and longitudinal prediction remain vulnerable to case mix, selection and unmeasured organisational differences.[ref]
Transparency about the outcomes of mental health services (IAPT approach): an analysis of public data by David M. Clark and others. Lancet 391, 679–686; 98% outcome coverage among treated patients, organisational predictors and between-year analyses
At the individual level, a visible trajectory can identify deterioration or lack of progress earlier than an end-of-treatment assessment. This provides a reason to review the formulation, barriers, intervention fidelity or level of care. It can make supervision concrete: a supervisor and therapist can examine which patients are not improving and whether the active treatment has actually been delivered. A score should initiate inquiry rather than automatically trigger a uniform decision, since transient distress, measurement error and contextual crises can change a session's result.
There is experimental evidence for an additional feedback system. Jaime Delgadillo and colleagues randomised therapists to automated outcome feedback or usual psychological treatment across eight NHS trusts. Seventy-seven therapists participated and 2233 patients were included. The system flagged people who were not on track and prompted supervisory review. Among those classified as not on track, feedback was associated with modestly better depression and anxiety outcomes, with effect sizes around 0.23 and 0.19 respectively. The trial tested feedback and its linked clinical response within services already collecting measures, not questionnaire collection versus no monitoring.[ref]
Feedback-informed treatment versus usual psychological treatment for depression and anxiety: a multisite, open-label, cluster randomised controlled trial by Jaime Delgadillo and others. Lancet Psychiatry 5, 564–572; 77 participating therapists, 2233 patients, cluster allocation and not-on-track outcomes
This distinction is central to interpreting the benefits. Data make a problem detectable; feedback makes it salient; a feasible clinical action must then address it. An alert that repeatedly identifies nonresponse without available treatment alternatives may add burden without improvement. Cluster allocation appropriately recognises that therapists change their practice across patients, while open-label delivery and quasi-random patient allocation to available therapists still qualify the causal interpretation. The modest subgroup effects should not be presented as proof that monitoring transforms every case.
At service level, routinely available outcomes support accountability, training evaluation and investigation of inequalities. Comparisons can identify where referral pathways, waiting times or treatment delivery need examination. However, unadjusted league tables can penalise services treating more complex or disadvantaged populations. Risk adjustment should be transparent and should not erase the very inequalities that require attention. Process measures, symptom outcomes, functioning and reach together give a fuller picture than one recovery percentage.
Targets can also create incentives to select easier cases, change denominators or emphasise crossing a threshold over a person's priorities. A reliable change index scales change by expected measurement error. Reliable improvement distinguishes such a change from a small numerical movement, while reliable recovery additionally considers caseness; neither removes the need to monitor deterioration and residual disability. Questionnaire accessibility, language and the validity of comparing groups require attention. Patients should understand why information is collected and how it contributes to care.
By May 2022, the clearest benefits were high outcome coverage, a transparent basis for improving implementation and a modest experimentally supported benefit from targeted feedback. Routine data had narrowed the gap between trial evidence and what services actually achieved. Further progress required responding intelligently to trajectories, preserving inclusive denominators and testing organisational changes, rather than treating measurement or a rising aggregate recovery figure as self-validating evidence of effectiveness.
A psychological treatment has a specific effect only relative to a clearly defined alternative explanation. Benefit beyond waiting is different from benefit beyond credible therapeutic contact, and both differ from evidence that a named technique works through its proposed mechanism. No single research design establishes all three. A persuasive programme combines controlled clinical comparisons with component and process experiments, while keeping patient-relevant outcomes central.
An uncontrolled before-and-after study cannot isolate a treatment effect. People may enter care when symptoms are unusually severe, creating regression toward their longer-term level; difficulties can improve naturally; expectations, concurrent care and repeated assessment can also change outcomes. A waiting-list randomised trial controls some time-related explanations but adds unequal expectations and contact. It can establish benefit from being offered the treatment package compared with waiting under those conditions, without identifying which ingredient produced the difference.
For specificity beyond nonspecific therapy effects, use a randomised comparison with a credible active intervention. Match time, attention, therapist competence and assessment opportunities as far as the question permits. Measure credibility and expected benefit rather than assuming equivalence from similar session counts. Keep relevant usual care available in both arms. Allocation concealment prevents recruitment decisions from anticipating the next assignment, while blinded independent outcome assessment reduces a different source of bias after allocation. Therapists and patients usually cannot be fully blinded to psychological procedures.
Daniel Freeman and colleagues' Feeling Safe trial illustrates this stronger package comparison. Patients with persistent persecutory delusions received the programme or befriending delivered by the same therapists, alongside usual care. At six months, the primary continuous conviction measure favoured Feeling Safe. This supports an effect beyond the particular befriending comparator, but does not establish that each module is necessary or that the whole benefit travelled through one nominated mediator.[ref]
Comparison of a theoretically driven cognitive therapy (the Feeling Safe Programme) with befriending for the treatment of persistent persecutory delusions: a parallel, single-blind, randomised controlled trial by Daniel Freeman and others. Lancet Psychiatry 8, 696–707; 130 patients, same-therapist befriending, six-month continuous conviction and categorical recovery distinction
The comparator should be interpreted fairly. A weak or implausible control can exaggerate apparent specificity, while an active comparator may itself change the proposed mechanism. If befriending improves social confidence, it is not a biologically inert placebo. A null result may mean two useful treatments have similar effects, both are ineffective, or the study is too imprecise. Failure of a superiority test does not demonstrate equivalence; an equivalence or noninferiority question requires prespecified clinically justified margins and appropriate precision.
A dismantling trial varies a specified component while keeping the surrounding treatment adequate and similar. For example, compare the same exposure programme with and without a safety behavior intervention. This estimates a conditional contribution: absence of an additional benefit does not imply that the component is useless in every context, because another part may produce similar learning. A factorial design can independently vary an action and its explanatory rationale, estimating their effects and interaction when the study has adequate power.
The early panic safety behavior experiment provides both an example and a caution. Greater change after brief exposure with precautions reduced supports the combined manipulation. Yet behavioral instructions and the explanation of the exercise were not fully separated. The appropriate next test would vary those elements independently and check actual behavior and expectancy change. Simply renaming the conditions 'cognitive' and 'behavioral' would not remove the confounding.[ref]
An experimental investigation of the role of safety-seeking behaviours in the maintenance of panic disorder with agoraphobia by Paul Salkovskis and others. Behaviour Research and Therapy 37, 559–574; brief exposure manipulation and repeated behavioural test
A mechanistic experiment can provide more direct leverage than a full treatment comparison. Colin MacLeod and colleagues trained attentional bias using a modified dot-probe task and tested later responses to stress. This asked whether experimentally changing information processing altered emotional vulnerability. It remains necessary to establish that the manipulation engaged the intended process rather than only a task-specific strategy, and that any effect transfers to the clinical phenomenon of interest. Laboratory emotional vulnerability is not itself diagnostic remission.[ref]
Selective attention and emotional vulnerability: assessing the causal basis of their association through the experimental manipulation of attentional bias by Colin MacLeod and others. Journal of Abnormal Psychology 111, 107–123; modified dot-probe training and responses to a standardised stress task
Likewise, Daniel Freeman and colleagues used virtual social environments to compare exposure against threat testing with safety behavior reduction. Both groups encountered graded situations, making the content of learning more directly investigable than in a therapy-versus-waiting comparison. The combined manipulation and brief follow-up constrain the mechanism claim. A useful manipulation check, an independent behavioral outcome and later transfer assessment strengthen the design more than a treatment label does.[ref]
Virtual reality in the treatment of persecutory delusions: randomised controlled experimental study testing how to reduce delusional conviction by Daniel Freeman and others. British Journal of Psychiatry 209, 62–67; 30 participants, graded social environments, safety reduction versus exposure and real-world assessment
Mediation analysis is informative but insufficient on its own. Randomising treatment identifies the total effect of assignment under the trial's assumptions; it does not automatically randomise the mediator. Symptom improvement could change reported beliefs, or an unmeasured process could influence both the belief score and the outcome. Measure the proposed mediator before the downstream outcome, assess competing pathways and perform sensitivity analyses. Replication using a different way to alter the same process can provide converging evidence; stronger identification may require experimental manipulation of that process itself.
Clinical trials also need suitable sampling, prespecified outcomes, adequate power, intention-to-treat analysis and transparent missing data handling. Outcomes should include functioning and possible deterioration, with follow-up long enough to distinguish transient reassurance from durable benefit. Treatment fidelity and competence must be assessed in both arms. Therapist allegiance, clustering of patients within therapists and differential dropout can affect interpretation. Statistical significance alone does not establish a meaningful improvement, especially when many outcomes or subgroup comparisons are explored.
Pragmatic implementation trials answer a complementary question: does the intervention add benefit in ordinary care, at acceptable cost and burden? Jaime Delgadillo and colleagues' therapist-cluster trial tested an automated feedback system linked to supervisory review within routine services. Its comparison isolates the added feedback arrangement more closely than an observational association between high-performing services and monitoring. It still tests a specified package of information and response, rather than an abstract effect of measurement divorced from clinical action.[ref]
Feedback-informed treatment versus usual psychological treatment for depression and anxiety: a multisite, open-label, cluster randomised controlled trial by Jaime Delgadillo and others. Lancet Psychiatry 5, 564–572; 77 participating therapists, 2233 patients, cluster allocation and not-on-track outcomes
The strongest conclusion consequently states its level of specificity. A well-conducted active control trial can establish an incremental treatment-package effect. A dismantling or factorial trial can identify a component's contribution within a defined context. An experimental process manipulation, supported by temporally ordered measurements and converging clinical evidence, can constrain the mechanism. Keeping these claims separate prevents a successful therapy from being treated as proof of its entire theory, while preserving the practical importance of improvements patients actually experience.
Recent innovations offered plausible routes to better outcomes for delusions by replacing a broad, undifferentiated treatment target with specific maintaining processes. Persistent persecutory beliefs may be supported by worry, poor sleep, felt vulnerability, low confidence, reasoning inflexibility and safety behaviors. Changing one of these may create opportunities for a person to reconsider threat without demanding immediate agreement that their belief is wrong. The promise is mechanistic and practical; it does not imply that all delusions share one cause or that every plausible target will improve clinical outcomes.
A contributory-causal approach begins by identifying a potentially modifiable process, experimentally changing it and examining consequences for the clinical problem. Worry is an example: repeated anticipation of danger can generate threatening explanations and keep them mentally available. In the Worry Intervention Trial, Daniel Freeman and colleagues randomised 150 patients with persistent persecutory delusions to six sessions targeting worry alongside standard care, or standard care alone. Worry and delusion outcomes improved, with gains followed to 24 weeks. Because therapist contact was not matched, the result supports the added intervention package more securely than an exclusively worry-mediated effect.[ref]
Effects of cognitive behaviour therapy for worry on persecutory delusions in patients with psychosis (WIT): a parallel, single-blind, randomised controlled trial with a mediation analysis by Daniel Freeman and others. Lancet Psychiatry 2, 305–313; 150 patients, six worry sessions plus usual care versus usual care, eight-/24-week outcomes
Sleep offers a different entry point that may be more acceptable than directly debating a threat belief. The OASIS trial randomised 3755 university students with insomnia to digital CBT for sleep or usual practice. It produced a large sleep benefit and smaller changes in paranoia and hallucinatory experiences. This supports testing sleep as a contributory process, while the nonclinical student sample and usual-practice comparator prevent direct inference that the same intervention treats persistent delusions in patients with psychosis.[ref]
The effects of improving sleep on mental health (OASIS): a randomised controlled trial with mediation analysis by Daniel Freeman and others. Lancet Psychiatry 4, 749–758; 3755 university students with insomnia, digital CBT versus usual practice and population limits
The Feeling Safe Programme combined individually selected modules addressing relevant maintaining factors. Its 2021 trial allocated 130 patients with persistent persecutory delusions to Feeling Safe or same-therapist befriending, with usual care continuing. The six-month adjusted difference in delusional conviction favoured Feeling Safe by about 10.7 points on a 0–100 scale. A categorical recovery comparison was less precise and did not reach conventional significance. The positive continuous primary outcome therefore should not be restated as a definitively superior recovery rate.[ref]
Comparison of a theoretically driven cognitive therapy (the Feeling Safe Programme) with befriending for the treatment of persistent persecutory delusions: a parallel, single-blind, randomised controlled trial by Daniel Freeman and others. Lancet Psychiatry 8, 696–707; 130 patients, same-therapist befriending, six-month continuous conviction and categorical recovery distinction
Reasoning interventions aim to increase flexibility and slow hasty acceptance of threatening explanations. Philippa Garety and colleagues' SlowMo combined eight face-to-face sessions, digital material and a mobile application. In the 361-person analysis, the primary total paranoia score at 24 weeks did not show a statistically significant advantage over usual care, although several secondary and earlier outcomes favoured the intervention. There was no significant effect on jumping to conclusions. This mixed pattern is particularly important: an engaging, mechanistically informed treatment can show promising signals without meeting its prespecified primary test.[ref]
Effects of SlowMo, a Blended Digital Therapy Targeting Reasoning, on Paranoia Among People With Psychosis: A Randomized Clinical Trial by Philippa Garety and others. JAMA Psychiatry 78, 714–725; 361 in analysis, prespecified 24-week GPTS total endpoint and secondary outcomes
These approaches could improve outcomes for several reasons. Targeting common difficulties such as insomnia or worry can give treatment an understandable starting point. Personalised modules can concentrate time on processes actually present instead of requiring every patient to complete the same sequence. Concrete experiments may provide more persuasive evidence than verbal reassurance. Digital support can make an exercise accessible between appointments, while carefully designed measures can show whether the nominated process changed before the belief or distress changed.
However, a target can be associated with delusions without causing them. Poor sleep and worry may partly reflect a common adversity, or lessen when general distress improves. An intervention intended for one process can alter several others, making a statistical mediator an uncertain guide to the active ingredient. Even when a factor contributes causally, changing it may produce only modest benefit because other maintaining processes remain. Necessary theoretical precision includes specifying who has the target, how much it must change and which outcome should follow.
Outcome choice can make an innovation appear more or less successful. Conviction, preoccupation, distress, activity, quality of life and diagnostic status are related but distinct. Greater doubt about a threatening explanation may be valuable without elimination of the belief; conversely, a questionnaire change need not restore work or social participation. The difference between SlowMo's primary and secondary findings illustrates why the endpoint and assessment time should be specified in advance. Multiple favourable secondary results cannot simply replace an unsuccessful primary test.
Clinical heterogeneity also matters. A treatment developed for persistent persecutory delusions is not automatically established for every delusional theme, acute state or diagnostic group. Language requirements, willingness to attend research therapy and referral patterns select who enters a trial. Comorbid depression, cognitive difficulties, substance use or continuing victimisation may alter the usefulness of a module. An unusual belief should be assessed in its cultural and social context; a psychological account must not assume that all reported threats are unreal.
Innovations can fail at implementation even when the trial mechanism is sound. Skilled research therapists, close supervision and protected time may be unavailable in routine services. A mobile application can increase opportunity for practice but also introduce access, privacy or comprehension barriers. Adding modules can increase burden, dilute effective content or delay the experiment that matters most. Patients may prefer a different target from the one selected by a questionnaire. Acceptability, fidelity, reach and cost therefore need direct measurement alongside symptom outcomes.
A strong next study would compare an adapted innovation with a credible active treatment in several services, with adequate power and blinded assessment. Prespecify primary conviction or distress outcomes, patient-prioritised functioning and longer-term maintenance. Measure candidate mechanisms repeatedly, recording which modules are actually received; module choice in a tailored treatment is not random and cannot itself identify the best component. A complementary factorial or sequentially randomised experiment could test specific additions while preserving adequate care for all participants.
By May 2022, the most convincing advance was the shift toward testable mechanisms and more rigorous, symptom-focused clinical comparisons. Worry, sleep, flexible reasoning and personalised threat-learning approaches offered reasons for optimism, with some positive clinical results and important null findings. Better outcomes would depend on genuine target engagement, adequate comparisons, generalisation and feasible delivery, rather than novelty, a digital format or a plausible causal diagram alone.
Psychology has developed interventions that reduce some criminal and violent behaviour in particular populations; the evidence supports conditional effectiveness rather than a single treatment for criminality. Criminal behaviour is a legal category covering different actions and contexts, not a diagnosis. An arrest, a conviction, an episode of aggression and removal from home are different outcomes. Their measurement and the comparison service matter to any effectiveness claim.
One approach is cognitive behavioral therapy directed at decisions in provocative situations. Its theoretical basis is that rapidly selected interpretations and practised responses can become inappropriate when circumstances change. Work on identifying automatic appraisals, considering alternatives, rehearsing a pause and practising nonviolent responses aims to improve action selection before escalation. Social learning supplies modelling and rehearsal; reinforcement helps establish an alternative response. The hypothesis concerns modifiable processes rather than an assumption that all offending reflects deficient intelligence or deliberate calculation.
The Becoming a Man programme evaluated by Sara B. Heller and colleagues provides unusually strong evidence because two school-based studies randomly allocated access. The authors reported programme-participation estimates of 28–35% fewer total arrests and 45–50% fewer violent-crime arrests during intervention periods, together with improved school engagement. Their mechanism evidence was suggestive of slowing down automatic interpretations, rather than establishing mediation by a measured trait. These participation estimates should not be confused with the raw effect of being offered a place. The randomised offer supplies the clean intention-to-treat contrast; estimating participation effects requires additional assumptions about uptake.[ref]
Thinking, Fast and Slow? Some Field Experiments to Reduce Crime and Dropout in Chicago by Sara B. Heller and others. Quarterly Journal of Economics 132, 1–54; two Becoming a Man randomized trials and mechanism analyses
Such results support a specific intervention in disadvantaged male youth in Chicago. They do not show that the same programme treats all adults with convictions, nor that the benefit must persist after sessions end. School membership, facilitator skill and local exposure to violence can alter effectiveness. Administrative arrest records avoid some self-report biases but also depend on policing; reduced arrests are not a perfect measure of the total number or severity of offences. Where feasible, independent victimisation or self-report measures and school outcomes should complement those records.
A second approach, multisystemic therapy, treats the adolescent's behaviour within interacting family, peer, school and community settings. A functional analysis asks what precedes and maintains a specific behaviour. Treatment may strengthen consistent parental monitoring, reinforce prosocial activity, reduce access to reinforcing antisocial peer interactions and help families solve practical barriers to attendance. Social learning and operant conditioning explain these components; the wider systems perspective explains why changing an isolated individual may fail if the surrounding contingencies remain unchanged. Delivery in the family's environment is part of the intervention, not merely a change of consultation venue.
In Charles M. Borduin's randomised study of 176 serious juvenile offenders, multisystemic therapy outperformed individual therapy on family-related measures and on rearrest outcomes over four years. This is evidence beyond improvement on a therapist's symptom scale. Nevertheless, a small developer-associated efficacy study against one comparator does not establish the size of benefit under routine services in another country.[ref]
Multisystemic treatment of serious juvenile offenders: long-term prevention of criminality and violence by Charles M. Borduin and others. Journal of Consulting and Clinical Psychology 63, 569–578; randomized 176-youth comparison and four-year rearrest follow-up
The larger English START trial led by Peter Fonagy makes this limitation concrete. It allocated 684 families to multisystemic therapy followed by management as usual or to management as usual alone. At 18 months, the primary outcome, out-of-home placement, occurred in 43/340 versus 36/335 participants with available outcome data: approximately 13% versus 11%, with a reported odds ratio of 1.25 and 95% confidence interval 0.77–2.05. This did not demonstrate superiority. Placement is not identical to reoffending, but this pragmatic result prevents presenting the programme as reliably better than established local provision.[ref]
Multisystemic therapy versus management as usual in the treatment of adolescent antisocial behaviour (START) by Peter Fonagy and others. Lancet Psychiatry 5, 119–133; Methods, primary outcome and Findings at 18 months
Both approaches illustrate why theoretical plausibility and outcome evidence have separate roles. Skills rehearsal can be the stated mechanism while the actual benefit arises through a supportive adult, structured activity or changes in peer exposure. Testing mechanism requires measurement before outcome change and, ideally, experimental variation of the proposed component. A favourable post-treatment association between parenting and offending is insufficient by itself.
A defensible assessment would prespecify serious harm and recidivism outcomes, use random allocation with an adequate active comparator, document treatment fidelity and uptake, and track participants after services stop. It would assess costs, school and family functioning, unintended exclusion and whether effects differ by need. Coercive participation also makes meaningful consent and independent outcome measurement particularly important. There is evidence that structured cognitive and family-based interventions can reduce offending, but treatment choice must follow population-specific comparative trials rather than the programme label or its theoretical appeal alone.
By June 2022, important principles of reading acquisition were established, including the need to learn written word forms and to understand the language they express. The major unanswered questions concerned how these skills become efficient and integrated, why children respond differently to experience and instruction, and how experimental gains become sustained comprehension and participation. Useful future research should target those uncertainties with explicit competing predictions rather than reopen every instructional question as if no evidence existed.
One question concerns what is learned from a successful encounter with a new written word. Does the child acquire an item-specific spelling, a reusable mapping, a contextual guess, or some combination? David L. Share's delayed learning experiments motivate the distinction, while artificial orthography work shows that strong item learning and generalisation need not move together. Future studies should therefore distinguish recognition of practised items from transfer to novel combinations and later retention, rather than use one immediate naming test as a complete index of learning.[ref]
Phonological recoding and orthographic learning: A direct test of the self-teaching hypothesis by David L. Share. Journal of Experimental Child Psychology 72, 95–129; second-grade pseudoword reading, delayed spelling-choice/naming/spelling and recoding controls
[ref]The influence of consistency, frequency, and semantics on learning to read: an artificial orthography paradigm by Joanne S. H. Taylor and others. Journal of Experimental Psychology: Learning, Memory, and Cognition 37, 60–76; sixteen/32 adults, novel script, frequency/consistency and pretraining
A specific experiment could randomise unfamiliar but pronounceable items to matched exposure schedules varying the consistency of a spelling–sound relation. Hold the number of encounters, visual complexity and oral vocabulary knowledge constant. Assess trained spellings against homophonic alternatives after a delay, and test untrained recombinations that require the relevant mapping. Eye tracking during text reading could establish where the new form attracts attention, while comprehension questions verify meaningful engagement. The experiment should specify whether its prediction concerns initial learning, retention or generalisation.
A second question is how the distribution of teaching examples interacts with the learner's existing knowledge. Keith S. Apfelbaum and colleagues found that varied irrelevant consonants helped first graders learn vowel mappings. It remains necessary to identify when variation helps, whether its effects depend on prior decoding and how long the advantage lasts. A multisite classroom experiment could independently vary relevant consistency and irrelevant variation while matching total teaching time and opportunities to respond.[ref]
Statistical learning in reading: variability in irrelevant letters helps children learn phonics skills by Keith S. Apfelbaum and others. Developmental Psychology 49, 1348–1365; 224 first graders, vowel mappings with varied/similar consonants and transfer tasks
Pretraining measures should be collected before randomisation, and interaction tests powered prospectively. A significant benefit in one subgroup and a nonsignificant effect in another does not demonstrate different treatment effects. Instructional fidelity and actual exposure need observation because a teacher may adapt a nominally identical activity in different ways. Broader spelling, unfamiliar-word reading and later passage comprehension would distinguish a useful instructional principle from a narrow training-task effect.
A third question is how best to coordinate word-level and language-level support. Margaret J. Snowling and colleagues' longitudinal profiles show that dyslexia, DLD and their co-occurrence can lead to comprehension difficulty through different constraints. The unresolved question is not whether either dimension matters, but which combination, timing and intensity of support helps a specified child. Diagnostic categories are too coarse to substitute for a measured profile.[ref]
Dyslexia and Developmental Language Disorder: comorbid disorders with distinct effects on reading comprehension by Margaret J. Snowling and others. Journal of Child Psychology and Psychiatry 61, 672–680; dyslexia-only, DLD-only and comorbid groups at eight, comprehension at eight/nine
A factorial teaching trial could retain adequate core reading instruction for everyone and independently randomise additional decoding and oral language components, with contact and resource use measured. Include children across the skill distribution rather than only extreme, mutually exclusive categories. Prespecify primary outcomes for word reading, language and comprehension, with delayed follow-up. A subsequent adaptive stage could randomise a well-defined change for children not responding, instead of attributing improvement after an uncontrolled adjustment to personalisation itself.
The trial would also address a fourth question: what constitutes meaningful transfer? Janice M. Keenan and colleagues showed that comprehension assessments differ in their reliance on component skills. An intervention can look more successful simply because its outcome task resembles training. Future evaluations need independent passages, several assessment formats and checks that the construct retains a comparable meaning across time and groups. Function in the classroom and the child's experience should accompany test scores, without treating either as a substitute for accurate measurement.[ref]
Reading Comprehension Tests Vary in the Skills They Assess: Differential Dependence on Decoding and Oral Comprehension by Janice M. Keenan and others. Scientific Studies of Reading 12, 281–300; five measures, differential decoding/listening dependence and developmental changes
A fifth uncertainty concerns how findings generalise across writing systems, language backgrounds and educational environments. Artificial-script work offers experimental control, but Joanne S. H. Taylor and colleagues' instruction study used adults learning small novel vocabularies. It cannot establish the full trajectory of a multilingual child encountering an unfamiliar language of instruction. Coordinated cross-language studies should define the mappings and language experiences that differ, rather than merely compare national averages.[ref]
Comparing and validating methods of reading instruction using behavioural and neural findings in an artificial orthography by Joanne S. H. Taylor and others. Journal of Experimental Psychology: General 146, 826–858; 24 adults, two novel scripts, eight-day training, generalisation and fMRI
Recruitment should include varied socioeconomic circumstances and children whose language development differs from the majority sample. Assessment needs to separate opportunity to learn from persistent difficulty and to examine the validity of the measures in each context. Shared protocols and culturally appropriate materials can coexist. The aim is to test which mechanisms generalise and which depend on script, vocabulary or teaching, not presume that every observed group difference reveals an intrinsic deficit.
Computational models can sharpen all these questions. A model should learn from a specified developmental input, make predictions for held-out items and trajectories, and face comparison with alternatives that use different representations or learning rules. Matching average skilled-reader accuracy is weaker than predicting the effect of an experimental change in input. Parameters should not be allowed to absorb every individual difference without independent constraints; failure should inform revision rather than invite unrestricted refitting.
Finally, the timescale of research must match the educational claim. Short experiments identify candidate processes, longitudinal cohorts reveal ordering and trajectories, and controlled implementation studies assess delivery and lasting benefit. Preregistration, transparent exclusions, appropriate handling of school clustering and missing follow-up, and independent replication make the chain more credible. The central unanswered problem is how to connect the child's particular learning history and profile with an instructionally manipulable process that produces durable, generalisable gains.
