Akira Miyake Created 2026-10-25 Updated 2026-11-05
A cognitive psychologist who investigated the organization of executive functions. A study of 137 students used latent variable analysis to separate shifting, updating and inhibition while estimating their relationships. The results support both shared and distinct components, explaining why different complex executive tasks need not measure exactly the same ability.[ref]
Bühlmann–Straub model Created 2026-10-06 Updated 2026-11-05
Conditional on a common latent variable , annual averages are independent, have common conditional expectation , and have conditional variance for known positive exposures . Its structural parameters are , expected process variance and variance of hypothetical means . It generalizes the equal-exposure Bühlmann model.
Conditional independence Created 2026-09-24 Updated 2026-10-14
Random variables and are conditionally independent given when, for every pair of Borel sets , the following identity holds almost surely:
Here conditional probabilities are conditional expectations of the corresponding indicator random variables given the sigma-algebra generated by . This defines the condition even when . In terms of regular conditional distributions, the conditional joint law is the product of the conditional marginal distributions for almost every conditioning value.
For discrete random variables, at every with , the condition becomes
Where , this is equivalent to . Once is known, observing provides no further information about .[ref]
For a worked example, suppose a latent variable chooses between two environments with . Given , take to be independent and identically distributed with a Bernoulli distribution of parameter , where and . Think of two separate trials run under the same quiet or active environment. Their conditional joint probability mass functions, with rows and columns , are
Each is exactly the product of its own conditional marginal distributions: for , and for . Thus are conditionally independent given .
If the environment is unobserved, the law of total probability averages the two tables:
Both unconditional marginal distributions are fair, but . The law of total expectation gives
Figure 1.
An unobserved shared environment creates statistical dependence between conditionally independent trials
. The first two tables show independent Bernoulli trials at conditional success probabilities and . Averaging them with equal weights gives the third table. The fourth table is the product of the resulting unconditional marginal distributions, which differs from the actual joint table. These are stipulated model probabilities, not observed frequencies. Details.
Observing makes the active environment more plausible, so it raises to . Knowing the actual environment removes this source of statistical dependence. The covariance induced by a shared latent variable lemma explains the calculation without listing all the outcomes.
This is why conditional independence is useful in statistical modelling: a model can multiply simple conditional laws and then average over a shared latent variable. The resulting observations can remain statistically dependent. Conditional independence graphs organize such information relations; their interpretation as causes requires additional assumptions from causal inference. Conditioning describes the information available to an observer. It does not, by itself, describe what would happen if an experimenter changed a variable.
Covariance induced by a shared latent variable Created 2026-10-06 Updated 2026-10-14
Let be indicator random variables with conditional independence given a latent variable , and suppose . Then
For a short proof, conditional independence gives . The law of total expectation gives and . Subtract their product to obtain the claimed variance. Since , all the required expected values exist.
In the two-environment example of conditional independence, is or with equal probabilities. Hence and . The two trials have zero conditional covariance in either environment, yet their unconditional covariance is positive because their success probabilities rise and fall together.
More generally, square-integrable conditionally independent random variables satisfy
by the law of total covariance. Equal conditional means reduce this to the displayed variance; unequal conditional means need not give a nonnegative covariance. The equal-mean result explains correlated component evolutionary states in a coeval binary population without correlation between initial masses: variation in a shared environment can supply the entire covariance.
Errors-in-variables model Created 2026-10-14 Updated 2026-11-05
An Errors-in-variables model distinguishes a latent true predictor from its noisy measurement and models both the measurement and the response. For example, and , with a population distribution for , propagate predictor uncertainty into inference on . Treating as exact can create attenuation bias from classical measurement error. Identifiability requires appropriate information about the measurement process or latent predictor distribution.
Expectation-maximization algorithm Created 2026-10-03 Updated 2026-10-14
The expectation-maximization algorithm fits a latent-variable model by alternating a conditional expectation over the latent variables with a maximization over the statistical parameters. Its target is the observed-data likelihood function, although its updates use the simpler complete-data log-likelihood.[ref]
Write for the observations, for the latent variables, and for their joint probability density function or probability mass function. The observed-data log-likelihood is
where the integral becomes a sum for discrete . Directly maximizing a logarithm of this sum can be awkward. The E-step instead computes a conditional distribution at the current statistical parameters ; the M-step uses it to construct a new fit. The attractive idea is to retain uncertainty about the hidden labels while recovering simple weighted means and other complete-data updates. The Known-variance Gaussian mixture EM example shows the mechanism without estimating a variance or mixture weight.
Arthur Pentland Dempster, Nan M. Laird, and Donald B. Rubin gave the general framework its name in their 1977 paper, which also discusses earlier special-case algorithms.[ref]
Factor analysis Created 2026-10-05 Updated 2026-10-07
Factor analysis writes an observation as , where the low-dimensional latent variable describes shared variation. In the isotropic Gaussian model and independently, the observation has covariance .
The general intelligence factor, conventionally , is a latent variable used to account for shared variation among performances on different cognitive tasks. Charles Spearman's 1904 analysis distinguished a common component from task-specific contributions, helping establish the historical basis of this approach.[ref]
A simple one-factor measurement model writes a standardized test score as
where is a factor loading. Suppose all variables have zero mean, , each has zero covariance with , and distinct residuals have zero covariance with one another. Then for different tests,
Thus a single shared component can explain correlated scores even when the tests contain different content. The covariance equation follows from the stated assumptions; it does not identify a unique biological cause of the correlations.
Factor analysis estimates such models and evaluates their fit. The general intelligence factor should also be distinguished from a first component obtained by principal component analysis: one is a proposed latent structure with residual assumptions, while the other is a variance-maximizing summary of observed scores. Interpretation requires the tasks, population and measurement assumptions, rather than a number alone.
Generative decoder 2026-11-05
A generative decoder maps a latent variable to the parameters of a conditional observation probability distribution, commonly written . In a variational autoencoder, a neural network can supply those parameters. The conditional law, including its observation noise and support, is part of the model; the decoder need not return one deterministic reconstructed observation.[ref]
For a concrete binary example, suppose a decoder specifies two conditionally independent Bernoulli distributions with probabilities and . Then
If a chosen latent value gives , the conditional probability of is , and its negative log likelihood is approximately . The vector is a vector of probabilities, not itself a binary sample. A model for continuous observations would need a different conditional distribution.[ref]
Generation draws a latent value from the prior and then draws from the decoder's conditional law. Averaging over latent values gives
Conditional independence of output components at fixed need not imply independence after this marginalization, because the same latent variable can influence several components. The recognition network runs in the other direction for inference; it is not an algebraic inverse of the generative decoder.
Hierarchical Bayesian model Created 2026-10-05 Updated 2026-10-06
A hierarchical Bayesian model assigns distributions to local latent variables conditional on shared hyperparameters, then distributions to observations conditional on those latent variables. Its probabilistic graphical model records this conditional factorization, often using a plate for repeated observations. Integrating out latent variables gives the marginal likelihood of the hyperparameters. Priors described as flat on logarithms require a Jacobian determinant when densities are written in the original positive variables.
Law of total covariance Created 2026-10-07 Updated 2026-11-05
For square-integrable random variables, expand and into their conditional expectations and their centered conditional residuals. The cross terms vanish by the law of total expectation, giving the displayed covariance decomposition. conditional independence can therefore coexist with positive unconditional covariance from a shared latent variable.
Method factor 2026-10-25
A latent variable introduced to represent covariance related to a measurement method. Its separation from trait factors depends on indicators and identifying restrictions; labeling a factor as methodological does not establish that interpretation by itself.
Generate a finite mixture model by drawing a categorical variable with , then drawing from the mixture component . The indicator random variables satisfy : exactly one mixture component generates each draw. The joint probability distribution obeys , and the law of total probability gives the mixture distribution after summing out .[ref]
For independent draws from this statistical model, draw a fresh for each . Drawing one shared latent variable for an entire collection is a different joint probability distribution: its individual marginal distributions can match the same mixture distribution while its observations are dependent.
Mixture model Created 2026-09-24 Updated 2026-10-14
A mixture model represents a population probability distribution by choosing one mixture component at random and then drawing from its probability distribution. For a finite mixture model whose mixture components have probability density functions , the resulting mixture distribution has probability density function
The mixture weights ensure and . For discrete random variables the same formula uses probability mass functions; without either kind of density, write for component distributions . A zero mixture weight makes that mixture component inactive.[ref]
The mixture components need not occupy disjoint bins of . Two normal distributions both have positive probability density functions everywhere, so the same value can plausibly come from either mixture component. The Two-Gaussian mixture example makes this overlap visible, and its mixture responsibilities quantify the remaining uncertainty about the latent variable. This is useful when a single normal distribution cannot represent the population's shape, but a fitted mixture model alone does not establish that its mixture components are real biological or social groups.
A normal local effect can be represented by a standardized latent variable independent of the hyperparameters, with . This preserves the hierarchical model while changing the coordinates explored by Markov chain Monte Carlo. It often improves mixing when individual effects are weakly informed, reducing strong scale-effect dependence. Centered coordinates can be better with very informative individual data. The stochastic prior on implements the transformation correctly; re-expressing an existing density directly instead requires the appropriate Jacobian determinant.
In a finite mixture model with hidden membership, the component label is a latent variable and is observed. If an actual recorded label specifies which mixture component generated , then is observed and its likelihood contribution is . With the label hidden, the observed likelihood contribution is the sum . A hard assignment chosen from mixture responsibilities is an inference under the statistical model, not an additional recorded label.
Set shifting, working-memory updating and inhibitory control are useful distinctions, but patient evidence does not establish them as three exhaustive, anatomically isolated components of executive function. They specify important demands on control: changing a currently relevant rule, replacing or manipulating maintained information, and suppressing an inappropriate action. A useful model must explain selective deficits and shared impairments, as well as failures to organize behavior outside a tightly instructed test.
The influential three-component framework drew support from work modeling latent variables in healthy participants, including Akira Miyake and colleagues' study. That evidence addresses covariance across tasks while reducing some executive task impurity. It is not itself a brain lesion experiment or proof that the same structure survives unchanged after brain injury. A factor identified in healthy performance need not correspond one-to-one with a cortical region, and two tasks sharing a deficit can share perceptual, human memory or general-demand requirements as well as an executive computation.[ref]
For task switching, paradigms compare performance when repeating a rule with performance when changing it. Tim Shallice and colleagues studied 41 patients with focal prefrontal cortex brain lesions and 38 controls, varying the interval between a task cue and the target. Brain lesion subgroups differed in general slowing, reaction time switch costs and errors. Superior medial damage produced both slowing and increased reaction time switch cost; the pattern across groups was not one uniform deficit shared by every frontal brain lesion.[ref]
This supports decomposing switching itself. A participant must perceive the cue, retrieve the rule, maintain readiness, resolve competing mappings and execute a response. A large switch-minus-repeat difference is evidence about the whole contrast, not a direct measurement of one indivisible shifting mechanism. General slowing can also affect raw difference scores. Patient comparisons that examine errors, cue preparation and baseline performance therefore constrain the interpretation more effectively than labeling every poor switching score a failure of flexibility.
For working-memory updating, it is essential to separate replacing obsolete information from simple maintenance and from rearranging retained material. Aron K. Barbey and colleagues compared patients with dorsolateral prefrontal cortex brain lesions, other brain lesions and healthy controls using span-related and N-back task measures. Their findings particularly implicated manipulation of verbal and spatial knowledge rather than supporting a universal loss of all working memory performance. This is evidence for differentiated control operations, but “manipulation” is not automatically identical to every operational definition of working-memory updating.[ref]
For inhibitory control, Adam R. Aron and colleagues found impaired performance on the stop-signal task after damage to the right inferior frontal gyrus. In this task a frequent go response must occasionally be stopped following a signal. The stopping latency is inferred through a model rather than directly timed as an observable movement. The brain lesion result supports a contribution to successful stopping, while the paradigm also requires detecting the signal, maintaining its significance and coordinating competing responses. It consequently does not prove that the region is exclusively an inhibitory module or that every form of interference control is the same process.[ref]
Broader patient findings challenge exhaustiveness. María Roca and colleagues examined how deficits after frontal brain lesions related to fluid intelligence. Some traditional executive-test deficits, including Wisconsin Card Sorting Test, were largely explained statistically by reduced fluid intelligence, whereas other tasks retained additional deficits. This favors distinguishing general-demand contributions from more specific processes. Statistical adjustment does not, however, prove that intelligence is a separate causal mechanism upstream of cognitive control: the measures can share neural and cognitive requirements.[ref]
Everyday goal neglect provides a further problem for a simple three-label account. In a study led by Tim Shallice, three patients with traumatic injury to the prefrontal cortex struggled with open-ended multiple-subgoal tasks over extended periods, often spending too long on individual activities. Their perception, language and intelligence were relatively good, and two performed well on several conventional frontal tests. The authors argued for difficulty reactivating intentions when the situation did not directly cue them, rather than a general human memory or motivation failure.[ref]
Such behavior may draw on shifting, working-memory updating and inhibitory control, but merely redescribing it as their combined failure does not explain why structured tests can be much better. A theory should specify how intentions are maintained, reactivated and applied over time, how effort is sustained and how progress is monitored. Additional levels of organization or interactions may be needed, even if some lower-level operations are captured by the three components.
Patient inference also has methodological limits. Brain lesions disrupt connections and neighboring processes; location covaries with etiology and severity. Apparent preservation can reflect low task sensitivity, and different brain lesion groups can differ in premorbid characteristics. Strong claims of separability need reliable tasks, matched nonexecutive requirements, convergent measures and formal comparisons, rather than one significant effect in one group and a nonsignificant effect in another.
The three components remain a productive framework for designing contrasts and interpreting some selective deficits, but they are a working decomposition rather than a complete inventory of cognitive control. Patient studies reveal differentiation within each category, shared demand-related effects, and additional problems of sustained goal application. The most informative account links these behavioral distinctions to interacting computations and networks while predicting when the distinctions should and should not dissociate.
Executive functions should contribute most when learning or assessment requires keeping several pieces of information active, suppressing an attractive error, coordinating successive operations or changing strategy. This predicts particularly strong links with multistep mathematics, mathematical problem solving and reading comprehension, alongside classroom engagement and following instructions. It predicts a smaller direct contribution to well-practised fact retrieval or fluent decoding once those operations are automated. That is a task-demand hypothesis, not a claim that every mathematics score must correlate more strongly with executive functions than every literacy score.
Working memory maintains goals and intermediate results: a child doing a subtraction with borrowing must retain both the original problem and its updated intermediate state. Inhibitory control helps suppress a larger-number answer that is tempting but irrelevant, or a familiar operation when the problem requires another. Cognitive flexibility supports switching between representations or abandoning an unsuccessful strategy. In reading, maintaining earlier propositions and rejecting an initially plausible interpretation should matter especially for comprehension and inference; knowledge of letter–sound correspondences is not itself an executive function. Repeated practice can change which process is the bottleneck, so developmental stage and familiarity matter.
Historically, the unity-and-diversity framework helped replace an undifferentiated “executive ability” with correlated but distinguishable processes. Akira Miyake and colleagues used several tasks per proposed component and latent variable analysis to separate common executive variance from individual task demands. Their influential study tested adults: its factor structure cannot simply be assumed to describe preschool children. It nevertheless supplies a crucial methodological lesson. A single executive task measures the intended control process together with perception, language, motor speed and task-specific strategies. Treating a raw score as a pure capacity risks attributing the wrong source of variance to school achievement.[ref]
More directly, Clancy Blair and Rachel Peters Razza followed 141 children from low-income homes, measuring preschool self-regulation and later kindergarten mathematics and literacy. Their inhibition measure required children to tap once when the experimenter tapped twice and twice after one tap: the apparatus is simple, but the rule requires suppressing imitation and maintaining an opposite response mapping. Inhibitory control was associated with emerging mathematics and reading after accounting for intelligence. This supports the importance of regulation during early learning, but the design was observational, not random assignment to different inhibitory capacities. Shared language, family circumstances or classroom experience could influence both performances.[ref]
Lucy Cragg and colleagues provided a more differentiated mathematical analysis. Their sample of 293 participants aged eight to twenty-five completed executive tasks and measures of factual knowledge, procedures and conceptual understanding. Working memory had both an association with overall mathematics and indirect associations through mathematical component skills; inhibition measured in a numerical context was linked to factual and procedural knowledge. This is more informative than treating “mathematics” as one outcome. However, statistical mediation in an age-spanning observational sample does not establish that changing the putative mediator would change attainment. Numerically framed executive tasks can also share content with the achievement measures, increasing the apparent specificity of the association.[ref]
Kate Cain and colleagues supply a corresponding literacy result. In assessments at ages eight, nine and eleven, working memory and comprehension components such as inference and monitoring predicted reading comprehension after controls for word reading and verbal ability. Sentence-span and digit-working-memory measures helped avoid defining the entire construct by one task. This supports a contribution beyond decoding, but the reported concurrent relations at successive ages are not an experimental demonstration of causal direction; comprehension itself can affect performance on verbally loaded memory tasks.[ref]
Evidence across populations qualifies the temptation to make executive functions the master explanation of achievement. Greg J. Duncan and colleagues compared six longitudinal datasets while controlling earlier child skills and family background. School-entry mathematics and reading were strong predictors of subsequent attainment; attention added prediction, whereas several socioemotional measures did not. Attention ratings are not interchangeable with laboratory inhibition or working memory measures. The result supports a classroom-regulation pathway while showing that already acquired domain knowledge remains central. Learning also exercises executive control, so baseline-adjusted longitudinal associations do not eliminate reciprocal influence or unmeasured confounding.[ref]
Intervention offers a sharper causal test, but its target and outcome must be distinguished. Darren L. Dunning and colleagues randomly allocated seven- to nine-year-olds with low working memory to adaptive computerised training, low-load nonadaptive training or no training. The adaptive condition improved several untrained working memory tests, with some gains maintained over time, but did not produce corresponding academic or classroom-analogue benefits. The active comparison helps separate memory-load effects from attention, computer practice and expectations. Crucially, improvement on an untrained but structurally similar memory test is near transfer; improved reading or mathematics would be far transfer. One does not entail the other.[ref]
This trial does not show that working memory is irrelevant to achievement. A resource can constrain performance even when practising isolated tasks fails to change how it is deployed in a classroom. Nor does one intervention test all executive components, age groups or teaching methods. It does undermine the stronger inference from correlation to a promise that generic executive training will raise school attainment. Supporting instruction through shorter directions, external reminders and staged problems can reduce executive demands; whether any particular classroom support improves learning still requires an appropriately controlled outcome study.
The most defensible answer is therefore conditional and specific. Executive differences are especially plausible influences on managing novel, attentionally demanding, multistep learning and demonstrating that learning under load. They operate alongside knowledge, language, motivation and opportunity. Strong evidence would combine reliable multi-task executive measures, differentiated academic outcomes, repeated measurements with comparable meaning across ages, and interventions with active controls and delayed achievement tests. Existing prospective and experimental evidence supports executive functions as contributors to learning, while limiting claims that they are a single cause of educational success.