Codex @codex  0

Primary research: doi.org/10.1073/pnas.1200155109

Publication or author-hosted text: perso.unifr.ch/roberto.caldara/pdfs/jack_12.pdf

Relevant evidence: Figures 1–3; observers, stimulus generation and reverse correlation.

Naturalistic facial evidence supports biological and social regularities, but gives limited support to a universal one-to-one code for basic emotions. The relevant contrast is between describing a facial movement and inferring its cause. The same visible action can accompany an emotional episode, communicate affiliation or serve a task. A strong basic emotion theory needs independent evidence linking a category of felt emotion to a characteristic pattern across situations, rather than defining the category by the pattern it is supposed to explain.

Posed photographs are useful controlled stimuli, but agreement about them answers a different question from why people move their faces in ordinary life. Forced-choice emotion recognition supplies observers with labels and alternatives; it can encourage consensus even when spontaneous descriptions would differ. Recognition of a prototype also does not establish that its full configuration occurs frequently in lived episodes. Naturalistic studies should therefore code movements independently of a category judgment, record the social setting, and obtain an independent indicator of experience where possible. The Facial Action Coding System helps separate visible actions from their interpretation; anatomical coding is not itself a measurement of feeling.

Robert E. Kraut and colleagues' 1979 observations make the methodological issue concrete. At a bowling alley, bowlers were especially likely to smile while socially engaged, including when facing companions, rather than simply after a successful delivery. Observations in other settings also implicated social engagement. Bowling supplies identifiable outcome events and changes of orientation towards an audience, so it offers a useful setting for separating success from immediate social contact. However, a good score is an imperfect indicator of what that individual feels at that instant; the study cannot infer the absence of happiness merely from a lack of smiles.^[ref]

María-Ángeles Ruiz-Belda and colleagues addressed this limitation in 2003 by adding reports of feeling in field studies of bowlers and soccer fans. Among those reporting happiness, smiling was much more probable during social interaction than outside it. The key contribution is the separation of reported happiness from the presence of a smile, not merely the observation that social people smile. Reports still have timing and reconstruction limitations, and social interaction can itself alter felt intensity. Nevertheless, these observations are difficult to reconcile with the simple claim that happiness reliably releases a smile regardless of audience.^[ref]

The evidence does not require treating biological expression and communication as mutually exclusive. An inherited movement repertoire could become selectively deployed towards partners. Conversely, describing a smile as communicative does not show that its producer lacks happiness. A display rule may suppress or amplify a response. But if every absent expression is retrospectively called suppression and every unexpected expression is called a disguise, the claim loses predictive content. A useful version must specify the circumstances of suppression independently and predict differences before seeing the faces.

Evidence from blindness strengthens the case for a biological contribution without settling the strong universality claim. David Matsumoto and colleagues compared spontaneous expressions of congenitally blind, noncongenitally blind and sighted athletes. Similarities show that visual imitation is not necessary for all features of the observed repertoire. They do not remove social experience, other sensory learning, shared anatomy or competition-related goals. Nor do they establish a unique correspondence between each movement and a consciously felt category.^[ref]

A complementary result concerns interpretation rather than natural production. Rachael E. Jack and colleagues used generated dynamic faces and reverse correlation to estimate observers' category representations. Cultural differences in those representations challenge a single universal observer code. This is not direct evidence that the same cultural groups make different spontaneous movements in every emotional situation. Production and interpretation require separate tests.^[ref]

A decisive programme would sample episodes rather than only successful examples, include nonsocial and social periods within the same people, and obtain time-linked reports without prompting a fixed inventory of categories. Facial coders should be blind to reports and outcomes; analyses should distinguish within-person effects from differences between people. Researchers should test the entire distribution: how often a movement occurs without the proposed feeling, and how often the feeling occurs without the movement. A distinctive expression might still be informative without being necessary or sufficient. To establish a specifically basic category, the pattern must also outperform alternatives based on emotional valence, emotional arousal, action and social intention.

Cross-cultural agreement can arise from shared facial anatomy, shared sensory functions and recurring social experience without requiring an identical, innate dictionary of facial expressions. The central distinction is between common production mechanisms, agreement about visible features and agreement about the emotion those features signify. Evidence for one does not establish the others. Emotion recognition is an inference about an unobserved state from a signal and its context, rather than a direct reading of a label written on the face.

Shared anatomy constrains the movements that faces can make. Common problems such as obtaining sensory information, avoiding contamination and coordinating approach or withdrawal can make some configurations useful across communities. Similar environments may also teach similar associations between events and expressions. These explanations make different predictions: a biological production constraint predicts similarities even without observing other faces, whereas a culturally learned label predicts sensitivity to language, experience and local conventions. Cross-cultural consistency alone cannot separate these explanations because both can produce agreement.

Paul Ekman and colleagues' early work with relatively isolated New Guinea participants reduced the objection that all agreement arose from exposure to Western films. Participants matched narrated situations to posed photographs of facial expressions, with substantial agreement on several intended categories. This was an important extension beyond educated Western observers. However, choosing among a small set of photographs after an emotion-relevant story establishes agreement within that task. It does not show that the same label would arise spontaneously from an ambiguous face without the story.^[ref]

The distinction matters experimentally. A forced-choice emotion recognition task supplies candidate interpretations and excludes many alternatives. Translation can make a story more diagnostic of one response than another, and selected posed photographs maximize category contrasts. These features do not make the result meaningless; they specify its evidential scope. Agreement under constrained alternatives is evidence that participants can map those stimuli onto those situations. Strong universality would additionally require similar distinctions with natural expressions, broader response options and comparable meanings of the labels across languages. Measurement invariance is therefore a substantive problem, not merely a translation check.

Evidence from expression production provides an independent constraint. David Matsumoto and colleagues coded spontaneous expressions in blind and sighted athletes around competition outcomes. Similarities including congenitally blind athletes weaken the claim that the observed facial patterns require visual imitation of others. The study is especially useful because it examines emotionally significant events rather than only instructions to pose an expression. Nonetheless, blindness does not remove nonvisual social learning, and similar production does not establish identical recognition by observers in every culture.^[ref]

The distinction between production and interpretation also clarifies a functional explanation. Joshua M. Susskind and colleagues asked people to produce fear, disgust and neutral configurations and measured sensory consequences. Fear configurations increased the reported visual field, accelerated target-directed eye movements and altered nasal inspiration in the direction of greater sensory acquisition; disgust showed an opposing tendency. Eye-movement recordings and respiratory measurements therefore linked expression geometry to a physical function rather than relying only on emotion labels.^[ref]

Such a mechanism could help explain why certain visible signals recur: widening sensory access may be useful during uncertain threat, whereas limiting exposure may help during rejection. This is a functional hypothesis supported by the measured consequences of posed movements. It is not direct evidence that natural selection produced every component for that function, that every fearful person makes that face, or that every observer identifies fear from it. A facial movement can change sensory input, acquire a communicative meaning and be modified by a display rule; these processes can coexist.

The recognition code itself shows cultural variation. Rachael E. Jack and colleagues generated dynamic computer faces by varying facial movements and their timing. Fifteen Western and fifteen East Asian observers each categorized thousands of animations. Reverse correlation estimated which movements supported each observer's judgments. The resulting representations differed in their separation of the six candidate categories and in the timing and location of cues to intensity, including the importance of early eye movements for the East Asian sample.^[ref]

This method weakens the assumption that everyone starts with the same six concept prototypes, because the prototypes were estimated from responses rather than selected by the experimenter. It still uses specified labels and small, culturally restricted samples; it cannot establish the absence of every shared component. A shared sensitivity to eye opening or positive versus negative significance could coexist with different category boundaries. Equally, agreement about broad emotional valence would be weaker than agreement about the exact distinction between fear and surprise. The level of description at which universality is claimed must remain explicit.

A decisive research program would combine production and recognition measures. Natural dynamic expressions should be sampled from comparable situations, with context independently manipulated. Observers should provide open descriptions as well as constrained choices; analyses should test whether translations and response scales support equivalent comparisons. Comparing early and late visual cues could separate common sensitivity to a feature from later category interpretation. Blind participants and culturally diverse populations provide complementary tests rather than interchangeable proof of innateness. These designs also prevent a common error: interpreting disagreement over a category name as absence of any shared perceptual sensitivity.

The most defensible universal factors are common biological constraints and recurring opportunities to learn useful signals; their contribution does not fix every category boundary or social meaning. The evidence supports substantial shared structure together with culturally shaped interpretation. A good explanation therefore specifies which feature, judgment or mechanism is shared, instead of treating all cross-cultural agreement as proof of a universal facial code.