Research on emotion recognition has been dominated by studies of photographs of facial expressions. A full understanding of emotion perception and its neural substrate will require investigations that employ dynamic displays and means of expression other than the face. Our aims were: (i) to develop a set of dynamic and static whole-body expressions of basic emotions for systematic investigations of clinical populations, and for use in functional-imaging studies; (ii) to assess forced-choice emotion-classification performance with these stimuli relative to the results of previous studies; and (iii) to test the hypotheses that more exaggerated whole-body movements would produce (a) more accurate emotion classification and (b) higher ratings of emotional intensity. Ten actors portrayed 5 emotions (anger, disgust, fear, happiness, and sadness) at 3 levels of exaggeration, with their faces covered. Two identical sets of 150 emotion portrayals (full-light and point-light) were created from the same digital footage, along with corresponding static images of the ‘peak’ of each emotion portrayal. Recognition tasks confirmed previous findings that basic emotions are readily identifiable from body movements, even when static form information is minimised by use of point-light displays, and that full-light and even point-light displays can convey identifiable emotions, though rather less efficiently than dynamic displays. Recognition success differed for individual emotions, corroborating earlier results about the importance of distinguishing differences in movement characteristics for different emotional expressions. The patterns of misclassifications were in keeping with earlier findings on emotional clustering. Exaggeration of body movement (a) enhanced recognition accuracy, especially for the dynamic point-light displays, but notably not for sadness, and (b) produced higher emotional-intensity ratings, regardless of lighting condition, for movies but to a lesser extent for stills, indicating that intensity judgments of body gestures rely more on movement (or form-from-movement) than static form information.
Get full access to this article
View all access options for this article.
References
1.
AdolphsRTranelDDamasioA R, 2003“Dissociable neural systems for recognizing emotions”Brian and Cognition5261–69.
2.
AdolphsRTranelDDamasioHDamasioA, 1994“Impaired recognition of emotion in facial expressions following bilateral damage to the human amygdala”Nature372669–672.
3.
AdolphsRTranelDHamannSYoungA WCalderA JPhelpsE AAndersonALeeG PDamasioA R, 1999“Recognition of facial emotion in nine individuals with bilateral amygdala damage”Neuropsychologia371111–1117.
4.
AllisonTPuceAMcCarthyG, 2000“Social perception from visual cues: Role of the STS region”Trends in Cognitive Sciences4267–278.
5.
ArcherJHayD CYoungA W, 1992“Face processing in psychiatric conditions”British Journal of Clinical Psychology3145–61.
6.
ArcherJHayD CYoungA W, 1994“Movement, face processing, and schizophrenia: Evidence of a differential deficit in expression analysis”British Journal of Clinical Psychology33517–528.
7.
AronoffJWoikeB AHymanL M, 1992“Which are the stimuli in facial displays of anger and happiness? Configurational bases of emotion recognition”Journal of Personality and Social Psychology621050–1066.
8.
BassiliJ N, 1978“Facial motion in the perception of faces and of emotional expression”Journal of Experimental Psychology: Human Perception and Performance4373–379.
9.
BassiliJ N, 1979“Emotion recognition: The role of facial movement and the relative importance of upper and lower areas of the face”Journal of Personality and Social Psychology372049–2058.
BooneR TCunninghamJ G, 1998“Children's decoding of emotion in expressive body movement: The development of cue attunement”Developmental Psychology341007–1016.
12.
BraddickO, 1992“Motion may be seen but not used”Current Biology2597–599.
13.
BreazealC L, 2002Designing Sociable Robots (Cambridge, MA: MIT Press).
14.
BroksPYoungA WMaratosE JCoffeyP JCalderA JIsaacC LMayesA RHodgesJ RMontaldiDCezayirliERobertsNHadleyD, 1998“Face processing impairments after encephalitis: Amygdala damage and recognition of fear”Neuropsychologia3659–70.
15.
BrownlowSDixonA REgbertC ARadcliffeR D, 1997“Perception of movement and dancer characteristics from point-light displays of dance”The Psychological Record47411–421.
16.
CalderA JKeaneJManesFAntounNYoungA W, 2000a“Impaired recognition and experience of disgust following brain injury”Nature Neuroscience31077–1078.
17.
CalderA JLawrenceA DYoungA W, 2001“Neuropsychology of fear and loathing”Nature Reviews Neuroscience2352–363.
18.
CalderA JRowlandDYoungA WNimmo-SmithIKeaneJPerrettD I, 2000b“Caricaturing facial expressions”Cognition76105–146.
19.
CalderA JYoungA WRowlandDPerrettD I, 1997“Computer-enhanced emotion in facial expressions”Proceedings of the Royal Society of London, Series B264919–925.
20.
CalderA JYoungA WRowlandDPerrettD IHodgesJ REtcoffN L, 1996“Face perception after bilateral amygdala damage: Differentially severe impairment of fear”Cognitive Neuropsychology13699–745.
21.
CohenJ DMacWhinneyBFlattMProvostJ, 1993“PsyScope: An interactive graphic system for designing and controlling experiments in the psychology laboratory using Macintosh computers”Behavioral Research Methods, Instruments, & Computers25257–271.
22.
CuttingJ EKozlowskiL T, 1977“Recognizing friends by their walk: Gait perception without familiarity cues”Bulletin of the Psychonomic Society9353–356.
23.
DarwinC, 1872/1998The Expression of the Emotions in Man and Animals Ed. EkmanP, (London: HarperCollins).
24.
DawkinsRKrebsJ R, 1978“Animals' signals: Information or manipulation?”, in Behavioural Ecology: An Evolutionary Approach Eds KrebsJ RDaviesN B, (Oxford: Blackwell Scientific Publications) pp 282–309.
25.
De MeijerM, 1989“The contribution of general features of body movement to the attribution of emotions”Journal of Nonverbal Behavior13247–268.
26.
De MeijerM, 1991“The attribution of aggression and grief to body movements: The effect of sex stereotypes”European Journal of Social Psychology21249–259.
27.
DittrichW, 1991“Das Erkennen von Emotionen aus Ausdrucksbewegungen des Gesichts”Psychologische Beiträge33366–377.
28.
DittrichW H, 1993“Action categories and the perception of biological motion”Perception2215–22.
29.
DittrichW H, 1999“Seeing biological motion–Is there a role for cognitive strategies?”, in Gesture-based Communication in Human – Computer Interaction Eds BraffortAGherbiRGibetSRichardsonJTeilD, (Berlin: Springer) pp 3–22.
30.
DittrichW HTrosciankoTLeaS E GMorganD, 1996“Perception of emotion from dynamic point-light displays represented in dance”Perception25727–738.
31.
EkmanP, 1992“An argument for basic emotions”Cognition and Emotion6169–200.
32.
EkmanPFriesenW V, 1974“Detecting deception from the body or face”Journal of Personality and Social Psychology29288–298.
EkmanPFriesenW VEllsworthP, 1972Emotion in the Human Face (New York: Pergamon Press).
35.
FridlundA J, 1994Human Facial Expression: An Evolutionary View (San Diego, CA: Academic Press).
36.
FrijdaN H, 1989“The function of emotional expression”, in Recent Advances in Social Psychology: An International Perspective. Proceedings of the 39th International Congress of Psychology of the International Union of Psychological Science Eds ForgasJ PInnesJ M, (Amsterdam: Elsevier) pp 205–217.
37.
GrossmanEDonnellyMPriceRPickensDMorganVNeighborGBlakeR, 2000“Brain areas involved in perception of biological motion”Journal of Cognitive Neuroscience12711–720.
38.
HadjikhaniNDe GelderB, 2003“Seeing fearful body expressions activates the fusiform cortex and amygdala”Current Biology132201–2205.
39.
HaxbyJ VHoffmanE AGobbiniM I, 2000“The distributed human neural system for face perception”Trends in Cognitive Sciences4223–233.
40.
HeberleinA SAdolphsRTranelDDamasioH, in press “Cortical regions for judgments of emotions and personality traits from point-light walkers”Journal of Cognitive Neuroscience.
41.
HillHJinnoYJohnstonA, 2003“Comparing solid-body with point-light animations”Perception32561–566.
42.
HillHPollickF E, 2000“Exaggerating temporal differences enhances recognition of individuals from point-light displays”Psychological Science11223–228.
43.
HobsonR POustonJLeeA, 1988“Emotion recognition in autism: Coordinating faces and voices”Psychological Medicine18911–923.
44.
HumphreysG WDonnellyNRiddochM J, 1993“Expression is computed separately from facial identity, and it is computed separately for moving and static faces: Neuropsychological evidence”Neuropsychologia31173–181.
45.
JamesW, 1932“A study of the expression of bodily posture”Journal of General Psychology7405–436.
46.
JohanssonG, 1973“Visual perception of biological motion and a model for its analysis”Perception 6 Psychophysics14201–211.
47.
KamachiMBruceVMukaidaSGyobaJYoshikawaSAkamatsuS, 2001“Dynamic properties influence the perception of facial expressions”Perception30875–887.
48.
KiltsC DEganGGideonD AElyT DHoffmanJ M, 2003“Dissociable neural pathways are involved in the recognition of emotion in static and dynamic facial expressions”Neurolmage18156–168.
49.
KozlowskiL TCuttingJ E, 1977“Recognizing the sex of a walker from a dynamic point-light display”Perception & Psychophysics21575–580.
50.
LaBarK SCrupainM JVoyvodicJ TMcCarthyG, 2003“Dynamic perception of facial affect and identity in the human brain”Cerebral Cortex131023–1033.
51.
MatherGMurdochL, 1994“Gender discrimination in biological motion displays based on dynamic cues”Proceedings of the Royal Society of London, Series B258273–279.
52.
MorrisJ SFrithC DPerrettD IRowlandDYoungA WCalderA JDolanR J, 1996“A differential neural response in the human amygdala to fearful and happy facial expressions”Nature383812–815.
53.
NarumotoJOkadaTSadatoNFukuiKYonekuraY, 2001“Attention to emotion modulates fMRI activity in human right superior temporal sulcus”Cognitive Brain Research12225–231.
54.
OramM WPerrettD I, 1994“Responses of anterior superior temporal polysensory (STPa) neurons to ‘biological motion’ stimuli”Journal of Cognitive Neuroscience699–116.
55.
PatersonH MPollickF ESanfordA J, 2001“The role of velocity in affect discrimination”Proceedings of the 23rd Annual Conference of the Cognitive Science Society Edinburgh, August 1st-4th, pp 756–761.
56.
PhillipsM LYoungA WScottS KCalderA JAndrewCGiampietroVWilliamsS C RBullmoreE TBrammerMGrayJ A, 1998“Neural responses to facial and vocal expressions of fear and disgust”Proceedings of the Royal Society of London, Series B2651809–1817.
57.
PhillipsM LYoungA WSeniorCBrammerMAndrewCCalderA JBullmoreE TPerrettD IRowlandDWilliamsS C RGrayJ ADavidA S, 1997“A specific neural substrate for perceiving facial expressions of disgust”Nature389495–498.
58.
PlutchikR, 1980Emotion: A Psychoevolutionary Synthesis (New York: Harper Row).
59.
PollickF EFidopiastisCBradenV, 2001a“Recognising the style of spatially exaggerated tennis serves”Perception30323–338.
60.
PollickF EHillHCalderAPatersonH, 2003“Recognising facial expression from spatially and temporally modified movements”Perception32813–826.
61.
PollickF EPatersonH MBruderlinASanfordA J, 2001b“Perceiving affect from arm movement”Cognition82B51–B61.
62.
RothG, 1990Maps to Ecstasy (London: HarperCollins).
63.
RozinPFallonA E, 1987“A perspective on disgust”Psychological Review9423–41.
64.
RozinPHaidtJMcCauleyC R, 1993“Disgust”, in Handbook of Emotions Eds LewisMHavilandJ, (New York: Guilford) pp 575–594.
65.
RozinPLoweryLImadaSHaidtJ, 1999“The CAD triad hypothesis: A mapping between three moral emotions (contempt, anger, disgust) and three moral codes (community, autonomy, divinity)”Journal of Personality and Social Psychology76574–586.
66.
RussellJ A, 1994“Is there universal recognition of emotion from facial expression? A review of the cross-cultural studies”Psychological Bulletin115102–141.
67.
SchererK RWallbottH GSummerfieldA B, (Eds), 1986Experiencing Emotion: A Cross-cultural Study (Cambridge: Cambridge University Press).
68.
SchneiderKDittrichW, 1989“Functions and evolution of emotions”, in Enzyklopaedie der Psychologie, Bd. C/IV/3 Ed. SchererK, (Göttingen: Hogrefe) pp 41–115.
69.
SprengelmeyerRRauschMEyselU TPrzuntekH, 1998“Neural structures associated with recognition of facial expressions of basic emotions”Proceedings of the Royal Society of London, Series B2651927–1931.
70.
SprengelmeyerRYoungA WCalderA JKarnatALangeHHombergVPerrettD IRowlandD, 1996“Loss of disgust: Perception of faces and emotions in Huntington's disease”Brain1191647–1665.
71.
SprengelmeyerRYoungA WPundtISprengelmeyerACalderA JBerriosGWinkelRVollmöllerWKuhnWSartoryGPrzuntekH, 1997“Disgust implicated in obsessive-compulsive disorder”Proceedings of the Royal Society of London, Series B2641767–1773.
72.
SprengelmeyerRYoungA WSchroederUGrossenbacherP GFederleinJButtnerTPrzuntekH, 1999“Knowing no fear”Proceedings of the Royal Society of London, Series B2662451–2456.
73.
StanislavskiK, 1936An Actor Prepares translated by HopgoodE R, (New York: Theatre Arts).
74.
ThomasS MJordanT R, 2001“Techniques for the production of point-light and fully illuminated video displays from identical recordings”Behavior Research Methods, Instruments, & Computers3359–64.
75.
WalkR D, 1984“Perceptual organization”, in Encyclopedia of Psychology Ed. CorsiniR J, (New York: John Wiley).
76.
WalkR DHomanC P, 1984“Emotion and dance in dynamic light displays”Bulletin of the Psychonomic Society22437–440.
77.
WallbottH G, 1998“Bodily expression of emotion”European Journal of Social Psychology28879–896.
78.
WallbottH GSchererK R, 1986“Cues and channels in emotion recognition”Journal of Personality and Social Psychology51690–699.
79.
WaltersK LWalkR D, 1988“Perception of emotion from moving body cues in photographs”Bulletin of the Psychonomic Society26112–114.
80.
WickerBKeysersCPlaillyJRoyetJ-PGalleseVRizzolattiG, 2003“Both of us disgusted in My Insula: The common neural basis of seeing and feeling disgust”Neuron40655–664.
81.
YoungA WHellawellD JVan De WalCJohnsonM, 1996“Facial expression processing after amygdalotomy”Neuropsychologia3431–39.
