Recent judgment studies have shown that people are able to fairly correctly attribute emotional states to others' bodily expressions. It is, however, not clear which movement qualities are salient, and how this applies to emotional gesture during speech-based interaction. In this study we investigated how the expression of emotions that vary on three major emotion dimensions—that is, arousal, valence, and potency—affects the perception of dynamic arm gestures. Ten professional actors enacted 12 emotions in a scenario-based social interaction setting. Participants (N = 43) rated all emotional expressions with muted sound and blurred faces on six spatiotemporal characteristics of gestural arm movement that were found to be related to emotion in previous research (amount of movement, movement speed, force, fluency, size, and height/vertical position). Arousal and potency were found to be strong determinants of the perception of gestural dynamics, whereas the differences between positive or negative emotions were less pronounced. These results confirm the importance of arm movement in communicating major emotion dimensions and show that gesture forms an integrated part of multimodal nonverbal emotion communication.
AtkinsonA PDittrichW HGemmellA JYoungA W, 2004“Emotion perception from dynamic and static body expressions in point-light and full-light displays”Perception33717–746
2.
AtkinsonA PTunstallM LDittrichW H, 2007“Evidence for distinct contributions of form and motion information to the recognition of emotions from body gestures”Cognition10459–72
3.
AviezerHHassinR RRyanJGradyCSusskindJAndersonAMoscovitchMBentinS, 2008“Angry, disgusted, or afraid? Studies on the malleability of emotion perception”Psychological Science19724–732
4.
BanseRSchererK R, 1996“Acoustic profiles in vocal emotion expression”Journal of Personality and Social Psychology70614–636
5.
BänzigerTMortillaroMSchererK R, 2012“Introducing the Geneva Multimodal Expression Corpus for experimental research on emotion perception”Emotion121161–1179
6.
BänzigerTSchererK R, 2010“Introducing the Geneva multimodal emotion portrayal (GEMEP) corpus”, in Blueprint for Affective Computing: A Sourcebook Eds SchererK RBänzigerTRoeschE B (Oxford: Oxford University Press) pp 271–294
7.
CoulsonM, 2004“Attributing emotion to static body postures: Recognition accuracy, confusions, and viewpoint dependence”Journal of Nonverbal Behavior28117–139
8.
DaelNGoudbeekMSchererK R, submitted “Attributing emotion dimensions to expressive body movement”
9.
DaelNMortillaroMSchererK R, 2012“Emotion expression in body action and posture”Emotion121085–1101
10.
de GelderB, 2006“Towards the neurobiology of emotional body language”Nature Reviews Neuroscience7242–249
11.
de MeijerM, 1989“The contribution of general features of body movement to the attribution of emotions”Journal of Nonverbal Behavior13247–268
12.
DittrichW HTrosciankoTLeaS E GMorganD, 1996“Perception of emotion from dynamic point-light displays represented in dance”Perception25727–738
13.
Douglas-CowieECowieRSneddonICoxCLowryOMcRorieMMartinJ-CDevillersLAbrilianSBatlinerAAmirNKarpouzisK, 2007“The HUMAINE database: Addressing the collection and annotation of naturalistic and induced emotional data”, Second International Conference on Affective Computing and Intelligent Interaction (ACII 2007)Lecture Notes in Computer Science. Volume 4738 Eds PaivaAPradaRPicardR W (Heidelberg: Springer-Verlag) pp 488–500
14.
EkmanP, 1965“Differential communication of affect by head and body cues”Journal of Personality and Social Psychology2726–735
15.
EkmanP, 1992“Facial expressions of emotion: New findings, new questions”Psychological Science334–38
16.
EkmanPFriesenW V, 1967“Head and body cues in the judgment of emotion: A reformulation”Perceptual & Motor Skills24711–724
17.
EkmanPFriesenW V, 1972“Hand movements”Journal of Communication22353–374
18.
FontaineJ R JSchererK RRoeschE BEllsworthP C, 2007“The world of emotions is not two-dimensional”Psychological Science181050–1057
19.
FrijdaN H, 1986The Emotions (Cambridge: Cambridge University Press)
20.
FrijdaN HKuipersPter SchureE, 1989“Relations among emotion, appraisal, and emotional action readiness”Journal of Personality and Social Psychology57212–228
21.
GlowinskiDDaelNCamurriAVolpeGMortillaroMSchererK R, 2011“Towards a minimal representation of human nonverbal affective behavior”IEEE Transactions on Affective Computing1106–118
22.
GoudbeekMSchererK R, 2010“Beyond arousal: Valence and potency/control in the vocal expression of emotion”Journal of the Acoustical Society of America1281322–1336
23.
GrossM MCraneE AFredricksonB L, 2010“Methodology for assessing bodily expression of emotion”Journal of Nonverbal Behavior34223–248
24.
HallJ AHarriganJ ARosenthalR, 1995“Nonverbal behavior in clinician—patient interaction”Applied and Preventive Psychology421–37
25.
HarriganJ A, 2005“Proxemics, kinesics, and gaze”, in The New Handbook of Methods in Nonverbal Behavior Research Eds HarriganJ ARosenthalRSchererK R (New York: Oxford University Press) pp 137–198
26.
JuslinP NLaukkaP, 2003“Communication of emotions in vocal expression and music performance: Different channels, same code?”Psychological Bulletin129770–814
27.
JuslinP NSchererK R, 2005“Vocal expression of affect”, in The New Handbook of Methods in Nonverbal Behavior Research Eds HarriganJ ARosenthalRSchererK R (New York: Oxford University Press) pp 65–135
28.
KeltnerDEkmanPGonzagaG CBeerJ, 2003“Facial expression of emotion”, in Handbook of Affective Sciences Eds DavidsonR JSchererK RGoldsmithH H (New York: Oxford University Press) pp 415–432
29.
KendonA, 2004Gesture: Visible Action as Utterance (Cambridge: Cambridge University Press)
30.
KitaSÖzyürekAAllenSBrownAFurmanRIshizukaT, 2007“Relations between syntactic encoding and co-speech gestures: Implications for a model of speech and gesture production”Language and Cognitive Processes221212–1236
31.
KleinsmithABianchi-BerthouzeN, 2007“Recognizing affective dimensions from body posture”, Second International Conference on Affective Computing and Intelligent Interaction (ACII 2007)Lecture Notes in Computer Science. Volume 4738 Eds PaivaAPradaRPicardR W (Heidelberg: Springer-Verlag) pp 48–58
32.
McNeillD, 2005Gesture and Thought (Chicago, IL: University of Chicago Press)
33.
MontepareJKoffEZaitchikDAlbertM, 1999“The use of body movements and gestures as cues to emotions in younger and older adults”Journal of Nonverbal Behavior23133–152
34.
OsgoodC E, 1966“Dimensionality of the semantic space for communication via facial expressions”Scandinavian Journal of Psychology71–30
35.
OsgoodC EMayW HMironM S, 1975Cross-cultural Universals of Affective Meaning (Urbana, IL: University of Illinois Press)
36.
PeelenM VAtkinsonA PAnderssonFVuilleumierP, 2007“Emotional modulation of body-selective visual areas”Social Cognitive and Affective Neuroscience2274–283
37.
PollickF EPatersonH MBruderlinASanfordA J, 2001“Perceiving affect from arm movement”Cognition82B51–B61
38.
ReillyJ SMcIntireM LSeagoH, 1992“Affective prosody in American Sign Language”Sign Language Studies75113–128
39.
RiskindJ H, 1984“They stoop to conquer: Guiding and self-regulatory functions of physical posture after success and failure”Journal of Personality and Social Psychology47479–493
40.
RoetherC LOmlorLChristensenAGieseM A, 2009“Critical features for the perception of emotion from gait”Journal of Vision9(6): 15, 1–32
41.
RosenthalR, 2005“Conducting judgment studies: Some methodological issues”, in The New Handbook of Methods in Nonverbal Behavior Research Eds HarriganJ ARosenthalRSchererK R (New York: Oxford University Press) pp 199–234
42.
RussellJ ABachorowskiJ AFernández-DolsJ, 2003“Facial and vocal expressions of emotion”Annual Review of Psychology54329–349
43.
RussellJ ABarrettL F, 1999“Core affect, prototypical emotional episodes, and other things called emotion: Dissecting the elephant”Journal of Personality and Social Psychology76805–819
44.
RussellJ AMehrabianA, 1977“Evidence for a three-factor theory of emotions”Journal of Research in Personality11273–294
45.
SawadaMSudaKIshiiM, 2003“Expression of emotions in dance: Relation between arm movement characteristics and emotion”Perceptual & Motor Skills97697–708
46.
SchererK R, 2001“Appraisal considered as a process of multilevel sequential checking”, in Appraisal Processes in Emotion: Theory, Methods, Research Series in Affective Science, Eds SchererK RSchorrAJohnstoneT (New York: Oxford University Press) pp 92–120
47.
SchererK R, 2005“What are emotions? And how can they be measured?”Social Science Information44695–729
48.
SchererK R, 2009“The dynamic architecture of emotion: Evidence for the component process model”Cognition and Emotion231307–1351
49.
SchererK RBänzigerT, 2010“On the use of actor portrayals in research on emotional expression”, in Blueprint for Affective Computing: A Sourcebook Eds SchererK RBänzigerTRoeschE B (Oxford: Oxford University Press) pp 166–176
50.
SchererK REllgringH, 2007“Multimodal expression of emotion: Affect programs or componential appraisal patterns?”Emotion7158–171
51.
SchererK RJohnstoneTKlasmeyerG, 2003“Vocal expression of emotion”, in Handbook of Affective Sciences Eds DavidsonR JSchererK RGoldsmithH H (New York: Oxford University Press) pp 433–456
52.
SchindlerKVan GoolLde GelderB, 2008“Recognizing emotions expressed by body pose: A biologically inspired neural model”Neural Networks211238–1246
53.
SmithC AEllsworthP C, 1985“Patterns of cognitive appraisal in emotion”Journal of Personality and Social Psychology48813–838
54.
StepperSStrackF, 1993“Proprioceptive determinants of emotional and non emotional feelings”Journal of Personality and Social Psychology64211–220
55.
TracyJ LRobinsR W, 2004“Show your pride: Evidence for a discrete emotion expression”Psychological Science15194–197
56.
TracyJ LRobinsR W, 2007“The prototypical pride expression: Development of a nonverbal behavior coding system”Emotion7789–801
57.
TukeyJ W, 1977Exploratory Data Analysis (Reading, MA: Addison-Wesley)
58.
Van den StockJRighartRde GelderB, 2007“Body expressions influence recognition of emotions in the face and voice”Emotion7487–494
59.
WallbottH G, 1985“Hand movement quality: A neglected aspect of nonverbal behavior in clinical judgment and person perception”Journal of Clinical Psychology41345–359
60.
WallbottH G, 1998“Bodily expression of emotion”European Journal of Social Psychology28879–896
61.
WallbottH GSchererK R, 1986“Cues and channels of emotion recognition”Journal of Personality and Social Psychology51690–699
62.
WundtW, 1897Outlines of Psychology translated by JuddC H (Leipzig: Wilhelm Englemann)
