Can face actions that carry significance within language be perceived categorically? We used continua produced by computational morphing of face-action images to explore this question in a controlled fashion. In Experiment 1 we showed that question-type—a syntactic distinction in British Sign Language (BSL)—can be perceived categorically, but only when it is also identified as a question marker. A few hearing non-signers were sensitive to this distinction; among those who used sign, late sign learners were no less sensitive than early sign users. A very similar facial-display continuum between “surprise” and “puzzlement” was perceived categorically by deaf and hearing participants, irrespective of their sign experience (Experiment 2).
The categorical processing of facial displays can be demonstrated for sign, but may be grounded in universally perceived distinctions between communicative face actions. Moreover, the categorical perception of facial actions is not confined to the six universal facial expressions.
Get full access to this article
View all access options for this article.
References
1.
BakerC.PaddenC. (1978). Focussing on the nonmanual components of ASL.Understanding language through sign language research.SipleP.New York: Academic Press.
2.
Baron-CohenS. (1995). Mindblindness: an essay on autism and theory of mindCambridge, MA: MIT Press.
3.
BealeJ. M.KeilF. C. (1995). Categorical effects in the perception of faces.Cognition57, 217–239.
4.
BellugiU.FisherS. (1972). A comparison of sign language and spoken language: Rate and grammatical mechanisms.Cognition1, 173–200.
5.
BellugiU.O'GradyL.Lillo-MartinD.O'GradyM.HynesM.van HoekK.CorinaD. (1990). Enhancement of spatial cognition in deaf children.From gesture to language in hearing and deaf children.VotterraV.ErtingC. J.Berlin: Springer Verlag278–303.
6.
BellugiU.PoiznerH.KlimaE. S. (1989). Language, modality and the brain.TINS10, 380–388.
7.
BellugiU.PoiznerH.KlimaE. S. (1993). Language, modality and the brain.Brain development and cognition.JohnsonM.Cambridge, MA: Blackwell.
8.
BensonP. J. (1994). Morph transformation of the facial image.Image and Vision Computing12, 691–696.
9.
BensonP. J. (1996). Perspectives on face perception: Directing research by exploiting emergent prototypes.Cognitive and computational aspects efface recognition.ValentineT.London: Routledge204–224.
10.
BensonP. J.PerrettD. J. (1991). Synthesising continuous tone caricatures.Images and Vision Computing9, 123–129.
11.
BettgerJ.EmmoreyK.McCulloughS. H.BellugiU. (1997). Enhanced facial discrimination: Effects of experience with American Sign language.Journal of Deaf Studies and Deaf Education2.
12.
BrothersL. (1994). Neurophysiology of the perception of intentions by primates.The cognitive neurosciences.GazzanigaM.Cambridge, MA: MIT Press1107–1115.
13.
BulwerJ. (1648). Philocophus: Or the deafe and dumb man's friendLondon: Humphrey Moseley.
CruttendenA. (1986). IntonationCambridge, UK: Cambridge University Press.
16.
CuttingJ. E.RosnerB. S. (1974). Categories and boundaries in speech and music.Perception and Psychophysics16, 564–570.
17.
DarwinC. (1872). The expression of the emotions in man and animalsChicago: University of Chicago Press reprinted 1965.
18.
De GelderB.TeunisseJ.-P.BensonP. J. (1997). Categorical perception of facial expressions: categories and their internal structure.Cognition and Emotion11, 1–23.
19.
DeucharM. (1984). British Sign LanguageLondon: Routledge.
20.
DeValoisR. L.DeValoisK. K. (1975). Neural coding of color.Handbook of Perception.CarteretteE. C.FriedmanM. P.New York: Academic PressVol. 5.
21.
EkmanP. (1989). The argument and evidence about universale in facial expressions of emotion.The handbook of social psychophysiology.WagnerH.MansteadA.Chichester, UK: Wiley143–164.
22.
EkmanP.FriesenW. V. (1975). Unmasking the faceNJ: Prentice Hall Inc.
23.
EkmanP.SorensenE. R.FriesenW. V. (1969). Pan-cultural elements in facial displays of emotion.Science164, 86–88.
24.
EmmoreyK.The impact of sign language on visuospatial cognition.Psychological perspectives on deafness.MarscharkM.ClarkD.Hillsdale, NJ: Lawrence Erlbaum Associates, Incin press.
25.
EtcoffN. L.MageeJ. J. (1992). Categorical perception of facial expression.Cognition44, 227–240.
26.
FridlundA. J. (1991). Evolution and facial action in reflex, social motive and paralanguage.Biological Psychology32, 3–100.
27.
GarmanM. (1990). PsycholinguisticsCambridge, UK: Cambridge University Press.
28.
GoldsteinN. E.FeldmanR. S. (1996). Knowledge of American Sign Language and the ability of hearing individuals to decode facial expressions of emotion.Journal of Nonverbal Behavior20, 111–122.
29.
HarnadS. (1987). Category induction and representation.Categorical perception: The groundwork of cognition.HarnadS.New York: Cambridge University Press535–565.
30.
JusczykP. W. (1992). Developing phonological categories from the speech signal.Phonological development: Models, Research & Implications.FergusonC. E.MennL.Stoel-GammonC.Parkton, MD: York Press.
31.
KeglJ.PoiznerH. (1996). Crosslinguistic/crossmodal syntactic consequence of left hemisphere damage: Evidence from an aphasie signer and his identical twin.Aphasiology11, 1–37.
32.
KluenderK. R.DiehlR. L.KilleenP. R. (1987). Japanese quail can learn phonetic categories.Science237, 1195–1197.
33.
KuhlP. (1987). Perception of speech and sound in early infancy.Handbook of infant perception.SalapatekP.CohenL.New York: Academic PressVol. 2, 275–382.
34.
KuhlP. K.MillerJ. D. (1978). Speech perception by the chinchilla: Identification functions for synthetic VOT stimuli.Journal of the Acoustic Society of America63, 542–550.
35.
LibermanA. M.CooperF. S.ShankweilerD. P.Studdert-KennedyM. (1967). Perception of the speech code.Psychological Review74, 431–461.
36.
LibermanA. M.HarrisK. S.HoffmanH. S.GriffithB. C. (1957). The discrimination of speech sounds within and across phoneme boundaries.Journal of Experimental Psychology53, 358–368.
37.
LiddellS. (1978). Nonmanual signals and relative clauses in American Sign language.Understanding language through sign language research.SipleP.New York: Academic Press59–90.
38.
MayberryR. I. (1993). 1st language acquisition after childhood differs from 2nd-language acquisition-the case of American sign language.Journal of Speech and Hearing Research36, 1258–1270.
39.
MayberryR. I.EichenE. B. (1991). The longlasting advantage of learning sign language in childhood.Journal of Memory and Language30, 486–512.
40.
McNemarQ. (1962). Psychological statistics, 3rd ed. New York: Wiley.
41.
NewportE. L. (1987). Task specificity in language learning?, Evidence from speech perception and American Sign Language.Language acquisition: The state of the art.WannerE.GleitmanL.Cambridge, MA: Cambridge University Press450–486.
42.
O'TooleA.DeffenbacherK. A.ValentinD.AbdiH. (1994). Structural aspects of face recognition and the other-race effect.Memory and Cognition22, 208–224.
43.
PisoniD. (1977). Identification and discrimination of the relative onset of two component tones: Implications for the perception of voicing in stops.Journal of the Acoustic Society of America61, 1352–1361.
44.
ReillyJ. S.McIntireM. L.BellugiU. (1990). From gesture to language in hearing and deaf children.VolterraV.ErtingC. J.Berlin: Springer Verlag128–145.
45.
ReillyJ. S.McIntireM. L.BellugiU. (1991). Baby face. A new perspective on universale in language acquisition.Theoretical issues in Sign Language Research.SipleP.FischerS. D.Chicago, IL: University of Chicago Press9–23.
46.
RussellJ. (1980). A circumplex model of affect.J. Personality and Social Psychology39, 1161–1178.
47.
UltanR. (1978). Some general characteristics of interrogative systems.Universals of human language. Vol. 4: Syntax.GreenbergJ. H.FergusonC. A.MoravsikE. A.Stanford, CA: Stanford University Press.
48.
Vargha-KhademF. (1983). Visual field asymmetries in congenitally deaf and hearing children.British Journal of Developmental Psychology1, 375–387.
49.
WerkerJ. F.TeesR. C. (1992). The organization and reorganization of human speech perception.Annual Reviews of Neuroscience15, 377–402.
50.
WollB. (1983). The semantics of British Sign Language signs.Language in Sign.KyIeJ.WollB.London: Croom-Helm41–45.
51.
WoodworthR. S.SchlosbergH. (1952). Experimental psychology. rev. ed. New York: Holt.
52.
YoungA. W.RowlandD.CalderA. J.EtcoffN. L.SethA.PerrettD. I. (1997). Facial expression megamix: Tests of dimensional and category accounts of emotion recognition.Cognition63, 271–313.
