Individual speechreading abilities have been linked with a range of cognitive and language-processing factors. The role of specifically visual abilities in relation to the processing of visible speech is less studied. Here we report that the detection of coherent visible motion in random-dot kinematogram displays is related to speechreading skill in deaf, but not in hearing, speechreaders. A control task requiring the detection of visual form showed no such relationship. Additionally, people born deaf were better speechreaders than hearing people on a new test of silent speechreading.
Get full access to this article
View all access options for this article.
References
1.
ArmstrongB ANevilleH JHillyardS AMitchellT V, 2002“Auditory deprivation affects processing of motion, but not color”Brain Research, Cognitive Brain Research14422–434
2.
AtkinsonJBraddickOAnkerSCurranWAndrewRWattam-BellJBraddickF, 2003“Neurobiological models of visuospatial cognition in children with Williams' syndrome: measures of dorsal-stream and frontal function”Developmental Neuropsychology23139–172
3.
AtkinsonJKingJBraddickONokesLAnkerSBraddickF, 1997“A specific deficit of dorsal stream function in Williams' syndrome”NeuroReport81919–1922
4.
AuerEBernsteinL E, 1997“Speechreading and the structure of the lexicon: modeling the effects of reduced phonetic distinctiveness on lexical uniqueness”Journal of the Acoustical Society of America1023704–3710
5.
BavelierDBrozinskyCTomannAMitchellTNevilleHLiuG, 2001“Impact of early deafness and early exposure to sign language on the cerebral organization for motion processing”Journal of Neuroscience218931–8942
6.
BavelierDNevilleH J, 2002“Cross-modal plasticity: where and how?”Nature Reviews Neuroscience3443–452
7.
BavelierDTomannAHuttonCMitchellTCorinaDLiuGNevilleH, 2000“Visual attention to the periphery is enhanced in congenitally deaf individuals”Journal of Neuroscience20RC93
8.
BernsteinL EDemorestM ETuckerP E, 2000“Speech perception without hearing”Perception & Psychophysics62233–252
9.
BishopD V, 1983“Comprehension of English syntax by profoundly deaf children”Journal of Child Psychology and Psychiatry24415–434
10.
BraddickOAtkinsonJWattam-BellJ, 2003“Normal and anomalous development of visual motion processing: motion coherence and ‘dorsal-stream vulnerability”’Neuropsychologia411769–1784
11.
CalvertGCampbellR, 2003“Reading speech from still and moving faces: the neural substrates of seen speech”Journal of Cognitive Neuroscience1557–70
12.
CampbellR, 1992“The neuropsychology of lipreading”Philosophical Transactions of the Royal Society of London, Series B33539–44
13.
CampbellRZihlJMassaroD WMunhallKCohenM M, 1997“Speechreading in the akinetopsic patient”Brain1211794–1803
14.
CathiardM-ATiberghienG, 1994“Le visage de la parole: une cohérence bimodale temporelle ou configurationnelle?”Psychologie Française39357–374
15.
ConlonESandersMZapartS, 2004“Temporal processing in poor adult readers”Neuropsychologia42142–157
16.
EllisTMacSweeneyMCampbellR, 2001“TAS, a new test of adult speechreading: Deaf people really can be better speechreaders”Proceedings of the International Conference on Auditory-Visual Speech Processing (AVSP2001), Scheelesmunde, Denmark (Santa Barbara, CA: University of California) pp 13–17, see http://mambo.ucsc.edu/avsp2001/frame13.html
17.
ElphickR, 1996“Issues in comparing the speechreading abilities of hearing-impaired and hearing 15 to 16 year-old pupils”British Journal of Educational Psychology66357–365
18.
FinneyE MClementzB AHickokGDobkinsK R, 2003“Visual stimuli activate auditory cortex in deaf subjects: evidence from MEG”NeuroReport141425–1427
19.
GeffnerD SFreemanL R, 1980“Assessment of language comprehension of 6-year-old deaf children”Journal of Communication Disorders13455–470
20.
HansenP CSteinJ FOrdeS RWinterJ LTalcottJ B, 2001“Are dyslexics' visual deficits limited to measures of dorsal stream function?”NeuroReport121527–1530
21.
HietenanJ KManninenPSamsMSurakkaV, 2001“Does audiovisual speech perception use information about facial configuration?”European Journal of Cognitive Psychology13395–407
22.
JacksonP L, 1988“The theoretical minimal unit for visual speech perception: visemes and coarticu-lation”, in New Reflections on Speechreading Eds DeFillipoCSimsD (Washington, DC: A G Bell Association for the Deaf) pp 99–105
23.
JeffersJBarleyM, 1971Speechreading (Lipreading) (Springfield, IL: C C Thomas)
24.
KaernbachC, 1991“Simple adaptive testing with the weighted up-down method”Perception & Psychophysics49227–229
25.
KricosP BLesnerS A, 1982“Differences in visual intelligibility across talkers”The Volta Review84219–225
26.
LidestamBLyxellBAnderssonG, 1999“Speech-reading: cognitive predictors and displayed emotion”Scandinavian Audiology28211–217
27.
McCulloughSEmmoreyK E, 1997“Face processing by deaf ASL signers: evidence for expertise in distinguishing local features”Journal of Deaf Studies and Deaf Education2212–222
28.
MacEachernM R, 2000“On the visual distinctiveness of English words in the lexicon”Journal of Phonetics28367–376
29.
McGurkHMacDonaldJ, 1976“Hearing lips and seeing voices”Nature264746–748
30.
MacSweeneyMCampbellRWollBGiampetroVBrammerMMcGuirePDavidA, 2004, “Dissociating linguistic and non-linguistic gestural communication in the brain”NeuroImage221605–1618
31.
MeadR ALapidusL B, 1989“Psychological differentiation, arousal and lipreading efficiency in hearing impaired and normal children”Journal of Clinical Psychology45851–859
32.
MilneESwetternhamJHansenPCampbellRJefferiesHPlaistedK, 2002“High motion coherence thresholds in autism”Journal of Child Psychology and Psychiatry43255–263
33.
MogfordK, 1987“Lip-reading in the prelingually deaf”, in Hearing by Eye: The Psychology of Lipreading Eds DoddBCampbellR (Hillsdale, NJ: Lawrence Erlbaum Associates) pp 191–211
34.
MohammedTMacSweeneyMCampbellR, 2003“Developing the TAS: Individual differences in silent speechreading, reading and phonological awareness in deaf and hearing speechreaders”Proceedings of the Meeting on Auditory – Visual Speech Processing (AVSP2003), St Joriot, France (ISCA) pp 49–54 see http://www.isca-speech.org/archive/avsp03
35.
NakamuraMKaneokeYWatanabeKKakigiR, 2002“Visual information process in Williams syndrome: intact motion detection accompanied by typical visuospatial dysfunctions”European Journal of Neuroscience161810–1818
36.
NevilleH JLawsonD, 1987“Attention to central and peripheral visual space in a movement detection task: an event-related potential and behavioral study. II. Congenitally deaf adults. III. Separate effects of auditory deprivation and acquisition of a visual language”Brain Research405268–283, 284–294
37.
O'BrienJSpencerJAtkinsonJBraddickOWattam-BellJ, 2002“Form and motion coherence processing in dyspraxia: evidence of a global spatial processing deficit”NeuroReport131399–1402
38.
RettenbachRDillerGSireteanuR, 1999“Do deaf people see better? Texture segmentation and visual search compensate in adult but not in juvenile subjects”Journal of Cognitive Neuroscience11560–583
39.
RosenblumL D, in press “The primacy of multimodal speech perception”, in The Handbook of Speech Perception Eds PisoniDRemezR (Malden, MA: Blackwell)
40.
RosenblumL DJohnsonJ ASaldañaH M, 1996“Point-light facial displays enhance comprehension of speech in noise”Journal of Speech and Hearing Research391159–1170
41.
SamarV JSimsD G, 1984“Visual evoked-response components related to speechreading and spatial skills in hearing and hearing-impaired adults”Journal of Speech and Hearing Research27167–172
42.
ShapiroSWilkM B, 1965“An analysis of variance test for normality (complete samples)”Biometrika52591–611
43.
ShepherdD CDelavergneR WFruehF XClobridgeC, 1977“Visual-neural correlate of speech-reading ability in normal-hearing adults”Journal of Speech and Hearing Research20752–765
44.
SolanH AHansenP CShelley-TremblayJFicarraA, 2003“Coherent motion threshold measures for M-cell deficit differ for above- and below-average readers”Optometry74727–734
45.
SpencerJO'BrienJRiggsKBraddickOAtkinsonJWattam-BellJ, 2000“Motion processing in autism: evidence for a dorsal stream deficiency”NeuroReport112765–2767
46.
StrangeWJenkinsJ JJohnsonT L, 1983“Dynamic specification of coarticulated vowels”Journal of the Acoustical Society of America74695–705
47.
SumbyW HPollackI, 1954“Visual contribution to speech intelligibility in noise”Journal of the Acoustical Society of America26212–215
48.
SummerfieldA Q, 1979“The use of visual information in phonetic perception”Phonetica36314–331
49.
SummerfieldA Q, 1987“Some preliminaries to a comprehensive account of audiovisual speech perception”, in Hearing by Eye Eds DoddBCampbellR (London: Lawrence Erlbaum Associates) pp 53–83
WatsonC SQiuW WChamberlainM MLiX, 1996“Auditory and visual speech perception: confirmation of a modality-independent source of individual differences in speech recognition”Journal of the Acoustical Society of America1001153–1162
52.
YakelD A, 2000Effects of Timevarying Information on Vowel Identification Accuracy in Visual Speech Perception Doctoral dissertation, University of California at Riverside, Riverside, USA
53.
YehiaHRubinPVatikiotis-BatesonE, 1998“Quantitative association of vocal-tract and facial behavior”Speech Communication2623–43
