A computer-animated tutor, Baldi, has been successful in teaching vocabulary and grammar to children with autism and those with hearing problems. The present study assessed to what extent the face facilitated this learning process relative to the voice alone. Baldi was implemented in a Language Wizard/Tutor, which allows easy creation and presentation of a vocabulary lesson involving the association of pictures and spoken words. The lesson plan included both the receptive identification of pictures and the production of spoken words. A within-subject design with five children with autism followed an alternating treatment in which each child continuously learned to criterion sets of words with and without the face. The rate of learning was significantly faster and the retention was better with the face. The research indicates that at least some children with autism benefit from the face in learning new language within an automated program.
AMERICAN PSYCHIATRIC ASSOCIATION (1994) Diagnostic and Statistical Manual of Mental Disorders., 4th edn (DSM-IV). Washington, DC: APA .
2.
BAER, D.M. , WOLF, M .M. & RISLEY, T.R. (1968) ‘Some Current Dimensions of Applied Behavior Analysis’ ,Journal of Applied Behavior Analysis1: 91–97 .
3.
BARKER, L .J. (2003) ‘Computer-Assisted Vocabulary Acquisition: The CSLU Vocabulary Tutor in Oral-Deaf Education’ ,Journal of Deaf Studies and Deaf Education8: 187–198 .
4.
BARLOW, D.H. & HAYES, S .C. (1979) ‘Alternating Treatments Design: One Strategy Comparing the Effects of Two Treatments in a Single Subject’ ,Journal of Applied Behavior Analysis12: 199–210 .
5.
BOSSELER, A. & MASSARO, D.W. (2003) ‘Development and Evaluation of a Computer-Animated Tutor for Vocabulary and Language Learning for Children with Autism’ ,Journal of Autism and Developmental Disorders33: 653–672 .
6.
BOUCHER, J. , LEWIS, V. & COLLIS, G. (1998) ‘Familiar Face and Voice Matching and Recognition in Children with Autism’ ,Journal of Child Psychology and Psychiatry39: 171–181 .
7.
BOUCHER, J. , LEWIS, V.A. & COLLIS, G.M. (2000) ‘Voice Processing Abilities in Children with Autism, Children with Specific Language Impairments and Young Typically Developing Children’ ,Journal of Child Psychology and Psychiatry41 (7): 847–857 .
8.
BRYSON, C.Q. (1970) ‘Systematic Identification of Perceptual Disabilities in Autistic Children’ ,Perceptual and Motor Skill31: 239–246 .
9.
CHUN, D.M. & PLASS, J.L. (1996) ‘Effects of Multimedia Annotations on Vocabulary Acquisition’ ,Modern Language Journal80: 183–198 .
10.
DAWSON, G. , CARVER, L. , MELTZOFF, A .N. , PANAGIOTIDES, H. , MCPARTLAND, J. & WEBB, S .J. (2002) ‘Neural Correlates of Face and Object Recognition in Young Children with Autism Spectrum Disorder, Developmental Delay, and Typical Development’ ,Child Development73: 700–717 .
11.
DE GELDER, B. , VROOMAN, J. & VAN DER HEIDE, L. (1996) ‘Face Recognition and Lip-Reading in Autism’ ,European Journal of Cognitive Psychology3: 69–86 .
12.
DUBOIS, M. & VIAL, I. (2000) ‘Multimedia Design: The Effects of Relating Multimodal Information’ ,Journal of Computer Assisted Learning16: 157–165 .
13.
HAPPÉ, F.G.E. (1996) ‘Studying Weak Central Coherence at Low Levels: Children with Autism Do Not Succumb to Visual Illusions. A Research Note’ ,Journal of Child Psychology and Psychiatry37 (7): 873–877 .
14.
HEIMANN, M. , NELSON, K. , TJUS, T. & GILBERG, C. (1995) ‘Increasing Reading and Communication Skills in Children with Autism through an Interactive Multimedia Computer Program’ ,Journal of Autism and Developmental Disorders25: 459–480 .
15.
KUCERA, H. & FRANCIS, W.N. (1967) Computational Analysis of Present-Day American English. Providence, RI: Brown University Press .
16.
LELORD, G. , LAFFONT, F. , JUSSEAUME, P. & STEPHANT, J.L. (1973) ‘Comparative Study of Conditioning of Averaged Evoked Responses by Coupling Sound and Light in Normal and Autistic Children’ ,Psychophysiology10: 415–425 .
17.
MARTINEAU, J. , GARREAU, B. , ROUX, S. & LELORD, G. (1987) ‘Auditory Evoked Responses and Their Modifications during Conditioning Paradigm in Autistic Children’ ,Journal of Autism and Developmental Disorders17: 525–539 .
18.
MASSARO, D.W. (1998) Perceiving Talking Faces: From Speech Perception to a Behavioral Principle.. Cambridge, MA: MIT Press .
19.
MASSARO, D.W. (2004) ‘Symbiotic Value of an Embodied Agent in Language Learning’ , in Proceedings of 37th Annual Hawaii International Conference on System Sciences (CD/ROM), Computer Society Press, 2004, 8-8 pp. (best paper in ‘Emerging Technologies’).
20.
MASSARO, D.W. & BOSSELER, A. (2003) ‘Perceiving Speech by Ear and Eye: Multimodal Integration by Children with Autism’ ,Journal of Developmental and Learning Disorders7: 111–144 .
21.
MASSARO, D.W. & LIGHT, J. (2004) ‘Improving the Vocabulary of Children with Hearing Loss’ ,Volta Review104 (3): 141–174 .
22.
MOORE, M. & CALVERT, S. (2000) ‘Brief Report: Vocabulary Acquisition for Children with Autism: Teacher or Computer Instruction’ ,Journal of Autism and Developmental Disorders30: 359–362 .
23.
ROGERS, S .J. (1999) ‘An Examination of the Imitation Deficit in Autism’, in J. NADEL & G. BUTTERWORTH (eds) Imitation in Infancy., pp. 254–284. Cambridge, MA: Cambridge University Press .
24.
SPARROW, S. , BALLA, D. & CICCHETTI, D. (1984) Vineland Adaptive Behaviour Scales. Windsor: NFER-Nelson .
25.
TAGER-FLUSBERG, H. (1999) ‘A Psychological Approach to Understanding the Social and Language Impairments in Autism’ ,International Review of Psychiatry11: 325–334 .
26.
WALKER-ANDREWS, A .S. , HAVILAND, J.M. , HUFFMAN, L. & TOCI, L. (1994) ‘Brief Report: Preferential Looking in Intermodal Perception by Children with Autism’ ,Journal of Autism and Developmental Disorders24: 99–107 .
27.
WATERHOUSE, L. , FEIN, D. & MODAHL, C. (1996) ‘Neurofunctional Mechanisms in Autism’ ,Psychological Review103: 457–489 .
28.
WECHSLER, D. (1991) Wechsler Intelligence Scale for Children–Third Edition. San Antonio,TX: Psychological Corporation .
29.
WILLIAMS, J.H. , WHITEN, A. , SUDDENDORF, T. & PERRETT, D.I. (2001) ‘Imitation, Mirror Neurons and Autism’ ,Neuroscience and Biobehavior Review25: 287–295 .
