Objective: A pair of experiments investigated the hypothesis that bimodal (auditory-visual) speech presentation and expanded auditory bandwidth would improve speech intelligibility and increase working memory performance for older adults by reducing the cognitive effort needed for speech perception.
Background: Although telephone communication is important for helping older adults maintain social engagement, age-related sensory and working memory limits may make telephone conversations difficult.
Method: Older adults with either age-normal hearing or mild-to-moderate sensorineural hearing loss performed a running memory task. Participants heard word strings of unpredictable length and at the end of each string were required to repeat back the final three words. Words were presented monaurally in telephone bandwidth (300 Hz to 3300 Hz) or expanded bandwidth (50 Hz to 7500 Hz), in quiet (65 dBZ SPL), or in white noise (65 dBZ SPL with noise at 60 dBZ SPL), with or without a visual display of the talker.
Results: In quiet listening conditions, bimodal presentation increased the number of words correctly reported per trial but only for listeners with hearing loss and with high lipreading proficiency. Stimulus bandwidth did not affect performance. In noise, bimodal presentation and expanded bandwidth improved performance for all participant groups but did so by improving speech intelligibility, not by improving working memory.
Conclusion: Expanded bandwidth and bimodal presentation can improve speech perceptibility in difficult listening conditions but may not always improve working memory performance.
Application: Results can inform the design of telephone features to improve ease of communication for older adults.
Adams, P.F., & Benson, V. ( 1992). Current estimates from the National Health Interview survey, 1991. Vital and Health Statistics Series10, 184, 1-232.
2.
Arnold, P., & Hill, F. ( 2001). Bisensory augmentation: A speech reading advantage when speech is clearly audible and intact. British Journal of Psychology , 92, 339-355.
3.
Baddeley, A. ( 2007). Working memory, thought, and action. Oxford, England: Oxford University Press.
4.
Bernstein, L.E., Auer, E., Jr., & Takayanagi, S. (2004). Auditory speech detection in noise enhanced by lipreading. Speech Communication, 44, 5-18.
5.
Boersma, P., & Weenink, D. ( 2006). Praat: Doing phonetics by computer (Version 4.4.13) [Computer program]. Retrieved from http://www.praat.org/
6.
Carey, M.B., Chen, H.T., Descloux, A., Ingle, I.F., & Park, M.I. ( 1984). End office connection study: Analog voice and voiceband data transmission performance characterization of the public switched network . AT&T Bell Labs Technical Journal, 63, 2059-2119.
7.
Cienkowski, K.M., & Carney A.E. ( 2002). Auditory-visual speech perception and aging. Ear and Hearing, 23, 439-449.
8.
CHABA Working Group on Speech Understanding and Aging. ( 1988). Speech understanding and aging. Journal of the Acoustical Society of America, 83, 859-895.
9.
Cohen, G. ( 1979). Language comprehension in old age. Cognitive Psychology, 11, 412-429.
10.
Cohen, G. ( 1981). Inferential reasoning in old age. Cognition , 9, 59-72.
11.
Engle, R.W. ( 2002). Working memory capacity as executive attention. Current Directions in Psychological Science, 11, 19-23.
12.
Erber, N.P. ( 1969). Interaction of audition and vision in the recognition of oral speech stimuli. Journal of Speech and Hearing Research , 12, 423-425.
13.
Folstein, M.K., Folstein, S.E., & McHugh, P.H. (1975). Mini-Mental State: A practical method for gathering the cognitive state of patients for the clinician. Journal of Psychiatric Research, 12, 189-198.
14.
French, N.R., & Steinberg, J.C. (1947). Factors governing the intelligibility of speech sounds. Journal of the Acoustical Society of America , 19, 90.
15.
Fu, Q.J., & Galvin, J.J. ( 2006). Recognition of simulated telephone speech by cochlear implant users. American Journal of Audiology, 15, 127-132.
16.
Gates, G.A., Cooper, J.C., Kannel, W.B., & Miller, N.J. ( 1990). Hearing in the elderly: The Framingham cohort 1983-1985. PartI. Basic audiometric test results. Ear and Hearing, 11, 247-256.
17.
Gelfand, S.A. ( 2004). Hearing: An introduction to psychological and physiological acoustics. New York, NY: Marcel Dekker.
18.
Gilhooly, J.K., & Logie, R.H. ( 1980). Age-of-acquisition, imagery, concreteness, familiarity, and ambiguity measures for 1,944 words. Behavior Research Methods and Instrumentation, 12, 395-427.
19.
Gordon-Salant, S., & Fitzgibbons, P.J. (1997). Selected cognitive factors and speech recognition performance among young and elderly listeners. Journal of Speech, Language and Hearing Research, 40, 423-431.
20.
Grant, K.W., & Seitz, P. ( 2000). The use of visible speech cues for improving auditory detection of spoken sentences. Journal of the Acoustical Society of America, 108, 1197-1208.
21.
Hallberg, L.R. ( 1999). Hearing impairment, coping and consequences on family life. Journal of the Academy of Rehabilitative Audiology, 32, 45-59.
22.
Ickes, W.K. ( 1980). Viseme weighting systems and lipreading: A comparative reappraisal. Journal of the Academy of Rehabilitative Audiology , 13, 4-15.
23.
Jordan, T., McCotter, M., & Thomas, S. ( 2000). Visual and audiovisual speech perception with color and gray-scale facial images. Perception and Psychophysics, 62, 1394-1404.
24.
Kučera, H., & Francis, W.N. ( 1967). Computational analysis of present-day American English . Providence, RI: Brown University Press.
25.
Kurniawan, S. ( 2008). Older people and mobile phones: A multi-method investigation . International Journal of Human-Computer Studies, 66, 889-901.
26.
Lidestam, B., Danielsson, H., & Lönnborg, T. (2006). Mobile phone video as an aid to speech understanding for persons with hearing impairment. Technology and Disability, 18, 99-105.
27.
Light, L.L., & Anderson, P.A. (1985). Working-memory capacity, age and memory for discourse. Journal of Gerontology, 40, 1414-1419.
28.
Light, L.L., Zelinski, E.M., & Moore, M. ( 1982). Adult age differences in reasoning from new information. Journal of Experimental Psychology: Learning, Memory and Cognition , 8, 435-477.
29.
Lindenberger, U., & Baltes, P.B. ( 1994). Sensory functioning and intelligence in old age: A strong connection. Psychology and Aging, 9, 339-355.
30.
Loftus, G.R., & Masson, M.E.J. (1994). Using confidence intervals in within-subjects designs. Psychonomic Bulletin and Review , 1, 476-490.
Macleod, A., & Summerfield, Q. (1987). Quantifying the contribution of vision to speech perception in noise. British Journal of Audiology, 21, 131-141.
33.
Macleod, A., & Summerfield, Q. (1990). A procedure for measuring auditory and audio-visual speech-reception thresholds for sentences in noise: rationale, evaluation, and recommendations for use. British Journal of Audiology, 24, 29-43.
34.
McCoy, S.L., Tun, P.A., Cox, L.C., Colangelo, M., Stewart, R.A., & Wingfield, A. ( 2005). Hearing loss and perceptual effort: Downstream effects on older adults’ memory for speech. Quarterly Journal of Experimental Psychology, 58A, 22-33.
35.
Mikkonen, M., Väyrynen, S., Ikonen, V., & Heikkilä, M.O. (2002). User and concept studies as tools in developing mobile communication devices for the elderly. Personal and Ubiquitous Computing, 6, 113-124.
36.
Pichora-Fuller, M.K., Schneider, B.A., & Daneman, M. ( 1995). How young and old adults listen to and remember speech in noise. Journal of the Acoustical Society of America, 97, 593-608.
37.
Pollack, I., Johnson, L.B., & Knaff, P.R. ( 1959). Running memory span. Journal of Experimental Psychology, 57, 137-146.
38.
Pulakka, H., Laaksonen, L., Vainio, M., Pohjalainen, J., & Alku, A. ( 2008). Evaluation of artificial speech bandwidth extension method in three languages. IEEE Transactions on Audio, Speech, and Language Processing, 16, 1124-1137.
39.
Rabbitt, P.M.A. ( 1968). Channel capacity, intelligibility, and immediate memory . Quarterly Journal of Experimental Psychology, 20, 241-248.
40.
Rabbitt, P.M.A. ( 1991). Mild hearing loss can cause apparent memory failures which increase with age and reduce with IQ. Acta Otolaryngologica Supplementum, 476, 167-176.
41.
Reisberg, D., McLean, J., & Goldfield, A. ( 1987). Easy to hear but hard to understand: A speechreading advantage with intact auditory stimuli. In B. Dodd & R. Campbell (Eds.), Hearing by eye: The psychology of lipreading (pp. 97-113). London , England: Erlbaum.
42.
Rodman, J. ( 2003). The effect of bandwidth on speech intelligibility. Pleasanton, CA: Polycom.
43.
Rosenblum, L., & Saldaña, H. (1998). Time-varying information for visual speech perception. Hearing by eye II: Advances in the psychology of speechreading and auditory-visual speech (pp. 61-81). Hove , England: Psychology Press.
44.
Ross, L.A., Saint-Amour, D., Leavitt, V.A., Javitt, D.C., & Foxe, J.J. ( 2007). Do you see what I’m saying? Exploring visual enhancement of speech comprehension in noisy environments. Cerebral Cortex , 17, 1147-1153.
45.
Rudmann, D.S., McCarley, J.S., & Kramer, A.F. ( 2003). Bimodal displays improve Speech comprehension in environments with multiple speakers. Human Factors, 45, 329-336.
46.
Salthouse, T.A. ( 1996). The processing-speed theory of adult age differences in cognition. Psychological Review, 103, 403-428.
47.
Scialfa, C.T. ( 2002). The role of sensory factors in cognitive aging research . Canadian Journal of Experimental Psychology, 56, 153-163.
48.
Spilich, G.A. ( 1983). Life-span components of text processing: Structural and procedural differences. Journal of Verbal Learning and Verbal Behavior, 22, 231-244.
49.
Stach, B.A., Hornsby, B.W.Y., Rosenfeld, M.A.L., & DeChicchis, A.R. (2009). The complexity of auditory aging. Seminars in Hearing, 30, 94-110.
50.
Sumby, W.H., & Pollack, I. ( 1954). Visual contribution of speech intelligibility in noise . Journal of the Acoustical Society of America, 26, 212-215.
51.
Toglia, M.P., & Battig, W.F. ( 1978). Handbook of semantic word norms. Oxford, England: Erlbaum.
52.
Turner, M.L., & Engle, R.W. ( 1989). Is working memory capacity task dependent? Journal of Memory and Language, 28, 127-154.
53.
Tye-Murray, N., Sommers, M.S., & Spehar, B. ( 2007). Audiovisual integration and lipreading abilities of older adults with normal and impaired hearing. Ear and Hearing, 28, 656-668.
54.
Utley, J. ( 1946). A test of lipreading ability. Journal of Speech and Hearing Disorders, 11, 109-116.
55.
Weinstein, B. ( 2000). Aging of the outer, middle and inner ear and neural pathways . In B. Weinstein (Ed.), Geriatric audiology (pp. 55-80). New York, NY: Thieme Medical.
56.
Willot, J.F. ( 1991). Aging and the auditory system. San Diego, CA: Singular.
