Sources of Human Error in Data Entry Tasks Using Speech Input

Abstract

Where speech recognition devices are used for entering data, some form of feedback is usually provided so that recognition errors can be detected and corrected. The present experiments were designed to investigate how the accuracy of data entry is influenced by the type of feedback used and by the structure of the error correction dialogue. Experiment 1 compared the effects of visual and spoken feedback delivered either after each item or at the end of the data string. With visual feedback, most failures to achieve correct data entry occurred when subjects failed to detect recognition errors. Spoken feedback was much more closely monitored, but with word-by-word feedback, subjects had difficulty in recovering from mis-recognitions in the error correction dialogue. Experiment 2 was designed to examine possible interactions between presentation and feedback modalities when data strings were entered from memory. Although there was some evidence of an interaction, the effects were small in relation to the much greater disruption of memory caused by correction of recognition errors in midentry. The implications of these findings for the design of feedback and error correction dialogues are discussed.

Get full access to this article

View all access options for this article.

References

Ainsworth, W. A. (1988). Optimization of string length for spoken digit input with error correction. International Journal of Man-Machine Studies, 28, 573–581.

Arnold, B. , and Roe, R. (1987). User errors in human-computer interaction. In M. Frese , E. Ulich , and W. Dzida (Eds.), Psychological issues of human-computer interaction in the work place (pp. 203–220). Amsterdam: Elsevier.

Chan, C. F. , Ramesh, P. , and Holen, R. (1984). Design considerations in the selection of an automatic speech recognition system for the quality control inspection function. In Proceedings of the IEEE Global Telecommunications Conference (GLOBECOM), Communication in the Information Age (Vol. 1, pp. 273–276). New York: IEEE.

Colquhoun, W. P. (1961). The effect of unwanted signals on performance on a vigilance task. Ergonomics, 4, 41–51.

Crowder, R. G. , and Morton, J. (1969). Precategorical acoustic storage (PAS). Perception and Psychophysics, 5, 365–373.

Doddington, G. R. , and Schalk, T. B. (1981). Speech recognition: Turning theory to practice. IEEE Spectrum, 18(9), 26–32.

Frankish, C. (1987). Voice input applications and human factors criteria. In Proceedings of International Speech Tech 1987, Voice I/O Applications Show and Conference (pp. 133–136). New York: Media Dimensions.

Gaines, B. R. , and Shaw, M. L. G. (1983). Dialogue engineering. In M. E. Sime and M. J. Coombs (Eds.), Designing for human-computer communication (pp. 23–53). London: Academic.

Klemmer, E. T. (1971). Keyboard entry. Applied Ergonomics, 2(1), 2–6.

10.

Leiser, R. G. , de Alberdi, M. , and Carr, D. J. (1987). Generic issues in dialogue design for speech input/output. In J. Laver and M. A. Jack (Eds.), European Conference on Speech Technology, 1987 (Vol. 2, pp. 69–72). Edinburgh: CEP Consultants.

11.

Lewis, C. , and Norman, D. A. (1986). Designing for error. In D. A. Norman and S. W. Draper (Eds.), User-centered system design (pp. 411–432). Hillsdale, NJ: Erlbaum.

12.

Lind, A. J. (1986). Voice recognition—An alternative to keypad. In Proceedings of Speech Tech 1986, Voice I/O Applications Show and Conference (pp. 66–67). New York: Media Dimensions.

13.

Martin, T. B. , and Welch, J. R. (1980). Practical speech recognizers and some performance effectiveness parameters. In W. A. Lea (Ed.), Trends in speech recognition (pp. 24–38). Englewood Cliffs, NJ: Prentice-Hall.

14.

McCauley, M. E. (1984). Human factors in voice technology. In F. A. Muckler (Ed.), Human factors review (pp. 131–166). Santa Monica, CA: Human Factors Society.

15.

Pallett, D. S. (1985). Performance assessment of automatic speech recognizers. Journal of Research of the National Bureau of Standards, 90(5), 1–17.

16.

Penney, C. G. (1975). Modality effects in short-term verbal memory. Psychological Bulletin, 82, 68–84.

17.

Pierce, J. (1986). A voice recognition application: Burlington Industries Fabric Inspection System. Speech Technology, 3(2), 64–66.

18.

Rabbitt, P. M. A. (1968). Three kinds of error-signalling responses in a serial choice task. Quarterly Journal of Experimental Psychology, 20, 179–188.

19.

Rehsoft, C. (1984). Voice recognition at the Ford warehouse in Cologne. In J. N. Holmes (Ed.), Proceedings of the 1st International Conference on Speech Technology (pp. 103–112). Bedford, England: Kempston.

20.

Schurick, J. M. , Williges, B. H. , and Maynard, J. F. (1985). User feedback requirements with automatic speech recognition. Ergonomics, 28, 1543–1555.

21.

Talbot, M. (1987). The myth of speech technology. In J. A. Waterworth (Ed.), Speech and language-based interaction with machines (pp. 45–65). Chichester, England: Ellis Horwood Ltd.

22.

Waterworth, J. A. (1987). Towards conversational systems. In J. A. Waterworth (Ed.), Speech and language-based interaction with machines (pp. 120–140). Chichester, England: Ellis Horwood Ltd.

23.

Wickens, C. D. , Sandry, D. L. , and Vidulich, M. (1983). Compatibility and resource competition between modalities of input, central processing, and output. Human Factors, 25, 227–248.