Three fallacies about generalization are that so-called basic research is more generalizable than applied research, that general findings are immediately useful for design purposes, and that the use of taxonomies increases the generalizability of human factors studies. Some factors that limit generalizability are the use of unrepresentative subjects, insufficient training subjects receive before measurements are begun, inadequate sampling of tasks and situations, inappropriate selection of dependent variables, long-term changes in the world of work, and artifacts attributable to the measurement process itself In designing a study to predict behavior in a specific application, the guiding principle is similarity. The study should be as similar as possible to the real situation. Two principles should be followed to design studies whose findings can be extrapolated to a wide range of situations: (1) design heterogeneity into the studies and (2) replicate earlier studies with variations in subjects, variables, or procedures.
Get full access to this article
View all access options for this article.
References
1.
Anastasi, A. (1979). Fields of applied psychology (2nd ed.). New York: McGraw-Hill.
2.
Aronson, E., and Carlsmith, J. M. (1968). Experimentation in social psychology. In G. Lindzey and E. Aronson (Eds.), The handbook of social psychology. Vol. 2: Research methods (2nd ed., pp. 1-79). Reading, MA: Addison-Wesley.
3.
Brunswik, E. (1956). Systematic and representative design of psychological experiments. Berkeley: University of California Press.
4.
Bryan, W. L., and Harter, N. (1897). Studies in the physiology and psychology of the telegraphic language. Psychological Review, 4, 27-53.
5.
Bryan, W. L., and Harter, N. (1899). Studies on the telegraphic language: The acquisition of a hierarchy of habits. Psychological Review, 6, 345-375.
6.
Campbell, D. T., and Stanley, J. C. (1963). Experimental and quasi-experimental designs for research. Chicago: Rand McNally.
7.
Chapanis, A. (1967). The relevance of laboratory studies to practical situations. Ergonomics, 10, 557-577.
8.
Chapanis, A. (1971). The search for relevance in applied research. In W. T. Singleton, J. G. Fox, and D. Whitfield (Eds.), Measurement of man at work (pp. 1-14). London: Taylor and Francis.
9.
Chapanis, A., Garner, W. R., and Morgan, C. T. (1949). Applied experimental psychology: Human factors in engineering design. New York: Wiley.
10.
Cook, T. D., and Campbell, D. T. (1979). Quasi-experimentation: Design and analysis issues for field settings. Chicago: Rand McNally.
11.
Ergonomics Group, Health and Environment Laboratories, Eastman Kodak Company. (1986). Ergonomic design for people at work (Vol. 2). New York: Van Nostrand Reinhold.
12.
Fitts, P. M., and Jones, R. E. (1961). Analysis of factors contributing to 460 “pilot-error” experiences in operating aircraft controls. In H. W. Sinaiko (Ed.), Selected papers on human factors in the design and use of control systems (pp. 332-358). New York: Dover.
13.
Fleishman, E. A., and Quaintance, M. K. (1984). Taxonomies of human performance. New York: Academic Press.
14.
Foxx, R. M., McMorrow, M. J., and Mennemeier, M. (1984). Teaching social/vocational skills to retarded adults with a modified table game: An analysis of generalization. Journal of Applied Behavior Analysis, 17, 343-352.
15.
Fromkin, H. L., and Streufert, S. (1976). Laboratory experimentation. In M. D. Dunnette (Ed.), Handbook of industrial and organizational psychology (pp. 415-465). Chicago: Rand McNally.
16.
Gambrill, E. D. (1977). Behavior modification: Handbook of assessment, intervention and analysis. San Francisco: Jossey-Bass.
17.
Haring, T. G. (1985). Teaching between-class generalization of toy play behavior to handicapped children. Journal of Applied Behavior Analysis, 18, 127-139.
18.
Koelega, H. S., and Brinkman, J-A. (1986). Noise and vigilance: An evaluation review. Human Factors, 28, 465-481.
19.
Kogel, R. L., Glahn, T. J., and Nieminen, G. S. (1978). Generalization of parent-training results. Journal of Applied Behavior Analysis, 11, 95-109.
20.
Ledgard, H., Singer, A., and Whiteside, J. (1981). Directions in human factors for interactive systems. New York: Springer-Verlag.
21.
Lindsay, A. D. (Ed.). (1911). A treatise on human nature by David Hume (Vol. 1). London: J. M. Dent.
22.
Lutz, M. C., and Chapanis, A. (1955). Expected locations of digits and letters on ten-button keysets. Journal of Applied Psychology, 39, 314-317.
23.
Martin, G., and Pear, J. (1978). Behavior modification: What it is and how to do it. Englewood Cliffs, NJ: Prentice-Hall.
24.
Meister, D. (1985). Behavioral analysis and measurement methods. New York: Wiley.
25.
National Aeronautics and Space Administration. (1987). Man-system integration standards, Vol. 1, (NASA-STD 3000). Washington, DC: Author.
26.
National Commission on Excellence in Education. (1983). A nation at risk: The imperative for educational reform. Washington, DC: U.S. Department of Education.
27.
Odom, S. L., Hoyson, M., Jamieson, B., and Strain, P. S. (1985). Increasing handicapped preschoolers' peer social interactions: Cross-setting and component analysis. Journal of Applied Behavior Analysis, 18, 3-16.
28.
Parsonson, G. S., and Baer, D. M. (1978). Training generalized improvisation of tools by preschool children. Journal of Applied Behavior Analysis, 11, 363-380.
29.
Roethlisberger, F. J., and Dickson, W. J. (1939). Management and the worker. Cambridge, MA: Harvard University Press.
30.
Schneider, W. (1985). Training high-performance skills: Fallacies and guidelines. Human Factors, 27, 285-300.
31.
Shepard, R. N. (1987). Toward a universal law of generalization for psychological science. Science, 237, 1317-1323.
32.
Simon, C. W. (1973). Economical multifactor designs for human factors engineering experiments (Tech. Report P73-326A). Culver City, CA: Hughes Aircraft Company.
33.
Simon, C. W. (1977). Design, analysis and interpretation of screening designs for human factors engineering experiments (Tech. Report CWS-03-77). Westlake Village, CA: Canyon Research Group.
34.
Simon, C. W. (1987). Will egg-sucking ever become a science?Human Factors Society Bulletin, 30(6), 1-4.
35.
Smith, L. L. (1987). Whyfore human factors?Human Factors Society Bulletin, 30(2), 6-7.
36.
Sprague, J. R., and Horner, R. H. (1984). The effects of single instance, multiple instance and general class training on generalized vending machine use by moderately and severely handicapped students. Journal of Applied Behavior Analysis, 17, 273-278.
37.
Webb, E. J., Campbell, D. T., Schwartz, R. D., and Sechrest, L. (1966). Unobtrusive. measures: Nonreactive research in the social sciences. Chicago: Rand McNally.
38.
Wierwille, W. W., Rahimi, M., and Casali, J. G. (1985). Evaluation of 16 measures of mental workload using a simulated flight task emphasizing mediational activity. Human Factors, 27, 489-502.
