Despite content adequacy being essential for valid measurement, a well-delineated quantitative method for its examination only recently has become available. Using this new approach, an empirical comparison of three methods of collecting and two methods of analyzing content adequacy data is presented. It is shown that these different methods yield results that have not only substantial similarities but also some differences. Several recommendations for future use and future research are presented and discussed.
Get full access to this article
View all access options for this article.
References
1.
Anastasi, A.
(1982). Psychological testing (5th ed.). New York: Macmillan.
2.
Bass, B. M.
, Cascio, W. J., & O’Connor, E. J. (1974). Magnitude estimation of expressions of frequency and amount. Journal of Applied Psychology, 34, 313-320.
3.
Cattell, R. B.
(1978). The scientific use of factor analysis in behavioral and life sciences.New York: Plenum.
4.
Cook, J. D.
, Hepworth, S. J., Wall, T. D., & Warr, P. B. (1981). The experience of work: A compendium and review of 249 measures and their use. New York: Academic Press.
5.
Fitzpatrick, A. R.
(1983). The meaning of content validity. Applied Psychological Measurement, 7, 3-13.
6.
Ford, J. K.
, MacCallum, R. C., & Tait, M. (1986). The application of exploratory factor analysis in applied psychology: A critical review and analysis. Personnel Psychology, 39, 291-314.
7.
Fried, Y.
, & Ferris, G. R. (1986). The dimensionality of job characteristics: Some neglected issues. Journal of Applied Psychology, 71, 419-426.
8.
Gorsuch, R. L.
(1983). Factor analysis (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum.
9.
Guilford, J. P.
(1954). Psychometric methods (2nd ed.). New York: McGraw-Hill.
10.
Guion, R. M.
(1997a). Construct validity. In L. H. Peters, C. R. Greer, & S. A. Youngblood (Eds.), The Blackwell encyclopedic dictionary of human resource management (pp. 57-58). Cambridge, MA: Blackwell.
11.
Guion, R. M.
(1997b). Content validity. In L. H. Peters, C. R. Greer, & S. A. Youngblood (Eds.), The Blackwell encyclopedic dictionary of human resource management (pp. 58-59). Cambridge, MA: Blackwell.
12.
Guion, R. M.
, & Schriesheim, C. A. (1997). Validity. In L. H. Peters, C. R. Greer, & S. A. Youngblood (Eds.), The Blackwell encyclopedic dictionary of human resource management (pp. 380-381). Cambridge, MA: Blackwell.
13.
Hicks, L. E.
(1970). Some properties of ipsative, normative, and forced-choice normative measures. Psychological Bulletin, 74, 167-184.
14.
Jackson, D. N.
(1971). The dynamics of structured personality tests. Psychological Review, 78, 229-248.
15.
Jöreskog, K. G.
, & Sörbom, D. (1993). LISREL 8 user’s reference guide. Mooresville, IN: Scientific Software.
16.
Kerlinger, F. N.
(1986). Foundations of behavioral research (3rd ed.). New York: Holt, Rhinehart & Winston.
17.
Locke, E. A.
(1976). The nature and causes of job satisfaction. In M. D. Dunnette (Ed.), Handbook of industrial and organizational psychology (pp. 1297-1349). Chicago: Rand McNally.
18.
Messick, S.
(1989). Validity. In R. Linn (Ed.), Educational measurement (3rd ed., pp. 13-103). Washington, DC: American Council on Education.
19.
Nunnally, J. C.
, & Bernstein, I. H. (1994). Psychometric theory (3rd ed.). New York: McGraw-Hill.
20.
Podsakoff, P. M.
, & Dalton, D. R. (1987). Research methodology in organizational studies. Journal of Management, 13, 419-441.
21.
Rummel, R. J.
(1970). Applied factor analysis. Evanston, IL: Northwestern University Press.
22.
Schriesheim, C. A. (1978). Development, validation, and application of new leadership behavior and expectancy research instruments. Unpublished doctoral dissertation, Ohio State University.
23.
Schriesheim, C. A.
, Powers, K. J., Scandura, T. A., Gardiner, C. C., & Lankau, M. J. (1993). Improving construct measurement in management research: Comments and a quantitative approach for assessing the theoretical content adequacy of paper-and-pencil survey-type instruments. Journal of Management, 19, 385-417.
24.
Schwab, D. P.
(1980). Construct validity in organizational behavior. Research in Organizational Behavior, 2, 3-43.
25.
Snyder, C. W.
, Law, H. G., & Hattie, J. A. (1984). Overview of multimode analytic methods. In H. G. Law, C. W. Snyder, Jr., J. A. Hattie, & R. P. McDonald (Eds.), Research methods for multimode data analysis (pp. 2-35). New York: Praeger.
26.
Stephenson, W.
(1953). The study of behavior: Q-technique and its methodology. Chicago: University of Chicago Press.
27.
Weiss, D. J.
, Dawis, R. V., England, G. W., & Lofquist, L. H. (1967). Manual for the Minnesota Satisfaction Questionnaire. Minneapolis: Industrial Relations Center, University of Minnesota.
