Leniency Effects on Convergent and Discriminant Validity for Grouped Questionnaire Items: A Further Investigation

Abstract

Two previous investigations revealed that grouping (rather than randomizing) questionnaire items measuring similar constructs (in subsections) resulted in impaired discriminant validity (Schrie-sheim and DeNisi, 1980) and that grouping also strengthened the impact of leniency response bias (Schriesheim, 1981). This study reanalyzed the data of the two earlier investigations to determine whether the impairment of the discriminant validity of the grouped questionnaire items might be due to spurious correlations attributable to leniency. The responses of thirty discount store employees to a questionnaire containing grouped items measuring leniency in leader behavior descriptions (Schriesheim, 1980) and four similar constructs from the Leader Behavior Description Questionnaire (Stogdill, 1963) and Four-Factor Theory Questionnaire (Taylor and Bowers, 1972) were examined for convergent and discriminant validity by using a traditional zero-order multitrait-multimethod correlation matrix analysis (Campbell and Fiske, 1959) and by statistically controlling the effect of spurious correlation attributable to leniency (by computing a first-order partial multitrait-multimethod correlation matrix, controlling for leniency as measured by the leniency scale). It was found that controlling for leniency resulted in a slight decrement in convergent validity, but that discriminant validity was substantially improved. Implications for questionnaire validity and further research are discussed.

Get full access to this article

View all access options for this article.

References

Anastasi

Psychological testing (4th ed.). New York: Macmillan. 1976.

Campbell

D. T.

Fiske

D. W.

Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 1959, 56, 81–105.

McNemar

Psychological statistics (4th ed.). New York: Wiley. 1969.

Schriesheim

C. A.

Development and validation of a scale to measure leniency in descriptions of others. Unpublished manuscript, Department of Organizational Behavior, Graduate School of Business Administration, University of Southern California, 1980.

Schriesheim

C. A.

The effect of grouping or randomizing items on leniency response bias. Educational and Psychological Measurement , 1981, 41, 401–411.

Schriesheim

C. A.

DeNisi

A. S.

Item presentation as an influence on questionnaire validity: A field experiment. Educational and Psychological Measurement , 1980, 40, 175–182.

Stogdill

R. M.

Manual for the leader behavior description questionnaire—Form XII. Columbus: Bureau of Business Research, Ohio State University, 1963.

Taylor

J. C.

Bowers

D. G.

Survey of organizations: A machine-scored, standardized questionnaire instrument. Ann Arbor: Institute for Social Research, University of Michigan, 1972.