Potential Biases in Leadership Measures: How Prototypes,Leniency,and General Satisfaction Relate to Ratings and Rankings of Transformational and Transactional Leadership Constructs

Abstract

Eighty-seven respondents completed either a graphic rating or a forced ranking questionnaire describing their immediate superior. Five leadership scales were embedded in each questionnaire. Three represented transformational leadership constructs (charismatic leadership, individualized consideration, and intellectual stimulation); two reflected transactional leadership constructs (contingent reward and management-by-exception). Appended to each questionnaire were five additional scales. The items constituting these scales measured two outcomes-satisfaction with the leader and effectiveness of the leader. The remaining scales measured each participant's leadership prototype, the participant's tendency to be lenient in his/her ratings, and a general measure of satisfaction. As expected, the intercorrelations among the factor scores representing the transformational and transactional leadership constructs were reduced substantially by using the forced rankings as compared with the graphic ratings. Also, the magnitude of the relationships among leadership and outcome factor scores was reduced, on average, when using the forced rankings. Prototypicality factor scores were more highly correlated with factor scores reflecting transformational than were factor scores portraying transactional leadership. The tendency of participants to be more or less lenient in their ratings or rankings and their general level of satisfaction were of little or no consequence to the intercorrelations among the leadership and outcome factor scales.

Get full access to this article

View all access options for this article.

References

Avolio, B. J. and Bass, B. M. (1988). Transformational leadership, charisma, and beyond. In J. G. Hunt , B. R. Baliga , H. P. Dachler , and C. A. Schriesheim (Eds.), Emerging Leadership Vistas, (pp. 29-50). Lexington, Mass: Lexington Books.

Anderson, N. H. (1961). Scales and statistics: Parametric and nonparametric. Psychological Bulletin, 58, 305-316.

Bass, B. M. (1985). Leadership and performance beyond expectations. New York: Free Press.

Bass, B. M. and Avolio, B. J. (1989). Manual for the Multifactor Leadership Questionnaire. Palo Alto, CA: Consulting Psychologists Press.

Bass, B. M. , Avolio, B. J. , and Goodheim, L. (1987). Biography and the assessment of transformational leadership at the world-class level. Journal of Management, 13, 5-17.

Bass, B. M. , Avolio, B. J. , and Yammarino, F. J. (1988). A strategy for evaluating single source bias. Paper presented at the Third Annual Meeting of the Society for Industrial and Organizational Psychology, Dallas.

Bass, B. M. , Cascio, W. F. , and O'Connor, E. J. (1974). Magnitude estimations of expressions of frequency and amount. Journal of Applied Psychology, 51, 313-320.

Bass, B. M. , Valenzi, E. R. , Farrow, D. L. , and Solomon, R. J. (1975). Management styles associated with organizational, task, personal, and interpersonal contingencies. Journal of Applied Psychology, 60, 720-729.

Boneau, C. A. (1961). A note on measurement scales and statistical tests. American Psychologist, 16, 160-161.

10.

Burns, J. M. (1978). Leadership. New York: Harper & Row.

11.

Feldman, J. M. (1981). Beyond attribution theory: Cognitive processes in performance appraisal. Journal of Applied Psychology, 66, 127-148.

12.

Gioia, D. A. and Sims, H. P., Jr. (1985). On avoiding the influence of implicit leadership theories in leader behavior description questionnaires. EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 45, 217-232.

13.

Glick, W. H. , Jenkins, G. D. , and Gupta, N. (1986). Method vs. substance: How strong are underlying relationships between job characteristics and attitudinal outcomes? Academy of Management Journal, 29, 441-464.

14.

Hater, J. J. and Bass, B. M. (1988). Supervisors' evaluations and subordinates' perceptions of transformational and transactional leadership. Journal of Applied Psychology, 73, 695-702.

15.

Lord, F. M. (1953). On statistical treatment of football numbers. American Psychologist, 8, 750-751.

16.

Lord, R. G. , Binning, J. F. , Rush, M. C. , and Thomas, J. C. (1978). The effects of performance cues and leader behavior on questionnaire ratings of leadership. Organizational Behavior and Human Performance, 21, 27-39.

17.

Lord, R. G. , Foti, R. J. , and DeVader, C. L. (1984). A test of leadership categorization theory: Internal structure, information processing, and leadership perceptions. Organizational Behavior and Human Performance, 34, 343-378.

18.

Nathan, B. R. and Alexander, R. A. (1985). The role of inferential accuracy in performance rating. Academy of Management Review, 10, 109-115.

19.

Rush, M. C. , Thomas, J. C. , and Lord, R. G. (1977). Implicit leadership theory: A potential threat to the internal validity of leader behavior questionnaires. Organizational Behavior and Human Performance, 20, 93-110.

20.

Salancik, G. R. and Pfeffer, J. (1977). A social information processing approach to job attitudes and task design. Administrative Science Quarterly, 22, 427-456.

21.

Schriesheim, C. A. , Kinicki, A. J. , and Schriesheim, J. F. (1979). The effect of leniency on leader behavior descriptions. Organizational Behavior and Human Performance, 23, 1-29.

22.

Spangler, W. D. (1988). Single source bias in the job diagnostic survey. Unpublished manuscript.

23.

Waldman, D. A. , Bass, B. M. , and Einstein, W. O. (1985). Effort, performance and transformational leadership in industrial and military settings. (Working Paper 85-80). School of Management, SUNY-Binghamton.