Modern Data Analytic Techniques for Multisource Feedback

Abstract

For nearly three decades, the use of multisource ratings of organizational phenomena for developmental feedback to managers has grown. As work on multisource feedback moved from the practitioner to academic realms, scholars have sought to advance theoretical and methodological understanding of multisource ratings. The intent of this feature topic is to develop the use of rigorous analytic methods for the evaluation of the construct validity and psychometric properties of multisource ratings and feedback. In this introductory article, an overview of the four articles and techniques that comprise this feature topic are presented. Common themes and issues of the analytic methods, another technique for the analysis of multisource data, Within and Between Analysis, and directions for future research also are highlighted.

Get full access to this article

View all access options for this article.

References

Atwater, L. E., Ostroff, C., Yammarino, F. J., & Fleenor, J. W. (1998). Self-other agreement: Does it really matter? Personnel Psychology, 51, 577-598.

Atwater, L. E., & Yammarino, F. J. (1992). Does self-other agreement on leadership perceptions moderate the validity of leadership and performance predictions? Personnel Psychology, 45, 141-164.

Atwater, L. E., & Yammarino, F. J. (1997). Self-other rating agreement: A review and model. Research in Personnel and Human Resources Management, 15, 121-174.

Bracken, D. W., Timmreck, C. W., & Church, A. H. (Eds.). (2001). Handbook of multisource feedback. San Francisco: Jossey-Bass.

Dansereau, F., Alutto, J. A., & Yammarino, F. J. (1984). Theory testing in organizational behavior: The varient approach. Englewood Cliffs, NJ: Prentice Hall.

Dansereau, F., & Yammarino, F. J. (Eds.). (1998a). Leadership: The multiple-level approaches (Part A: Classical and new wave). Stamford, CT: JAI Press.

Dansereau, F., & Yammarino, F. J. (Eds.). (1998b). Leadership: The multiple-level approaches (Part B: Contemporary and alternative). Stamford, CT: JAI Press.

Dansereau, F., & Yammarino, F. J. (2000). Within and between analysis: The varient paradigm as an underlying approach to theory building and testing. In K. J. Klein & S. W. J. Kozlowski (Eds.), Multilevel theory, research, and methods in organizations: Foundations, extensions, and new directions (pp. 425-466). San Francisco: Jossey-Bass.

Dansereau, F., & Yammarino, F. J. (Eds.). (2003). Research in multi-level issues: Vol. 2. Multilevel issues in organizational behavior and strategy. Oxford, UK: Elsevier Science.

10.

Edwards, J. R. (1993). Problems with use of profile similarity indices in the study of congruence in organizational research. Personnel Psychology, 46, 641-665.

11.

(Organizational Behavior and Human Decisions Processes erratum, 58, 323-325).

12.

Edwards, J. R. (2002). Alternatives to difference scores: Polynomial regression analysis and response surface methodology. In F. Drasgow & N. Schmitt (Eds.), Measuring and analyzing behavior in organizations (pp. 350-400). San Francisco: Jossey-Bass.

13.

Yammarino, F. J. (1998). Multivariate aspects of the varient/WABA approach: A discussion and leadership illustration. Leadership Quarterly, 9, 203-227.

14.

Yammarino, F. J., & Atwater, L. E. (1997). Do managers see themselves as others see them? Implications of self-other rating agreement for human resource management. Organizational Dynamics, 25(4), 35-44.

15.

Yammarino, F. J., & Dansereau, F. (2002a). Individualized leadership. Journal of Leadership and Organization Studies, 9, 90-99.

16.

Yammarino, F. J., & Dansereau, F. (Eds.). (2002b). Research in multi-level issues: Vol. 1. The many faces of multi-level issues. Oxford, UK: Elsevier Science.

17.

Yammarino, F. J., & Markham, S. E. (1992). On the application of within and between analysis: Are absence and affect really group-based phenomena? Journal of Applied Psychology, 77, 168-176.