This article is designed to provide psychologists who publish articles in Personality and Social Psychology Bulletin (PSPB) with a set of basic issues to consider when reporting their analyses and results. We first assessed the current reporting practices of social and personality psychologists by conducting an analysis of PSPB articles published in the first half of 2007. We evaluated the completeness of these reports with respect to the level of detail in both the Method and Results sections. We then used this information to develop recommendations that we hope will enhance the reporting of quantitative research in social and personality psychology. These suggestions emphasize ways to increase transparency in research reports. Transparency facilitates replication and a critical evaluation of research, thereby promoting scientific progress.
Adair, J.G., & Vohra, N. (2003). The explosion of knowledge, references, and citations: Psychology's unique response to a crisis. American Psychologist , 58, 15-23.
2.
Aiken, L.S., West, S.G. (1991). Multiple regression: Testing and interpreting interactions. Newbury Park, CA: Sage.
3.
American Psychological Association. (2001). Publication manual of the American Psychological Association (5th ed.). Washington, DC: American Psychological Association.
4.
Anderson, J.C., & Gerbing, D.W. (1988). Structural equation modeling in practice: A review and recommended two-step approach. Psychological Bulletin , 103, 411-423.
5.
Baron, R.M., & Kenny, D.A. (1986). The moderator-mediator variable distinction in social psychological research: Conceptual, strategic, and statistical considerations . Journal of Personality and Social Psychology, 51, 1173-1182.
6.
Barrett, P. (2007). Structural equation modeling: Adjudging model fit. Personality and Individual Differences, 42, 815-824.
7.
Cliff, N. (1988). The eigenvalues-greater-than-one rule and the reliability of components. Psychological Bulletin, 103, 276-279.
8.
Cohen, J., Cohen, P., West, S.G., & Aiken, L.S. (2003). Applied multiple regression/correlation analysis for the behavioral sciences (3rd ed.). Hillsdale, NJ: Lawrence Erlbaum.
9.
Courville, T., & Thompson, B. (2001). Use of structure coefficients in published multiple regression articles: β is not enough. Educational and Psychological Measurement, 61, 229-248.
10.
Cumming, G., Fidler, F., Leonard, M., Kalinowski, P., Christiansen, A., Kleinig, A., et al. (2007). Statistical reform in psychology: Is anything changing? Psychological Science, 18, 230-232.
11.
Cumming, G., & Finch, S. (2005). Inference by eye: Confidence intervals and how to read pictures of data. American Psychologist, 60, 170-180.
12.
Dearing, E., & Hamilton, L.C. (2006). Contemporary advances and classic advice for analyzing mediating and moderating variables. Monographs of the Society for Research in Child Development, 71(3), 88-104.
13.
Edwards, J.R., & Lambert, L.S. (2007). Methods for integrating moderation and mediation: A general analytic framework using moderated path analysis. Psychological Methods, 12, 1-22.
14.
Embretson, S.E., & Reise, S.P. (2000). Item response theory for psychologists. Mahwah, NJ: Lawrence Erlbaum.
15.
Enders, C.K., & Tofighi, D. (2007). Centering predictor variables in cross-sectional multilevel models: A new look at an old issue. Psychological Methods, 12, 121-138.
16.
Fabrigar, L.R., Wegener, D.T., MacCallum, R.C., & Strahan, E.J. (1999). Evaluating the use of exploratory factor analysis in psychological research. Psychological Methods, 4, 272-299.
17.
Fraley, R.C., & Marks, M.J. (2007). The null hypothesis significance testing debate and implications for personality research. In R. Robins, R. C Fraley, & R. F. Krueger (Eds.), Handbook of research methods in personality (pp. 149-169). New York: Guilford.
18.
Freese, J. (2007). Replication standards for quantitative social science: Why not sociology? Sociological Methods & Research , 36, 153-172.
19.
Harris, R.J. (1997). Significance tests have their place. Psychological Science, 8, 8-11.
20.
Hoyle, R.H., & Duvall, J.L. (2004). Determining the number of factors in exploratory and confirmatory factor analysis. In D. Kaplan (Ed.), Handbook of quantitative methodology for the social sciences (pp. 301-315). Thousand Oaks, CA: Sage.
21.
Hu, L., & Bentler, P.M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1-55.
22.
Judd, C.M., & Kenny, D.A. (1981). Process analysis: Estimating mediation in treatment evaluations. Evaluation Review, 5, 602-619.
23.
Kline, R.B. (2004). Beyond significance testing: Reforming data analysis methods in behavioral research. Washington, DC: American Psychological Association.
24.
Kreft, I.G.G., de Leeuw, J., & Aiken, L.S. (1995). The effect of different forms of centering in hierarchical linear models. Multilevel Behavioral Research , 30, 1-21.
25.
Little, T.D., Cunningham, W.A., Shahar, G., & Widaman, K.F. (2002). To parcel or not to parcel: Exploring the question, weighing the merits. Structural Equation Modeling, 9, 151-173.
26.
Lynam, D.R., Hoyle, R.H., & Newman, J.P. (2006). The perils of partialling: Cautionary tales from aggression and psychopathy. Assessment, 13, 328-341.
MacCallum, R.C., Wegener, D.T., Unchino, B.N., & Fabrigar, L.R. (1993). The problem of equivalent models in applications of covariance structure analysis. Psychological Bulletin, 114, 185-199.
29.
MacCallum, R.C., Zhang, S., Preacher, K.J., & Rucker, D.D. (2002). On the practice of dichotomization of quantitative variables. Psychological Methods, 7, 19-40.
30.
MacKinnon, D.P. (2008). An introduction to statistical mediation analysis . Mahwah, NJ: Erlbaum.
31.
MacKinnon, D.P., Fairchild, A.J., & Fritz, M. (2007). Mediation analysis. Annual Review of Psychology, 58, 593-614.
32.
MacKinnon, D.P., Lockwood, C.M., Hoffman, J.M., West, S.G., & Sheets, V. (2002). A comparison of methods to test mediation and other intervening variable effects. Psychological Methods , 7, 83-104.
33.
Marsh, H.W., Hau, K., & Wen, Z. (2004). In search of golden rules: Comment on hypothesis-testing approaches to setting cut-off values for fit indexes and dangers in overgeneralizing Hu and Bentler's (1999) findings. Structural Equation Modeling , 11, 320-341.
34.
Maxwell, S.E., & Delaney, H.D. (1993). Bivariate median splits and spurious statistical significance. Psychological Bulletin, 113, 181-190.
35.
McDonald, R.P., & Ho, M.H. R. (2002). Principles and practice in reporting structural equation analyses. Psychological Methods, 7, 64-82.
36.
McKnight, P.E., McKnight, K.M., Sidani, S., & Figueredo, A.J. (2007). Missing data: A gentle introduction. New York: Guilford .
37.
Muller, D., Judd, C.M., & Yzerbyt, V.Y. (2005). When moderation is mediated and mediation is moderated . Journal of Personality and Social Psychology, 89, 852-863.
38.
Noftle, E.E., & Shaver, P.R. (2006). Attachment dimensions and the Big Five personality traits: Associations and comparative ability to predict relationship quality . Journal of Research in Personality, 40, 179-208.
39.
O'Connor, B.P. (2000). SPSS and SAS programs for determining the number of components using parallel analysis and Velicer's MAP test. Behavior Research Methods, Instruments, & Computers, 32, 396-402.
40.
Preacher, K.J., & Hayes, A.F. (2004). SPSS and SAS procedures for estimating indirect effects in simple mediation models. Behavior Research Methods, Instruments, & Computers, 36, 717-731.
41.
Preacher, K.J., & Hayes, A.F. (2007). Contemporary approaches to assessing mediation in communication research. In A. F. Hayes , M. D. Slater, & L. B. Snyder (Eds.), The Sage sourcebook of advanced data analysis methods for communication research. Thousand Oaks, CA: Sage.
42.
Preacher, K.J., Rucker, D.D., MacCallum, R.C., & Nicewander, W.A. (2005). Use of the extreme groups approach: A critical reexamination and new recommendations. Psychological Methods, 10, 178-192.
43.
Raudenbush, S.W., Bryk, A., Cheong, Y.F., & Congdon, R. (2004). HLM6: Hierarchical linear and nonlinear modeling . Chicago: Scientific Software International .
44.
Reis, H.T. & Stiller, J. (1992). Publication trends in JPSP: A three-decade review . Personality and Social Psychology Bulletin, 18, 465-472.
45.
Rosenthal, R., & Rosnow, R.L. (2008). Essentials of behavioral research: Methods and data analysis (3rd ed.). New York: McGraw-Hill.
46.
Russell, D.W. (2002). In search of underlying dimensions: The use (and abuse) of factor analysis in Personality and Social Psychology Bulletin. Personality and Social Psychology Bulletin, 28, 1629-1646.
47.
Schafer, J.L. & Graham, J.W. (2002). Missing data: Our view of the state of the art . Psychological Methods, 7, 147-177.
48.
Sherman, R.C., Buddie, A.M., Dragan, K.L., End, C.M., & Finney, L.J. (1999). Twenty years of PSPB: Trends in content, design & analysis. Personality and Social Psychology Bulletin , 25, 177-187.
49.
Shrout, P.E., & Bolger, N. (2002). Mediation in experimental and nonexperimental studies: New procedures and recommendations. Psychological Methods, 7, 422-445.
50.
Sinharay, S., Stern, H.S., & Russell, D.W. (2001). The use of multiple imputation for the analysis of missing data. Psychological Methods, 6, 317-329.
51.
Spencer, S.J., Zanna, M.P., & Fong, G.T. (2005). Establishing a causal chain: Why experiments are often more effective in examining psychological process than mediational analyses . Journal of Personality and Social Psychology, 89, 845-851.
52.
Steiger, J. (1990). Structural model evaluation and modification: An interval estimation approach. Multivariate Behavioral Research , 25, 173-180.
53.
Tabachnick, B.G., & Fidell, L.S. (2001). Computer-assisted research design and analysis . Boston: Allyn & Bacon.
54.
Vandenberg, R.J., & Lance, C.E. (2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3, 4-69.
55.
West, S.G., Aiken, L.S., Wu, W., & Taylor, A.B. (2007). Multiple regression: Applications of the basics and beyond in personality research. In R. Robins, R. C. Fraley, & R. F. Krueger (Eds.), Handbook of research methods in personality (pp. 149-169). New York: Guilford.
56.
West, S. G., Newsom, J. T., & Fenaughty, A. M. (1992). Publication trends in JPSP: Stability and change in the topics, methods, and theories across two decades. Personality and Social Psychology Bulletin, 18, 473-484.
57.
Wicherts, J.M., Borsboom, D., Kats, J., & Molenaar, D. (2006). The poor availability of psychological research data for reanalysis. American Psychologist, 61, 726-728.
58.
Widaman, K.F. (2007). Common factors versus components: Principals and principles, errors and misconceptions. In R. Cudeck & R. C. MacCallum (Eds.), Factor analysis at 100: Historical developments and future directions (pp. 177-203). Mahwah, NJ: Erlbaum .
59.
Wilkinson, L., & Task Force onStatistical Inference. (1999). Statistical methods in psychology journals: Guidelines and explanations. American Psychologist , 54, 594-604.
