Meta-analytic techniques were used to explore overall conclusions and variables moderating treatment effects in the research literature on school desegregation and black achievement. Studies were classified on the basis of the threats to their validity as either accepted or rejected for the analysis. For the initial analysis quasi-experimental studies were accepted, yielding an average effect size of .45. The better-designed studies had an average effect size of .34, which was reduced to .16 when adjusted for pretest differences. The National Institute of Education (NIE) convened an expert panel that reviewed and reanalyzed these results. An average pretest-adjusted effect size of .14 was found for the 19 studies selected for analysis by the NIE panel. An average effect size of .20 was found for the better-designed studies that had no selection problems. This is equivalent to two months of educational gain. The largest effects occurred among students moving from highly segregated to predominantly white schools. Reading achievement gains were larger than those for mathematics, but the difference was not statistically significant.
Get full access to this article
View all access options for this article.
References
1.
ARONSON, E.
and D. BRIDGEMAN (1979) “Jigsaw groups and the desegregated classrooms: in pursuit of common goals.”Personality and Social Psychology Bull.54: 438-446.
2.
BLOOM, B. S.
(1976) Human Characteristics and School Learning. New York: McGraw-Hill.
3.
BORUCH, R. F.
and H. GOMEZ (1977) “Sensitivity, bias, and theory in impact evaluations.”Professional Psychology8: 411-434.
4.
BRADLEY, L. A.
and G. W. BRADLEY (1977) “The academic achievement of black students in desegregated schools: a critical review.”Rev. of Educ. Research47: 399-449.
5.
BRYANT, F. B.
and P. M. WORTMAN (forthcoming) “Methodological issues in the meta-analysis of quasi-experiments.”New Directions for Program Evaluation.
6.
BRYANT, F. B.
and P. M. WORTMAN(1978) “Secondary analysis: the case for data archives.”Amer. Psychologist13: 381-387.
7.
CAMPBELL, D. T.
and A. E. ERLEBACHER (1970) “How regression artifacts in quasi-experimental evaluations can mistakenly make compensatory education look harmful,” pp. 185-210 in J. Hellmuth (ed.) Compensatory Education: A National Debate. Volume 3, Disadvantaged Child. New York: Brunner/Mazel.
8.
CAMPBELL, D. T.
and J. C. STANLEY (1966) Experimental and Quasi-Experimental Designs for Research. Chicago: Rand McNally.
9.
COHEN, J.
(1969) Statistical Power for the Behavioral Sciences. New York: Academic Press.
10.
COLEMAN, J. S.
, E. Q. CAMPBELL, C. J. HOBSON, J. McPARTLAND, A. M. MOOD, F. D. WEINFELD, and R. L. YORK (1966) Equality of Educational Opportunity. Washington, DC: Government Printing Office.
11.
COOK, T. D.
(1983) Critical Examination of Meta-Analyses of School Desegregation and the Academic Achievement Gains of Black Children.” (Report to National Institute of Education.) Evanston, IL: Northwestern University.
12.
COOK, T. D.
and D. T. CAMPBELL (1979) Quasi-Experimentation: Design and Analysis Issues for Field Settings. Boston: Houghton Mifflin.
13.
COOPER, H. M.
(1982) “Scientific guidelines for conducting integrative research reviews.”Rev. of Educ. Research52: 291-302.
14.
CRAIN, R. L.
(1983) Is Nineteen Really Better Than Ninety-Three? (Technical Report). Washington, DC: National Institute of Education.
15.
CRAIN, R. L.
and R. E. MAHARD (1982) Desegregation Plans That Raise Black Achievement: A Review of the Research (N-1844-NIE). Santa Monica, CA: Rand Corporation.
16.
CRAIN, R. L.
and R. E. MAHARD(1978) “Desegregation and Black achievement: a review of the research.”Law and Contemporary Problems42: 17-56.
17.
CRONBACH, L. J.
, S. R. AMBRON, S. M. DORNBUSCH, R. D. HESS, R. C. HORNIK, and Associates (1980) Toward Reform of Program Evaluation. San Francisco: Jossey-Bass.
18.
DIRECTOR, S. M.
(1979) “Underadjustment bias in the evaluation of manpower training.”Evaluation Q.3: 190-218.
19.
EYSENCK, H. J.
(1978) “An exercise in mega-silliness.”Amer. Psychologist33: 517.
20.
GEHAN, E. A.
and E. J. FREIREICH (1974) “Non-randomized controls in cancer clinical trials.”New England J. of Medicine290: 198-203.
21.
GILBERT, J. P.
, B. McPEEK, and F. MOSTELLER (1977) “Progress in surgery and anesthesia: benefits and risks of innovative therapy,” in J. P. Bunkeret al. (eds.) Costs, Risks, and Benefits of Surgery. New York: Oxford Univ. Press.
22.
GLASS, G. V
(1978) “Reply to Mansfield and Busse.”Educ. Research7: 3.
23.
GLASS, G. V
(1977) “Integrating findings: the meta-analysis of research,” in L. S. Shulman (ed.) Review of Research in Education. Volume 5. Itasca, IL: Peacock.
24.
GLASS, G. V
(1976) “Primary, secondary and meta-analyses of research.”Educ. Researcher5: 3-8.
25.
GLASS, G. VB. McGAW
, and M. L. SMITH (1981) Meta-Analysis in Social Research. Beverly Hills, CA: Sage.
26.
GLASS, G. VB. McGAW
, M. L. SMITHand M. L. SMITH (1981) “Meta-analysis of research on class size and achievement.”Educ. Evaluation and Policy Analysis1: 2-16.
27.
GRANT, G.
(1975) “Shaping social policy: the politics of the Coleman Report.”Teachers College Record75: 17-54.
28.
HEDGES, L. V.
(1982) “Estimation of effect size from a series of independent experiments.”Psych. Bull.92: 490-499.
29.
IWANICKI, E. F.
and R. K. GABLE (1978) “A quasi-experimental evaluation of the effects of a voluntary urban/suburban busing program on student achievement.” Presented at the Annual Meeting of the American Educational Research Association, Toronto, March.
30.
JACKSON, G. B.
(1980) “Methods for integrative reviews.”Rev. of Educ. Research50: 438-460.
31.
KLUGER, R.
(1975) Simple Justice. New York: Random House.
32.
KROL, R. A. (1979) “A meta analysis of comparative research on the effects of desegregation on academic achievement.” Ph.D. dissertation, University of Michigan—Ann Arbor (University Microfilms 7907962).
33.
LANDMAN, J. T.
and R. M. DAWES (1982) “Psychotherapy outcome: Smith and Glass' conclusions stand up under scrutiny.”Amer. Psychologist37: 504-516.
34.
LIGHT, R. J.
, and P. V. SMITH (1971) “Accumulating evidence: procedures for resolving contradictions among different research studies.”Harvard Educ. Rev.41: 429-471.
35.
LINSENMEIER, J.A.W.
and P. M. WORTMAN (1978) “The Riverside School Study of desegregation: a re-examination.”Research Rev. of Equal Education2: 1-40.
36.
MANSFIELD, R. S.
and T. V. BUSSE (1979) “Meta-analysis of research: a rejoinder to Glass.”Educ. Research6: 3.
37.
MOSKOWITZ, J. M.
and P. M. WORTMAN (1981) “A secondary analysis of the Riverside School Study of Desegregation,” in R. F. Boruchet al. (eds.) Reanalyzing Program Evaluations. San Francisco: Jossey-Bass.
38.
PERRY, S.
and J. T. KALBERER (1980) “The NIH consensus development program and the assessment of health-care technologies: the first two years.”New England J. of Medicine303: 169-172.
39.
RENTSCH, G. J. (1967) “Open-enrollment: an appraisal.” Ph.D. dissertation, State University of New York, Buffalo.
40.
ROCK, W. C.et al.
(1968) A Report on a Cooperative Program Between a City School District and a Suburban School District. Rochester, NY.
41.
ROSENTHAL, R.
(1978) “Combining results of independent studies.”Psych. Bull.85: 185-193.
42.
SACKS, H.
, T. C. CHALMERS, and H. SMITH (1982) “Randomized versus historical controls for clinical trials.”Amer. J. of Medicine72: 233-240.
43.
SAMUELS, J. M. (1971) “A comparison of projects representative of compensatory busing; and non-compensatory programs for inner-city students.” Ph.D. dissertation, University of Connecticut.
44.
SECHREST, L.
and W. YEATON (1981) “Empirical bases for estimating effect size,” in R. F. Boruchet al. (eds.) Reanalyzing Program Evaluations. San Francisco: Jossey-Bass.
45.
SHEEHAN, D. S.
(1979) “Black achievement in a desegregated school district.”J. of Social Psychology107: 185-192.
46.
SLAVIN, R. E.
and N. A. MADDEN (1979) “School practices that improve race relations.”Amer. Educ. Research J.16: 169-180.
47.
SMITH, M. L.
and G. V. GLASS (1977) “Meta-analysis of psychotherapy outcome studies.”Amer. Psychologist32: 752-760.
48.
SMITH, M. L.G. V. GLASS
and T. I. MILLER (1980) The Benefits of Psychotherapy. Baltimore, MD: Johns Hopkins Univ. Press.
49.
SNEDECOR, G. W.
and W. G. COCHRAN (1967) Statistical Methods. Ames: Iowa State Univ. Press.
50.
STAINES, G. L.
(1974) “The strategic combination argument,” in W. Leinfellner and E. Kohler (eds.) Developments in the Methodology of Social Science. Dordecht, Holland: Reidel.
51.
STEPHAN, W. G.
(1982) Blacks and Brown: The Effects of School Desegregation on Black Students. (Technical report). Washington, DC: National Institute of Education.
52.
ST. JOHN, N. H.
(1975) School Desegregation Outcomes for Children. New York: John Wiley.
53.
TEELE, J. E.
(1973) Evaluating School Busing: A Case Study of Boston's Operation Exodus. New York: Praeger.
54.
WALBERG, H. J.
(1971) “An evaluation of an urban-suburban school bussing program: Student achievement and perception of class learning environments.” Presented at the annual meeting of the American Educational Research Association, New York.
55.
WALBERG, H. J.
(1983) “Desegregation and educational productivity.” (Technical Report). Washington, DC: National Institute of Education.
56.
WEINBERG, M.
(1977) Minority Students: A Research Appraisal. Washington, DC: U.S. DHEW, National Institute of Education.
57.
WORTMAN, P. M.
(1983) “Evaluation research: a methodological perspective.”Annual Rev. of Psychology34: 223-260.
58.
WORTMAN, P. M.
(1981) “Randomized clinical trials,” in P. M. Wortman (ed.) Methods for Revaluating Health Services. Beverly Hills, CA: Sage.
59.
WORTMAN, P. M.C. KING
, and F. B. BRYANT (1982) “Meta-analysis of quasi-experiments: school desegregation and black achievement. Part I—Retrieval and coding.”Ann Arbor, MI: Institute for Social Research.
60.
ZDEP, S. M.
(1971) “Educating disadvantaged urban children in suburban schools: an evaluation.”J. of Applied Social Psychology1. (ERIC number ED 053 186 TM 00716).
