Abstract
This study reports two independent meta-analyses on the relationship between (a) classroom climate and academic achievement; and (b) school climate and academic achievement. The analyses were based on extant correlational research studies at the K-12 level that were published between 2000 and 2020. The relationships were analyzed in terms of various moderator variables. The first dataset included 53 research studies focusing on classroom climate and academic achievement, and the second dataset included 37 research studies on school climate and academic achievement. The meta-analyses were carried out with a random effects model. Fisher's effect size was calculated for each study. Publication bias was tested with Egger's linear regression method and Duval and Tweedie's trim and fill method. We used the Q-test for moderation analyses and I2 test for heterogeneity analyses. The results revealed that the mean effect size for the relationship between classroom climate and academic achievement was small, while it was medium for the relationship between school climate and academic achievement. The effect sizes regarding classroom climate differed significantly only in terms of the academic area moderator variable, and the effect sizes regarding school climate differed in terms of school area, report type, and unit of analysis. This meta-analysis study confirmed that school climate and classroom climate are significant correlates of academic achievement, and the dataset in this study revealed a greater magnitude of relationship in favor of school climate (although a comparison is not meant in this study). This study suggests that policymakers and practitioners should invest their efforts in promoting sound school climates while maintaining an emphasis on classroom climate components, as the two types of climates are intertwined.
Introduction
Learning occurs in classroom, school, family, and social environments. Classroom and school environments are where students spend most of their time. In these environments, planned instructional activities are offered. Research has revealed that school and classroom environments, often referred to as school climate and classroom climate, respectively, influence student learning and are associated with better academic performance (Schweig et al., 2019). Since a positive climate is needed for effective schools, improving school and classroom climates has become an aim of initiatives across the world (Koth et al., 2008). Recently, there is a growing interest in promoting positive K-12 school climates, since this is vital for fostering safer, more supportive and more successful schools (Thapa et al., 2013). In the past two decades, classroom climate has been identified as a significant factor contributing to students’ experiences and outcomes, and efforts have been undertaken to improve classroom climate as a means for improving students’ academic performance, well-being, and school quality (Wang et al., 2020).
Providing effective teaching and learning requires an understanding of complex psychological processes, and researchers are working to identify means of improving students’ academic performance (Maxwell et al., 2017). In particular, classroom climate and school climate are two factors thought to be related to academic achievement because they can influence students’ cognitive, affective, and behavioral development. There is empirical evidence that school climate affects students’ academic achievement (Brand et al., 2008). Schools with positive climates help students perform better academically (Berkowitz et al., 2017). Students’ perceptions of school climate influence their academic performance both directly and indirectly (Wang & Holcombe, 2010). Similarly, classroom climate is related to both cognitive and affective learning outcomes (Charalampous & Kokkinos, 2017), including students’ academic, socio-emotional and behavioral skills (Wang et al., 2020). Therefore, there is a great amount of research on the association between school climate and academic achievement as well as classroom climate and academic achievement. However, the link between these climate types and achievement needs further research (Maxwell et al., 2017).
The literature offers conflicting findings and explanations regarding how school climate is related to academic achievement (Berkowitz et al., 2017). While this literature generally indicates a positive relationship (with more favorable perceptions of school climate being associated with higher academic achievement, Greenway, 2017; Priddy, 2018), there are also studies reporting even negative relationships (Berkowitz et al., 2015; Trinidad, 2020). In the same vein, studies on the relationship between classroom climate and academic achievement have yielded inconsistent results (Wang et al., 2020). Moreover, some studies report relatively weak relationships (Bulotsky-Shearer et al., 2012; Bustamante & Hindman, 2019), with others reporting much stronger ones (Malik & Rizvi, 2018; Yang, 2012). The reasons for these inconsistent findings may stem from the characteristics of individual research studies. Thus, this study offers two separate meta-analyses based on correlational studies in the literature. The first meta-analysis examines the relationship between classroom climate and academic achievement, and the second examines the relationship between school climate and academic achievement at the K-12 level.
In addition to reporting effect sizes for these relationships, we explore moderator variables that may have contributed to mixed results in the literature. Wang et al. (2020) reported that research design, instrument and other methodological differences impact the nature of findings in regard to classroom climate and students’ outcomes. Accordingly, scale type in classroom climate research was used as a moderator, since certain instruments were widely used in the studies. Additionally, research has revealed different relationships between academic achievement and classroom/school climate depending on the area of achievement (Barksdale et al., 2019; Berkowitz et al., 2015; Dulay & Karadag, 2017; Larocque, 2008; Trinidad, 2020). Thus, achievement area (e.g., reading, math) and scale type for measuring achievement were used as moderators. School level (i.e., primary, middle, or high school) and area (i.e., urban or suburban) were selected as moderator variables because research suggests variability in relations between school/classroom climate and academic achievement in accordance with these variables (Daily et al., 2019; Sulak, 2016). Research has also demonstrated that the magnitude of the relationship between school/classroom climate and academic achievement varies greatly across countries with different Human Development Index (HDI) values (Geleta, 2017; Karadağ et al., 2016), suggesting that HDI may be a moderator of interest. Other moderators included in this study were publication year and report type, as several meta-analyses have revealed that results may be impacted by time and the tendency of studies with major significant findings to be published more readily.
Though one study examined the relationship between classroom climate and student outcomes more broadly (Wang et al., 2020), no meta-analyses have analyzed the relationship between classroom climate and academic achievement specifically. The first meta-analysis in this study focuses specifically on this relationship and offers a comprehensive analysis. With regard to school climate and academic achievement, two meta-analysis studies have been published (i.e., Berkowitz et al., 2017; Karadağ et al., 2016); however, these two studies included both school and classroom climate simultaneously. In contrast, the current study analyzed school and classroom climate separately. Specifically, this study aimed to analyze the relationship between academic achievement and classroom climate and the relationship between academic achievement and school climate.
Theoretical framework
Classroom climate and its relationship with academic achievement
Classroom climate refers to perceptions of a classroom's characteristics, or the “personality” of the classroom experienced (López et al., 2018). Despite the significance of classroom climate for shaping teaching and learning, there is not yet consensus on its definition; however, it is widely accepted that classroom climate is a multidimensional concept (Wang et al., 2020). Classroom climate, in broad terms, refers to “the dynamics of classroom interaction, the relationships in the classroom and the nature of the learning environment” (Slee & Skrzypiec, 2016, p. 96). The multidimensionality of classroom climate is reflected in the literature in that different elements or components are highlighted by scholars to define or explain the concept.
Positive classroom climates involve clear rules, high academic expectations, and elements such as respect, emotional safety, cooperation, and caring (Slee & Skrzypiec, 2016). According to Adelman and Taylor (2005), classroom climate includes concepts such as social attitudes, staff and student morale, power, control, guidance, support and evaluation structures, communicated expectations, competition, safety, orderliness, accountability of demands, curricular and instructional practices, and social system organization, all of which can be grouped into the dimensions of relationship, personal development, and system maintenance and change (Adelman & Taylor, 2005). As the components of classroom climate, Creemers and Reezigt (2005) listed the physical environment of the classroom, an orderly classroom environment, the social system, and teacher expectations for student outcomes. Finally, Wang et al. (2020) highlighted three basic components of classroom climate: instructional support, socio-emotional support, and classroom organization and management. They argued that these components involve classroom interactions, which impact the students’ outcomes.
Classroom climate may either help or hinder students’ learning and academic outcomes. Sometimes referred to as the classroom learning environment, classroom climate is the social environment wherein students learn (Johnson & McClure, 2004). Intervening on classroom climate may help improve students’ academic, socio-emotional and behavioral outcomes (Wang et al., 2020). Classroom climate is related to both cognitive and affective learning outcomes (Charalampous & Kokkinos, 2017). For instance, it has been evidenced that classroom climate is negatively associated with cyber bullying in WhatsApp classmate groups, which is also related to sense of belonging (Kashy-Rosenbaum & Aizenkot, 2020).
Classroom climate and its relationship with constructs such as student engagement, academic achievement, motivation, teacher burnout or social and emotional development are discussed in the literature (Adelman & Taylor, 2005; Allen et al., 2013; Wang et al., 2020). Among these matters, academic achievement holds significance because of its emphasis in schooling. There is a large body of research on the association between classroom climate and academic achievement directly or indirectly. However, the results of these studies vary. Larocque (2008) reported that students’ perceptions of their general classroom climate were significantly related to their achievement in reading and math. Likewise, López et al. (2018) found that students’ perceptions of classroom climate were related to academic achievement. On the other hand, there are studies reporting contrary findings. Barksdale et al. (2019) found no significant relationship between classroom climate and academic achievement, and there are also studies reporting negative relationships (Berkowitz et al., 2015; Trinidad, 2020).
School climate and its relationship with academic achievement
School climate refers to within-school characteristics that affect behaviors of members of the school community, and it distinguishes one school from another (Hoy & Miskel, 1998). It has been likened to an individual's personality (Hoy & Miskel, 1998) or the air we breathe (Freiberg, 1999). It is also defined as “the quality and frequency of interpersonal interactions,” and it has organizational, interpersonal and instructional dimensions (Loukas et al., 2006, p. 491). Though definitions vary, they mostly refer to school members’ beliefs, impressions and expectations about the school (Chen & Weikart, 2008).
The literature references a number of elements that school climate includes, such as ecology, milieu, social system, culture, safety, quality of teaching and learning, relationships, discipline, school connectedness, school facilities, and academic outcomes (Cohen et al., 2009; Stewart, 2003; Zullig et al., 2010). The components of school climate can be grouped into two key areas: school structure and culture (Chen & Weikart, 2008). Though there is not a consensus on which dimensions are essential for school climate, Thapa et al. (2013) addressed the dimensions of safety, relationships, teaching and learning, institutional environment, and the school improvement process. An important distinction regarding school climate is whether the school climate is understood and measured at the school level or the individual level (van Horn, 2003). At the school level, the unit of measurement is the school itself, and climate is viewed as a property of school. In this model, all students, though to varying degrees, experience school climate in similar ways. On the other hand, at individual level, it is thought that students experience the school climate differently, and what is measured is the student's perception (Slee & Skrzypiec, 2016). This difference is also addressed as a moderator variable in the current study.
According to the National School Climate Council, a positive school climate encompasses values, norms, and expectations that support school members in social, physical and emotional aspects, which also lead to a productive and democratic society (Thapa et al., 2013). School climate, therefore, has a number of influences on students. School climate has been linked to connectedness to school (Loukas et al., 2006), self-esteem (Way et al., 2007), out-of-school suspensions (Huang & Cornell, 2018), and academic, behavioral and socioemotional adjustment (Brand et al., 2003). It has been highlighted in the literature that school climate is related to students’ academic achievement, and there is a great deal of research on this issue (Alhosani et al., 2017; Chen & Weikart, 2008; Konold et al., 2018; Shindler et al., 2016; Wang & Holcombe, 2010).
School climate may contribute to or hinder academic achievement in many ways. Feeling safe in school settings may increase students’ academic performance (Karadağ et al., 2016); moreover, school climate may affect teachers’ expectations of students (Haynes et al., 1997; Urick & Bowers, 2014). Teacher expectations and teacher beliefs predict students’ academic experiences and performance (Archambault et al., 2012; Gentrup et al., 2020; Papageorge et al., 2018). In another study, it was revealed that students’ perceptions of school climate affected their achievement through influencing their identification with school, school participation, and use of self-regulation strategies (Wang & Holcombe, 2010). Despite these studies evidencing the relationship between school climate and academic achievement, there are also studies reporting no relationship between school climate and academic achievement (Allen et al., 2015).
Classroom climate and school climate: which should we focus on?
Research has highlighted that school climate and classroom climate are closely related (Barksdale et al., 2019). Classroom climate and school climate both reflect the school's culture (Adelman & Taylor, 2005) through beliefs, values, traditions, and ideologies (Slee & Skrzypiec, 2016). School climate is also reflected in classroom climate because student learning, interactions among students and teachers take place in classrooms (Berkowitz et al., 2017). In their climate factors in educational effectiveness model, Creemers and Reezigt (2005) described classroom climate as a subsystem of school climate, both of which affect student motivation and contribute to shaping cognitive and affective educational outcomes. Thus, in their model, school climate and classroom climate are embedded into each other.
Although the two concepts are interrelated and are sometimes even used interchangeably in the literature, school climate and classroom climate refer to different dynamics. While school climate is related to overall school environment, classroom climate has to do with each student's experiences in individual classrooms, which explains differences in students’ perceptions of their classroom and school (Schweig et al., 2019). Each classroom has its own dynamics among students and teachers. Therefore, classroom climates may differ within the same school. Given that students spend most of their school time in classrooms, their perceptions of their school's climate may differ from their perceptions of their classroom's climate, though these climates are thought to be mutually influencing.
Present study
The overall aim of the present meta-analyses was to provide a better understanding of the relationship of academic achievement with school climate and classroom climate, respectively. Research hypotheses were as follows:
A more positive classroom climate is associated with higher levels of academic achievement.
1.1. Publication year, report type, classroom climate scale type, academic achievement area, academic achievement scale type, school level, school area, country level and analysis level are significant moderators of the relationship between classroom climate and academic achievement. A more positive school climate is associated with higher levels of academic achievement.
2.1. Publication year, report type, academic achievement area, academic achievement scale type, school level, school area, country level and analysis level are significant moderators of the relationship between classroom climate and academic achievement.
Method
Research design
This study employed a meta-analysis method. This method was used because we aimed to analyze the relationships between academic achievement and classroom climate, and academic achievement and school climate, respectively, based on the studies in the literature. Meta-analysis involves synthesizing quantitative findings of research studies using statistical techniques (Card, 2015). It also allows for comparing mean effect sizes (Borenstein et al., 2011). Therefore, meta-analysis is well suited to the aims of this study.
Data collection
Data were obtained through online databases. Data from articles and proceedings were obtained from ERIC, Academic Search Complete, Education Source, Scopus ScienceDirect, PsycNet, and Google Scholar; data from doctoral dissertations were obtained from ProQuest. Two separate datasets were formed. The first dataset included studies on classroom climate and academic achievement, and the second dataset included studies on school climate and academic achievement. We used keywords which were searched in the titles of the studies. The references of the independent studies in the datasets are provided at the Open Science Framework website (osf.io/7ezmw).
Dataset of classroom climate and academic achievement (dataset 1)
The keywords “classroom climate OR climate OR classroom environment OR classroom quality AND achievement OR performance OR outcome OR success” in English were used. The last date of search for the studies published between 2000 and 2020 was January 11, 2020. The search was carried out by the first author. The titles of the studies were examined in line with the inclusion criteria (see below), and potential studies were selected. The pool included 83 studies. Then, the abstracts were examined, and qualitative studies and literature reviews were excluded from the study. Of these 79 studies, some were also excluded because they included intervention (n = 1), constructivist classroom settings (n = 4), teachers as participants (n = 1), a higher education sample (n = 8), or did not include appropriate statistical data (n = 11). Hence, the dataset was composed of 53 independent studies. If a study included more than one sample, these samples were coded independently. Therefore, this dataset comprised 55 independent samples. Appendix 1 presents data flow diagram in line with PRISMA (2020). The characteristics of the studies in the dataset are provided in Table 1.
Characteristics of the dataset of classroom climate and academic achievement.
WIHIC: ‘What Is Happening in this Class’ scale by Aldridge and Fraser (2000); CLASS: ‘Classroom Assessment Scoring System’ scale by Pianta et al., (2006); COS: ‘Classroom Observation System’ scale by National Institute of Child Health and Human Development Early Child Care Research Network (2005); MCI: and ‘My Class Inventory’ scale by Sink and Spencer (2007).
Some of the noteworthy characteristics of Table 1 are as follows. Nearly 44% of dataset 1 consisted of studies published between 2010 and 2014. Nearly 30% of the studies employed the What is Happening in this Class? (WIHIC) scale. In terms of academic area, half of the studies measured students’ general academic achievement. Similarly, about half of the studies used standardized achievement tests. Nearly half of the studies collected data from urban schools. Samples of slightly more than half of the studies were at the elementary education level. The majority of the studies were journal articles and report data from countries with high HDIs.
Dataset of school climate and academic achievement (dataset 2)
The keywords of “school climate OR school culture OR school environment AND achievement OR performance OR outcome OR success” in English were searched in the same databases listed above. The last date of search for the studies published between 2000 and 2020 was January 11, 2020. The search was carried out by the second author. The titles of the studies were examined in line with the inclusion criteria (see below), and potential studies were selected. The researcher made sure the samples represented K-12 students. The data pool included 99 studies. Then the abstracts were examined, and qualitative studies and literature review studies were excluded from the study. Of the resulting 97 studies, some were excluded because they included teachers as the sample (n = 27), school administrators as the sample (n = 11), a higher education sample (n = 2), or did not include the appropriate statistical data (n = 20). Hence, the second dataset comprised 37 studies. If a study included more than a single sample, each sample was coded independently. Therefore, this dataset comprised 48 independent samples. Appendix 2 presents a flow diagram of this dataset in line with PRISMA (2020). The characteristics of the studies in the second dataset are provided in Table 2.
Characteristics of the dataset of school climate and academic achievement.
Some of the noteworthy characteristics of Table 2 are as follows. About one-third of the second dataset consisted of studies published between 2015 and 2019. The majority of the studies in this set were from very countries with high HDI values (83.3%). The majority of the studies measured students’ academic achievement in general (mixed). Half of the studies focused on participant samples at the elementary school level and from urban areas. In two-thirds of the studies, standardized tests were used for measuring academic achievement and student level statistical analyses were used.
Inclusion and exclusion criteria
The inclusion and exclusion criteria were as follows:
The study was published in English between 2000 and 2020. The study addressed pre-school, elementary school, or secondary school sample(s). The study focused on the relationship between classroom climate and academic achievement for dataset 1. The study focused on the relationship between school climate and academic achievement for the dataset 2. The study focused on classroom climate for dataset 1. Studies focusing on constructivist classroom climate were excluded from the study because they involve intervention. The study focused on school climate for dataset 2. Studies focusing on specific types, such as cooperative school climate, school discipline climate and peer culture, were excluded because these studies mostly did not focus on overall school climate. The study should include adequate data to calculate effect size. Studies without these data were excluded. The study was correlational design. Intervention studies were excluded. The sample should comprise students. Studies measuring school administrators, teachers and parents’ perceptions were excluded.
Classroom climate scale types.
The WIHIC was developed by Aldridge and Fraser (2000). This Likert-type scale includes 55 items and consists of the dimensions of student cohesiveness, teacher support, involvement, investigation, task orientation, cooperation, and equity. The CLASS was developed by Pianta et al. (2006). This Likert-type scale is based on teachers’ observations and consists of emotional support, classroom organization and instructional support dimensions. The COS was developed by the National Institute of Child Health and Human Development Early Child Care Research Network (2005). It has ten items gathered under the dimensions of student behavioral engagement and classroom climate. The My Class Inventory (MCI) was developed by Sink and Spencer (2007). The scale has 20 items and consists of the dimensions of satisfaction, friction, competition, and cohesiveness. The primary studies in the dataset used various versions of the scales explained here or other scales. The characteristics of the independent studies, including reliability values of the scale used in the studies, are provided at Open Science Framework website (osf.io/xvutr).
Data analysis
Analyses were carried out separately for the datasets. The analysis unit was the study level. Each study was represented with an effect size. The effect size calculations and statistical tests were performed with CMA 2 package program.
Two different statistical models are employed in meta-analysis research, namely the random effects model and fixed effect model (Borenstein et al., 2011). It is advised to use the random effects model when characteristics of the studies included in the meta-analysis differ or the studies have different sample groups (Field & Gillett, 2010). This study employed the random effects model since the independent studies in this analysis used different sample groups.
In the calculation of effect sizes, the Pearson correlation coefficients were transformed to Fisher Z (Fz) coefficients (r = Fz = ES). The mean effect sizes were calculated in line with the random effects model. In mean effect size interpretations, we used the value intervals recommended by Funder and Ozer (2019). The effect sizes of the independent studies were examined, and there were no statistical outliers.
Regarding publication bias, the funnel plot method was used to determine whether the distribution of the dataset was symmetrical. We also employed Egger's linear regression method and Duval and Tweedie's trim and fill method (Jin et al., 2015). Findings regarding the publication bias are reported.
To identify the total heterogeneity value of the studies in the dataset, we used the Q-statistic and calculated I2 values. The heterogeneity level was interpreted by I2 value intervals recommended by Higgins et al. (2003). The moderator variables in this study included report type, analysis unit, classroom climate scale type, academic achievement scale type, school level, academic area, school area, and country level. We used a Q within-groups test for determining whether mean effect sizes differed significantly in terms of categorical moderator variables. For continuous moderator variables, we used meta-regression.
Findings
Dataset 1 (classroom climate and academic achievement)
This section includes descriptive statistics, publication bias analysis, mean effect size and moderator analyses regarding dataset 1. The total sample size of the studies in dataset was 40,710. While the smallest sample size was 77, the biggest sample size was 4,199. Dataset 1 produced 55 effect sizes. The smallest effect size was .03, and the highest was .42. The funnel plot is presented in Figure 1 and the forest plot is provided in Appendix 3.

The funnel plot of the distribution of effect sizes in dataset 1.
According to Egger's linear regression coefficient calculation method, there was no publication bias in the dataset (B = −.020; p = .40). Figure 1 presents the publication bias graph regarding the distribution of effect sizes. As seen in Figure 1, the distribution of effect sizes by their standard errors is almost symmetrical. Additionally, no publication bias was found with Duval and Tweedie's trim and fill method. The results of this test are provided in Table 4. This method revealed that the distribution of the effect sizes would be totally symmetrical if four studies were excluded from the set. As these studies comprised only 7.2% of the dataset, we decided that this percentage was insignificant. In other words, the difference between the mean effect size value and adjusted mean affect size value was .01. This was an insignificant difference.
Duval and Tweedie's trim and fill test for dataset 1.
We revealed that the relationship between classroom climate and academic achievement was small (ES = .20; LL = .17 UL = .23). The total heterogeneity amount of the dataset was Q(t) = 410.12. This meant that the level of heterogeneity was high (I2 = 86.83). Table 5 presents the moderator analysis of the effect size distribution regarding classroom climate and academic achievement.
Moderator analysis regarding dataset 1.
WIHIC: ‘What Is Happening in this Class’ scale by Aldridge and Fraser (2000); CLASS: ‘Classroom Assessment Scoring System’ scale by Pianta et al., (2006); COS: ‘Classroom Observation System’ scale by National Institute of Child Health and Human Development Early Child Care Research Network (2005); and MCI: ‘My Class Inventory’ scale by Sink and Spencer (2007).
As is evident in Table 5, the effect sizes did not differ significantly in terms of the moderator variables of classroom climate scale type, academic achievement scale type, report type, school level, school area, and country level. The mean effect sizes differed significantly in terms of academic area (Q(4) = 14.77; p = . 01). The effect size for the relationship between classroom climate and academic achievement in mathematics was medium (ES = 27; LL = .22 UP = .31). This relationship was greater than other academic areas. The effect size was lowest for the relationship between classroom climate and social studies (ES = .15; LL = −.02 UP = .31). In addition, the effect size for classroom climate's relationship with general academic achievement was small (ES = .16; LL = .12 UP = .19). Meta-regression was used for the years of the reports. The distribution of the effect sizes did not differ significantly in terms of publication year (B = −.001 p = .88).
Dataset 2 (school climate and academic achievement)
This section includes descriptive statistics, publication bias analysis, the mean effect size, and moderator analyses regarding dataset 2. Dataset 2 included studies whose units of analysis were students and schools. The total number of students in the studies with student-level analysis was 208,043. While the smallest sample size was 33, the biggest sample size was 29,415. The total number of schools in the studies with school level analysis was 1,403. Dataset 2 produced 48 effect sizes. The effect sizes ranged from ES = −.08 to ES = .887. The funnel plot is presented in Figure 2, and the forest plot is provided in Appendix 4.

The funnel plot of the distribution of effect sizes in dataset 2.
Egger's linear regression coefficient calculation method revealed that there was no publication bias in the dataset (B = 1.46; p = .60). Figure 2 presents the publication bias graph. It was observed that the distribution of effect sizes by their standard errors was almost symmetrical. Duval and Tweedie's trim and fill method also did not reveal a publication bias. The results of this test are presented in Table 6. This method revealed that the distribution of the effect sizes would be totally symmetrical if four studies were excluded from the set. As the percentage of these studies was 8.3% in the dataset, we decided that this percentage was insignificant. In other words, the difference between mean effect size value and adjusted mean effect size value was .03. This was an insignificant difference.
Duval and Tweedie's trim and fill test for dataset 2.
There effect size for the relationship between school climate and academic achievement was medium (ES = .28; LL = .20; UP = .35). The total heterogeneity amount of the dataset was Q(t) = 9924.98. This meant that the level of heterogeneity was high (I2 = 99.52). Table 7 presents the moderator analysis of the effect size distribution regarding school climate and academic achievement.
Moderator analysis regarding dataset 2.
The effect sizes did not differ significantly in terms of the moderator variables of academic achievement scale type, academic achievement area, and school level or country level. Yet, the relationship between school climate and academic achievement differed significantly in terms of the school area, report type, quality level, and the unit of analysis (respectively, Q(b) = 8.96, p = .03; Q(b) = 11.16, p = .01; Q(b) = 5.37 p = .02; Q(b) = 11.87,and p = .01).
Studies that were carried out in suburban settings produced larger effect sizes; the relationship between school climate and academic achievement was very high (ES = 0.79, LL = 0.38 and UL = 1.19). Yet, it should also be noted that suburban level was represented with a single study. Moreover, studies that did not clearly report school area produced small effect sizes (ES = 0.19, LL = 0.08, and UL = 0.30).
Regarding report type, studies reported in doctoral dissertations produced larger effect sizes than studies reported in articles and proceedings. Considering the lower and upper limits of mean effect sizes produced by the doctoral dissertation, it was observed that the effect sizes were large (ES = 0.39; LL = 0.30; and UL = 0.49).
The effect sizes also varied significantly in regard to study quality. The studies with high quality produced lesser effect sizes (ES = 0.19; LL = 0.11; and UL = 0.26) while studies with medium-level quality produced higher effect sizes (ES = 0.36; LL = 0.23; and UL = 0.48).
For the unit of analysis, school-level studies produced larger effect sizes than student-level studies. The studies which used schools as the units of analysis produced large mean effect sizes (ES = 0.50; LL = 0.35; and UL = 0.65). Meta-regression was performed for the publication year variable. It was observed that the distribution of the effect sizes differed significantly in terms of publication year (B = −.002; p = .02).
Discussion
School and classroom climate have been associated with a variety of student outcomes; however, results are mixed. An examination of their relationships with academic achievement would provide valuable information for supporting youth in schools. To this end, we synthesized published and unpublished research to evaluate the strength of the relationships of academic achievement with classroom climate and school climate, respectively, through two independent meta-analyses. Moreover, we explored which factors moderated these relationships. The analysis focused on studies based on students’ perceptions of classroom and school climate. The same inclusion criteria were used for studies of both classroom and school climate. Two separate datasets (dataset 1 for classroom climate and academic achievement, and dataset 2 for school climate and academic achievement) were formed with the studies that met the criteria. The meta-analyses were then performed independently with the datasets.
Dataset 1, which included 55 effect sizes and a sample size of 40,710 participants, focused on classroom climate. The meta-analysis revealed a small mean effect size (ES = .20). This means that the level of the relationship between classroom climate and academic achievement is small. The meta-analysis by Wang et al. (2020) also revealed a small effect size. Results of similar studies also lend their support to this finding. Braithwaite et al. (2011) examined experimental studies on the effects of motivational climate in the classroom on student outcomes and revealed a small level effect. The effect of classroom management strategies on students’ academic achievement was also reported as small (Korpershoek et al., 2016). The level of the relationship between teacher efficacy and students’ academic achievement was also reported as low (Kim & Seo, 2018). Both the results of the current study and these review studies on classroom climate suggest that the level of the relationship between students’ perceptions of classroom climate and their academic achievement is low.
This study also examined this relationship in terms of a number of moderator variables such as the types of classroom climate scales used in the research studies, achievement scale type (school record, standardized test, etc.), report type (article, dissertation, etc.), academic achievement area (math, language, etc.), school level (elementary, secondary, etc.), school area (urban, suburban, etc.), and HDI of the country where the study was conducted (medium, high, very, etc.). The only significant difference was in terms of academic achievement area; specifically, the relationship between classroom climate and academic achievement was significantly higher for mathematics. One reason for this finding may be that mathematics anxiety is a real problem for students from elementary school through college (McLeod, 1992; Peker & Ertekin, 2011; Szczygieł & Pieronkiewicz, 2021), and positive classroom climates may be especially important for lowering this anxiety and promoting achievement.
Dataset 2, which included 48 effect sizes and a sample of 208,043 students and 1,403 schools, focused on school climate. The meta-analysis on this dataset resulted in a medium mean effect size for the relationship between school climate and academic achievement. This finding is supported in similar studies (Bektas et al., 2015; Berkowitz et al., 2017; Karadağ et al., 2016), though the strength of the relationship between school climate and student outputs was reported as weaker in one meta-analysis (Scheerens et al., 2013). Notably, this weaker relationship may have been due to including other student outputs as well as academic achievement. Overall, the relationship between academic achievement and school climate is at medium level based on the studies in the literature.
The moderator analysis for dataset 2 revealed significant differences in regard to the report type, school area, unit of analysis, and publication year. In this study, doctoral dissertations produced larger effect sizes than articles and proceedings, which contradicted Karadağ et al.'s (2016) findings. This contradiction may stem from the fact that their study included a higher percentage of doctoral dissertations than did the present study.
The relationship also differed in terms of unit of analysis. Studies with school-level analyses produced higher effect sizes than studies with student-level analyses. These findings indicate that the unit of analysis is a significant variable in school climate research. Notably, the sample sizes of the studies with student-level analyses were big, while the sample sizes of the studies with school-level analyses were very small (as they considered each school a unit of analysis). The Pearson correlation coefficient is sensitive to the sample size, which may account for this difference.
The relationship between school climate and academic achievement also differed in terms of school area. The strength of the relationship was quite high for suburban schools. However, a suburban sample was represented in only one study, which may explain this finding. Notably, the studies on school climate mostly focused on urban samples. Future studies should examine school climate in suburban areas. Finally, more recent studies produced smaller effect sizes. This may reflect the fact that new measurement tools have been developed over time and that newer studies tend to use multiple variables to explain academic achievement. Therefore, newer studies may have yielded less strong relationships. The relationship between school climate and academic achievement was not moderated significantly by the variables of academic achievement scale type, academic achievement area, school level, or country of the sample. This shows that studies from different countries reveal similar results regarding the nature of the relationship. Moreover, whether academic achievement is measured through school reports, standardized tests or self-report does not make a difference in this relationship. School level is also an important moderator. Our study demonstrated that the association between school climate and academic achievement is similar in elementary and secondary levels, indicating that it is significant for both levels at similar degrees.
Conclusion
One indicator of effective schools is students’ academic achievement. School and classroom climate are considered to be linked to academic achievement; however, the results of independent studies are mixed. Meta-analyses can offer a broader perspective on this issue. This study synthesized results regarding the relationship between classroom climate and academic achievement as well as the relationship between school climate and academic achievement. We found that both classroom climate and school climate are significantly related to students’ academic achievement. We also found that the magnitude of the relationship is greater for school climate based on the studies in these datasets. While the relationship between classroom climate and academic achievement is small, it is larger for school climate. Surely, this does not mean that one is more important than the other, since the two are interrelated and affect one another. As noted previously, while school climate refers to the general school environment, classroom climate is related to specific experiences in individual classrooms (Schweig et al., 2019). The results certainly have implications for researchers, school leaders and teachers.
Implications
It was revealed in this study that both school and classroom climate are related to academic achievement, with achievement's relationship with school climate having a greater magnitude. School leaders and teachers should exert great effort to create positive classroom climates to achieve effective schools. It is well accepted that school leadership is critical for academic improvement (Hallinger & Heck, 2010; Özdemir et al., 2022) and shaping school climate (Cohen et al., 2009). Both school leaders’ and teachers’ behaviors and efforts have a significant influence on student achievement (Heck et al., 1990; Karadağ et al., 2016; York-Barr & Duke, 2004). At the classroom level, teachers should set clear rules with students and provide a respectful, safe, cooperative and caring classroom climate (Slee & Skrzypiec, 2016). They should also maintain high academic expectations for students while also supporting them in meeting those expectations. Teacher expectations and teacher beliefs predict students’ academic experiences and performance (Archambault et al., 2012; Gentrup et al., 2020; Papageorge et al., 2018)
Teachers should pay attention to relationships, personal development, and system maintenance and change in the classroom (Adelman & Taylor, 2005). Students’ psychological needs should also be met. Social Determination Theory posits that meeting students’ psychological needs (i.e., feeling competent, autonomous, and related to others) improves students’ motivation, well-being and willingness, culminating in better academic performance (Amholt et al., 2020; Deci & Ryan, 2012). At the school level, teachers and school leaders should foster a positive school climate encompassing values, norms and expectations that support school members in social, physical and emotional domains by promoting relationships, safety, teaching and learning, institutional environment, and school improvement processes (Thapa et al., 2013).
Limitations and future research
This study examined the relations of students’ perceptions of school climate and classroom climate with academic achievement. Further meta-analysis studies on this issue based on the perceptions of teachers, school leaders or parents may be helpful for comparing results. This study focused on academic achievement in particular. Future studies may address other student outcomes, such as behavioral outcomes or well-being. Further studies should investigate differences in the strength of the relationships for school climate and academic achievement, and classroom climate and academic achievement, respectively. Multi-level studies may help us understand the nature of the phenomenon. In this study, the analyses were performed in the contexts of school and classroom climate. These concepts can be combined and analyzed within the concept of learning climate.
This meta-analysis involved studies with correlation and regression analyses. Notably, both school and classroom climate are context-specific; therefore, more qualitative or mixed-method studies are needed to better understand factors affecting climate in the school and classroom. In one mixed-method study, qualitative findings revealed significant results regarding classroom climate that quantitative findings missed (Barksdale et al., 2019). Meta-synthesis studies for qualitative results may also be fruitful.
Another limitation of this study is that it involved studies only in English. Further, meta-analyses should involve studies in other languages. More studies are also needed with suburban samples. Additionally, a great number of the studies in this meta-analysis came from very countries with high HDI values. More data are needed from suburban populations and countries with lower HDI values. Finally, this meta-analysis did not address issues of missing data in the independent studies it synthesized; however, bias due to missing data in independent studies generally is propagated in meta-analyses (Mavridis & White, 2020). Future meta-analysis studies should consider this issue.
Footnotes
Declaration of conflicting interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) received no financial support for the research, authorship, and/or publication of this article.
Author biographies
Appendix
