Abstract
The purpose of the current study was to examine perceptions of school climate among youth identifying as lesbian, gay, or bisexual (LGB) using the Georgia Brief School Climate Inventory (GaBSCI). Confirmatory factor analysis was conducted to confirm the one-factor school climate construct of the GaBSCI, and measurement invariance was established among LGB students and their counterparts. Students identifying as LGB reported significantly lower perceptions of school climate. Establishing valid and reliable tools that can be integrated within the School Wide Positive Behavior Interventions and Supports (SWPBIS) framework to guide data-based decision making may enhance positive outcomes for students.
Keywords
Students spend a majority of their day in an educational setting, making schools an important developmental context for adolescents. Growing attention is focused on understanding, supporting, and maintaining positive school climates because of data supporting the relationship between a positive school climate and student social, emotional, behavioral, and academic outcomes (Lewis & Sugai, 1999). Youth identifying as lesbian, gay, or bisexual (LGB) have consistently been identified as a group at increased risk of being subjected to negative school experiences (Russell & McGuire, 2008), including poor academic performance, negative perceptions of school climate, and peer victimization (Russell & McGuire, 2008). In addition, sexual minority youth exhibit more discipline problems, are more likely to be absent from school because of feeling unsafe or uncomfortable, and report lower levels of school engagement and academic achievement (Kosciw, Palmer, Kull, & Greytak, 2013).
Negative and hostile school climates have a detrimental effect on LGB students and reduce their access to education. According to Russell and McGuire (2008), “at the school level, homophobia has been directly implicated in hostile school climates” (p. 136). In a study conducted with sexual minority youth, 73.6% of students reported hearing homophobic remarks on an ongoing basis, with less than one fifth reporting any adult interference during such incidents; furthermore, 86.2% of students reported verbal and physical harassment at school (Diaz, Kosciw, & Greytak, 2010; Harris Interactive and GLSEN, 2005). Challenges such as peer victimization and harassment make it difficult for all students, and specific to this study, LGB students, to benefit from their educational environments.
School Climate, Defined
School climate is a multidimensional construct based on the patterns of individuals’ experiences that reflect school norms, values, expectations for behaviors, and organizational structures (National School Climate Council, 2007; Thapa, Cohen, Guffey, & Higgins-D’Alessandro, 2013). School climate is positively associated with student achievement, school engagement, and social, emotional, and behavioral outcomes, and negatively associated with absenteeism, peer victimization, and engagement in risky youth behaviors (Cohen, McCabe, Michelli, & Pickeral, 2009; Kuperminc, Leadbeater, Emmons, & Blatt, 1997). A major component of adolescence is defining self or identity, as well as forming relationships with individuals outside of the family, including adults and peers; perceptions of school climate may reflect these aspects of school life. Adolescence is a difficult transition period for all students. Collecting data on school climate perceptions provides a valuable snapshot of how individuals feel, at any given time, about their school environment.
Perceptions of School Climate Among LGB Students
Research has established that minority students generally report lower perceptions of school climate than their White counterparts (Koth, Bradshaw, & Leaf, 2008; White, La Salle, Ashby, & Meyers, 2014) and males report lower perceptions than females. However, there is limited research assessing perceptions of school climate among students identifying as gay, lesbian, or bisexual. Research has shown that students identifying as LGB tend to report lower perceptions of school experiences, more school-related problems, and lower academic achievement (Elias et al., 1992). They are more likely to experience bullying and peer victimization, isolation, and harassment. Also, an average of 30% of students identifying as LGB end up dropping out of school (Birkett, Espelage, & Koenig, 2009; Russell, Seif, & Truong, 2001). In a 2009 study, researchers assessed differences in perceptions of school climate among 7,000 middle school students identifying as either heterosexual, LGB, or questioning. Findings indicated differences in perceptions of school climate between students identifying as questioning and heterosexual, with the former having lower perceptions. However, there was no difference in perceptions among students identifying as LGB and heterosexual (Birkett et al., 2009). Given previous research suggesting adverse school experiences for LGB students, further research is needed to examine perceptions of school climate for sexual minority youth in comparison to their counterpart. Using surveys demonstrating invariance across groups (i.e., LGB vs. Heterosexual) is an important factor in this process so that we are able to reliably interpret results and comparisons.
Fully supporting the range of needs for LGB students requires developing a continuum of proactive supports that are integrated with initiatives to promote positive behavior and reduce bullying. A multitiered framework can provide a way to organize these supports (McIntosh & Goodman, 2016). Measuring the perceptions of school climate using valid and reliable tools, particularly for LGB students, provides leadership teams with essential data to guide the development of this continuum of supports which, in turn, can improve supports for LGB students.
School Climate and School Wide Positive Behavior Interventions and Supports (SWPBIS)
SWPBIS is a multitiered data-based decision-making framework used to improve the selection, organization, and implementation of evidence-based practices for enhancing student outcomes including school climate, especially among groups of students that may be most marginalized, such as LGB students (Lewis & Sugai, 1999). SWPBIS is how we organize what we do to improve teaching and learning in classroom and school environments to ultimately impact student outcomes. School climate is how people report feeling and perceiving the school environment and their experiences in classrooms and school, which is the direct and indirect natural effect of school improvement efforts. School improvement initiatives increasingly include perceptions of school climate as a way to evaluate the outcomes of evidence-based school improvement practices (e.g., teaching and acknowledging social skills, preventive active supervision) and systems (e.g., SWPBIS). However, to rely on school climate data, it is important that we use scales with sound psychometric properties that can support reliable and valid cross-group comparisons.
Researchers have documented the positive impact of SWPBIS on student outcomes across grade levels, for example, (a) reduction in problem behavior, (b) increased academic performance, (c) improved perception of school safety, (d) enhanced staff retention, (e) improved organizational health of schools, (f) reduction in bullying behaviors, and (g) increased social emotional competence of students (Bradshaw, Mitchell, & Leaf, 2010; Horner, Sugai, & Anderson, 2010). High-fidelity implementation of the SWPBIS framework creates a predictable, positive, safe, and consistent school environment that is associated with an enhanced and safer learning environment, more positive relationships between students and adults, and improved overall perceptions of school climate for all students (Horner et al., 2010). In a study conducted by Bradshaw, Koth, Thornton, and Leaf (2009), SWPBIS had a positive impact on the work environment and staff perceptions of school climate when SWPBIS was implemented with fidelity, and may have been linked to staff members’ capacity to implement other preventive interventions for students requiring additional supports. Together, these initial findings suggest that gathering student perceptions of school climate data and using it as a resource to guide data-based decision making within the SWPBIS framework may be a logical and effective means for enhancing classroom and school teaching and learning environments that, in turn, may be experienced and reported by students identifying as gay or straight as more positive school climates.
School Climate Measurement
A plethora of school climate scales have been used to examine student perceptions of school climate ranging in items from around 25 to more than 100 (e.g., California Healthy Students Survey: Furlong, Greif, Bates, Whipple, & Jimenez, 2005; Comer Development Program Climate Survey: Haynes, Emmons, Ben-Avie, & Comer, 2001; Comprehensive School Climate Survey: Stamler, Scheer, & Cohen, 2009; Delaware School Climate Survey: Bear, Gaskins, Blank, & Chen, 2011). Researchers have recommended the development of brief measures of school climate as a way to assess school climate over time in a way that is efficient and meaningful. Researchers also suggested the use of a general school climate survey to examine overall perceptions of the school environment and relationships with variables such as peer victimization or high school completion (Bandyopadhyay, Cornell, & Konold, 2009; Furlong et al., 2005; White et al., 2014).
Georgia Brief School Climate Inventory (GaBSCI)
The GaBSCI was developed to provide schools with an overall snapshot of how students perceive their school environment. The scale is brief with only nine items, allowing for it to be administered on an ongoing basis. Prior research established the GaBSCI as a one-factor school climate tool with adequate psychometric properties: root mean square error approximation (RMSEA) = .035, standardized root mean square residual (SRMR) = .023 and Cronbach’s alpha = .71 (White et al., 2014). Measurement invariance across the five ethnic groups has previously been established (see La Salle, Wang, Parris, & Brown, 2017, for a full review). However, to date, measurement invariance across sexual orientation has not previously been established and, as such, is part of the aim of the current study.
Purpose
This study had two primary purposes. First, we sought to confirm the one factor structure of the GaBSCI among a large and diverse middle and high school sample, and specifically across sexual orientation groups (i.e., heterosexual, lesbian, gay, bisexual). Second, once the measurement structure of the tool was established for use across groups, we examined the average perceptions of school climate reported by two groups of students in Grades 6 to 12, those identifying as heterosexual and those identifying as LGB.
Method
Participants
Participants included 22,949 students who completed the GaBSCI in the spring of 2017, representing 113 schools, 50 districts, and 19 states. For the purposes of this study, researchers considered two broad categories for sexual orientation: “Heterosexual/Straight” (heterosexual) and “Lesbian/Gay/Bisexual” (LGB). Of the survey respondents, 20,765 (90.5%) reported that they identify as heterosexual, while 2,184 (9.5%) reported an LGB sexual orientation. In the original sample, 26,617 participants completed the survey; however, some participants did not answer the optional demographic questions and their sexuality and grade level could not be determined in the analyses. Thus, we excluded 2,411 participants who provided invalid responses for grade level, and 3,668 participants who did not report their sexual orientation. The final sample for analysis included 13,784 middle and 9,165 high school students, and descriptive characteristics are provided in Table 1.
Student Demographic Information.
Missing/I prefer not to answer were excluded from the database and not calculated as part of the demographic percentage representation.
GaBSCI
The GaBSCI is a computerized school climate rating scale that was developed as part of the Georgia School Climate Survey Suite (White et al., 2014). The purpose of the GaBSCI is to obtain middle and high school student perception ratings of school climate, and it provides a composite rating that represents the nine items within the GaBSCI. Respondents use a 4-point Likert-type scale: 1 = strongly disagree, 2 = disagree, 3 = agree, and 4 = strongly agree. To compute the overall school climate score, item responses are summed and then divided by the total number of items. Higher overall scores reflect a positive sense of the school environment with respect to (a) interpersonal relations among and between peers and adults, (b) learning environment, and (c) feelings of belonging and acceptance. Lower perceptions reflect a negative perception in one or more of the aforementioned areas.
Sexual orientation
Within the section of optional demographic questions, participants were asked to describe their sexual orientation (“Which of the following best describes you?”) by indicating one the following responses: “Heterosexual (straight),” “Gay or Lesbian,” “Bisexual,” or “I prefer not to answer.” For the purposes of this study, we included only students who selected “Heterosexual (straight)” in the heterosexual group, and any student who selected “Gay or Lesbian” or “Bisexual” in the GLB overall group, as has been done in prior studies focusing on sexual minority youth (Goodenow, Szalacha, & Westheimer, 2006; Poteat, Sinclair, DiGiovanni, Koenig, & Russell, 2013).
Procedures
The GaBSCI is administered in an online format, and students take the survey during school hours using school-based technology (e.g., computer, iPad). Through an online portal (www.pbisapps.org), individual students enter their item responses, which are stored in a confidential and private site managed by the National PBIS Technical Assistance Center at the University of Oregon.
Students are exempted from participation if their parent or guardian returned a signed refusal to participate form. In addition, students may opt out of the survey at any point before or during the survey. Students are permitted to skip demographic questions that they prefer not to answer. As students must select an answer for each school climate item to proceed to the next item, there are no missing data for school climate survey items.
School sites had no associated costs to complete the survey or obtain their data. Institutional review board (IRB) safeguards with respect to confidentiality, privacy, and informed consent were secured for conducting this study (University of Connecticut) and collecting, maintaining, and accessing the data (University of Oregon). Date were de-identified at the individual level and considered extant; as such, the study was approved as IRB exempt.
Analyses
Multilevel confirmatory factor analysis (CFA) was conducted using Mplus 7.4 (Muthén & Muthén, 1998–2012) to account for the nested nature of the data (i.e., students nested within schools) and standard error. Maximum Likelihood Estimation was used. To conduct the measurement invariance analyses, the 4-point Likert-type scale was treated as categorical and was estimated using weighted least squares (WLSMV). In WLSMV, missing data are accommodated by using an analog of full information maximum likelihood (FIML) with the WLSMV estimation as categorical.
The model included nine school climate items (see Figure 1) represented by one overall school climate factor. Several model fit indices were examined. Given that the chi-square test of model fit is sensitive to large sample sizes, we did not rely solely on the significance of the chi-square tests to evaluate model fit. To assess model fit, three additional common fit indices were examined: comparative fit index (CFI), Tucker–Lewis index (TLI), RMSEA. The CFI and TLI are measures of the incremental fit index to assess relative improvement in the fit of the model relative to the baseline model. Ideally, CFI and TLI should be at or above .90 (Hu & Bentler, 1999). The RMSEA is an absolute fit index that evaluates the relationship between the observed data and the data pattern that would be expected based on the estimated model. Generally, RMSEA values less than .08 are considered indicative of adequate model fit (Hu & Bentler, 1999; Pendergast, Von der Embse, Kilgus, & Eklund, 2017).

School climate survey items.
To establish that school climate is measured consistently across both groups, three types of measurement invariance were examined. Configural variance is used to assess whether the factor structure is equivalent across groups. Metric invariance permits determination of whether the items are equally discriminating across groups. Finally, scalar invariance is examined to assess whether item difficulty (or level of endorsement) varies across groups, holding constant the level of the overall factor. Scalar invariance is assessed by constraining both the factor loadings and the intercepts to be equal across groups. To evaluate change in model fit for measurement invariance analyses, changes in TLI and RMSEA were evaluated. Pendergast et al. (2017) suggest that a ΔRMSEA change of ⩽–0.015 and a ΔCFI ⩽–0.01 from the metric to the scalar model, would indicate invariance; Chen (2007) also recommends a ΔCFI ⩾ –.01 or for sample sizes larger than 300 (Pendergast et al., 2017). Following factor analyses, ANOVA was conducted with the final model to examine school climate means for both samples (heterosexual and LGB).
Results
Measure Validity
The CFA examined a single factor model labeled School Climate that was represented by nine first-order items (see Figure 1). The model yielded good fit statistics and formed the factor structure of a one-factor school climate model with nine first-order items with factor loadings greater than .4 (see Table 2) and adequate model fit indices after the error for Item 1 “I like school” and Item 2 “I feel successful at school” were correlated; χ2(26) = 1,647.735, p < .001, TLI = .93, CFI = .95, RMSEA = .31. Scale reliability for the model was .81. The error terms for the two items were correlated because it is likely that some of the variance in the indicators is not explained by the latent variable and is accounted for by an outside cause; this is likely because the items are similarly worded or interpreted and/or prone to social desirable responses (Brown, 2014).
Factor Loadings for School Climate Items.
Measurement invariance indices indicated that the change in model fit from the configural to metric and metric to scalar models were not significantly worse (see Table 3); for each model the change in CFI and RMSEA was <.01. As such, the model demonstrated full configural, metric, and scalar invariance. These data support the GaBSCI as a tool that measures the construct of school climate similarly across groups, with items being equally discriminated and level of endorsement for each item being relatively consistent among students identifying as heterosexual and LGB.
Measurement Invariance Results.
Note. CFI = comparative fit index; TLI = Tucker–Lewis index; RMSEA = root mean square error approximation.
p < .01.
Across-Group Means
Results from ANOVA indicated that the means of the two groups were significantly different from one another F(27, 22921) = 18.852, p < .001. Perceptions of school climate among students identifying as LGB were significantly lower than students identifying as heterosexual. The mean school climate for students identifying as heterosexual was 2.9 (SD = .56), and the mean for students identifying as LGB was 2.65 (SD = .066). The effect size, calculated as Cohen’s d was moderate (.041).
Discussion
The two purposes of this study were to (a) establish the validity and measurement invariance of the GaBSCI for use with students who identify as LGB and (b) examine school climate perceptions among students identifying as LGB and heterosexual. CFA results supported a one-factor school climate model with nine items, and measurement invariance among students identifying as heterosexual and LGB was established.
These overall findings are important because having a reliable and valid measure of the way students identifying as heterosexual and LGB perceive their environment provides important insight into how groups of students might participate in and benefit from supports provided within a multitiered framework, especially for students identifying as LGB. An overall school climate score indicates how all students generally report their experiences in classrooms and schools. In the current study, students identifying as LGB reported significantly lower perceptions of school climate than heterosexual students; the ability to examine overall perceptions across demographic groups (i.e., LGB) can inform the provision of targeted supports for these student groups.
Specific adjustments can be made to improve student interactions and experiences. The current national focus on multitiered systems of support (i.e., Tier 1—universal for all students, Tier 2—targeted for some students, Tier 3—indicated for a few students) provides a framework for organizing and implementing these adjustments. For example, at the school-wide level (Tier 1), all students might benefit from a reteaching and increased focus on respect, equity, and diversity. A subset of all students (Tier 2) may require additional supports (e.g., group discussions, counseling, skill practice) to enhance their personal and interpersonal success. A few students (Tier 3) might need more individualized and specialized supports (e.g., function-based intervention plans, cognitive behavior therapies, intensive personal skill development and training).
Strengths and Limitations
Strengths
This study has several strengths that contribute to the research literature and advance our classroom and school practices. First, the national sample of nearly 23,000 students from 112 schools and 19 states across the United States provided a sizable sample and data set for analysis using a multilevel framework. As a result, we were able to conduct a multilevel CFA and take advantage of the nested nature of the data, specifically, to compare heterosexual and LGB student school climate perceptions.
Second, having a large and diverse sample and using a technically adequate school climate instrument increase the generalizability of our results to comparable locations and contexts, and similar samples of students, classrooms, and schools. Finally, the results from this study enhance opportunities and efforts related to developing, integrating, and studying school climate and tiered systems of support.
Limitations
However, this study is not without limitations and cautions. The GaBSCI is based on student self-report data which reflects their perceptions of their past learning experiences and how they verbally describe their experiences in classroom and school settings. Although research supports the association between self-report school climate survey data and other data sources (e.g., observational information, extant discipline data, environmental assessments; Bradshaw et al., 2009), what students are actually experiencing and observing should be cautiously inferred.
Also, this study focused on students in Grades 6 to 12. Generalizations should not be extended to elementary students and schools. Finally, although our results suggest that LGB students generally have different perceptions of school climate than heterosexual students, generalizations about their actual and specific experiences should not be inferred. Within the LGB sample, determination of subgroup differences (e.g., high vs. middle school, lesbian vs. gay vs. bisexual) will require further study. Furthermore, other sexual and gender minority subgroups (e.g., transgender, queer) were not included in this study.
Implications for Research
The limitations noted above also represent opportunities for future research (e.g., categorical vs. continuous ratings, extending to elementary grade students). In addition, a number of other research opportunities are indicated. First, although the GaBSCI is a technically sound school climate survey, further research should investigate its potential for supporting LGB student populations, for example, (a) in international sites (e.g., European, Asian, South and Central American), (b) by including family and staff reported perceptions, and (c) with other combinations of characteristics (e.g., disability, race, academic achievement).
Second, although self-report data are proving to be informative, future research might examine how survey self-report data relate to other forms of school climate measures (e.g., focus groups, direct observations, disciplinary actions, counseling, and nursing referrals) from students and staff and family members.
Third, given the response variation found within large-group research, future research might focus on case study and single-subject research designs that would permit examination of how individual student needs can be addressed with individualized supports (i.e., Tier 2/3; for example, victimization, trauma, suicidal ideation).
Fourth, future research should use school climate information to identify and test effective school climate practices that align with the multitiered continuum logic. This research should focus on how the needs, strengths, and supports for LGB students can be enhanced at the school-wide, classroom, small group, and individual student level.
Finally, The GaBSCI is one of a small number of surveys that assesses perceptions of school climate and also includes demographic questions specific to student sexual orientation (GLSEN National School Climate Survey; Kosciw, Greytak, Bartkiewicz, Boesen, & Palmer, 2012; National School Climate Survey Youth Risk Behavior Survey; Grunbaum et al., 2004). School climate is an important factor in student outcomes, and more research should focus on examining the experiences of students identifying as LGB within the school context. Tools like the GaBSCI provide great value to the multi-tiered systems of support (MTSS) frameworks, like SWPBIS, because increased access to data reported by students about their school experiences can enhance the school’s capacity to meet the needs of students.
Implications for Policy
As the amount research from studies like this one increases, individuals in leadership (e.g., school boards, superintendents and commissioners, legislators, principals) must develop new and modified policies that specifically reflect what and how data are collected, and what and how practices and systems are enacted for LGB students. These efforts should look at how LGB students fare within, for example, disciplinary systems, zero tolerance rules, access to counseling and mental health supports, incident investigations, referral processes, and so on.
Implications for Practice
A majority of the research related to experiences of students identifying as LGB is gathered from specific advocacy organizations, such as GLSEN or gay-straight alliances (Goodenow et al., 2006). Students considered sexual minorities represent a notable portion of the U.S. public school enrollment. Although these specific advocacy organizations represent important resources, formal and systemic supports for all students within classrooms and schools are lacking.
At best, students and staff receive exposure and awareness information about sexual orientation, but few LGB-specific strategies. Because our data suggest that LGB students describe school climate more negatively, an integrated continuum of supports may be suggested. An MTSS approach would provide increased attention to students and staff who might require more intensive supports (Tiers 2/3) that would enhance their school climate experiences. Data from the GaBSCI can be a constructive tool in guiding such efforts by providing aggregated (whole-school; White et al., 2014) and disaggregated (e.g., LGB students) data to identify how and where to deploy school-wide, targeted, and indicated resources, specifically for students identifying as LGB. For example, research results have shown that in schools with gay–straight alliances and positive representations of LGB people in curriculum, LGB students are less likely to experience threats of violence, miss school because of fear of feeling unsafe, and engage in suicidal thoughts and behaviors, in comparison to schools that do not have such supports (Goodenow, Szalacha, & Westheimer, 2006; Poteat et al., 2015). Research-supported practices such as these should be integrated into the overall SWPBIS framework ensuring that all students have access to effective supports.
Conclusion
Students who identify as LGB have been particularly marginalized in education settings, so identifying tools that can capture their experiences can enhance schools’ ability to better understand, make decisions, and support all students (Goodenow et al., 2006; Poteat et al., 2013). These tools, however, must be psychometrically sound to ensure that schools make decisions that are accurate, valid, relevant, and useful for their intended populations and settings. The GaBSCI is such a tool and can be used to support short, efficient, and valid progress-monitoring decisions based on student reported perceptions about the climate of their classrooms and schools.
The purpose and findings of this study are both unique and important in that we learned that GaBSCI data can be used to examine the reported experiences of LGB students, especially those who may be at risk of being marginalized and within the context of school climate. Furthermore, when paired with existing school level data including achievement, discipline, and safety data, these forms of school climate data can enhance the capacity of schools to develop and use a multitiered continuum of supports, like SWPBIS, to enhance the selection and fidelity implementation of effective and equitable practices and interventions for all students.
Footnotes
Declaration of Conflicting Interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) received no financial support for the research, authorship, and/or publication of this article.
