Abstract
Data from a campus climate/violence survey (CCS) include psychometric information for survey items/scales plus findings from a large state university to promote its usefulness for assessment of interpersonal violence/harassment. This CCS can thus be evaluated for its measurement and documented findings, allowing for benchmarking purposes. An innovative measurement strategy is introduced to comprehensively capture incidence of victimization types through streamlined questioning. Tables provide detailed data for 6,995 undergraduate and graduate/professional students over a 1-year period. Adding to published literature on existing CCSs, this article provides the range of information needed for universities to determine the potential usefulness of a CCS.
Introduction
With the relatively new introduction of campus sexual violence surveys and the possibility that campus climate surveys (CCSs) may be legislated (i.e., Campus Accountability and Safety Act [CASA], 2015), institutions of higher education (IHE) have begun to administer these surveys for policy and program planning at their individual campuses (Wood et al., 2017). The source of these CCSs has varied from research agencies (e.g., Cantor et al., 2015), national surveys (e.g., Bureau of Justice Statistics, 2014; Fisher et al., 2000; C. P. Krebs et al., 2007), coalitions of like-minded researchers across institutions (e.g., Administrator-Researcher Campus Climate Collaborative [ARC3], 2015), as well as individual universities (e.g., McMahon et al., 2016; University of Oregon, 2015). It is important to note that universities conducting their own surveys have often used or adapted other surveys in existence (e.g., University of Oregon, 2015), which may limit the information obtained but which also allows for comparison across institutions. It is certainly expected that universities striving to obtain campus climate information may find it instructive to compare their campus findings with data from other sources and benchmark campuses (White House Toolkit, 2014). In addition, findings from a range of survey instruments may be informative regarding the impact of the specificity of questions, the definition of types of victimization, and the breadth of different surveys. For example, the uncertainty that has been raised over what is considered the most accurate percentage of college women experiencing sexual violence is often attributed to particular studies posting differing results that are likely a function of the way questions are asked or the samples are selected (e.g., Beaver, 2017; Gerstmann, 2019). Thus, the purpose of this article was to provide as comprehensive a picture as possible of information regarding a CCS administered at a large university along with prevalence data, such that the survey could be used by other entities with knowledge of the psychometric properties of scales and items and benchmark findings for comparison purposes. In addition, some features of the survey provide more streamlined, yet comprehensive data collection that may be considered useful for gathering sensitive information.
Purpose of CCSs
Social scientists responsible for developing CCSs have been hopeful that IHEs will consider the role of these surveys to be broader than merely responding to potential reporting requirements (White House Toolkit, 2014). At their most basic function, these surveys are expected to yield more accurate assessments of campus violence than data supplied from campus police or even anonymous counts from campus violence intervention and prevention units. However, these surveys can additionally supply data for potential institutional change regarding increased safety and decreased violence. Proactively, these surveys can provide data to support the need for changes, programs, and/or improvements that can be implemented to increase student safety. Following implementation of such programs or improvements, universities can use a CCS to conduct longitudinal assessments evaluating students’ changes in perceptions, attitudes, behaviors, and responses to violence. While these compelling reasons are mostly focused on administrative concerns, students may also directly benefit simply by completing a CCS. These surveys have the potential to serve as an educational tool, for example, by alerting students to concepts for which they lack knowledge (e.g., which personnel at a university are mandated reporters), by raising their awareness (e.g., affirmative elements for sexual consent), or by alerting them to available resources (e.g., accommodations postassault). Institutionalization of a CCS measurement tool also serves as a message to students that their safety is important to the administration, which in turn can generally affect campus climate.
CCS Literature
Although extant literature was reviewed prior to the development and administration of the instrument presented in this article, it is important to determine whether information about this particular CCS provides a unique or useful purpose in the published campus climate literature. (Of note, campus climate, for this article, refers to assessment of interpersonal violence/harassment on college campuses and students’ perceptions of safety, resources, and college responses. Early literature using the term “campus climate” has also assessed student morale, and gender, racial, and sexual minority student perceptions of acceptance vs. hostility on campus.) A review of the literature determined that most studies have focused on what content was covered in CCSs administered at IHEs, especially whether the surveys adhered to the recommended content areas that the White House Toolkit (2014) considered important to include in a CCS (e.g., Krause et al., 2019; Moylan et al., 2018; Pritchard et al., 2019; Wood et al., 2017). For example, Krause and colleagues (2019) reviewed the gray (unpublished) literature and concluded that only one third of CCSs covered the six major areas recommended by the White House Toolkit (2014) and that “there needs to be a national mechanism to systematically identify survey reports and to standardize measures and reporting” (p. 611). Another focus of studies reviewing CCSs reflected concern regarding response rates to distributed surveys in that they focused on reviewing which methodologies (e.g., survey delivery mechanism, incentives) appeared most effective for producing larger and more representative samples (e.g., Berzofsky et al., 2019; C. Krebs et al., 2016; Rosenberg et al., 2019). However, these studies did not imply that the information collected would necessarily be the most comprehensive or reflective of campus interpersonal violence. Some of the research studies preferred to investigate relationships of factors in their collected data, especially related to examining victimization for marginalized groups compared with general student populations (e.g., de Heer & Jones, 2017). Even though Cantalupo (2014) believed that there were many disincentives for IHEs to conduct CCSs at the same time, she purported that benefits from such surveys were widespread. The issue more recently has not been whether institutions would conduct CCSs (Krause et al., 2019), but rather the difficulties of comparing findings across IHEs because of the variation among surveys as to how they are conducted, what content areas are covered, and how victimization is measured.
A few major CCSs deserve more detailed discussion. Early campus sexual assault studies looking at national samples of college women (C. P. Krebs et al., 2007, 2009) provided some of the earliest benchmark data on rates of sexual victimization, but specific items and psychometric data were not provided, nor were other forms of sexual misconduct or interpersonal violence included in these pioneering studies. The Association of American Universities (AAU) survey (Cantor et al., 2015) was an important model for multiple university assessment which provided an overall report for the 27 IHEs in their consortium (with an overall response rate of ~19%), but only one institution, University of Virginia, made their results public. While some psychometric information was provided on their items, this information was not comprehensive (i.e., missing means [M] and standard deviations [SDs], missing factor loadings, not listing psychometrics for all items). The survey was very long, often asking highly specific victimization behaviors and did not include some areas of content that could have been highly relevant (e.g., affirmative consent items, rape myth items). The ARC3 survey (Swartout et al., 2019), bringing together administrators and researchers to produce a comprehensive assessment of campus climate, demonstrated extensive coverage with suggestions for implementation of a CCS and provided data for IHEs for comparison purposes. However, they did not provide psychometric information to support the reliability of the scales and items or scale information (e.g., factor loadings) by which universities could judge the viability of the scales that they might wish to administer to their own students. The Campus Climate Survey Validation Study (CCVS; C. Krebs et al., 2016) provided some valuable information regarding survey methodology (e.g., US$25 incentive for participation produced a larger response than US$10, multiple reminders to potential participants increased participation) and provided important recommendations for researchers conducting CCSs; however, this survey only assessed sexual assault and sexual harassment with three additional items asking respondents about physical threats or violence in an intimate relationship. Forms of interpersonal violence/harassment that were not included in the CCVS were stalking, bullying, psychological abuse, and reproductive coercion. C. Krebs et al. (2016) also recommended that further research clarify items for students assessing sexual victimization to determine whether an incident qualified technically as sexual assault. And finally, Moylan et al. (2018) analyzed the quality of 105 publicly available CCSs regarding their methodology, topics included in the CCSs, and key findings. Due to much inconsistency across climate surveys, these researchers focused on the reason that most CCSs have been instituted and concluded that, “The variation in measurement of sexual victimization limits the ability of campuses, students, and researchers to make comparisons and raises concerns about unscientific measurement likely to produce inaccurate estimates of prevalence” (p. 447). They specifically cited the reason for this as the problematic use of measurement that was not shown to be valid or reliable.
Purpose of This Project
The goal of providing CCS items, psychometric data for the items and scales, and benchmark data from a major southern university was to provide a survey that could be evaluated for its measurement in light of documented findings useful for benchmarking purposes. In addition, the survey instrument provides some measurement strategies designed to comprehensively capture incidence of seven forms of interpersonal victimization through streamlined questioning. Regarding coverage, this survey is consistent with recommended topics of campus climate as well as prevalence of interpersonal violence/harassment suggested by the White House Toolkit (2014).
The campus climate/violence data set used for these analyses consisted of anonymous data from students who consented to their information being included in aggregate analyses that could be disseminated to external audiences. Psychometric data presented for this CCS’s scales and items assessed campus climate regarding perception of safety, knowledge of resources, perception of the university’s response to reports of sexual assault, risk factors, and participation in programs to prevent sexual violence. In addition, prevalence and frequency data were collected for seven forms of interpersonal violence/harassment for the prior school year from the students, and survey findings are presented in several formats (e.g., M, percentages). Basic demographics of the students were also collected. This project is expected to add to the CCS literature by providing a survey (with improvements based on concerns raised by prior literature) that can potentially be used for assessment of campus interpersonal violence/harassment knowing relevant psychometric information of items and scales used, and benchmark data for a large state university.
Method
Participants
The data for these analyses came from a CCS conducted in 2017 at a large southern university which examined campus climate and interpersonal violence/harassment victimization. Of those eligible to complete the survey (N = 21,836), 6,995 participants (26%) consented to share their survey responses for external dissemination. Of these students, 31 responded “choose not to answer” for every question resulting in a negligible nonresponse rate of 0.4%; these were removed due to providing no data. The final data set consisted of 6,964 participants.
The participants constituted a sample of 63% (n = 4,342) female and 37% (n = 2,573) male students. The racial distribution was 78.0% White, 6.5% Black, 6.2% Asian, and 9.3% Other. The majority (93.5%) of participants were domestic students; 6.5% were international students. A breakdown by class status indicated that 24.9% were in their first year on campus, 49.3% were non-first-year undergraduates, and 23.2% were graduate/professional students. Compared with campus statistics for that academic year, this sample is quite similar, with the few significant differences for these demographics being negligible (<0.20 criterion signifying a small effect size).
Content and Description of the Survey
The CCS was designed by senior faculty at a center of the university with expertise in conducting research on violence against women. In line with the White House Toolkit (2014) recommendations, survey items analyzed in this project (see Table 1) assessed both what has been termed “campus climate” as well as a range of interpersonal victimization experiences. Campus climate is the general term under which many attitudes, behaviors, risk factors, behavioral intentions, and perceptions (which are hypothesized to relate to experiencing sexual assault and other forms of interpersonal victimization) are assessed as well as students’ perceptions of whether their campus is seen to be proactive and/or responsive to such victimization. Such survey items are expected to inform university administrations regarding students’ perceptions and knowledge regarding safety/violence that, in turn, could influence policy or program changes. This CCS included items that covered all the White House Toolkit’s (2014) recommended climate assessments of students’ perceptions: university response to reports of sexual assault; university orientation toward protection of students; training for intervention and prevention; knowledge of how to report and get help; bystanding confidence; and view of sexual violence on campus.
Item Content, Means, Loadings, and Percentage of Endorsement of the Scales Used to Measure Campus Climate Factors (Perception of Safety, Perception of University Response to Report of Sexual Assault, Knowledge of Resources), Social Risk Factors (Attitudes toward Affirmative Elements of Consensual Sex, Alcohol Use, Peer Support for Violence), Bystanding Factors (Attitudes, Observed or Suspected Risky Behaviors, Participation in Prevention Programs), and Interpersonal Victimization (Bullying, Sexual Harassment, Stalking, Psychological Abuse, Physical Violence, Reproductive Coercion, and Sexual Assault).
Assessment of “victimization” has expanded beyond the initial determination of the extent of sexual assault on campuses, spurred by the Clery Act (1998) and VAWA (1994; 2013) as major pieces of legislation mandating reporting of crime statistics to include sexual assault, stalking, dating violence, and domestic violence. The White House Toolkit (2014) sample survey, however, only included assessment of sexual assault (with follow-up questions for victims regarding contextual aspects of this victimization) and physical intimate partner violence. Because Title IX has conceptualized sex discrimination to include sexual assault, stalking, and sexual harassment, over time sexual harassment has typically been assessed in CCSs as well. As an expansion of the terms “dating violence” and “domestic violence,” assessment of severe psychological abuse and reproductive coercion as well as physical abuse within intimate relationships is considered a more comprehensive measurement of ways in which intimate partners can abuse or harass. Although “bullying” is not typically included as a potentially gendered form of violence, this interpersonal harassment has been assessed through CCSs as well.
Campus Climate Assessment
As seen in Table 1, this CCS addressed the concepts and knowledge recommended by the White House Toolkit (2014) and the Defense Equal Opportunity Climate Survey (2014), but also included known associations and/or risk factors of sexual misconduct on college campuses identified in research literature (e.g., DeKeseredy, 1990; Langhinrichsen-Rohling et al., 2000; Payne et al., 1999). Faculty also reviewed all early versions of CCSs that were in the public purview at the time (e.g., Banyard et al., 2013; Campbell, 2014; McMahon et al., 2016). As a result, items and scales for the “campus climate” section of the survey included (a) students’ perceptions of safety (both general and specific to sexual violence; four items); (b) students’ perceptions of safety as one’s own or others’ responsibility (one item); (c) students’ perceptions of the university’s response to a report of sexual assault (three items); (d) students’ perceptions of the likelihood of retaliation by peers for a reported sexual assault (one item); (e) students’ personal knowledge for reporting sexual assault (three items); and (f) students’ accuracy of knowledge regarding administrative and reporting aspects of sexual assault (four items). The research team determined the need to include risk factors for victimization identified or hypothesized in the literature as potentially useful data for university violence prevention through planning and policy. These risk factors, which can be targeted for violence prevention, (see Table 1 for individual items and sources) included (a) attitudes toward affirmative elements of consensual sexual activity (five items); (b) alcohol use and exposure to substances (six items); (c) friends involved in violent behavior (three items); (d) safety planning for potentially problematic situations (one item); (e) attitudes toward intervening in potentially violent/harassing situations (four items); (f) involvement in the university’s violence prevention programming (five items); (g) opportunities for intervening in risky situations (five items); and (h) endorsement of rape myths (five items). (Of note, the White House Toolkit (2014) had also recommended assessment of bystander confidence and rape myth acceptance.)
Victimization scales
Several concepts guided decision-making for assessment of victimization. Expanding on the White House Toolkit (2014), covering a wide range of violence/harassment was considered important to understand the scope and range of victimization experiences of students. For university purposes, determining “victims” likely in need of services influenced employing legal definitions where appropriate (e.g., for stalking to be endorsed, the actions of the stalker had to result in fear for the recipient rather than being viewed as humorous or annoying) or more serious behaviors would be assessed (e.g., psychological abuse items did not include nonharmful couple conflict). Because a CCS survey is not a research study to provide highly detailed concepts and specificity about forms of victimization, the faculty opted against collecting victimization information for every conceivable behavioral way that a type of violence/harassment could be manifested. For example, the university likely would be best served by knowing, on a yearly basis, the prevalence and incidence of students experiencing general forms of bullying (i.e., verbal face-to-face; social media; physical) rather than knowing how many students experienced each of many specific types of bullying behaviors. In addition, covering a wide range of victimization required a streamlined approach to produce information useful to a university’s administration without producing survey fatigue for participants. Endorsement of victimization experiences on the survey was not limited to incidents occurring specifically on campus or only involving people at the university; rather, victimization of students from any source was expected to be problematic for the recipients and thus could affect their performance or require university services. To aid universities in understanding the extent to which perpetration was a function of its students and employees, however, for each form of victimization (except bullying, which specifically asked for incidents from other students), the CCS determined whether the perpetrator was affiliated with the university.
For all seven forms of interpersonal violence/harassment (see Table 1 for items), the literature was reviewed to identify all existing published scales for each form. Because existing scales for most forms of victimization typically consisted of long lists of specific behaviors, faculty engaged in an innovative approach to synthesize these lists into categories to streamline assessment of victimization without losing incidents of violence/harassment. Specifically, faculty first plotted these behaviors across scales to determine overlap among them. Then, for most of the victimization scales, faculty devised general concepts under which the specific behaviors could be classified to distill long lists of specific behaviors into general category items that would capture all individual forms of that type of victimization. For example, five items assessing stalking categories covered the range of methods by which a person could be stalked without listing all possible behavioral instances (e.g., the categorical item, “Repeatedly tried to communicate with you in ways that made you afraid,” was used rather than listing individual behaviors such as “sent you flowers you did not want,” or “kept calling you after you said you did not want to speak with that person”). Exceptions to this mode of distilling specific behaviors for developing the victimization scale were the intimate partner physical violence scale (which required specification of physical acts although some items were listed as one item if they represented similar level actions, for example, shoved, shook, pinched) and the reproductive coercion scale, which asked two items about interference with birth control and protection from sexually transmitted infections (STIs).
To keep definitions as distinct as possible, sexual assault was defined in this CCS using Uniform Crime Reporting (UCR) criteria for forms of “rape” as “being forced to have sex (intercourse, oral sex, anal sex, or penetration with an object) against your will” (U.S Department of Justice, 2014), which includes physical force, threatened force, or incapacitation. Unsuccessful attempts at forced sex were also recorded as incidents. Thus, this survey required some form of penetration forced on a person (or the unsuccessful attempt to do so) to be recorded as sexual assault. [The survey included an item in the sexual harassment scale to measure incidence of sexual assault that did not involve penetration which assessed incidence of unwanted sexual touching. Specifically, students were asked “How often, in the past year [has] someone touched you sexually (breast, buttocks, or genitals) when you did not want them to?”] Sexual assault incidence was collected through the filter of the conditions under which it occurred. Specifically, students reported forced sex occurring against their will due to (a) physical force; (b) being threatened with physical harm; (c) incapacitation due to substances slipped to them; (d) incapacitation due to voluntary use of substances; or (e) an attempted sexual assault from which they escaped. Thus, a total of sexual assault victims could be identified, but specific data were also obtained regarding assault-specific details.
Because the original intent for the resurgence of CCSs was to collect more contextual information regarding sexual assault, and because potential legislation (e.g., CASA, 2015) would have additionally required assessment of postassault responses of victims, the CCS included items which assessed whether victims reported the sexual violence, impact of the sexual assault, and situation-specific details of sexual assaults (e.g., location, relationship to the perpetrator, perpetrator’s affiliation to the university, to whom the sexual assault was reported, and barriers for not reporting to university personnel).
Methodological Considerations of the CCS
Survey administration
This CCS was administered in accordance with recommendations by the White House Toolkit (2014) as well as other pioneering CCSs (e.g., C. Krebs et al., 2016). Specifically, all full-time students who participated in classes on campus and were above the age of 18 years were eligible for inclusion, students were given a unique link to complete the survey preventing them from completing it multiple times, the representativeness of the respondents was reviewed, and students with disabilities were accommodated. The survey remained open for 10 weeks during the spring semester and was advertised through email, yard signs placed throughout the campus, and the university’s newspaper. In addition, incentives (e.g., drawing for a US$250 gift card) were offered weekly. The survey itself used evidence-informed measures when applicable, limited the reporting time frame, insured confidentiality of responses, and provided resources for students should any experience distress while completing the questionnaire. Students in these analyses consented for their information to be included in analyses for external dissemination.
Survey design
The survey was designed with two key points: (a) to ensure that victimization was measured during the students’ enrollment at the institution, and (b) to streamline the questions to require less time for survey completion for students who did not have any, or very limited, exposure to violence or harassment. The survey was completed on the Qualtrics survey platform, which formatted the survey to be computer- and mobile-friendly. Qualtrics survey design allows for text to be “piped” or inserted based on designated criteria. This function allowed questions to be asked for the prior year if students indicated they were a sophomore or above or a transfer student returning for their second year on campus; for first-year students and first-year transfers, questions were asked using the time frame since the beginning of the academic school year. Varying the time period being assessed based on the student’s classification ensured that interpersonal forms of violence were measured during the student’s academic career on campus. In addition, the survey employed branching questions to direct follow-up items only to individuals for whom they were relevant (e.g., questions about postassault experience were only given to individuals reporting a sexual assault), thereby streamlining the survey for students with minimal exposure to victimization. Question wording and response options were inclusive of all genders and intimate relationships, and all items included the response option “Choose not to answer.”
Regarding assessment of sexual assault, most sexual assault scales currently being used require detailed reporting on specific sexual acts that occurred for specific reasons. To make this section easier for responding and more palatable to the average student, we chose a format that defined “sex” as intercourse, oral sex, or anal sex (including penetration with an object) and which asked students to report if sex had occurred against their will due to conditions that constitute legal definitions of sexual assault/rape (e.g., physically forced, threatened with harm if they did not comply, physically unable to consent to sex due to alcohol or drugs). This approach not only shortened the number of items to which they had to respond but also alleviated respondents from having to specify the type of sex that occurred.
Statistical analyses
All analyses for this article were conducted using SPSS 25. Percentages of endorsement of items and scales were also calculated by gender as well as for the overall sample. Factor analyses were conducted for multi-item factors to determine whether items loaded on the primary factor for that scale at .40 or above. Items not meeting that criterion were removed from the scale, and the alpha was recalculated. In this way, we identified some items that needed to be analyzed individually rather than as part of the scale for which they were originally expected to contribute. Scale reliabilities were calculated using Cronbach’s alpha. KR-20, a special case of Cronbach’s alpha, was calculated if the data were binary. Descriptive data (M, SDs, and range of response options) were computed for items, scales, overall sample, and by male and female gender. The numbers of transgender and gender-nonconforming students were too small to include in analyses.
Results
Table 1 presents scale-level data (i.e., reliability coefficients and response options) as well as item-level data, specifically the content, item M and factor loadings, and the percentage of endorsement for each item by the overall sample and by gender. Table 2 provides descriptive statistics of the items and scales in the survey consisting of overall sample M and SDs, numerical response range, and M and SDs by gender.
Mean, Standard Deviation (SD), and Range of Items and Scales in the Survey.
Note. IPV = intimate partner violence.
The factor is an item.
Scale and Item Psychometric Information
See scale and item psychometric information, which is included in Table 1.
Internal reliability
Internal consistency (i.e., Cronbach’s alpha/KR-20) for the campus climate factors ranged from .66–.91. Most of the scales in this CCS, however, had acceptable alphas at .70 and above. Cronbach’s alphas for the violence and harassment forms of victimization were typically higher, ranging from .79–.93, except for bullying (α = .63). Because the three bullying items assessed victimization of this type experienced face-to-face, through social media, and by physical means, assessment of the individual forms of bullying may be more useful than combining them into a scale. Two scales designed to assess the impact of sexual and physical violence yielded internal consistency alphas of .68 and .88, respectively. Although both impact scales included physical/medical consequences along with emotional/functioning consequences, it appears that the degree or severity of physical violence from an intimate partner (implied by severity of injuries) may be more related to emotional/functioning factors than for rape/sexual assault where the emotional/functioning disruption may occur irrespective of physical or medical consequences. Thus, the impact of the sexual assault scale might be better assessed by separating the items measuring physical consequences from items measuring emotional/functioning aspects.
Factor loadings
For the campus climate scales, factor loadings of individual items in the scales measuring students’ perceptions and knowledge were high, typically loading at .58 or above. For example, the scale assessing students’ report of their knowledge for reporting and seeking help for a sexual assault yielded factor loadings of .91–.95. Factor loading on scales assessing risk factors was also high (affirmative sexual consent: .55–.88; risky friends: .91–.91) as well as for scales designed to assess violence prevention (bystanding attitudes: .81–.87; opportunities for intervening in risky situations: .62–.71; rape myth acceptance: .56–.86).
Factor loading of items on victimization scales also demonstrated strong relationships of items with the primary factor for each form of violence/harassment. Specifically, sexual harassment items loaded .70–.85, stalking items loaded .79–.86, intimate partner psychological abuse items loaded .77–.82, physical violence loaded .74–.86, and reproductive coercion items both loaded .91. The items on the scale measuring impact of intimate partner physical violence loaded .71–.86, and the items measuring impact of sexual assault loaded .61–.81 on that scale.
Descriptive Data
Means for individual items and scales are presented in Tables 1 and 2, but descriptive data for benchmarking purposes are found in Table 1. Specifically, Table 1 provides the percentage of endorsement for individual items for assessment of campus climate, risk factors, and prevention of violence. Percentage endorsement rates for different forms of victimization are given as ever/never summations, such that if a student experienced at least one incident of the behaviors within a type of victimization, they were categorized as “ever” experiencing that type of violence/harassment in the past year. In addition, the percentage of university-affiliated perpetrators for students experiencing a form of victimization was reported to allow universities to understand the level to which victimization appears related to campus culture. Because of the poorer internal reliability of the bullying scale, data for the three forms of bullying were reported separately, but endorsement still signified ever or never experiencing that form of bullying during the prior year. Sexual assault (rape) was reported as ever/never for the overall sample, but incidents were also separately reported as to the percentage of incidents resulting due to the type of sexual assault. In line with recommendations of the White House Toolkit (2014), contextual information of sexual assaults was reported in percentages regarding location (on campus vs. off campus), relationship of the perpetrator to the victim, perpetrator’s affiliation with the university, impact of the sexual assault, to whom the sexual assault was reported, and reasons for not reporting the sexual assault to someone at the university.
Campus climate descriptive findings
Very high percentages of the students reported feeling generally safe at the university, with 99% reporting feeling safe during the day and 78% at night and that they believe the university cares about their personal safety (93%). However, female students feel less safe at night than male students (71–90%). In contrast, only 36% of students thought that “sexual violence is not a problem at the university.” The vast majority of students perceive that university administration would be fair and helpful if they were to report a sexual assault (84–92%) and that the university would prevent retaliation by a perpetrator toward a victim reporting such an assault (85%). While a majority of students appear to know how to report a sexual assault (58–71%), this still leaves a significant proportion of students lacking basic knowledge in this regard. In addition, a significant portion of students are not accurate (22–46%) in their knowledge of mandatory reporting, investigation procedures, and accessing accommodations postassault.
Risky factors descriptive findings
Only a small portion of students disagreed with statements of affirmative sexual consent (4–6%). Regarding substance use, a portion of students report lifestyles that appear potentially problematic, that is, 4% report drinking 6 or more days in the past 2-week period, 17% report binge drinking when they drink, and 6% report frequently getting “drunk.” Thirty-nine percent of students report that most every time they are going to an event, that they practice “pre-gaming,” in which students drink in advance of an event. When assessing potential peer influence, 6% of the students believed they had a friend who forced or pressured someone into having sex with them, and 6% believe they have friends who engaged in physical force with an intimate partner. Twenty percent reported having a friend who had been sexually forced or pressured.
Violence prevention descriptive findings
Almost 70% of the respondents reported making safety plans before going to events, and most students (77–93%) thought they would actively intervene in situations where a student was hurting another student even if particular barriers to intervening might arise. Of the situations presented to the students, they thought they would be least likely to intervene in such a situation if they did not know the individuals personally. Between 8 and 18% of students reported having observed the five described situations of potential violence/harassment that students are likely to experience in their social lives, such as suspecting someone was being led away for sex while too incapacitated from substances to know what was happening, or suspecting that drugs or extra alcohol was being slipped into someone’s drink. Small numbers of students (5–16%) endorsed different rape myths, except for the item where almost half of the students (48%) agreed “If a person is drunk, that person might sexually assault someone without intending to.”
Victimization descriptive findings
Percentages of student who “ever” versus “never” experienced different forms of victimization varied by type of violence/harassment. Face-to-face verbal bullying was the most common type of bullying (15%), but students also reported social media bullying (5%) and physical bullying (5%). Verbal bullying was reported more often by female students, although the other forms of bullying were reported by the genders at similar rates. Sexual harassment was the most highly endorsed form of victimization (28%) with almost three times as many female students as males reporting this experience in the prior year. Of those reporting ever experiencing sexual harassment, 62% reported the perpetrator was either another university student or an employee of the university. Stalking was experienced by 9% of the students with the majority (60%) of the perpetrators having some affiliation with the university as a student or employee. Serious psychological abuse was reported by 15% of the students and 6% of them reported physical violence (with negligible differences in reporting between genders for these forms). Respectively, 49 and 54% reported that psychological and physical abuse in relationships was instigated by a partner with an affiliation to the university as a student or employee. Other forms of intimate partner abuse measures indicated that students experienced reproductive coercion in the form of interference with birth control (2.4%) or condom use to prevent STIs (2.0%), with female students reporting interference with condom use to prevent STIs (2.7%) at a higher rate than male students (0.8%). (Percentages for psychological abuse, physical violence, and reproductive coercion were derived from questions asked only of students reporting a significant relationship during the prior year.)
Sexual assault, defined above as forced penetration against one’s will, was reported by 4% of the students, although an additional 8% reported, on the sexual harassment item assessing sexual touching against their will, that this had happened to them in the past year. Of the 4% reporting forced penetration, impacts of sexual assault were reported from 13–53%, with the most prominent impact being emotional problems (53%), followed by school problems (31%). Medical treatment was needed by 13% of sexually assaulted students and 20% reported physical injuries. Other contextual items revealed that the vast majority of the perpetrators were other university students (59%), that the sexual assault was more likely to have occurred off campus (67%; this percentages includes student residences off campus as well as other off-campus locations), and that assault victims were most likely to report the assault to a peer (92%) rather than a university official or employee (i.e., faculty, staff, or other employee—10%; university violence intervention and prevention center—12%). Eight percent reported the assault to police, although this included city police as well as university police. Thirteen percent reported the assault to a health care professional, although again this included both university health services as well as private medical personnel. If sexually assaulted students did not report the rape/assault to a university source, the reasons for not doing so varied widely. Students could choose more than one barrier for nonreporting. The most commonly reported reasons were that the student felt the incident was not serious enough (39%); the student felt it was private (34%); the student wanted to forget what happened (21%); the student did not want the other person to get into trouble (18%); and the student was embarrassed or ashamed (18%). Only 12% of the victims of sexual assault chose not to report the assault to the university because they thought that they would not be believed, that they would be blamed, or that others would not understand or think it was serious.
Discussion
A major aim of this article was to provide more comprehensive information about a CCS that not only presented its survey items, but could demonstrate psychometric data for its items and scales that would support its reliability and usefulness for future use as a CCS. In addition to providing information that would promote confidence in the use of the survey, providing benchmark data from a large university for which the sample was deemed representative was considered necessary for another university administration to consider using it.
Support for Survey Items and Scales
Because one of the advantages of this survey was promoted as collecting sensitive victimization information in a streamlined yet comprehensive manner, the excellent internal reliability and strong factor loadings of items on those scales supported our goal of producing useful scales. Thus, for assessment designed to determine the extent of student interpersonal violence/harassment, these scales are promising. The one exception may be bullying items which may function better for individually assessing face-to-face bullying versus social media bullying versus physical bullying. The internal consistency for these items assessed as a scale was not within an acceptable range (i.e., α < .70), and although they appear useful as categorical items for comprehensively capturing ranges of bullying behaviors, the three types of bullying may be distinct enough to warrant assessing the three categorical forms of bullying individually rather than as a scale.
The scale assessing the impact of intimate partner physical violence demonstrated excellent internal consistency and factor loadings using responses from the subset of students experiencing physical violence in a relationship. While the scale assessing impact of sexual assault did not demonstrate similarly strong internal consistency as the scale measuring the impact of partner physical abuse, the factor loadings were strong. Because a smaller percentage (13%) of sexually assaulted students reported physical injury as a result, assessing physical impacts from sexual assault separately from emotional/functioning consequences may be warranted.
Although other CCSs have devised items assessing campus climate (e.g., Banyard et al., 2013; Campbell, 2014; Cantor et al., 2015; C. Krebs et al., 2016; C. P. Krebs et al., 2007; Swartout et al., 2019), the psychometric data for this survey’s scales indicated that internal consistency for the campus climate factors was good to excellent, including the risk factor and violence prevention scales. Potentially useful are the shortened and adapted scales assessing acceptance of rape myths, the scale assessing barriers to intervening in risky situations, and attitudes toward affirmative consent scale, which all showed strong internal consistency as well as excellent factor loadings for the items used. The only scale indicating below acceptable internal reliability was the one for which students reported observation of risky behaviors for which they might have had the opportunity to intervene. Although the factor loadings for the items on this scale were high, the reliability of reporting having seen these different situations is likely influenced in large part by fate—that is, a person would have had to happen upon such an occurrence. However, researchers in the area of bystanding (e.g., Coker et al., 2011) have postulated that rates of observation of risky situations may increase when individuals trained in bystanding are both more aware of what situations might present opportunities for intervention and also feel as if they have an idea how to respond, thus reducing a need to avoid processing situations around them.
Descriptive Data
Benchmark data were provided for items and scales that included M and SDs (overall and by gender) as well as percentages of endorsement. Medians for victimization scales were all close to 0, which is not unexpected in a sample of 6,964 students where the likely data point reflects the fact that most students did not experience a particular form of victimization. However, the percentages of endorsement of the forms of victimization (i.e., a student was included if they experienced at least one behavior from the categories representing a type of victimization at least one time in the last year) demonstrate more clearly the proportion of students in this university sample who experienced the different forms of victimization.
Attempting to compare campus climate scales from this CCS with other surveys that have devised their own assessment scales does not appear possible. Even victimization data, which are defined and measured differently across CCSs (Moylan et al., 2018), are difficult for comparing instances of interpersonal victimization. For example, five different surveys that we were able to locate that collect data on sexual assault over a 12-month period from female college students reported a range of percentages of “unwanted sex” from 0.7–16.7% (Koss et al., 1987; Mohler-Kuo et al., 2007; National College Women Sexual Victimization Study, 2000; National Crime Victimization Survey, 2014; University of Michigan, 2015). These sources, which we hoped to use for comparison purposes, all included different types of “unwanted sex” in their data collection, rendering comparison impossible. Because this CCS assessed sexual assault/rape using the definition of completed or attempted penetration (typically considered first-degree sexual assault) and separately included an item regarding unwanted sexual touching (typically viewed as a lower degree of sexual assault or sexual battery), this distinction could potentially be used in the future for greater clarification of sexual misconduct rates.
Data are included that reflect students’ responses to some individual items that appear to constitute unique indicators rather than exist as part of a scale. For example, the item assessing perceptions as to whether persons accused of sexual assault or their friends would retaliate against the person reporting a sexual assault did not load on the primary factor of the scale, “Perceptions of University Response to a Report of Sexual Assault.” Rather, it appeared to exist as an independent factor. Survey items of interest which did not load on proposed scales are still included in the reported results with the suggestion that they can be used as independent factors for analyses.
Limitations
Because these data were collected at a large southern university, we recognize that it is impossible to know whether they potentially represent regional differences currently. In addition, the greater majority of this university’s student population is Caucasian, which also potentially limits generalizability of the findings. Further collection of data using this survey in other regions of the United States, in large urban universities with more diverse student populations, in smaller colleges, and in 2-year institutions would be important for comparison to determine the viability of the survey factors across a range of IHEs.
This CCS chose to use items that reflect more of the model of criminal sexual assault of the most severe degree. CCSs originated by other researchers have used, at times, broader definitions that include unwanted touching (e.g., kissing, fondling) in their counts of sexual assault, for which reported rates would be expected to be higher (Washington Post/Kaiser Family Foundation, 2015). To make comparisons of rates with other surveys, the data from this survey’s item assessing nonpenetration sexual assault in a separate item could be used in conjunction with the survey’s sexual assault data. Because this CCS collected incidence data from students for the prior year in college rather than determining rates of sexual violence since entering college, this survey’s rates are of course lower than those of surveys collecting data from the time students began their college career. Thus, any comparison with surveys using a different time frame must take that into consideration.
Implications
Like most CCSs, data on campus climate factors are presented mostly as percentages of students agreeing with scales or items, and violence/harassment data are typically represented as a student either experiencing such victimization or not. However, the function of these surveys is not to conduct in-depth research on a particular type of victimization but rather to help universities determine the extent of interpersonal violence on their campuses to potentially plan for services for students negatively impacted by victimization. Hopefully, IHEs reviewing the extent of these experiences for their students are also impelled to consider instituting prevention programs to reduce the need for intervention/treatment programs while taking a proactive approach to campus interpersonal violence/harassment.
The data from this CCS also provide a university with a greater awareness of whether perpetrators of violence toward university students themselves are affiliated with the university. While the focus of CCSs is typically on the extent of victimization, it can be quite enlightening to determine what proportion of perpetrators for each form of violence/harassment are either students or employees of one’s university, even for intimate partner forms. This has implications for intervention/educational programs aimed to enlighten and influence students’ actions and possibly also policy changes regarding employees. Data on the percentage of students for whom their victimization was perpetrated by either a student or employee (e.g., faculty, coach, staff, RA, TA) affiliated with the university allow for a better assessment of the campus climate, although administrations still need to plan for services for students experiencing victimization away from campus or from a person not affiliated with the university.
Future research using this CCS is welcomed for further replication of its elements, its psychometric properties, and resulting benchmark data. Additional analyses of the survey data are being conducted to go beyond basic descriptive data, but the information from this project is provided to produce a useable CCS with accompanying support for its scales, some survey strategies expected to enhance data collection, and benchmark data for future comparisons.
Footnotes
Acknowledgements
The authors wish to thank the Office of the President at the University of Kentucky for institutional support. The authors also wish to acknowledge the technical support of Zhengyan Huang, Adam Lindstrom, and Adam Recktenwald, and manuscript assistance of Hayley Cole, Eric Haak, and Kellie Lynch.
Declaration of Conflicting Interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: Financial support of the project was provided by the Office of the President at the University of Kentucky.
