Abstract
Reports of sexual assault have been found to elicit online discourse incivility. The present study employs a computerized coding tool to examine linguistic characteristics of news media that are likely to influence discourse incivility—specifically, negative emotion, disagreement, and discussion about power relations. Additionally, machine learning was harnessed to measure the levels of comment toxicity, insult, profanity, threat, and identity attack in Reddit and Twitter posts sharing news reports of sexual assault. Findings reveal that linguistic features of news articles interact with platform community norms to predict rape culture as expressed within online responses to reports of sexual assault.
Introduction
Five years before the advent of the #MeToo movement, news reports of a rape case in Steubenville, Ohio, spread across the United States. A 16-year-old victim had been repeatedly sexually assaulted by high school football players who also made a video of the assault and discussed it on social media. 1 Some news stories included horrific details (e.g., a graphic video of the teenage boys laughing about how the victim was “so raped”). 2 The public response was mixed, however. Frequently, rather than resolving to address systemic sexual violence, members of the public scrutinized specifics of the case, reacting with incivility toward the alleged victim and her assailants.3,4 Despite the Internet's potential to facilitate the democratic ideal of constructive debate, rape culture, a phenomenon wherein society trivializes systemic rape, pervades online forums. 5 Online rape culture is revealed, in part, in online discussions of sexual assault in which users react with incivility—blaming victims and defending accused rapists.6,7 Manifestations of rape culture as uncivil reactions to discourse around sexual assault raise questions about what features of news media elicit this behavior.
Discourse Incivility
Incivility presents itself in many forms; scholars characterize it as uncourteousness, irrational public expressions, refusal to acknowledge the legitimacy of opposing opinions, defensive reactions, disrespectful behaviors, disrespect for traditions of democracy, and violations of politeness norms.8–12 Lerner and Miller's just-world bias sheds light on incivility. 13 Just-world bias is the comforting illusion that good happens to good people and that bad people deserve their adversity. Literature reveals a link between just-world bias and incivility. For instance, research has shown that individuals react with empathetic anger, hostility, and aggression to unfair situations.14,15 Consequently, when bad things happen to good people (e.g., the innocent become rape victims), individuals (1) experience cognitive dissonance and (2) try to relieve cognitive discomfort by rationalizing what happened (e.g., blaming victims). 6 Just-world bias functions alongside stereotypes about which sexual assault and harassment victims are more worthy of empathy—namely blameless victims violently assaulted by deviant perpetrators.16–19
All news reports of sexual assault likely elicit some cognitive dissonance, yet it is unclear why some such reports elicit discourse incivility. This is consequential, as incivility perpetuates itself. For example, a recent content analysis of comments responding to news reports of sexual assault found that hostile attributions of blame (i.e., victim-blaming comments) generated hostile replies. 7 In this work, we examined characteristics of news media that influenced discourse incivility.
Defense motives and power
Perceptions of news accounts of sexual violence are shaped by many considerations, including characteristics of those accounts. Media gatekeepers frequently report on sexual assaults through a limited lens that perpetuates stereotypes about sexual violence1,20 and fails to address broader societal trends.21,22 For example, a qualitative analysis of news coverage of the Steubenville rape case found prevalent rape myth themes. 1 Likewise, an analysis of news reports of the USA gymnastics sex abuse scandal showed that gatekeepers generally employed episodic frames, focusing on specific situations, instead of including the context of the prevalence of child sexual abuse by those in positions of power. 21 Ignoring patterns of sexual violence may sustain and reinforce rape myths, including victim blaming.23,24 Such media-perpetuated myths about the role of power dynamics, sexuality, and gender in sexual violence influence individuals' responses to sexual assault.25,26
In concert with stereotypes and myths, audience motives can shape their reactions. When individuals are motivated to process a message, they give it more effortful attention. 27 One particularly salient motivation is the defense motive, 28 which is the drive to defend core beliefs and pre-existing stereotypes. 29 Research has repeatedly shown that threatening one's belief in a just world elicits discourse incivility.6,30,31 Scholars have investigated how defense motivations translate into attributions of blame, finding that observers attribute to minimize their own fear of being a victim or an accused perpetrator in a similar situation. 6 Salient power dynamics can prompt defense motives, motivating individuals to defend their in-groups and act with hostility toward out-groups. 32 Thus, we posit H1: Article discussions about group power dynamics will be associated with post incivility.
Disagreement and dissonance
A second source of incivility may be uncertainty around what happened in cases of sexual assault. Disagreement causes discomfort (i.e., cognitive dissonance). To ease dissonance-induced discomfort, individuals are motivated to resolve conflicting beliefs. 33 In online reports of sexual assault, individuals may resolve conflicting accounts by siding with in-group members and blaming out-group members. 6 While disagreement may prompt defensive reactions, most journalistic codes require journalists to report news stories with objectivity, 34 often interpreted as presenting all sides of a story. Yet, the conflict between entities, specifically the victim and perpetrator, can elicit uncertainty about what really happened. Indeed, extant research shows a positive relationship between the disagreement in news reports and discourse incivility. For example, an analysis of Tweets discussing climate change found that highly disputed topics positively predicted discourse incivility. 35 Accordingly, we predict H2: Article disagreement will increase post incivility.
Negative emotion
Negative information in reports of sexual assault may also provoke post incivility; such uncivil reactions may be a coping mechanism for managing distressing emotions. Underpinned by just-world bias,13,36 upsetting information in sexual assault news can motivate individuals to defend their belief in a just world.37–39 Furthermore, increased negative information motivates individuals to exert more cognitive energy attending to a message, 40 and individuals scrutinize negative news more than positive news. 41 Similarly, Trussler and Soroka investigated features of news articles that attract reader attention; they invited participants to the laboratory to read a news story for a bogus eye-tracking task. 42 When presented with 50 news stories, participants were more likely to select—and carefully read—negative news articles than positive and neutral ones. We predict such careful attention to upsetting information will trigger defense motives and incivility. We posit H3: Article negative emotion will be associated with post incivility.
Platform community norms
Organizational behavior scholars have long theorized that incivility stems from interactions between situational and community norms, shaped by organizational policies and measures. For example, low expectations of procedural justice might interact with employee anger to elicit uncivil behavior.43,44 Similarly, platform capabilities may shape community norms—both online and offline—that enable or impede incivility (e.g., Reddit moderator rules and Twitter's “hateful conduct policy”45,46). For example, the anonymity of many online communication spaces (e.g., Reddit) allows users to act without damaging their reputation, particularly when making uncivil comments.47,48 When anonymous, users may post hostile responses to news reports of sexual assault (e.g., the shaming and blaming of victims). 7 Research has shown that removing anonymity from an online forum can decrease discourse incivility. 49 Yet while anonymity may facilitate incivility in certain situations, identifiability may perpetuate incivility in others. For example, scholars have argued that identifiability to an in-group audience can prompt expressions of commitment to one's in-group. 50
Community norms are contextually dependent, and they vary—both within online culture broadly and within the microcultures of the online platforms. Accordingly, distinct online communities respond to and censure different dimensions of incivility differently.45,51 Thus, defensive comment incivility may vary by platform. Our related question here is RQ1: How does incivility vary by online platform?
Methods
Data collection
An anonymous social platform (Reddit) and an identifiable social platform (Twitter) were included in the sample because of their popularity as venues for sharing news.52,53 An investigation of the most popular news subreddits (forums dedicated to sharing news) found that the most popular U.S. news subreddit was “/r/news.” We felt that it was important to sample from a subreddit with all news, as opposed to subreddits specific to sexual assault, to mitigate sampling bias.
We began with a search of each platform using the terms “sexually assaulted,” “sexually assaulting,” and “sexual assault.” To extract posts sharing news reports of sexual assault, we took a systematic random sample of 50 posts shared to each platform every week for 5 years (from January 2015 to December 2019, totaling 24,000 posts). The GetOldTweets3 and Selenium Python3 libraries were used to scrape all Tweets and Reddit posts.54,55
To facilitate the representativeness of the news articles, researchers then manually filtered through a shuffled list of 50 English posts from each week per platform to randomly extract 10 posts from each week (5 from Reddit and 5 from Twitter) that shared the U.S. news report of a sexual assault. We only included reports of sexual assault and excluded all other news frames (e.g., stories about generalized rape culture). When a news article had been deleted, we sampled a different post for that week. Researchers manually extracted the text from the news articles; a similar approach has been used in media effects research to investigate the relationship between news sentiment and tweet sentiment. 56 The resulting sample contained 480 unique news articles and the post language associated with each.
Sentiment analysis procedures
Individuals express incivility in different ways, 57 requiring an operationalization that accounts for its various forms. We harnessed machine learning to provide a continuous measure of five prevalent kinds of comment incivility. Specifically, we employed Perspective API, an AI tool created by Google's Counter-Abuse Technology team, to measure levels of comment toxicity, insult, profanity, threat, and identity attack 58 (Table 1). Google Perspective API generates a comment score between 0 and 1 for each dimension of incivility. Higher scores show an increased likelihood of a reader perceiving the comment as that dimension of incivility. Notably, a single comment receives different scores for each dimension. For example, the comment “If I were her father, I'd have killed her” may receive a score of 0.75 for toxicity and 0.95 for threat, showing a 75% likelihood that a reader will perceive the comment as toxic and a 95% likelihood that a reader will perceive the same comment as threatening.
Definitions for the Google Perspective APIs Incivility Dimensions, Along with Example Comments
After measuring different incivility dimensions, we analyzed the news articles' features using the Linguistic Inquiry and Word Count (LIWC) computerized coding tool.
59
We extracted three message characteristics hypothesized to predict incivility:
We analyzed article disagreement language to measure differences between different sides of a story; these words are used to differentiate between ideas (e.g., “but,” “hasn't”). We measured negative emotion language to assess levels of anger, anxiety, and sadness in articles (e.g., “afraid,” “depressed”). We measured article words referencing power relations between groups (e.g., “famous,” “bully”).
LIWC is observational in nature and accounts for long vs. short texts by calculating the percentage of lexicon category words relative to all words in a text. For example, we might discover that 15/745 (2.04%) of words in an article were LIWC negative emotion lexicon words. The LIWC output would then assign that particular article a negative emotion value of 2.04.
Results
Repeated-measures analysis of variance
We first gauged whether to model the dimensions of incivility together or separately using a repeated-measures analysis of variance to determine whether significant differences existed among toxicity, identity attack, insult, profanity, and threat. We ran Mauchly's test to check the assumption of sphericity. 60 Based on an alpha of 0.05, variance of scores between repeated measurements differed significantly from one another (p < 0.001), suggesting that the assumption of sphericity was violated. Accordingly, results were calculated using the Greenhouse–Geisser correction to adjust for sphericity violation. 61 The main effect for the within-subjects factor was significant [F(4, 1916) = 131.02, p < 0.001], suggesting significant differences among toxicity, identity attack, insult, profanity, and threat (Tables 2 and 3).
Repeated-Measures Analysis of Variance Results
Means Table for Within-Post Variables
Note: n = 480.
SD, standard deviation.
Tukey's comparisons were used to test the marginal mean differences in each combination of within-subject effects (i.e., incivility dimension) based on an alpha of 0.05. There were significant differences between each combination of within-subjects dimensions of incivility, except for insult and profanity (Table 4).
The Marginal Means Contrasts for Each Combination of Within-Subject Variables for the Repeated-Measures Analysis of Variance
Note: df = 479.
SE, standard error.
Linear regression analyses
We conducted five linear regression analyses to assess whether linguistic indicators of power differentials, negative emotions, and disagreement in news articles predicted each of the five dimensions of incivility expressed in posts associated with those news articles. We also assessed whether our predictor variables interacted with platform (Reddit vs. Twitter).
Discussion of group power dynamics
There were no main effects of power dynamics on dimensions of incivility. However, the power dynamics in news articles in interaction with platform did significantly predict several modes of incivility, namely profanity, insult, threat, and toxicity. In each case, this reflected a stronger relationship between discussion about group power dynamics and post incivility on Reddit than on Twitter (Table 5).
Regression with Platform, Negative Emotion, Differentiation, Power, Platform:Power, Platform:Differentiation, and Platform:Negative Emotion Predicting Threat
Note: ***p < 0.001; **p < 0.01; *p < 0.05.
Linguistic disagreement
Our second hypothesis predicted that article disagreement, operationalized as linguistic differentiation, would increase post incivility. There were no main effects of disagreement on dimensions of incivility. However, the interaction between disagreement and platform had a significant effect on profanity (p = 0.020) and toxicity (p = 0.026), reflecting a stronger relationship between disagreement language and post incivility on Twitter compared with Reddit (Table 5).
Negative emotion
Hypothesis 3 predicted that article negative emotion will be associated with post incivility. Negative emotion significantly predicted identity attack (p = 0.035); contrary to our prediction, results revealed that increased negative emotion decreased identity attack. While there were no other main effects of negative emotion, it interacted with platform to predict profanity (p = 0.024), reflecting a stronger relationship between negative emotion and profanity on Twitter than on Reddit (Table 5).
Platform
Platform was found to significantly predict two dimensions of incivility—threat and identity attack. Moving from Twitter to Reddit significantly decreased the mean value of threat (p < 0.001) and identity attack (p = 0.004), showing a greater prevalence of both on Twitter than on Reddit (Table 5).
Discussion
The present study sheds light on rape culture by examining the antecedents of incivility associated with news reports of sexual assault in online forums. Offering partial support for our predictions, platform exerted a main effect on online threats and identity attacks. Extant organizational behavior literature provides a useful framework for examining how social network community norms are shaped by platform attributes and capabilities; for example, Reddit's AutoModerator bot allows moderators to customize rules for discourse. 45 Different automated rules may facilitate community norms discouraging incivility. Contrary to our prediction that article negative emotion would elicit identity attacks, negative emotion decreased identity attacks. Overall, there was no simple unitary explanation for incivility, and incivility dimensions should be unraveled and studied separately.
While there were no main effects of article group power dynamics and linguistic disagreement on any mode of incivility, these linguistic features of news reports interacted with platform to predict varying modes of incivility. News discussion of group power dynamics interacted with platform, producing greater profanity, insult, threat, and toxicity on Reddit than on Twitter. Conversely, linguistic disagreement in articles shared to Twitter exerted a stronger effect on profanity and toxicity. The relationship between article negative emotion and profanity was also greater on Twitter than on Reddit. In sum, incivility manifested differently on Reddit compared with Twitter, necessitating nuanced measures of incivility on different platforms. Contextualizing these findings with investigations of workplace incivility shed light on the role of online community norms in manifestations of discourse incivility.
Although there are many causes of rape culture, findings reveal that defense motives to sustain preexisting stereotypes may be one driving force behind rape culture as expressed within online responses to reports of sexual assault. Instead of viewing rape culture as a widespread societal problem, individuals may react defensively with discourse incivility to the cognitive discomfort elicited by news article discussion of group power dynamics, negative emotion, and linguistic disagreement—thus, reinforcing existing stereotypes and myths about sexual assault.1,16,17 Furthermore, distinct online community norms, shaped by a platform's affordances, can enable or impede such incivility.
These findings are consistent with organizational behavior theory suggesting that incivility stems from interactions between situational and community norms, which are shaped by organizational policies and measures.43,44 Distinct community norms, driven by platform capabilities, either enable or impede varying dimensions of incivility. For example, low expectations of being banned from Twitter for profanity might enable a profane response to a report of sexual assault containing heightened linguistic disagreement. Conversely, a user might filter their profanity on Reddit if the subreddit rules stipulate that they will be banned as a consequence.
While findings illuminate the relationship between linguistic style and online discourse incivility on two platforms, this study is not without limitations. The LIWC computerized coding tool does not allow the nuanced coding that human coders can generate. We endeavored to reduce this potential limitation by using a well-validated sentiment analysis procedure. 59 Future work might employ human coders to analyze specific attributes that make victims more worthy of empathy.16,17
Also, widespread concern about the role of anonymity in discourse incivility has prompted some media outlets to prohibit anonymous comments.62,63 Our results revealed that incivility is multidimensional, and anonymity may not be the underlying force driving discourse incivility. We focused on news articles shared to only two online platforms, namely Reddit and Twitter, and therefore cannot make general statements about expressions of rape culture in other discussion forums. Likewise, this work cannot make conclusions about expressions of rape culture in response to self-disclosures of sexual assault.
Community norms, both within online culture broadly and within the various microcultures of the online platforms, likely respond to and censure different dimensions of incivility differently.45,51 Given the significant role of platform community norms in predicting incivility modes, future work should investigate how specific platform affordances predict manifestations of incivility.
Conclusion
In summary, linguistic features of news provoke different modes of incivility, which manifest uniquely by platform. Future investigations of the effects of linguistic features of news reports of sexual assault require nuanced measures of incivility on different platforms. Our work raises ethical implications for the fields of journalism, suggesting that specific linguistic features of news—specifically, linguistic disagreement and discussion about group power dynamics—prompt incivility.
Footnotes
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
