Sociological Methodology

Protest event analysis is an important method for the study of collective action and social movements and typically draws on traditional media reports as the data source. We introduce collective action from social media (CASM)—a system that uses convolutional neural networks on image data and recurrent neural networks with long short-term memory on text data in a two-stage classifier to identify social media posts about offline collective action. We implement CASM on Chinese social media data and identify more than 100,000 collective action events from 2010 to 2017 (CASM-China). We evaluate the performance of CASM through cross-validation, out-of-sample validation, and comparisons with other protest data sets. We assess the effect of online censorship and find it does not substantially limit our identification of events. Compared to other protest data sets, CASM-China identifies relatively more rural, land-related protests and relatively few collective action events related to ethnic and religious conflict.

Social scientists have recently started discussing the utilization of text-mining tools as being fruitful for scaling inductively grounded close reading. We aim to progress in this direction and provide a contemporary contribution to the literature. By focusing on map analysis, we demonstrate the potential of text-mining tools for text analysis that approaches inductive but still formal in-depth analysis. We propose that a combination of text-mining tools addressing different layers of meaning facilitates a closer analysis of the dynamics of manifest and latent meanings than is currently acknowledged. To illustrate our approach, we combine grammatical parsing and topic modeling to operationalize communication structures within sentences and the semantic surroundings of these communication structures. We use a reliable and downloadable software application to analyze the dynamic interlacement of two layers of meaning over time. We do so by analyzing 15,371 newspaper articles on corporate responsibility published in the United States from 1950 to 2013.

Many research questions involve comparing predictions or effects across multiple models. For example, it may be of interest whether an independent variable’s effect changes after adding variables to a model. Or, it could be important to compare a variable’s effect on different outcomes or across different types of models. When doing this, marginal effects are a useful method for quantifying effects because they are in the natural metric of the dependent variable and they avoid identification problems when comparing regression coefficients across logit and probit models. Despite advances that make it possible to compute marginal effects for almost any model, there is no general method for comparing these effects across models. In this article, the authors provide a general framework for comparing predictions and marginal effects across models using seemingly unrelated estimation to combine estimates from multiple models, which allows tests of the equality of predictions and effects across models. The authors illustrate their method to compare nested models, to compare effects on different dependent or independent variables, to compare results from different samples or groups within one sample, and to assess results from different types of models.

Multilevel models with persons nested in countries are increasingly popular in cross-country research. Recently, social scientists have started to analyze data with a three-level structure: persons at level 1, nested in year-specific country samples at level 2, nested in countries at level 3. By using a country fixed-effects estimator, or an alternative equivalent specification in a random-effects framework, this structure is increasingly used to estimate within-country effects in order to control for unobserved heterogeneity. For the main effects of country-level characteristics, such estimators have been shown to have desirable statistical properties. However, estimators of cross-level interactions in these models are not exhibiting these attractive properties: as algebraic transformations show, they are not independent of between-country variation and thus carry country-specific heterogeneity. Monte Carlo experiments consistently reveal the standard approaches to within estimation to provide biased estimates of cross-level interactions in the presence of an unobserved correlated moderator at the country level. To obtain an unbiased within-country estimator of a cross-level interaction, effect heterogeneity must be systematically controlled. By replicating a published analysis, we demonstrate the relevance of this extended country fixed-effects estimator in research practice. The intent of this article is to provide advice for multilevel practitioners, who will be increasingly confronted with the availability of pooled cross-sectional survey data.

In multilevel data, cross-classified data structures are common. For example, this occurs when individuals move to different regions in longitudinal data or students go to different secondary schools than their primary school peers. In both cases, the data structure is no longer fully nested. Estimating cross-classified multilevel models is computationally intensive, so researchers have used several shortcuts to decrease run time. We consider how these shortcuts affect parameter estimates. In particular, we compare parameter estimates from fully nested and cross-classified models using a series of Monte Carlo simulations. When the outcome is continuous, we identify systematic differences in estimated standard errors and some differences in the estimated variance components. When the outcome is binary, we also find differences in the estimated coefficients. Accordingly, we caution researchers to avoid fully nested model specifications when cross-classification exists but suggest some limited conditions under which parameter estimates are unlikely to be different.

Social networks represent two different facets of social life: (1) stable paths for diffusion, or the spread of something through a connected population, and (2) random draws from an underlying social space, which indicate the relative positions of the people in the network to one another. The dual nature of networks creates a challenge: if the observed network ties are a single random draw, is it realistic to expect that diffusion only follows the observed network ties? This study takes a first step toward integrating these two perspectives by introducing a social space diffusion model. In the model, network ties indicate positions in social space, and diffusion occurs proportionally to distance in social space. Practically, the simulation occurs in two parts. First, positions are estimated using a statistical model (in this example, a latent space model). Then, second, the predicted probabilities of a tie from that model—representing the distances in social space—or a series of networks drawn from those probabilities—representing routine churn in the network—are used as weights in a weighted averaging framework. Using longitudinal data from high school friendship networks, the author explores the properties of the model. The author shows that the model produces smoothed diffusion results, which predict attitudes in future waves 10 percent better than a diffusion model using the observed network and up to 5 percent better than diffusion models using alternative, non-model-based smoothing approaches.

The dynamics of individual behavior are related to the dynamics of the social structures in which individuals are embedded. This implies that in order to study social mechanisms such as social selection or peer influence, we need to model the evolution of social networks and the attributes of network actors as interdependent processes. The stochastic actor-oriented model is a statistical approach to study network-attribute coevolution based on longitudinal data. In its standard specification, the coevolving actor attributes are assumed to be measured on an ordinal categorical scale. Continuous variables first need to be discretized to fit into such a modeling framework. This article presents an extension of the stochastic actor-oriented model that does away with this restriction by using a stochastic differential equation to model the evolution of a continuous attribute. We propose a measure for explained variance and give an interpretation of parameter sizes. The proposed method is illustrated by a study of the relationship between friendship, alcohol consumption, and self-esteem among adolescents.

This comment reconsiders advice offered by Bruch and Mare regarding sampling choice sets in conditional logistic regression models of residential mobility. Contradicting Bruch and Mare’s advice, past econometric research shows that no statistical correction is needed when using simple random sampling of unchosen alternatives to pare down respondents’ choice sets. Using data on stated residential preferences contained in the Los Angeles portion of the Multi-City Study of Urban Inequality, it is shown that following Bruch and Mare’s advice—to implement a statistical correction for simple random choice set sampling—leads to biased coefficient estimates. This bias is all but eliminated if the sampling correction is omitted.

The case-time-control design is a tool to control for measured, time-varying covariates that increase montonically in time within each subject while also controlling for all unmeasured covariates that are constant within each subject across time. Until recently, the design was restricted to data with only two timepoints and a single binary covariate, or data with a binary exposure. Sjölander (2017) made an important extension that allows for an arbitrary number of timepoints and covariates and a nonbinary exposure. However, his estimation method requires fairly strong model assumptions, and it may create bias if these assumptions are violated. We propose a novel estimation method for the case-time-control design, which to a large extent relaxes the model assumptions in Sjölander. We show in simulations that this estimation method performs well under a range of scenarios and gives consistent estimates when Sjölander’s estimation does not.