Abstract

Quoidbach and colleagues (2019) investigated the bidirectional relationship between happiness and social behavior. For this, they used experience-sampling data from 30,793 individuals who reported on their daily happiness and social-interaction partners. In line with the hedonic-flexibility principle, results showed that happier individuals were less likely to interact with other people at the next measurement time point than less happy individuals (see Quoidbach et al., Fig. 2). Furthermore, they reported evidence that individuals seek different interaction partners depending on their happiness and that certain interaction partners are more likely to increase individuals’ happiness.
Laudably, Quoidbach and colleagues followed good open-science practice and published their data online. Furthermore, their research is highly important for advancing knowledge on the interplay between the social environment and emotional experiences.
However, a methodological issue jeopardizes one of their main findings, namely the finding that happiness (Ht) is associated with a decreased probability of future interactions (Pt+1; see Quoidbach et al., Fig. 2). I will show that (a) when the raw data are investigated and (b) when the multilevel analyses are conducted excluding a particular covariate or with a set of more justifiable ones, the aforementioned association reverses in direction and is estimated to be positive (i.e., that happier individuals are more likely to interact subsequently than less happy individuals).
The data used by Quoidbach and colleagues are very rich in terms of participating individuals (N = 30,793); however, the data are often very sparse on an individual’s daily level: Participants on average had 1.49 (SD = 0.85) consecutive data points per analyzed day (computed using the publicly available data from the original study at https://osf.io/bxgn4). This is problematic because Quoidbach and colleagues controlled for the variable Hday, which represents an individual’s average happiness on a given calendar date (excluding happiness at the previous time point, Ht). The Hday variable suffers from two measurement-related limitations. First, on 66% of the observed days, there was only one observation per individual from which this “average” was calculated. Second, when the focus is on a given time point, the variable Hday contains information from observations of future happiness. In fact, in 49% of the data points, the Hday value is identical to happiness at the subsequent time point (Ht+1), and in the remaining cases, Ht+1 is part of the Hday average calculation. Hence, the Hday variable might not be a valid control for a daily average but often represents happiness at the next time point (Ht+1). If the aim was “to assess whether people’s current happiness significantly predicts their future social interactions” (Quoidbach et al., p. 1114), future happiness (Ht+1) should not be included as part of the variable that is controlled for—or at the very least the overrepresentation of Ht+1 in Hday should be highlighted and the model results should be interpreted with that in mind.
Quoidbach and colleagues argued for the presence of the variable Hday in the following way: Because our goal was to capture the high-frequency dynamics in happiness (e.g., hourly changes in happiness) while controlling for the low-frequency dynamics (e.g., daily or weekly changes in happiness), we included daily average happiness as a covariate in the regression models. (p. 1113)
According to this reasoning, controlling for alternative variables, such as the average of the past 24 hr (Hpastday) or the past week’s average (Hpastweek), should reveal similar results. To overcome the limitations of this Hday variable, I conducted additional robustness analyses on the publicly available data set with alternative model specifications.
Method
The analysis reported by Quoidbach and colleagues was reproduced as closely as possible using the publicly available data from their study (see https://osf.io/bxgn4 for data from the original study). For this reanalysis, the following multilevel time-lagged logistic regression model was estimated by Quoidbach and colleagues (Equation 1, p. 1114):
The model is specified with random intercepts
To better account for “low-frequency dynamics” of happiness that do not include future happiness values, I further included an Hpastweek variable and an Hpastday variable in the model, capturing the effects of the average happiness of an individual reported in the past week (excluding the current day) and the past 24 hr (excluding the measurements
Overall, this analysis focused on the comparison between model results based on different specifications (i.e., with and without the Hday variable and the alternative measures Hpastweek and Hpastday).
Results
Figure 1 shows the results of the reanalysis and the additional analyses conducted. The full model results are reported in Table S1 in the Supplemental Material. The red squares and error bars in Figure 1 represent the predicted values and 95% confidence intervals (CIs), respectively, of the odds ratios (ORs) of participants’ interacting with other people at time t + 1 depending on their level of happiness at time t. These values closely resemble the results reported by Quoidbach and colleagues, log OR = −0.003, 95% CI = [−0.003, −0.002], OR = 0.997, p < .001. The green triangles in Figure 1 represent predicted odds ratios of a model in which the Hday variable was removed. When the Hday variable was removed from the analyses, the association changed direction, log OR = 0.006, 95% CI = [0.005, 0.006], OR = 1.006, p < .001. Also, the raw data (i.e., means; gray dots in Fig. 1), which are not based on predicted values of a statistical model, suggest a positive association between happiness and the probability of being in a social interaction at the next time point.

Raw values (i.e., means) and predicted values of the odds ratios for participants’ reports of being with other people at time t + 1 (rather than being alone), depending on their previous happiness at time t. For predicted values, odds ratios are shown for models with the daily-average covariate Hday, without the daily-average covariate, with the daily-average covariate replaced by average happiness in the past week (Hpastweek), and controlling for average happiness in the past 24 hr (Hpastday). Full model results are reported in the Table S1 in the Supplemental Material available online. Error bars show 95% confidence intervals.
Instead of controlling for an individual’s daily happiness average, I created a further model that controlled for the individual’s average happiness over the past week. The predicted ORs based on the model including Hpastweek are reported as blue asterisks in Figure 1, log OR = 0.004, 95% CI = [0.003, 0.005], OR = 1.004, p < .001. The predicted ORs of a model containing the Hpastday variable are represented as blue squares in Figure 1, log OR = 0.003, 95% CI = [0.002, 0.004], OR = 1.003, p < .001. The models including Hpastweek or Hpastday suggest a positive association between happiness and subsequent social interactions. Further models using other alternative measures (e.g., past happiness measures of the current day, Hearlier_in_day; person-mean-centered happiness,
So why does only the Hday model reveal a negative association between happiness and subsequent social interactions? One reason might be the overrepresentation of Ht+1 in Hday, because a model with Ht+1 instead of Hday suggests almost identical results (see Table S2). After the model adjusted for the positive cross-sectional association (effect of Ht+1), log OR = 0.015, 95% CI = [0.014, 0.015], OR = 1.015, p < .001, previous happiness at time t was negatively associated with being in an interaction at t + 1, log OR = −0.003, 95% CI = [−0.004, −0.003], OR = 0.997, p < .001. In this case, the effect of Ht cannot be interpreted independently of the Ht+1 effect, as they are highly correlated, r(220292) = .70, p < .001, and part of the same model. Note that the Ht+1 effect is about 5 times larger than the effect of Ht. Hence, in order for the total contribution of happiness to be negative, Ht must be about 5 times larger than Ht+1, which is rarely the case in the observed data (2.5% of cases).
The nature of the interplay between Ht and Ht+1 can best be understood when looking at the change in happiness between t and t + 1 (i.e., using ΔH = Ht+1 − Ht). A model with ΔH instead of Ht+1 was estimated (see Table S2). This model essentially contains identical information to the Ht+1 model, but interpreting it is more straightforward. The results of that model suggest that if there is no happiness change between t and t + 1, the level of happiness at t predicts interactions at t + 1 positively, log OR = 0.012, 95% CI = [0.011, 0.012], OR = 1.012, p < .001. With each positive change in happiness, the likelihood of interactions increases, log OR = 0.015, 95% CI = [0.014, 0.015], OR = 1.015, p < .001. In the other direction, this also means that if someone becomes unhappy between t and t + 1, interactions become less likely. Hence, the residual negative effect of Ht on Pt+1 that emerged in the original analysis was likely driven by observations of individuals who were happy before (at t) and were not interacting at the subsequent time point (t + 1) because they had become less happy by the subsequent time point. The aspect of how future happiness (Ht+1)—as part of Hday—plays a role in the claimed association is not discussed in the original article.
Discussion
The results reported in this Commentary suggest that one of the main findings claimed by Quoidbach and colleagues is not robust. Quoidbach and colleagues reported a negative association between individual’s happiness (Ht) and the likelihood of future interactions (Pt+1). However, in my reanalysis, I found that the raw data and statistical models, in which the control variable Hday was removed, suggest that the association between happiness and the likelihood of future interactions is positive. Also, in models with alternative specifications with average happiness in the past week (Hpastweek) or the past 24 hr (Hpastday), the stated association was estimated to be positive.
The proclaimed negative effect of happiness on subsequent social interactions seems to be biased by the presence of unreported Ht+1 information in the model. The overrepresentation of Ht+1 in Hday is neither discussed nor considered in Quoidbach et al.’s interpretation of effects. This reanalysis suggests that if individuals were happy before and they were not interacting at the subsequent time point (the proclaimed negative effect of Ht), it is likely that they became unhappy between the two measurement time points. Although dynamic investigations of happiness and social interactions are novel, the finding that less happy individuals are less likely to socially interact has been frequently demonstrated (e.g., Elmer & Stadtfeld, 2020; Pavot et al., 1990; Sandstrom & Dunn, 2014). This reanalysis is in line with that literature.
A limitation of this reanalysis is that the alternative covariates (Hpastweek and Hpastday) were not computed on the complete data set, that is, before the data were reduced to only subsequent reports within 12 hr. The calculation of the alternative covariates was based on the reduced data used for the present reanalysis (see https://osf.io/bxgn4 for data).
The findings regarding the probability of participants’ interacting with certain interaction partners (e.g., best friends) when they were previously unhappy (see Quoidbach et al., Fig. 3a) was also affected by the Hday variable. See the Supplemental Material for additional analyses of these findings.
It is important to note that the intent of this Commentary is not to undermine the work of Quoidbach and colleagues. The importance and novelty of their research is without question. Nevertheless, the findings related to the prediction of social behavior (see Quoidbach et al., Figs. 2 and 3a) are not robust. Fortunately, Quoidbach and colleagues published their data online, which made this reanalysis possible. Beyond further encouraging open-science practices, I suggest that raw data and results of stepwise models should be more frequently reported in the psychological sciences.
Supplemental Material
sj-docx-1-pss-10.1177_0956797620956981 – Supplemental material for In Which Direction Does Happiness Predict Subsequent Social Interactions? A Commentary on Quoidbach et al. (2019)
Supplemental material, sj-docx-1-pss-10.1177_0956797620956981 for In Which Direction Does Happiness Predict Subsequent Social Interactions? A Commentary on Quoidbach et al. (2019) by Timon Elmer in Psychological Science
Footnotes
Acknowledgements
I thank Kieran Mepham, Laura Bringmann, Markus Eronen, Alvaro Uzaheta, and Christoph Stadtfeld for providing valuable feedback on this manuscript.
Transparency
Action Editor: D. Stephen Lindsay
Editor: D. Stephen Lindsay
Author Contributions
T. Elmer is the sole author of this article and is responsible for its content.
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
