Abstract
Abstract
We examined how young adults' use of instant messaging, text messaging, and traditional reading related to their self-reported experience of distractibility and impulsiveness and to their performance on computerized tasks designed to assess inattention and impulsive responses to visual stimuli. Participants reported their media use and completed self-report measures of impulsiveness (i.e., the Barratt Impulsiveness Scale) and distractibility for academic reading. They also completed performance based measures of inattention and impulsiveness using the Tests of Variables of Attention (T.O.V.A.®). Results demonstrated that instant message use was significantly related to higher levels of attentional impulsiveness and distractibility on the self-report measures, while traditional reading consistently predicted lower levels of impulsiveness and distractibility. However, media use was not significantly related to the performance measures of inattention and behavioral impulsiveness.
I
There is a growing body of research that shows that multitasking interferes with performance on academic and cognitive tasks. For example, students who instant messaged while reading academic material took significantly longer to accomplish the same task.5,6 Students who were interrupted by a cell phone during a lecture had poorer test performance. 7 Students who used laptops in class were likely to multitask, which correlated with poorer class performance and more distraction, 8 and 78% of students reported that electronic multitasking in class was distracting. 9 Cell phone use and texting while studying decreased accuracy in a learning and memory task. 10 Further, students who reported using media while studying performed more poorly in class, 11 and in self-report studies, greater electronic multitasking was associated with more distractibility and impulsiveness, while traditional reading was related to lesser amounts.12,13
Research on the relation between media use and distractibility and impulsiveness has relied on self-report measures. Commonly used self-report measures of impulsiveness (e.g., Barratt Impulsiveness Scale,
14
Eysenck Impulsiveness Scale,
15
Zuckerman Sensation Seeking Scale
16
) correlate with one another, but do not necessarily correlate with performance measures, suggesting that they are likely measuring different aspects of impulsiveness.
17
Self-report measures of impulsiveness are generally considered to be indicators of long-lasting traits. For example, the Barratt Impulsiveness Scale
14
has been interpreted as a measure of integrated trait impulsivity representing cognitive and behavioral domains that are stable and long lasting.18–21
However, impulsiveness can vary situationally, and performance tests, such as the Tests of Variables of Attention (T.O.V.A.
Currently no research has examined whether media multitasking is related to performance rather than self-report measures of distractibility and impulsiveness. The purpose of the present study was to examine relationships between media use patterns, specifically instant messaging, text messaging, and traditional reading, and both self-report and performance measures of inattention, impulsiveness, and distractibility. We predicted that instant messaging and text messaging, which often involve interruption and multitasking, would predict greater inattention, impulsiveness, and distractibility. We also hypothesized that more traditional reading would predict better attention and less impulsiveness and distractibility for performance as well as self-report measures.
Method
Participants
A total of 150 students enrolled in psychology classes at a public university participated. The students were aged from 18 to 28 years (M=20.12 years, SD=2.35), and 54% were women, 83% were white non-Latino, 7% African-American, 7% Latino, and 3% Asian. Students received course credit for their participation.
Self-report measures of impulsiveness and distractibility
Impulsiveness
The Barratt Impulsiveness Scale (BIS-11)14,30 is a 30-item self-report measure of impulsiveness that provides an overall impulsiveness score and three subscales scores described below. The BIS-11 has been widely used and found to be a reliable and valid standard measure of impulsiveness. 17 Participants responded to items such as “I act on impulse” on 4-point scales (1=“rarely/never” to 4=“almost always/always”). The total scale score is a measure of general impulsiveness. 30 Internal consistency with our sample was good (Cronbach's α=0.82) and consistent with prior reported values. 17
The three BIS subscales are: Attention Impulsiveness (e.g., inability to focus attention or concentrate; having intrusive or racing thoughts; 8 items); Motor Impulsiveness (e.g., acting without thinking; 11 items); and Non-planning Impulsiveness (e.g., lack of “futuring” or careful thinking; 11 items).17,30 Psychometric properties of the subscales are acceptable. 17 In our sample, the internal consistencies of the subscales (Cronbach's α) were 0.74, 0.62, and 0.73 respectively.
Distractibility for Academic Reading Scale (DAR)
Students completed the 4-item DAR on 5-point Likert type scales (1=“strongly disagree” to 5=“strongly agree”), adapted from Levine et al., 12 to measure self-reported academic focus and distractibility for academic reading. Higher scores indicate greater distractibility. Prior research has demonstrated the content validity, internal consistency, and test–retest reliability of the DAR. 13 For the present sample, the Cronbach's alpha was 0.77.
Performance measures of attention
Tests of Variables of Attention (T.O.V.A. version 7.3) is a valid and reliable computerized continuous performance test used to assess visual information processing and attention problems. 31
The T.O.V.A. presented targets (a square with a smaller square inside of it, near the upper border) or nontargets (a square with the smaller square inside of it, near the lower border) on a computer screen, in random order, for a duration of 100 milliseconds, every 2 seconds. Participants were asked to press a microswitch as fast as they could every time the target was presented, but not when a nontarget was presented. During the first half of the test (“target infrequent” condition), one target was presented, randomly, for every 3.5 nontargets. Participants needed to remain vigilant. During the second half (“target frequent” condition), the ratio was reversed (e.g., 3.5 targets to 1 nontarget). Participants needed to inhibit any response tendency.
In the present study, we used the following standard T.O.V.A. measures: 31 (a) response time variability (RTV)—a measure of inconsistency in response to targets that indicates attention difficulty; (b) response time (RT) taken to respond correctly to a target—an indicator of attentional difficulty; (c) omission errors (for the first half of the test; OE1) or “misses”— a measure of inattention; (d) commission errors (for the second half of the test; CE2) or “false alarms”—a measure of behavioral impulsiveness; (e) response sensitivity (d′) is a measure of the rate of deterioration of performance over time. 31 For easier interpretation, we report on, and use in our analyses, the T.O.V.A. standard scores.
Measures of media use
Students completed a questionnaire asking about electronic and print media use. From these items, we created summative composite measures for the amount of traditional reading, instant messaging, and text messaging. Specifically, our measure of traditional reading reflects the summed amount of traditional print reading per week that students reported on four measures—reading printed books for pleasure, books assigned for classes, magazines and newspapers (none online)—on 8-point scales: 0, <1, 1–2, 3–5, 6–9, 10–13, 14–17, or 18 or more hours per week. Responses for each reading measure were coded for data entry as 0 to 7 respectively and summed. Our measure of instant messaging (IM use) reflects the summed amount of three student reported measures. The first is the amount of time spent instant messaging in a typical week. Response choices in hours were 0, 1–7, 8–14, 15–21, 22–28, 29–35, or 36 or more, and were coded for data entry as 0 to 6 respectively. The second measure is whether their IM is typically used when their computer is turned on (1=“never” to 5=“very often”). The third measure is the immediacy of their responses to instant messages (1=“never respond immediately” to 5=“always respond immediately”). Responses for each measure were transformed into z scores and summed. Our measure of text messaging (TM use) reflects the summed amount of three student reported measures: (a) the number of text messages that they send in a typical month (open-ended); (b) the number of text messages that they receive in a typical month (open-ended); (c) the immediacy of their responses to text messages (1=“never respond immediately” to 5=“always respond immediately”). Responses for each measure were transformed into z-scores and summed.
Results
Instant messaging and text messaging were common activities for the study participants (see Table 1 for media use descriptive statistics). In sum, 68% of the students reported that they used IM in a typical week, most of those (79%) for between 1 and 14 hours, for a mean amount of approximately 8 hours and 50 minutes per week (SD=7.21). Most (82%) reported that their IM was turned on typically sometimes, often, or always, and 92% reported that they sometimes, often, or always respond right away when they received an IM. For text messaging, nearly all (96%) reported that they texted. For mean number of texts sent and received per month, see Table 1. About 98% reported that they sometimes, often, or always respond right away when they received a text message.
Response choices in hours were 0, 1–7, 8–14, 15–21, 22–28, 29–35, or 36 or more, and were coded for data entry as 0 to 6 respectively.
5-point Likert scale: 1=“never”; 5=“always.”
Reading total is combined amount of reading print media (total books, magazines, newspapers). Print media responses choices in hours were 0, <1, 1–2, 3–5, 6–9, 10–13, 14–17, 18 or more, and were coded 0 to 7 respectively.
Multiple regression analyses predicting distractibility and impulsiveness variables using TM and IM factors
We conducted a series of multiple regression analyses including IM use, TM use, amount of traditional reading, and gender as predictors for impulsiveness and distractibility variables. Descriptive statistics for the variables used in all regressions are presented in Table 2 and zero-order correlations are presented in Table 3.
Note. IM and TM predictors used in regressions were summed z scores for IM and TM measures.
Note. Gender was coded: 0=“male”; 1=“female.” *p≤0.05; **p≤0.01.
Regressions for self-report measures (BIS-11 and DAR)
In a series of five multiple regression analyses, we utilized IM use, TM use, amount of traditional reading, and gender to predict overall impulsiveness (BIS-11 total score), as well as the three BIS-11 subscales (BIS Attention Impulsiveness, BIS Motor Impulsiveness, BIS Non-planning Impulsiveness), and DAR Scale. All regressions were significant (p<0.05) except for the one predicting BIS Motor Impulsiveness (see left side of Table 4 for these regression results).
p ≤ .001, ** p ≤ .01, * p ≤ .05
Note 1. For all regressions dfn = 4, dfd = 145.
Note 2. Regressions results for each of the BIS-11, DAR, and T.O.V.A. DV's are reported separately in each column. TM Use is sum of z-scores for number of texts sent, number of texts received and text respond right away. IM Use is sum of z-scores for IM Hrs/week, IM is on when computer is on, and IM respond right away.
For all significant regressions, examination of the regression coefficients (β) demonstrates that the impulsiveness and distractibility measures were inversely related to the amount of time spent in traditional reading (p<0.05). For all significant regressions except for the one predicting overall impulsiveness, the self-reported impulsiveness and distractibility measures were significantly positively predicted by IM use (p<0.05).
Regressions for performance measures (T.O.V.A. measures)
Similarly, in a series of five multiple regression analyses, we used the same predictors described above to predict, separately, each of the T.O.V.A. performance measures (standard scores) of inattention and impulsiveness: response time variability, response time, omission errors (half 1), commission errors (half 2), and response sensitivity. All regressions were nonsignificant (p>0.05; see right side of Table 4 for these regression results).
Discussion
Results demonstrated that IM use and traditional reading were consistently related to self-report measures of impulsiveness and distractibility but not to performance measures of inattention and impulsiveness. Use of IM was related to higher levels of impulsiveness and distractibility while traditional reading was related to lower levels as measured by self-report. However, the T.O.V.A. performance measures were not significantly related to any type of media use. Amount of text messaging was not related to impulsiveness and distractibility in this sample.
The findings of differential outcome as a function of type of impulsiveness measure are interesting in light of a number of previous studies that examined the connections between nonmedia experiences or conditions, and self-report and performance-based attention measures. These studies on the whole demonstrated connections between the variables or conditions of interest and self-report but not performance measures of attention.19,22–24,26 The findings support the idea that performance measures are likely measuring different aspects of impulsiveness and distractibility than self-report measures. 17
As previously discussed, the BIS self-report measure has been interpreted as a measure of trait impulsiveness, while the T.O.V.A. measures state-dependent impulsiveness in a rapid response situation. In the present study, trait impulsiveness was predicted by self-reported history of IM use and reading. A state-dependent measure such as the T.O.V.A. might be useful in experimental investigations examining the immediate after effects of the use of IM or other interruptive technology. One issue in the interpretation of the study is whether self-report measures tend to be related more strongly to one another than to performance-based measures. In this study, the BIS-11 and the DAR were significantly related to each other and to the self-report measure of media use. Few of the self-report measures of impulsiveness and distractibility were related to the performance-based results of the T.O.V.A. Similar discrepancies between self-report and performance measures have been found in other studies. Numerous studies that used the BIS to measure self-control found smaller relationships between the BIS and behaviors assessed through direct observation than between the BIS and other self-report measures.17,32 The measures of distractibility and impulsiveness differ in the aspect of impulsiveness that they elicit. In this study, media use was found to be related to the subjective experience of distractibility and impulsiveness but not to actions demonstrating inattention and impulsiveness.
This difference is found both in performance on the T.O.V.A. and in responses to the Motor Impulsiveness Scale of the BIS-11. Whereas Attention Impulsiveness and Non-planning Impulsiveness measures of the BIS-11 were related to media use, the subscale of Motor Impulsiveness was not. The Motor Impulsiveness measure consists of items such as “I act ‘on impulse’” and “I act on the spur of the moment” that describe impulsive actions, whereas the other two scales contain items such as “I have ‘racing’ thoughts” and “I am a careful thinker” that focus more on mental activity.
In sum, there is no evidence in our study for connections between media use (IM, TM, traditional reading) and the behavioral or performance dimensions of impulsiveness and inattention. However, the connections between IM use, reading, and most self-report measures of trait impulsiveness and distractibility were consistent and significant, although not large, in both this and previous studies.5,12,13 Although there are many other factors associated with trait impulsiveness and distractibility, use of IM was consistently associated with an individual's level of impulsiveness and distractibility, particularly in regard to mental processes rather than physical actions.
Due to study design limitations, direction of effects is not clear from these findings. Media use and multitasking may contribute to the development of a style characterized by impulsiveness and distractibility, while reading promotes a more reflective, controlled style. However, it is also possible that someone with a more impulsive, distractible personality style will be more attracted to multitasking with media and less to traditional reading. At present, we can speculate that the relation found between multitasking and impulsivity may be both cause and effect. Individuals who are more impulsive and distractible may be drawn to media multitasking, but their experience with these media then encourages them to jump quickly from one event to the next, further developing their tendency to respond impulsively and attend to distractions. Such a bidirectional effect has been found in children who play videogames. 33 Individuals who are less impulsive may be more likely to engage in more traditional reading. They may then be more likely to find rewards in pursuing a single activity without distraction, thereby developing their tendency to maintain their focus and ignore distractions. In future research, it will be important to continue to explore the type of impulsivity and distractibility that is associated with new communication technology available to users and to add evidence concerning the direction of effects.
Footnotes
Author Disclosure Statement
No competing financial interests exist.
