Abstract
A growing number of studies examine the influence of classroom behavior on teaching and individual children’s behavior. However, limited work has examined the effects of classroom behavior on academic achievement. The present study used 14,537 children in 2,109 classrooms from the Early Childhood Longitudinal Study -Kindergarten Class of 1998-99 (ECLS -K) to examine the association between attention, aggressive behavior, and achievement at two levels --the child and classroom. Children with low attention, alone or in combination with aggressive behavior, made fewer gains in test scores during kindergarten. The achievement gap between children with low attention and those without was larger than those based on low-income status or race/ethnicity. Additionally, having more children in the classroom with low attention was negatively associated with achievement gains. No similar association was found for the number of children with high aggression. The authors discuss avenues for teacher training and intervention to facilitate attention.
The present study investigated the association between low attention and aggressive behavior and test scores using data from the Early Childhood Longitudinal Study–Kindergarten Class of 1998-99 (ECLS-K), a nationally representative sample of kindergarteners in the United States. Low attention reflects the lack (or lower levels of) persistence, task orientation, organization, and focus. Aggressive behavior reflects externalizing or acting out behavior in interactions with classmates and teachers such as disrupting instruction, hitting, or arguing. Our approach takes into account that low attention and high aggression might each be independently associated with test scores as well as the possibility that both problems, in combination, may be associated with test scores. Specifically, we examined clusters of children based on whether they exhibited neither problem, both problems, or one particular problem. Then, we examined whether any differences, or gaps, between these four groups were larger or smaller than test score gaps that have been seen between children with socieconomic status (SES) differences and from various race/ethnic groups. Finally, we also investigated the association between the two problem behaviors and achievement test scores at not only the child level, but at the classroom level (the latter often being term a compositional effect).
It is important to examine both levels if aggressive behavior impacts instructional time. Less instructional time will likely reduce opportunities to learn and could be detrimental to academic progress for all children in the classroom. Even if the child is not aggressive, inattentive classmates could nonetheless affect his or her opportunity to learn. Being an inattentive child is not necessarily disruptive to other children, but clearly such a child might not actively engage with peers, which could mean that the child is not receptive to, nor would benefit from, a classroom setting that stresses active participation with classmates.
The extant literature demonstrates that being attentive is positively associated with test scores; lack thereof was detrimental to learning. The relation of aggressive behavior to learning is less clear, having both negative and null associations with test scores. Moreover, the relation of attention and aggressive behavior to test scores has less often been examined concurrently and simultaneously, making it difficult to determine, at the individual and classroom levels, the differential impact of both problem behaviors versus one or none. And few if any studies have estimated the strength of the behavior problem–achievement association, in comparison to test score gaps for low-SES and minority children. Additionally, the literature is largely silent on how a child’s test scores are associated with behavior problem of other children in the class. These gaps in the literature motivate the current study.
The present study addressed three questions. First, to what extent are attention and aggressive behavior problems associated with mathematics and reading scores? Second, are these associations stronger than those for SES and ethnic test score gaps? Third, to what extent is the behavior of other children associated with a child’s mathematics and reading scores? We investigated differences among four behavior groups: children demonstrating no problem behavior, both attention and aggressive behavior, or one particular problem behavior.
Prior Studies
Research suggests that aggressive behavior and attention problems influence children’s learning by impeding their skills to interact with classmates and teachers, making for a tougher adjustment to school (Ladd, Kochenderfer, & Coleman, 1997; Miech, Essex, & Goldsmith, 2001). Children’s ability to regulate aggressive behavior facilitates working with groups and involvement with class discussion, both of which permit children to be aware of and become engaged in their own learning. Being attentive also fits the instruction model of school (Alexander, Entwisle, & Dauber, 1993; DiLalla, Marcus, & Wright-Phillips, 2004). For example, children with attention problems lack persistence, are unable to avoid distractions, and are limited in their ability to focus on tasks, which may lead to lower achievement and to greater problems in adjusting to the school setting (Miech et al., 2001).
Attention skills have been consistently linked to children’s school readiness and test scores (Howse, Lange, Farran, & Boyles, 2003; NICHD Early Child Care Research Network [ECCRN], 2003; Schoen & Nagle, 1994). For example, the NICHD study of early child care (NICHD ECCRN, 2003) found that sustained attention explained achievement gains between preschool and kindergarten. Studies also showed the association between attentive skills and test scores remained through elementary grades (Alexander et al., 1993; Linares et al., 2005; McClelland, Morrison, & Holmes, 2000; Yen, Konold, & McDermott, 2004). For example, using a sample drawn from Baltimore public school students, Alexander et al. (1993) found children’s attention skills were significantly associated with higher mathematics scores between the first and second grades. There were also indirect effects through increased first-grade academics and later social behavior on reading and mathematics scores between second and fourth grades among these students. Further evidence from a study that examined children’s achievement using data from six countries, including the United States, showed that attention skills during preschool and kindergarten were linked with gains in reading 3 to 9 years later, even after controlling for early cognitive skills at school entry and aggressive behavior (Duncan et al., 2007).
By contrast, findings of the association between aggressive behavior and test scores are mixed in that the association is not always statistically significant and the magnitude, when significant, tends to be weak. One study found aggressive behavior at age 5 strongly predicted lower academic achievement 2 years later (Trzesniewski, Moffitt, Caspi, Taylor, & Maughan, 2006). However, longitudinal investigations that controlled for prior achievement did not find a significant association between aggressive behavior and later achievement. For example, there were no significant associations between aggressive behavior and test scores between first and second grade for children in both working-class and low-income families (Miles & Stipek, 2006; Welsh, Parke, Widaman, & O’Neil, 2001). Similarly, in Alexander et al.’s (1993) investigation of Baltimore public school students, aggressive behavior was not significantly associated with mathematics or reading scores within a given year or across years except for one instance—first-grade behavior to fourth-grade mathematics. In a more recent investigation, Duncan et al.’s (2007) analyses of test scores showed that aggressive behavior at school entry generally was not significant at predicting later mathematics or reading test scores, and in the few cases where the association was significant, the coefficients were weak in magnitude, ranging from 2 to 5 percentile points (i.e., −0.05 to 0.11 SD). Furthermore, the meta-analyses across the six data sets including the ECLS-K revealed no significant associations between aggressive behavior and test scores (Duncan et al., 2007).
Part of the explanation for the negative association between aggressive behavior and test scores could be that children who are aggressive are unable to interact with peers effectively and have difficulty reading environmental cues (Crick & Dodge, 1994; Dodge, 1991). These children may also be frustrated with their academic difficulties such that they act out, in turn resulting in less task time and more negative interactions with classmates and teachers (Ladd, Birch, & Buhs, 1999; McEvoy & Welker, 2000; Miles & Stipek, 2006; Raver, 2002). Aggressive behavior has also been linked to lower achievement via lower class participation, indicating fewer opportunities to work cooperatively with and learn from classmates (Ladd et al., 1999; Raver, 2002). The negative interactions with teachers may result in less instructional feedback (Carr, Taylor, & Robinson, 1991; Raver, 2002), which could negatively affect the child’s test scores.
In all of these studies, attention and aggressive behavior problems tend to be examined separately (or attention is not included in regressions as a control when aggressive behavior is the outcome of interest such that links between aggressive behavior and achievement may be confounded by a third variable–in this case, attention problems). An examination of the combination of both behavior problems matter if their root includes difficulty processing information, difficulty with social skills, and inability to function (Dodge, 1991; McEvoy & Walker, 2000; Zhou et al., 2007). Some studies, like the one conducted by Duncan et al. (2007), included measures of both aggressive behavior and attention problems simultaneously to determine unique influences. However, their approach overlooked the comorbidity and reciprocal nature of both types of problems (Arnold et al., 1999).
The combination of attentive and aggressive behavior problems has been examined in only a handful of studies. In studies that did not control for prior academic achievement or ability, aggressive behavior appeared mediated by attention problems (Arnold, 1997; Friedman-Weieneth, Harvey, Youngwirth, & Goldstein, 2007). Attention problems were significant predictors of achievement, even while controlling for aggressive behavior (Duncan et al., 2007; Friedman-Weieneth et al., 2007). Aggressive behavior had an indirect path with achievement, operating through attention skills, in one study (Normandeau & Guay, 1998). In another study, aggressive behavior was not a significant predictor in a regression model once attention skills (Duncan et al., 2007) or teacher-student relationships were added (Graziano, Reavis, Keane, & Calkins, 2007) to the models. In general, direct associations between aggressive behavior and achievement were not maintained when considering attention skills. These models, though providing indication of the weight of aggressive behavior versus attention problems, did not clarify the influence of demonstrating one versus both types of problem behavior.
One study to date has considered the co-occurrence of attention and aggressive behavior problems by specifying groups based on the exact behavior present, though it did not consider test score gains or prior achievement. This study, conducted by Finn, Pannozzo, and Voelkl (1995), examined mathematics and reading scores among four groups of 1,000 fourth graders classified as aggressive behavior, attention problems, both aggressive and attention problems, and neither aggressive nor attention problems. In comparison to children with one problem behavior, those children with no such problems showed higher reading and mathematics scores, whereas children with both problems were no different from those with only one. Among children with one type of behavior problems, children who were aggressive scored higher than children who had attention problems. The authors did not formally contrast children with both problem behaviors versus the other groups; however, mean comparisons indicated they had lower test scores than children with aggressive behavior or no problem behaviors but were similar to children with attention problems (Finn et al., 1995). Thus, in isolation, attention is a significant predictor of test scores, but aggressive behavior may not be.
The classroom context established by other children’s behavior may play a role in academic achievement. Studies showed classroom disruption due to the presence of behavior problems among children reduced the instructional time provided to the class and to the individual child (Carr et al., 1991; Reynolds, 1998). Even for children who did not exhibit aggressive behavior, instruction time can be limited due to the teachers’ concentration on behavior management of other children. Reduced instruction time, in turn, may lead to lower test scores (Carr et al., 1991; Raver, 2002). Besides teachers’ ability to deliver instruction and children’s adjustment to the curriculum, children in collaborative, friendly, and empathetic groups have higher achievement test scores than children in groups with less of these qualities (Battistich, Solomon, & Delucchi, 1993). This kind of high-quality group may not occur as often in classrooms where there are children with behavior problems. For instance, children in classrooms with higher average classroom levels of aggressive behavior were rated on average as having less close relationships with teachers as compared to children in classrooms with lower classroom average aggressive behavior (Buyse, Verschueren, Doumen, Van Damme, & Maes, 2008).
Studies have focused on how the aggressive behavior may influence a child’s own behavior from year to year (Barth, Dunlap, Dane, Lochman, & Wells, 2004; Hanish, Martin, Fabes, Leonard, & Herzog, 2005), whereas limited work has focused on the extent to which the classroom compositional effects of other children’s behavior as a context informing academic achievement. The closest direct examination of this relationship comes from Finn and Pannozzo’s (2004) analysis with the ECLS-K. They found that the child’s own attention problems or aggressive behavior were weakly correlated with the overall classroom behavior, which they measured as teacher’s global rating of misbehavior, (−0.20 and −0.16, respectively), and that classroom behavior had a weak correlation with kindergarten reading and mathematics test scores. The measure of classroom behavior was based on teachers’ report of the overall behavior of the children rather than on the composition of behavior from each individual child.
Method
Participants
Data were from the ECLS-K, a nationally representative sample of children in the United States enrolled in kindergarten during the 1998-1999 school year. The ECLS-K data are well suited for this analysis because children were sampled within classrooms. Children were assessed (mathematics and reading achievement scores), and teachers and parents were interviewed at the beginning and end of the kindergarten year—the former on classroom characteristics, individual children’s behavior, and instructional techniques; and the latter on family characteristics and activities as well as on children’s behavior. After kindergarten, given the movement of children into different schools and first-grade classrooms, it is impossible to examine classroom composition.
At baseline, the ECLS-K consisted of 21,260 children. We excluded children who did not have mathematics and reading scores at both time points of the kindergarten survey (N = 4,587). Children with missing test scores were disproportionately in low-income families, more likely to be Asians, Blacks, or Latinos. Children who did not pass the English language assessment but spoke Spanish took the Spanish version of the mathematics assessment. However, because these children did not take the reading assessment, they were also among the children excluded due to missing reading scores (N = 1,115). We excluded children whose classrooms could not be identified or children who changed classrooms during the kindergarten school year (N = 887). We excluded any remaining classrooms with fewer than three sampled children, which resulted in an additional 134 children excluded.
After these exclusions, our analytic sample consisted of 14,537 children clustered in 2,109 classrooms in 895 public and private kindergarten programs. This sample reflects children who progressed normally without interruptions either by changing schools or classroom during kindergarten. Other than the exclusions described above, all predictors with missing values were imputed using the multiple imputation procedure described by Allison (2002) and Schaffer and Graham (2002). 1 The imputed values are such that their values are consistent with the observed variable values. In the imputation procedure model we incorporated all the variables in the analysis as well as several auxiliary variables that are correlated with the variables to be imputed. Moreover, the model accounted for the nested structure of the data by performing the imputation procedure for classroom- and school-level variables separately. The classroom and school models included, in addition to the classroom and school variables used in the analysis, auxiliary variables reflecting the average characteristics of the students in those classrooms and schools.
The full sample of 14,537 children was used to classify children into behavior groups and to evaluate whether distinct groups were formed. For the multivariate models, however, to be able to detect minimum effect size, we included classrooms where at least 50% of the children in the classroom were in the sample. This restriction resulted in a sample for the multivariate model of 6,212 children in 508 classrooms, with four to 27 children per classroom.
Mathematics and Reading Scores
Children completed one-on-one direct assessments of their mathematical and literacy skills with trained assessors. The ECLS-K assessments involved a two-stage format where all children took a common routing test that then directed them to a second skill-level test. The mathematics domain included recognizing numbers, counting, comparing, and ordering numbers; solving word problems; and recognizing and solving problems involving graphs and geometric relationships. The reading domain included vocabulary, listening and reading comprehension, knowledge of the alphabet, phonetics, print recognition and orientation, and sight vocabulary. We used the ECLS-K Item Response Theory (IRT) scale scores, which were based on an IRT model estimating item parameters for difficulty, discrimination, and “guessability” to calculate the probability of the child’s answering a particular item correctly as if she or he had taken all items in the assessment (Rock & Pollack, 2002). The IRT scale score is the sum of these probabilities across all items. The reliability coefficient for the mathematics scores was .92 in fall and .94 in spring; and for the reading scores it was .93 in fall and .95 in spring. The average spring mathematics scores were 28.3 points, with a range of 7.6 to 59.3 points. The average reading scores were 32.6 points, with a range of 11.0 to 70.8 points.
Behavior Problems
Teachers rated each sampled child on attention skills and aggressive behavior. Attention skills were derived from the Approaches Toward Learning scale in the ECLS-K, a composite score of the child’s level of attentiveness, task persistence, eagerness to learn, learning independence, flexibility, and organization (alpha = .89; rated on a 4-point Likert scale of 1 = never to 4 = very often). We reverse coded the composite score so that a high number would show that the child had attention problems such as distractibility and lack of persistence, organization, or flexibility. Aggressive behavior was derived from teachers’ responses about the child’s externalizing behavior, which was a composite score of the frequency with which the child argued, fought, got angry, acted impulsively, and disturbed ongoing activities (alpha = .90; rated on a 4-point Likert scale of 1 = never to 4 = very often). A high score on the externalizing behavior scale indicated the child had aggressive behavior. We used both the attention and aggressive behavior problems composite scores to specify groups based on the observed distribution of each behavior. After identifying each child’s behavior group membership, we computed the proportion of children, excluding the individual child, in each behavior group in each classroom.
Child and Family Background
We measured family and child characteristics to account for potential confounding factors known to be important determinants of test scores. We used several child and family characteristics variables including socioeconomic status (SES), a composite score (M = 0, SD = 1) derived from parents’ education, parents’ occupation and household income. The continuous SES composite score was then converted into quintiles. We used the data based on quintiles to create a dichotomous variable where low income is set to 1 if the family’s SES is in the fourth or fifth quintile; otherwise it is set to 0 (therefore, both poor (bottom quintile) and near poor (second to bottom quintile) were included in the low-income group). We created five ethnic groups: Asian American, African American, European American, Hispanic American, and Other. Other variables included whether the child lived in a single-parent family, the number of siblings, the child’s age at the time of the assessment, the mother’s age at the child’s birth, the child’s gender, the child’s birth weight, whether the primary language spoken at home was English, and number of places the child lived. We accounted for whether the child had any disability such as a diagnosed learning problem, hearing problem or sign language, vision problem, or enrolled in special needs classes.
We measured the frequency of reading activities either alone or with a parent and participation in organized activities outside the home (e.g., dance lessons, organized clubs, music lessons, drama classes, athletic or sporting events, art and craft classes, educational trips and visits to the library, a gallery, museum or historical site). We controlled for the number of children’s books and other educational media in the home and the child’s primary care arrangement prior to kindergarten (e.g., center, relative care, nonrelative care, or Head Start).
We controlled for the number of months that elapsed between fall and the end of the kindergarten assessments and the teachers’ rating of the child’s behavior. We decided to control for time between assessments and rating of the child’s behavior because children who are assessed later in the school year might have higher test scores than those assessed earlier by virtue of the fact that these children had additional learning time. Children whose behavior was assessed later may be rated somewhat differently because the teacher would have had more time to observe them.
Teacher Characteristics
We accounted for confounding factors in teachers’ ratings of the child’s behavior by controlling for teachers’ education, ethnicity, number of years of teaching experience at the kindergarten level and preschool level, and the number of courses taken in early childhood education and child development. We also measured two types of professional development participation. One measure was whether the child’s teacher participated in in-service days, problem-solving group, consultant meeting, early childhood conference, or computer and technology workshop. A second measure was whether the teacher participated in professional development that provided support to the teacher such as peer feedback, new skills support, or observed other school.
Classroom and School Characteristics
The school measures were whether it was a private or public kindergarten program and whether the school was located in a central city, in an urban fringe and large town, or in a small town or rural area. We accounted for teachers’ perceptions of whether discipline was maintained in the school to account for the possibility that schools that maintained stronger discipline may affect the level of aggressive behavior in the classroom.
Analytic Procedures
We performed cluster analysis using the K-Means algorithm method (Aldenderfer & Blashfield, 1984) to specify groups based on the distribution of attention and aggressive behavior. We specified separate models that tested for the presence of two to 10 behavior groups. We evaluated each model to determine whether the groups were distinct and whether some groups were more separated than others. The number of observations in each group was examined to determine if any outlier cases formed meaningless groups. Finally, for each cluster solution, we compared the behavior groups using multivariate analysis variance (MANOVA). The results of the cluster analysis are discussed subsequently.
Our regression strategy was to include rich sets of child and family characteristics to adjust for differences across children and to include rich measures of teacher, classroom, and school characteristics to account for potential confounding factors affecting how children’s behavior might be rated. These extensive set of controls will not fully account for the possibility that children within a classroom, because they are taught together, may tend to be similar in test scores; that the teacher may tend to rate the children in the same classroom similarly in their behavior; or that a child’s behavior is rated relative to the other children in their classroom. To account for these unobserved factors, we estimate two classroom fixed-effect models. One model examined end of kindergarten scores, given by
The second model examined gains in scores over the kindergarten year, given by
where f indicates that the variable was measured at kindergarten entry, s indicates that the variable was measured in spring of kindergarten, α is the average classroom-level test scores, T is mathematics or reading scores for child i in classroom j, Vi represents the behavior group the child is a member of, and
The coefficient β1 is interpreted as the association of the child’s behavior problems on test scores. The coefficient β2 is interpreted as the association between the behaviors of other children on the individual child’s test scores.
The outcome variables and all the continuous predictors are standardized (M = 0, SD = 1). As such, the coefficient estimates are in units of effect size. That is, the coefficient represents the expected standard deviation gain in test scores per standard deviation change in the predictor.
Results
We specified behavior groups based upon the distribution of attention and aggressive behavior. The model that specified four behavior groups yielded more satisfying solutions under all validation techniques. Figure 1 shows the mean value for the attention and aggressive behavior scale for each of the four groups: (a) group with both problems (11%), (b) group with low attention (26%), (c) group with high aggression (23%), and (d) group with neither (40%).

Mean attention and aggressive behavior scale score, by behavior groups: ECLS-K 1998-99
Table 1 shows the multivariate test statistics for group mean differences from the MANOVA analysis. Every test shows there are significant differences among the four groups. Table 2 presents mean values of family background and classroom variables for all children and for each of the four groups. A disproportionate share of children in low-SES families were in the both behavior problems or the attention problem group. For instance, children in low-SES families composed 34% of the sample; however, 48% of children in the both behavior problems group were low-SES, and 41% in the attention problems group were low-SES (Table 2). On the other hand, aggressive behavior was lower among children in low-SES families; 30% of the children in the aggressive behavior group were in low-SES families.
MANOVA Multivariate Analysis of Variance Tests of Group Mean Differences
Authors’ calculations based on data from the Early Childhood Longitudinal Study, Kindergarten Cohort. Estimates are weighted.
Mean Differences Between Groups Adjusted for Multiple Pairwise Comparisons
Authors’ calculations based on data from the Early Childhood Longitudinal Study, Kindergarten Cohort. Estimates are weighted. Standard deviations in parentheses.
There are differences in the race/ethnicity and gender makeup of the four groups. The race/ethnic composition of the sample was 64% White, 16% Black, 12% Latino, and 2% Asian. As shown in Table 2, Black and Latino children were overrepresented in the attention problem group, whereas Asian children were overrepresented in the neither problem group. For instance, 27% of children in the both behavior problems group were Black as well as 20% of children in the attention problems group (Table 2). Boys were more likely to be in the both behavior problems group compared to girls.
Table 3 shows whether the mean differences between groups are significant. To minimize the possibility of false positive comparisons due to multiple pairwise tests, we adjusted each comparison using Tukey’s HSD test and Scheffe test. As shown in Table 3, children in the attention problem group had similar test scores as children in the both behavior problems group. However, children in the attention problem group differed in background characteristics from children in the both behavior problems group. For instance, in comparison to the both behavior problems group, a significantly lower proportion of children in the attention problem group were in low-SES families, lived with a single parent, were Black, were boys, had a disability, or attended center-based programs (Table 3).
MANOVA Pairwise Multiple Comparisons for Observed Means
Authors’ calculations based on data from the Early Childhood Longitudinal Study, Kindergarten Cohort.
p < .05. **p < .01. ***p < .0001.
Children in the aggressive behavior group differed from the attention problem group in test scores and in family background characteristics. In particular, children in the aggressive behavior group had significantly higher mathematics and reading scores compared to children in the attention problem group. A significantly higher proportion of Whites, girls, and children who attended center-based programs were in the aggressive behavior group compared to the attention problem group. Another difference is that children in the aggressive behavior group have teachers with fewer years of kindergarten teaching experience compared to children without any behavior problem.
Behavior Problems and Test Scores
We estimated two models as specified in Equations (1) and (2) to determine the extent to which membership in one of the four behavior groups is associated with end of kindergarten test scores and gains in scores over the kindergarten year. 2 Both models investigated the association between a child’s own membership in a behavior group, the behavior of the other children, and test scores. Table 4 shows the results for both models. There is a significant mathematics and reading score gap for children with any behavior problem, all else equal. Children with both behavior problems and those with attention problems lagged further behind children with aggressive behavior. Specifically, children with both behavior problems had a gap of 7 percentile points in mathematics (effect size = −.18, ρ < .0001) and 6 percentile points in reading (effect size = −.16, ρ < .0001). The mathematics score gap for children with attention problems was 8 percentile points (effect size = −.20, ρ < .0001) and 7 percentile points in reading (effect size = −.18, ρ < .0001). By contrast, children with aggressive behavior were not as far behind as were children with both behavior problems or those with attention problems. There was a gap of 2 percentile points in mathematics (effect size = −.06, ρ < .0001) and a gap of 3 percentile points in reading (effect size = −.07, ρ < .0001) for children with aggressive behavior.
Relationships of Behavior Problem to Mathematics and Reading Scores in Kindergarten
Sample size is 6,212 students in 508 public and private kindergarten programs. The coefficients are standardized. Robust standard errors adjusted for clustering are shown. Continuous variables at the student level are centered at the classroom mean for that variable. Dichotomous variables are not centered. Each model includes a composite score for social economic status (SES); mother’s age; the child’s gender and race/ethnicity; the mode of care the child attended prior to kindergarten; the type of structured activities the child participated in outside of school; the child’s weight at birth; whether the child has a disability; age at time of assessment; whether the child enrolled in a part-time kindergarten program; whether the child lives with one parent; number of siblings; number of places the child lived since birth; and whether the child’s primary home language is English. The model also controls for class size; teachers’ education; teacher’s race/ethnicity; number of years of teacher experience; teachers perception of how frequently children in the classroom misbehave; and whether there is order in the school. The model also included the average background characteristics of the other children in the classroom. School-level variables include the geographic location of the school and whether it is a private kindergarten program. Variance attributable to classroom is computed as: (variance between classrooms) divided by the sum of the variance between classroom and the variance within classroom.
p < .05. **p < .01. ***p < .0001.
The score gap for children with both behavior problems or with attention problems trumps the SES, gender, and race/ethnic gap. The SES score gap in mathematics and reading was very modest at 2 percentile points (Table 4). There was no significant Black-White score gap or Latino-White score gap in reading, all else equal. There was a significant Black-White mathematics score gap of 3 percentile points (effect size = −.07, ρ < .0001).
Classroom Behavior and Test Scores
There are mixed results with respect to the association between the behaviors of other children and test scores. Higher proportions of other children in the classroom with attention problems were negatively associated with mathematics (effect size = −.12, ρ < .05) and reading scores (effect size = −.13, ρ < .05). These effect sizes represent a score gap of 5 percentile points in mathematics and reading among children in classrooms where other children had attention problems. Contrary to what might be expected, the child’s mathematics or reading score was not significantly affected if other children in the classroom exhibited aggressive behavior (Table 4).
Behavior Problems and Gain Scores
Children with attention problems made slower gains in mathematics and reading compared to children with aggressive behavior and children with no behavior problem. The slower pace of growth in mathematics and reading for children with both behavior problems or with attention problems was associated with a 4 percentile points gap in mathematics (effect size = −.10, ρ < .0001 for attention problems; effect size = −.09, ρ < .0001 for both behavior problems) and in reading (effect size = −.11, ρ < .0001 for attention problems; effect size = −.09, ρ < .0001 for both behavior problems). The pace of growth for children with aggressive behavior was not statistically different from that of children with neither behavior problem (Table 4).
There was a significant association between the behavior of other children and mathematics and reading score gains, but only in classrooms where the other children had attention problems. The presence of other children with aggressive behavior was not significantly associated with mathematics or reading gains scores. The largest source for the differences in the pace of growth in test scores was associated with the child’s own behavior and the child’s starting point in mathematics or reading at kindergarten entry (Table 4).
Interaction Effects
Given the difference in SES, gender, and minority status characteristics between the four behavior groups previously shown in Table 2, we tested whether the test score gap associated with any behavior problem is moderated or modified by SES, gender, or minority status. The score gaps were not moderated by SES, gender, or minority status. Interaction effects were not significant suggesting that the relation of behavior problems, SES, gender, and minority status to test score gaps are independent of each other. This means that the test scores of children in low-SES families with behavior problems are as adversely affected as the test scores of children in high-SES families with behavior problems.
Discussion
We unpacked the association between attention problems, aggressive behavior, and mathematics and reading scores over the kindergarten year at the child level as well as at the classroom contextual level. Unlike previous studies, we examined the combined effects of attention and aggressive behavior problems, making it possible to unpack to read, in order to tease apart the specific associations of aggressive behavior, as as children with such behavior may also have attention problems. (McWayne, Fantuzzo, & McDermott, 2004).
Behavior Problems and Test Scores
Children with both behavior problems and those with attention problems alone had lower scores and made fewer gains in both mathematics and reading over the kindergarten year compared with children with neither behavior problem or children with only aggressive behavior. The findings on the association between attention problems and test scores were consistent with previous studies (Alexander et al., 1993; Duncan et al., 2007; Finn et al., 1995; Friedman-Weieneth et al., 2007). For example, Duncan et al. (2007) found effect size of .08 (p < .001) for reading and effect size of .11 for mathematics (p < .001) when estimating the relation of attention skills to test scores with the ECLS-K data set. The present study goes further than previous research. It showed the negative association between attention problems and the mathematics and reading scores was greater than that associated with aggressive behavior. At the end of kindergarten, the score gap among children with attention problems was about 8 percentile points, and among children with aggressive behavior, the gap was 3 percentile points. Children with attention problems gained fewer points, about 4 percentile points, over the school year than children in low-SES families or minority children. When we consider that low-achieving children are more likely to have lower achievement in the future, such gap could widen considerably in middle school and high school. The present study shows that lack of attention skills is damaging and puts children at risk of school failure even more so than the risks of low academic performance often seen among children in low-SES families and minority children.
Classroom Behavior and Test Scores
With respect to the behavior of other children, our findings are consistent with other studies, with some distinctions. Classrooms with many aggressive children could affect the effectiveness of instruction because children who act out—such as arguing, fighting, getting angry, disturbing ongoing activities—may to get an immediate response from the teacher, as such instructional time is more likely to be affected, which could then adversely affect learning for all children (Finn et al., 1995; Raver, 2002; Reynolds, 1998). Our analyses show that a child’s test scores were unaffected if the classroom had other children with aggressive behavior. The classroom effects were related to the proportion of children with attention problems.
We did not find the expected large negative externalities from the presence of aggressive behavior in other children for several reasons. In kindergarten, the duration of academic instruction tends to be short, and classrooms tend to be, on average, small. The combination of short duration of instruction and small number of children with aggressive behavior in typically small classes might minimize negative externalities associated with the presence of aggressive children. It could also be that the kind of aggression that is typical among 5- and 6-year old children is not so detrimental to the point that children would be negatively affected by such behavior if teachers are able to easily regain control of the classroom.
The lack of large negative externalities could also stem from what children are learning in kindergarten. For example, the mathematics young children are expected to learn tend to be primarily computational and are not taught with emphasis on conceptual understanding, but rather with an emphasis on memorization (Georges, 2009). As such, the content of the curriculum and the approach of teaching mathematics in kindergarten may not require sustained collaboration or empathetic peers, both of which can be impeded by aggressive behavior. By contrast, if the curriculum emphasizes memorization, then a child with attention problems would have great difficulty academically. Children with attention problems are not engaged in their own learning and potentially are not engaged with their peers. However, even though they are not disruptive to their peers, nor do they disrupt ongoing instructional activities, the lack of engagement with their peers and teacher could limit learning opportunities. Consequently, such detachment negatively impacts learning not only for the child but other children in the classroom as well.
The study has some limitations. The classroom behavior measure was based on children sampled for the ECLS-K, rather than all children in the classroom. Even though that is the case, we captured at least the lower boundary effect because we still found significant, albeit modest, association with classroom-level behavior problems. To counter the measurement error of not observing all children in all classrooms, which could undermine the effect size of classroom behavior, we controlled for class size and included in all models the teacher’s rating of the overall level of behavior problem for the entire class. Another limitation of the data was that the individual items that composed each of the behavior scales were not available. It would have been desirable to have the individual items to extrapolate those specific items that directly measured levels of attention skills. This would have allowed us to estimate directly the importance of each type of skills and be able to isolate specific forms of children’s engagement and provide more specificity about intervention measures.
We conjecture that even though aggressive behavior among other children had minimal relation to gains in scores at the kindergarten level, in later grades being in classrooms with aggressive and disruptive children could have negative influences on test scores because older children may be more difficult to discipline than younger children. We were unable to test this hypothesis with the ECLS-K because even though the children are followed until fifth grade, over time the children transitioned to different schools and different classrooms. Over time there was insufficient number of children per classroom or school to perform a longitudinal test of the relation between aggressive and disruptive children in the classroom and test scores.
There could be concerns about measuring attention skills and aggressive behavior using teacher ratings because such measures may be neither reliable nor valid. Teachers’ ratings of a child’s behavior could be subjectively biased. Teachers’ ratings of children’s behavior have been shown to reflect perceptions and embed the teachers’ own characteristics or the classroom’s characteristics rather than the child’s actual behavior (Downey & Pribesh, 2004; Konold & Pianta, 2007; Mashburn, Hamre, Downer, & Pianta, 2006). For example, race influences teachers’ rating of the child’s behavior. In a study using ECLS-K data, Downey and Pribesh (2004) concluded that Black children were consistently rated lower than White children on behavior, but the poorer evaluation of Black children were from White teachers rather than from Black teachers. Similarly, Mashburn et al. (2006) examined whether the characteristics of teachers and classrooms were associated with teachers’ ratings of children social competencies. They found teachers’ race, years of teaching experience, the child-teacher ratio, and the length of school days significantly affected teachers’ ratings of children’s social competencies. As such, they concluded, teachers’ ratings of a child’s behavior were not solely a function of the child, but encompassed other external factors unrelated to the child’s actual behavior.
Our analysis did control for both the children’s and teachers’ race/ethnicity to account for the potential subjective bias arising from the teacher and the classroom environment in rating a child’s behavior. We also included several teacher characteristics variables to account, in part, for rater effects of children’s behavior including teacher’s education, years of teaching experience in kindergarten and preschool, and types of early childhood courses taken.
Conclusion
We found test score gaps among children with any behavior problems. The gap associated with attention problems was larger than that of aggressive behavior, SES, race/ethnicity, and gender. The score gaps for children with attention problems were 7 and 8 percentile points in mathematics and reading, respectively, which were greater than the score gaps for children in low-SES families (2 percentile points) and minority children (2 percentile points), all else equal. Being in a classroom where other children had attention problems also affected gains in test scores over the school year. On the other hand, aggressive behavior among other children in the classroom was not significantly associated with gains in mathematics or reading.
The results showed behavior problems that interfere with attending to and engaging in instructional activities, even if such behavior does not interfere with instructional activities, affect the ability to learn. The findings from this study and others (e.g., Epstein, Atkins, Cullinan, Kutash, & Weaver, 2008) show significant barriers to learning are present as early as the kindergarten year for children who lack attention skills. Minimizing the impact of attention problems is important because of its potential reciprocal nature with subsequent school failure (Miles & Stipek, 2006; Trzesniewski et al., 2006; Welsh et al., 2001) and also because children who start a grade lagging behind will not, on average, do well academically in that school year; and they may act out to avoid tasks that are too difficult for them (Epstein et al., 2008). It becomes important for schools to be prepared to address attention problems, in promoting academic success, and to minimize school failure because such failure might lead to aggressive behavior later on.
Given the fundamental goal of improving academic achievement and minimizing test score gaps, it makes sense to align teacher training and school intervention to foster children’s attentive behavior. Teachers can take some simple measures to foster attentive behavior. For example, teachers should be persistent in communicating the skills the child needs such as listening, following directions, and asking questions. These skills not only need to be communicated consistently but should be modeled for the child. Teachers should provide time for the child to understand the required skills, and the child should get feedback on their behavior (Epstein et al., 2008). We also believe that school psychologists and social workers should be integral to school intervention to address behavior problems because they might perhaps have greater familiarity with or be the best agent to train on helping young children with behavior problems. In that way, teachers will focus on what they do best, and at the same time children will get the intervention they need to be successful in school.
Footnotes
The author(s) declared no conflicts of interest with respect to the authorship and/or publication of this article.
The author(s) received no financial support for the research and/or authorship of this article.
