Abstract
The purpose of this systematic review was to examine the effectiveness of proportional reasoning interventions for students with learning disabilities (LD) or mathematics difficulty (MD). We evaluated fifth to ninth grade interventions on proportional reasoning content, instructional features, and disability and difficulty identification. The nine studies that met inclusion criteria yielded intervention effects ranging from g = −0.10 to 1.87 and from Tau-U = 0.88 to 1.00. Two of the nine studies were deemed high quality and very few studies included participants with LD. Although most studies identified the concepts addressed in the interventions, authors rarely provided in-depth descriptions of how the concept was taught. The results suggest that proportional reasoning interventions for students with LD and MD is underinvestigated. We posit that intervention research in proportional reasoning can and should be expanded upon and offer suggestions in terms of how researchers can continue to develop the knowledge base.
Proportional reasoning is an important mathematical concept for students to learn through middle school, algebra, and beyond. It is a major component of curriculum standards in sixth and seventh grades (National Governors Association Center for Best Practices & Council of Chief State School Officers [NGA & CCSSO], 2010) and is predictive of later performance in higher mathematics coursework, such as algebra (National Mathematics Advisory Panel [NMAP], 2008). Algebra is a “demonstrable gateway to later achievement” (NMAP, 2008, p. 5) in higher mathematics, is a major factor in high school graduation rates, and provides a foundation to concepts studied in calculus (i.e., velocity, acceleration, instantaneous rate of change, and derivatives), a stepping-stone to postsecondary scholastic and professional success.
Research has shown that students with learning disabilities (LD) underperform compared with their peers in proportional reasoning (Grobecker, 2000; Hecht et al., 2006; Mazzocco & Devlin, 2008). Students with LD experience more significant difficulties in acquiring proportional reasoning than typically progressing students (Mazzocco & Devlin, 2008). Thus, it is important to consider how proportional reasoning interventions can benefit students with LD, as well as for students with chronic low mathematics achievement in absence of a formal disability (i.e., mathematics difficulty [MD]). In the following paragraphs, we define LD and MD and expand the discussion on proportional reasoning in terms of its foundational nature for middle and high school mathematics. We review previous syntheses of mathematics interventions, highlighting conclusions and what is yet to be explored. Finally, we introduce the research questions for this study.
Learning Disabilities and Mathematics Difficulty
Results of prior work leave unanswered questions related to differences for students with LD and MD in terms of definition as well as their difficulties with proportional reasoning. Throughout this systematic review, we refer to students who have LD and MD. Many authors define LD as students who have a learning disability using state criteria or school records, or performance at or below a cutoff score (i.e., 10th percentile) on a standardized measure of mathematics achievement (Chong & Siegel, 2008). In contrast, there is less consistency with how students with MD are identified in the literature (Nelson & Powell, 2018). For example, authors use varying criteria, including but not limited to, teacher referral, performance below the 25th percentile, or lowest performing students.
Often, students with LD and MD exhibit similar behaviors in mathematics, including difficulty with counting, inefficient computation strategies, and difficulty with performing multiple steps to solve problems. Distinctive characteristics of the difficulties include poor fact retrieval and differences in working memory, processing speed, and spatial representations of numbers (Chong & Siegel, 2008; Cirino et al., 2015). In terms of proportional reasoning specifically, both similar and more nuanced characteristics of mathematics understandings emerge. Students with LD and MD both utilize additive reasoning, not proportional reasoning, to solve problems because they view relations as differences as opposed to rates of change (Grobecker, 2000; Hecht et al., 2006; Mazzocco & Devlin, 2008). For example, when examining students’ rational number reasoning, Mazzocco and Devlin (2008) reported that middle school age students with LD demonstrated statistically significant differences in identifying relationships between two fractions presented both pictorially and symbolically. In fact, due to the additive nature of their reasoning, students with LD identified a significant number of incorrect relationships.
Looking at proportional reasoning in students across grade levels, Grobecker (1997) presented students with a task-based scenario where a lion ate three grains in a bundle at a time and an elephant ate two grains in a bundle at a time. Students were given various scenarios requiring them to utilize the relationships between the animals and bundles to solve problems. She found four stages of understanding exhibited by students with LD and MD: (a) the inability to manipulate grains and bundles at the same time; (b) an additive ability to count and add grains and bundles; (c) representing grains and bundles as groups and then adding the groups; and (d) using proportional reasoning (i.e., using the multiplicative relationship between grains and bundles to manipulate values) to scale a relationship up and down. Students with both LD and MD experienced difficulty thinking proportionally (i.e., Stage 3 or Stage 4). Students with LD were unable to advance beyond Stage 2, using mostly additive structures, whereas older students with MD demonstrated higher stages of reasoning.
Framework: Proportional Reasoning
The difficulties students with LD and MD demonstrate underscores a major difference between additive and proportional reasoning and a need to support students to transition to more sophisticated reasoning. Proportional reasoning entails utilizing a multiplicative relationship between two or more quantities. When two quantities are related proportionally, the ratio of one quantity to the other is invariant as the numerical values of both quantities change by the same factor. This can be represented as a: b = c: d or
Arguably, the difficulties students with LD and MD experience with additive reasoning can be traced back to experiences, or the lack thereof, that students have to reason proportionally (NMAP, 2008). Research in learning trajectories (e.g., Battista & van Auken Borrow, 1994; Confrey et al., 2014) suggests potential pathways students may travel to build up conceptions of ratio and proportional reasoning. This research states that linking two composite units together is foundational to understanding ratios and rates conceptually. Students often connect such work to whole number multiplicative reasoning. For example, to conceptualize multiplication, such as 3 × 4, a student should be able to iterate three 4 times either in action or mentally. The result is a composite unit that consists of a unit of 12, which consists of a unit of three iterated 4 times.
Iterating linked composite units requires the enacted or mental iteration of two composite units at once—a multiplicative relation (Battista & van Auken Borrow, 1994). In other words, understanding that the ratio 3:4 represents the same proportional relation as 15:20 requires a concurrent iteration of the composite units three and four, 5 times. In the previous scenario involving sugar and lemonade, students may (a) add three 5 times and add four 5 times; (b) multiply 3 × 5, then 4 × 5 sequentially to obtain 15/20; or (c) add 16 to 3 to get 19 because they added 16 to 4 to get 20. The first and second strategies are an iteration of the linked composite using variations of multiplicative thought. The third is an additive view of the relation.
Students who reason proportionally realize that the composite values covary between equivalent classes yet the within relation remains invariant. For example, 4 is 4/3 times as large as 3, as is 20 is 4/3 times as large as 15. Put simply, all denominators of ratios written in the form
Previous Reviews and Rationale
Previous syntheses have examined the effectiveness of interventions in mathematics for students with LD and MD (e.g., Cook et al., 2019; Jitendra, Lein, et al., 2018; Stevens et al., 2018). For example, Jitendra, Lein, et al. (2018) examined middle and high school mathematics interventions for students with LD or MD and found a mean effect size of g = 0.37; authors further reported that the eight studies that used visual models combined with other strategies produced the largest effect size (g = 0.52). Stevens et al. (2018) examined mathematics intervention for students with MD in Grades 4 through 12; the authors reported extreme variability in the effectiveness of interventions ranging from d = 0.66 to 4.65. Cook et al. (2019) reviewed the effectiveness of schema-based instruction (SBI) on solving word problems for students with LD, and reported that SBI is a potentially evidence-based practice, but that more research needs to be done to strengthen the evidence base. Although SBI is a common instructional approach to teach proportional reasoning, Cook et al. did not focus specifically on proportional reasoning studies.
Although previous reviews examining the effectiveness of mathematics interventions may have included studies focused on proportional reasoning, research syntheses have not exclusively focused on the effectiveness of proportional reasoning interventions for students with LD or MD. This makes it difficult to generalize results of previous reviews specifically for students in the middle grades with LD or MD in the area of proportional reasoning because syntheses generally report summary effects for a pool of studies (e.g., such as by the same grade). To improve student outcomes, practitioners need targeted information about interventions, including what population of students the interventions were found to be effective. Many syntheses have targeted wide grade bands, making it difficult to generalize results of reviews that examine SBI or word problem solving to students who are typically taught proportional reasoning skills. Given that proportional reasoning skills are critical for success with more advanced mathematics and are also needed for success with daily living skills, such as cooking and financial management, it is essential that researchers and practitioners understand the research base supporting interventions in this area for students with LD and MD. Conducting a systematic review of the literature on proportional reasoning interventions for students with LD and MD will provide researchers and practitioners with information about what is currently available for students with LD or MD in the area of proportional reasoning interventions.
Purpose and Research Questions
The purpose of this study is to investigate proportional reasoning interventions for students with LD and MD in fifth to ninth grades. Specifically, we explored intervention effects as they related to how researchers defined LD and MD and determined how researchers measured intervention outcomes. We aimed to answer the following research questions:
Method
Literature Review
We were primarily interested in examining literature that reflected more current practices; therefore, we reviewed intervention studies published in the last 20 years, from January 1998 to December 2018. We searched Academic Search Premier, Education Research Complete, ERIC, ProQuest Dissertations & Theses Global, PsycINFO, and Web of Science databases with combinations of the following search terms: “composite unit,” covariation, disabilit*, dyscalcul*, intervention, iterating, “linked composite,” “math* difficult*,” “multiplicative reasoning,” partitioning, proportion*, “proportional reasoning,” rate, ratio*, and “unit* coordination.” We considered peer-reviewed journals, dissertations, conference proposals, book chapters, and research reports published in English for inclusion.
Inclusion Criteria
We used the following criteria to determine study inclusion:
The study examined the effects of a proportional reasoning intervention. We defined proportional reasoning as mathematical reasoning that involves covariation and multiple comparisons, with the ultimate goal to understand that proportion binds two variables (i.e., a change in one requires a change in another to maintain an equivalent relation). We defined intervention as instruction that supplemented or supplanted regular mathematics instruction that reflected a change to typical instruction, such as increased intensity (Wanzek & Vaughn, 2007). Studies that examined curriculum or intervention packages that included units on ratios and proportional reasoning were excluded unless the studies provided separate results for instruction in ratios and proportional reasoning.
Participants were in middle grades (i.e., fifth to ninth grade). Studies focused on other grades were excluded (e.g., Hunt, 2015), unless authors provided disaggregated results by grade level. We focused on fifth to ninth grades for a few reasons. First, according to the Common Core State Standards (CCSS), proportional reasoning is heavily emphasized beginning with sixth grade and extending to seventh grade (NGA & CCSSO, 2010); so, it makes sense to include these grade levels. Second, in terms of Multi-Tiered Systems of Support, the school structure would justify the use of proportional reasoning interventions beyond seventh grade with students who struggle; it is reasonable to extend the search to include eighth and ninth grades. Finally, early transitions to proportional reasoning can occur as early as fifth grade (Christou & Philippou, 2001; Ham & Gunderson, 2019; Lamon, 2007); in addition, we considered studies with fifth grade participants in an attempt to (a) gather studies conducted prior to the broad adoption of the CCSS; (b) gather studies with mixed grade level groupings of students without disaggregated data (e.g., fifth and sixth grade); and (c) gather studies conducted in non-U.S. countries who may introduce proportional reasoning knowledge and skills earlier than the United States.
The study identified a subset of participants as having a LD or MD. Although a common approach to identifying MD is with performance at or below the 25th percentile (Nelson & Powell, 2018), we were less restrictive in our inclusion criteria due to the small number of intervention studies that have examined proportional reasoning for students with either LD or MD. We included any study where authors specified that students had MD. When studies included students with and without LD or MD, studies that did not provide disaggregated data were excluded unless students with LD or MD made up more than 50% of participants (e.g., Xin et al., 2005). Studies that focused on disabilities other than LD were excluded (e.g., Deaf or hard of hearing; Nunes & Moreno, 2002).
The study employed a group design or single case design (SCD) and included a measure of effectiveness (e.g., means, SDs, and percentage of nonoverlapping data).
The study included at least one researcher-developed or norm-referenced mathematics measure of proportional reasoning or provided disaggregated scores for items that measured proportional reasoning. Studies that did not include a proportional reasoning measure or disaggregated results were excluded (e.g., Sawrey, 2018).
The comprehensive literature search resulted in 831 studies, which we reviewed in two phases (see PRISMA Figure S1 in online supplementary materials). First, we reviewed titles, keywords, and abstracts of all 831 studies to determine which studies were outside the scope of this systematic review; 88% of articles were excluded at this point for the following reasons: irrelevant focus (63.7%), participants were not in fifth through ninth grades (8.5%), the study was an intervention but did not focus on proportional reasoning (5.8%), the topic was proportional reasoning but the study was not an intervention (4.5%), and other (5.1%; for example, commentaries, meta-analyses, duplicates of peer-reviewed articles and conference proposals). We identified 104 studies for full-text review; we reviewed the method and results sections of all articles to determine if the study met all of the inclusion criteria for our systematic review. Many studies were excluded for more than one reason, including the following: the topic of the study was proportional reasoning but was not an intervention (n = 12), the study was a mathematics intervention not focused on proportional reasoning (n = 43), participants were not in fifth through ninth grades (n = 21), a subset of participants did not have LD or MD (n = 47), participants were not administered a measure of proportional reasoning (n = 20), and the study was irrelevant (n = 15). Nine studies met inclusion criteria for this systematic review, including three SCD studies and six group design studies.
Coding Procedures
We coded the studies that met inclusion criteria for (a) study and intervention information, (b) measures, (c) participants, (d) instructional content, and (e) study quality.
Study and intervention information
We coded studies for location, publication year, design, instructional arrangement, intervention agent, and intensity (duration, number of sessions). Regarding intervention features (Gersten et al., 2009; Siegler et al., 2010), we coded studies for the occurrence of scripted lessons, teacher modeling, meaningful practice opportunities, scaffolded instruction, explicit and systematic instruction, and pictorial and concrete representations. We also coded if interventions emphasized development progressions, student verbalizations and discourse, giving students “think time,” metacognition, and teaching underlying problem structures.
Measures
We coded all dependent mathematics measures. We identified each dependent measure as aligned (i.e., proximal) or not aligned (i.e., distal) to the intervention content and if the measure encompassed many different skills (i.e., broad) or focused on a single skill (i.e., narrow). We also recorded if studies provided reliability and validity information.
Participants
We coded participants’ grade/age, ethnicity, gender, free/reduced-price lunch (FRL) status, and English learner (EL) status. Because the focus of this systematic review was on students with LD or MD, we also coded how authors identified participants as atrisk. We coded if studies identified students as having a LD and the specific criteria (e.g., Individualized Education Program [IEP] goals in mathematics) as well as MD and the specific criteria used for identification (i.e., percentile on a mathematics screening measure).
Instructional content
We coded if interventions addressed the following content: ratio, unit rate, covariance, invariance, composite units, proportional reasoning, missing value, and additive comparison (National Research Council [NRC], 2001). For each, we coded for the level of specificity, including the following: (a) Study identified or listed the content that was addressed; (b) study provided a definition of the content in relation to the intervention; and (c) study illustrated or described in depth how the concept was taught, and student actions during intervention.
Study quality
We coded studies for quality according to guidelines recommended for group design studies (Gersten et al., 2005) and SCD studies (Horner et al., 2005). For group design studies, we coded essential quality indicators (QIs) on a 0 to 2 scale (0 = did not meet; 1 = partially met; 2 = fully met), and when studies met all but one essential QI (as outlined by Gersten et al.), we coded studies for desirable indicators on a 0 to 1 scale (0 = did not meet or partially met; 1 = fully met). For SCD studies, we coded all QIs on a 0 to 2 scale (0 = did not meet; 1 = partially met; 2 = fully met) as Horner et al. outlined one set QIs and did not specify essential versus desirable QIs.
Interrater Agreement
All five authors shared coding responsibilities for all studies included in this systematic review. Each study (100%) was coded once by two authors to determine interrater agreement. Interrater agreement was calculated as (agreements/disagreements × 100). The mean interrater agreement across categories was 91% (range = 82% to 96%). The authors resolved discrepancies and determined the final code prior to data analysis.
Data Analysis
We calculated effect sizes for group design studies as unbiased Hedges’ g to account for small sample sizes (What Works Clearinghouse [WWC], 2017). If studies with a pre–post design did not report adjusted post test means, effect sizes were calculated as the “difference between the mean outcome for the intervention group and the mean outcome for the comparison group, divided by the pooled within-group standard deviation of the outcome measure” (WWC, 2017, p. 13). When studies reported adjusted post-test scores or only reported post-test scores, effect sizes were calculated as the mean standardized difference between the experimental and control condition divided by the pooled SD at post-test. Group design effect sizes were interpreted as 0.20 = small, 0.50 = moderate, and 0.80 or greater = large (Cohen, 1988).
For SCD studies, we calculated effect sizes as Tau-U, which measures the amount of overlap between phases and controls for the trend in baseline data (Parker et al., 2011). First, we uploaded all graphs in WebPlotDigitizer Version 4.2 (Rohatgi, 2019) to extract raw data from the baseline and intervention phases from each study. Second, we inputted the raw data into a web-based calculator for SCD analysis (Vannest et al., 2016) to calculate Tau-U and the 95% confidence interval (CI). Generally, Tau-U effect sizes are interpreted as no effect (less than 0.50), small (0.50–0.60), moderate (0.60–0.90), and large (greater than 0.90). Due to the small number of studies included, we do not provide summary effects; we provide only individual study effect sizes.
Results
Descriptive Results
Nine studies met inclusion criteria (see Tables 1 and 2). All studies were conducted in the United States and were published between 2009 and 2018 (M = 2013). There were 2,804 total participants who were: 50% female, 57% Caucasian, 28% Hispanic, 21% African American, 6% Asian American, and 2% Other (percentages do not add to 100% as some studies reported participants as White Hispanic). Fifty-two percent of participants received FRL and 15% were ELs.
Summary of Single Case Design Studies and Effects.
Note. IEP = Individualized Education Program; LD = learning disabilities; MD = mathematics difficulty; WPS = word problem solving; CI = confidence interval.
Hours of intervention = approximate hours of intervention based on length of session and number of sessions.
Summary of Group Design Studies and Effects.
Note. GMADE = Group Mathematics Assessment and Diagnostic Evaluation; IEP = Individualized Education Program; LD = learning disabilities; MD = mathematics difficulty; MDRD = mathematics and reading difficulty; Mix = mix of researcher and teacher; PPS = Proportional problem solving; PSSA = Pennsylvania System of School Achievement; PST = problem-solving test; WPS = word problem solving.
For the Jitendra, Harwell, et al. (2018) article, two groups of students with MD are represented. These groups are not mutually exclusive. bHours of Intervention = approximate hours of intervention based on length of session and number of sessions.
Intervention characteristics
The average duration was 4.7 weeks (SD = 1.7 weeks) and the majority of studies (67%) used the intervention as a replacement curriculum; one study (Hunt & Vasquez, 2014) used the intervention in addition to the core mathematics curriculum, and two studies did not report whether the intervention was in addition to a replacement of core mathematics instruction (Xin, 2008; Xin et al., 2005). All but one study reported using features of explicit and systematic instruction and emphasized teaching the underlying problem structure (Hunt & Vasquez, 2014). Authors used pictorial representations in all studies except one (Brawand, 2013) to represent and model solution strategies. The most common pictorial representation reported was schematic diagrams. All but two studies (Brawand, 2013; Xin et al., 2005) reported using meta-cognitive strategies such as teaching the “think aloud” process for problem solving. In contrast, only a few studies reported incorporating the following intervention features: emphasizing developmental progressions (Hunt & Vasquez, 2014) and emphasizing student discourse and verbalizations (Hunt & Vasquez, 2014; Jitendra, Harwell, et al., 2018).
Intervention content
All studies included at least one skill in the area of proportional reasoning, and the most common skills addressed in interventions were as follows: unit rate (n = 8), ratios (n = 7), and proportional reasoning (n = 7). Other skills were only addressed by a few interventions including the following: missing values (n = 3), invariance (n = 2), covariance (n = 1), and numerical comparisons (n = 1). Only one intervention identified focusing on composite units (Hunt & Vasquez, 2014) and no interventions focused on qualitative comparisons. Although most studies identified concepts that interventions focused on, very few studies provided a definition of the content in relation to the intervention and only one study illustrated how the concept was presented to students and supported through instruction (Hunt & Vasquez, 2014). Across all studies, there were 29 instances of identified concepts we coded for; however, authors provided a definition of the concepts in only 15 instances (52%), and authors provided an in-depth illustration or description of how the concept was taught in only five instances (17%).
Study quality
Across the six group design studies, the average quality rating was 1.74 (SD = 0.16; max = 2.0). We identified two high- or acceptable-quality studies (Jitendra et al., 2009, Jitendra, Harwell, Karl, et al., 2017). The remaining four studies had more than one essential QI with a score below 2 and were not deemed high or acceptable quality. The area of essential QIs that studies scored the lowest (M = 1.0; SD = 0.58) was “sufficient information to confirm whether the participants had the disabilities or difficulties presented” followed by “control condition described with replicability” (M = 1.33; SD = 0.82) and “outcome measures administered at appropriate times” (M = 1.5; SD = 0.84). Regarding the two studies (eligible for high or acceptable), both met four or more desirable indicators, meaning they were each identified as high quality. For SCD studies, the average quality rating was 1.58 (SD = 0.23; max = 2.0). Horner et al. (2005) did not propose a recommended number of indicators needed for a study to be deemed high quality or acceptable quality. Therefore, we identified a high- or acceptable quality study as any study that met all but one QI (similar to Gersten et al.); however, none of the SCD studies met this criterion. We observed the lowest average scores for “social validity” (M = 1.00; SD = 0.58), “experimental control” (M = 1.0; SD = 1.0), and “three demonstrations of experimental effect” (M = 1.33; SD = 0.58).
How Authors Defined LD and MD
With this research question, we examined how authors identified participants with LD and MD within intervention studies (see Tables 1 and 2). Studies specifically identified participants as having a LD in four studies totaling 28 participants. Across the four studies, authors identified participants as having a LD according to school or district criteria, and in two studies, authors reported that students also had mathematics IEP goals. In all studies with participants with LD, authors also ensured that students demonstrated difficulty with the targeted intervention content (e.g., through additional intervention study screening measures).
In seven studies, authors identified many more students (n = 1,491) as having MD, using varying criteria. Only one study identified students as MD according to performance at or below the 25th percentile on a mathematics achievement test; this was surprising given that the 25th percentile is one of the most common cutoffs used by researchers to identify MD (Nelson & Powell, 2018). Other studies used less restrictive cutoffs (e.g., 35th percentile) or criteria that did not specify a percentile cutoff, such as performance on a state test. Finally, only two studies with participants with MD identified students using measures that specifically assessed an aspect of students’ understanding of proportional reasoning (Jitendra, Harwell, et al., 2018; Xin et al., 2005), meaning that studies more often used students’ performance in mathematics broadly to identify participants as MD for the proportional reasoning intervention study.
The Effectiveness of Proportional Reasoning Interventions
With the third research question, we examined the effectiveness of proportional reasoning interventions. Because we did not identify enough studies to statistically investigate moderators in intervention effectiveness, we were not able to explore patterns in effectiveness across participants’ characteristics, such as criteria for LD or MD. We first present the results for the three SCD studies followed by the results for the six group design studies.
The three SCD studies each reported that participants made gains from average scores during the baseline to average scores during the intervention phases. The authors reported overall gains between 52.3% and 60.4% (Brawand, 2013), 71% (Hunt & Vasquez, 2014), and 80.5% (Xin, 2008). The average Tau-U for all studies ranged from moderate to large (0.88–1.00); Table 1 presents the Tau-U effect sizes for each study.
The remaining six studies used group design methods and reported intervention outcomes at posttest and delayed posttest on a variety of measures. Effect sizes for proximal measures of proportional reasoning ranged from g = −0.01 to 1.87 at immediate post-test and from g = 0.16 to 2.69 at delayed post test. At immediate post-test, three treatment groups yielded negligible or small effects, four treatment groups yielded moderate effects, and only one treatment group yielded large effects. Effect sizes for distal measures of generalized mathematics performance ranged from g = −0.22 to 1.33.
How Do Studies Report Improvement?
With our final research question, we were interested in exploring how studies defined improvement of student understanding. In other words, did studies only use typical mathematics measures to report intervention effectiveness, or did studies also use other methods (e.g., social validity, anecdotal information) to report intervention effectiveness? All studies reported improvement on students’ ratio and proportion problem-solving skills, with fewer studies reporting improvement of general mathematics skills. However, one study also reported students’ results on measures of social validity and self-efficacy as related to the intervention. Regarding social validity, Brawand (2013) reported that the majority of participants enjoyed learning how to solve word problems using SBI format and that their word problem skills had improved as a result of using the SBI process. Most students also reported that they planned to continue to use the process learned in intervention. Brawand (2013) also measured students’ self-efficacy and the author reported that one more student at posttest compared with pre-test reported that they felt they could not manage a solution strategy even after the intervention; however, three more students at posttest reported they were surer of themselves solving word problems. The same number of students at pre- and post-test reported difficulty with solving word problems.
One study also examined students’ metacognitive strategy knowledge as a measure of intervention effectiveness (Jitendra et al., 2009). The results of the metacognitive assessment indicated that students in the low achieving classrooms were not completely sure how to organize information from a word problem using a diagram after the intervention, compared with students in the average and high achieving classrooms, though the difference between groups was not statistically significant. The authors also reported that high achieving students perceived all three solution strategies for solving ratio and proportion word problems (cross multiplication, equivalent fractions, and unit rate) to be equally easy to apply. In contrast, both average and low achieving students identified cross multiplication as an easier strategy to use compared with equivalent fractions or unit rate strategies.
Hunt and Vasquez (2014) examined strategy use through the lens of students’ own mathematical thinking and reported that all three students increased their reasoning as defined by increasingly sophisticated strategy usage evidenced across the intervention. Students’ use of build-up, emergent unit, and unit strategies evidenced increased multiplicative understanding of ratios, suggesting conceptual development. The authors also reported that all three students also increased their performance on ratio problems across the intervention, showing an iterative development of both procedural skill and multiplicative reasoning (NRC, 2001). In contrast, none of the other reported measures defined student proficiency in terms of student development.
Discussion
The purpose of this systematic literature review was to investigate proportional reasoning interventions for middle grade students with LD or MD. We explored the type of proportional reasoning content that researchers included in interventions and examined the level of study quality. Moreover, we investigated how researchers defined participants as having LD or MD and the effectiveness of the proportional reasoning interventions. Results of this systematic review uncover interesting information pertaining to the state of the knowledge base for proportional reasoning interventions and students with MD and LD. Taken together, findings support opportunities for the field to expand intervention work in ratio and proportional reasoning in the middle grades for students with more clearly defined MD or specific LD. Moreover, opportunities exist for studies that utilize more carefully articulated or illustrated foundational concepts and specially designed pedagogies. We discuss the state of the knowledge base and opportunities for growth in the area of proportional reasoning interventions for students with LD or MD as related to the results of this systematic review.
Characteristics of Included Studies
First, we examined the specific proportional reasoning content and study quality of the included studies. The dearth of research in specific, foundational areas of ratio and proportion content and specially designed pedagogy is also notable. Within the small number of studies we reviewed on ratio and proportion overall, very few addressed students’ prior or informal reasoning, focused on informal concepts of proportional reasoning (i.e., invariance, covariance, linked composites, qualitative comparison), or a careful sequencing of problems that could work to support students to advance their reasoning (Daro et al., 2011; Hunt & Vasquez, 2014). These topics have been researched more extensively with populations of students without disabilities or difficulties (e.g., Lamon, 2007; Streefland, 1997); thus, researchers in special education may continue to develop and investigate the efficacy of interventions in proportional reasoning, paying specific attention to less investigated concepts and skills (e.g., invariance). In addition, authors rarely defined or illustrated the concepts addressed by the interventions, reflecting a further lack of specificity. Future researchers may consider providing detailed supplementary materials such as lesson scripts or sequences that illustrate how a specific concept was presented. It may be difficult for researches to expand on the interventions conducted, to date, without explicit information about how researchers modeled and demonstrated content.
In terms of pedagogy, most interventions in this study used some form of explicit instruction, such as explicit teacher modeling, scripting of teacher language, and explicit modeling of proportional structure. This finding was not surprising given the evidence base that supports explicit and systematic instruction, especially for students with LD and MD (Gersten et al., 2009). The interventions and instructional strategies addressed in this systematic review provide a good foundation for future exploration and investigation of other potentially effective instructional practices for students with LD and MD. The need for more diverse research related to effective instructional strategies for students with LD or MD, however, cannot be ignored. Many of the design features across the studies were similar (likely due to the same research team conducting the majority of studies), reflecting a lack of variability in the interventions. One core component used heavily in the reviewed studies is SBI, which works to address students’ understanding of problem structures (Fuchs et al., 2004, 2008). In SBI, teachers train students to explicitly identify a problem structure and diagram key information into a schematic drawing (Gersten et al., 2009). SBI is showcased in Institute of Education Sciences (IES) practice guides for effective instructional practices in fractions and ratios (Siegler et al., 2010) and is potentially an evidence-based practice to teach students with MD (Cook et al., 2019).
Yet, the field also explicates that the predominance of SBI should not preclude the design, development, and testing of alternate intervention approaches (Gersten et al., 2009; Siegler et al., 2010). One major contribution of this systematic review rests with the potential contributions new approaches may yield for the field. For example, only one study utilized approaches that began with the student solving problems (Hunt & Vasquez, 2014) and utilized knowledge of development to inform task design, and only two studies utilized discourse and verbalizations of students’ thought processes to support student achievement (Hunt & Vasquez, 2014; Jitendra, Harwell, et al., 2018). Despite their generally positive effects, we have very little evidence about how such features support students with particular LD or MD in learning concepts of ratio and proportion in ways not addressed by the interventions in this systematic review. More research is needed to better understand how relatively novel intervention topics (invariance, covariance, qualitative comparison; problems used to nudge or challenge students’ prior reasoning), or pedagogical design features (e.g., task design, student verbalizations, knowledge of concept development), might support students to advance their reasoning.
We also examined study quality, and we reported that only two studies met QI to be deemed high quality; however, on a scale of 0 to 2, the average scores across group and SCD were relatively high, indicating that studies met most indicators fully or partially. Regarding the indicators with the lowest quality scores, future research may consider stricter or even different inclusion criteria for participants around disability and difficulty. Group design studies scored the lowest for providing “sufficient information provided to determine whether the participants demonstrated the disabilities or difficulties presented.” To score a 2, studies were required to (a) document that participants had LD or (b) document that participants had MD according to performance ≤25th percentile. We were firm in our criteria for studies to score a 2 because more restrictive criteria provided greater confidence that students in the study actually represented a population of students with LD or MD, allowing for more specific recommendations according to our systematic review. These results are similar to the results reported by Cook et al. (2019); the authors applied the Council for Exceptional Children (CEC) quality indicators to group and SCD studies and reported that there were not enough participants across studies identified as having LD to classify SBI as an evidence-based practice.
Studies might also ensure that post-test measures are administered immediately (Gersten et al., 2005) to have confidence in the reported intervention effectiveness; other QI frameworks also note the importance of appropriate timing of assessments (CEC, 2014). Authors may also consider providing more detailed information regarding the instruction provided in the control condition, as most group design studies in this systematic review only provided information about the textbooks and materials used in business as usual settings; these results are similar to other reviews of interventions regarding the lack of information about the control condition (Nelson & McMaster, 2019). Without comprehensive information about what instruction looks like in the control condition, it is difficult to have confidence in the efficacy of the intervention, even when authors report large effect sizes.
For SCD studies, one study (Xin, 2008) did not exhibit strong levels of experimental control or effect due to not including at least 3 data points in each phase for each participant (i.e., there were intervention phases with 1 or 2 data points); future research that utilizes SCD method may consider following recent advances in SCD to demonstrate the effectiveness of the intervention (Kratochwill et al., 2013). Moreover, although Brawand (2013) utilized measures of social validity, none of the SCD design studies employed typical intervention agents or discussed the cost or feasibility of the study. Authors in future research may consider providing this information, along with information about how feasible the intervention is to implement with little training in the content (e.g., paraprofessionals). It is important to note that the rubric we designed to code for the quality of studies only represents the information that authors actually reported in the published manuscripts and dissertations; quality as it is presented here may not be reflective of the actual research that occurred. For that reason, we encourage authors of future intervention studies to consider reporting full intervention study information in online supplementary materials to allow for replication and expansion of the studies.
Characteristics of Participants
Across the nine studies that addressed proportional reasoning interventions in the middle grades, approximately 2% to 3% of the students had LD as defined by school criteria and/or IEP goals specific to mathematics, a figure that is below the percentage of the population of middle grade students who possess LD reported nationally (McFarland et al., 2019). In Xin (2008), researchers included some participants without a formal LD diagnosis. Three of four participants were referred for difficulty in word problem solving; however, the authors did not indicate students’ initial level of MD as measured by an achievement test.
Furthermore, the majority of students served by the reported interventions had MD, a population often defined in the included studies by performance on a state test or by cutoff scores that fell above the commonly accepted criterion of the 25th percentile. Holistically, our results suggest ambiguities in terms of the nature or specificity of the LD and the severity of the MD these interventions addressed. Cognitive characteristics of both MD and LD vary as a function of the cutoff scores and diagnostic criteria utilized to define the population (Murphy et al., 2007). Thus, there is a need for additional studies that address the unique needs of students with LD or students who exhibit mathematics difficulties as defined by more selective sampling criteria.
Effectiveness of Proportional Reasoning Interventions and Outcome Measures
With our third research question, we examined the effectiveness of proportional reasoning interventions; however, we were unable to report a summary effect due to the small number of studies in the literature base focused on students identified with LD or MD. For group design studies, studies yielded variable effects, ranging from negligible to large. What is interesting is the variation in intervention effects given the fact that most of the group design studies were conducted by the same research team implementing a very similar SBI program with seventh grade students. The variable results suggest that more research with students with LD and MD is needed to identify practices that produce consistent results. For SCD studies, Tau-U ranged from 0.88 to 1.00, which suggests a moderate to large effect for students in these studies. However, the lower bound of the 95% CI for two studies bordered the range of “no effect” or “small effect.” This also indicates a need for more research in proportional reasoning interventions to identify what works, for what group of students, and under what conditions.
Finally, another area for expanding the intervention literature base in ratio and proportion lies in the ways that researchers measure student improvement across the studies. All studies reported some type of performance as the dominant method of improvement for students with LD and MD in proportional reasoning. Many of the studies utilized researcher-developed measures, which reflected improvement in intervention content as opposed to development, advancement in reasoning, or applicability of the knowledge to the construct of ratio and proportion generally. Moreover, because improvement on the distal measure was not always significant, it is unclear to what extent the interventions improved students’ global knowledge of ratio and proportion. Finally, only two studies examined other factors, such as strategy formulation, multiplicative reasoning, self-efficacy, or metacognition, as a gauge of improvement, despite the relationships between such factors and student achievement (NRC, 2001). In contrast, researchers have measured or investigated the role of self-efficacy with students with LD or MD in word problem solving (Owen & Fuchs, 2002) and fraction word problem solving (Fuchs et al., 2016), for example. Researchers have also investigated how different problem types may affect problem difficulty differently for students depending on the type of their learning difficulty (Powell et al., 2009). Taken together, these findings reveal a need to broaden the ways in which students’ improvement of knowledge in ratio and proportion is measured beyond the use of pre–post testing or performance-driven gauges of improvement.
Implications for Practice
The primary purpose of this study was to provide researchers with detailed information about the state of the knowledge base of proportional reasoning interventions for students with LD and MD; however, there are some practical implications to consider. Many studies in this systematic review reported moderate students gains on proximal outcomes measures, suggesting that interventions in ratios and proportional reasoning are effective, on average, for students with varying degrees of academic risk. These results suggest that when practitioners intervene in this area of mathematics, they can see improvement in understanding of ratios and proportional reasoning concepts. However, practitioners may need to consider a few aspects of these results. First, treatment effects were extremely variable, ranging from negligible to large. The interpretation of the results of this systematic review are constrained by a small research base, and practitioners should consider generalizing treatment outcomes with caution. Second, practitioners may also want to consider using additional measures of student understanding along with traditional mathematics assessments, such as self-efficacy and strategy use as these concepts are also critical for students’ success in all areas of mathematics. To date, these outcomes have largely been uninvestigated for students with LD or MD in the area of proportional reasoning; however, teachers may gain valuable information regarding making instructional decisions and designing supplementary learning activities based on student responses on assessments related to self-efficacy and strategy use.
In addition, practitioners may consider the fact that specific aspects of proportional reasoning have been investigated more often (e.g., unit rate, ratios) compared with other aspects (e.g., missing values, invariance, and covariance). Practitioners may consider the fact that recommendations in these areas of proportional reasoning will grow and change as the research base grows. Practitioners may carefully examine interventions for how aspects of proportional reasoning are defined by researchers and how it is taught to students in these studies. Very few studies, in their published form, provided lesson content in a manner that was replicable. Practitioners may consider requesting access to lesson plans and interventions to determine how the concepts were taught to make the best decisions for their own instruction.
Limitations
There are limitations with this systematic literature review. First, only nine studies met our inclusion criteria. This small number of studies limits the ability to perform meta-analytic techniques to find a summary effect for proportional reasoning interventions. Due to the small number of studies, we also were not able to investigate how variables moderated treatment effects. Second, the majority of studies focused on seventh grade and were conducted by similar research teams. This limits the generalizability of the results to students in different grade levels. Because similar research teams conducted the majority of the studies, the results of our study may also be limited due to researchers pulling intervention samples from similar geographic areas and testing similar interventions. The purpose of this study was to focus on middle grade students who have LD or MD, but future research may broaden the scope of the systematic review by expanding to studies with participants with other types of disability, or including studies the focus on typically achieving students. Finally, we only identified 28 participants as having a documented LD, and many other studies used less restrictive criteria for MD. This limits our ability to determine the effectiveness of interventions for students with LD and MD, in particular, students with the most persistent and chronic learning needs. Future research should attempt to include more students with varying ability levels (with disaggregated results), specifically those students who may need more support in the area of proportional reasoning.
Conclusion
The results of this systematic review add to the evidence base on proportional reasoning interventions for students with LD and MD and expose the need for more research in this area. Future researchers may use the results of this review as a foundation for exploring what other instructional strategies are effective for students with the most persistent learning needs. Our intent with this systematic review was to summarize the current knowledge base so that other researchers may make progress in aspects of proportional reasoning that have not yet been investigated. Given that proportional reasoning is the foundation of mathematics that all students learn in middle and high school, it is essential that more research in this area is conducted.
Supplemental Material
Figure_S1_PRISMA – Supplemental material for Current Knowledge and Future Directions: Proportional Reasoning Interventions for Students with Learning Disabilities and Mathematics Difficulties
Supplemental material, Figure_S1_PRISMA for Current Knowledge and Future Directions: Proportional Reasoning Interventions for Students with Learning Disabilities and Mathematics Difficulties by Gena Nelson, Jessica H. Hunt, Kristi Martin, Blain Patterson and Andy Khounmeuang in Learning Disability Quarterly
Footnotes
Declaration of Conflicting Interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) received no financial support for the research, authorship, and/or publication of this article.
Supplemental Material
Supplemental material for this article is available on the Learning Disability Quarterly website with the online version of this article.
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
