An Examination of Implementation Fidelity Within the Context of a Tier 2 Mathematics Intervention

Abstract

Evidenced-based mathematics interventions are critical for supporting students with mathematics difficulties. In research and practice, collecting implementation fidelity is important for ensuring that all the core components of the intervention are implemented as designed. Historically, implementation fidelity has been defined as multifaceted, including examinations of adherence, instructional quality, and student engagement, though mathematics intervention studies rarely report on fidelity components outside of adherence. The current study examined the relationships between these different components of fidelity and whether they are associated with student mathematics outcomes and intervention group size within the context of a first-grade mathematics intervention. Findings revealed relationships between components of fidelity with student’s initial mathematics skill; however, no relationship was observed between fidelity components and student mathematics growth. Findings for group size were mixed. Limitations, implications for research and practice, and future directions are discussed.

Keywords

multi-tiered systems of support mathematics intervention implementation fidelity elementary education

Get full access to this article

View all access options for this article.

References

Abry

Hulleman

C. S.

Rimm-Kaufman

S. E.

(2015). Using indices of fidelity to intervention core components to identify program active ingredients. American Journal of Evaluation, 36(3), 320–338. https://doi.org/10.1177/1098214014557009

Baker

Gersten

Lee

(2002). A synthesis of empirical research on teaching mathematics to low-achieving students. The Elementary School Journal, 103(1), 51–73. https://doi.org/10.1086/499715

Bos

S. E.

Powell

S. R.

Maddox

S. A.

Doabler

C. T.

(2022). A synthesis of the conceptualization and measurement of implementation fidelity in mathematics intervention research. Journal of Learning Disabilities, 56(2), 95–115. https://doi.org/10.1177/00222194211065498

Bryant

D. P.

Pfannenstiel

K. H.

Bryant

B. R.

Roberts

Fall

Nozari

Lee

(2021). Improving the mathematics performance of second-grade students with mathematics difficulties through an early numeracy intervention. Behavior Modification, 45(1), 99–121. https://doi.org/10.1177/0145445519873651

Capin

Roberts

Clemens

N. H.

Vaughn

(2022). When treatment adherence matters: Interactions among treatment adherence, instructional quality, and student characteristics on reading outcomes. Reading Research Quarterly, 57(2), 753–774. https://doi.org/10.1002/rrq.442

Carroll

Patterson

Wood

Booth

Rick

Balain

(2007). A conceptual framework for implementation fidelity. Implementation Science, 2, Article 40. https://doi.org/10.1186/1748-5908-2-40

Clarke

Doabler

C. T.

Fien

Smolkowski

(2016–2020). A randomized control trial of a Tier 2 first grade mathematics intervention (Project no. R324A160046, NCSER: Mathematics, Efficacy and Replication, Goal 3, CFDA no. 84.324). Institute of Education Sciences: Special Education Research. http://ies.ed.gov/funding/grantsearch/details.asp?ID=1815

Clarke

Doabler

C. T.

Strand Cary

Kosty

Baker

Fien

Smolkowski

(2014). Preliminary evaluation of a tier 2 mathematics intervention for first-grade students: Using a theory of change to guide formative evaluation activities. School Psychology Review, 43(2), 160–178. https://doi.org/10.1080/02796015.2014.12087442

Clarke

Doabler

C. T.

Sutherland

Kosty

Tutura

Smolkowski

(2022). Examining the impact of a first-grade whole number intervention by group size. Journal of Research on Educational Effectiveness, 16, 326–349. https://doi.org/10.1080/19345747.2022.2093299

10.

Clarke

Rolfhus

Dimino

Gersten

R. M.

(2012). Assessing student proficiency of number sense (ASPENS). Cambium Learning Group, Sopris Learning.

11.

Cohen

(1992). Statistical power analysis. Current Directions in Psychological Science, 1(3), 98–101. https://doi.org/10.1111/1467-8721.ep10768783

12.

Common Core State Standards Initiative. (2010). Common core standards for mathematics. http://www.corestandards.org/the-standards/mathematics

13.

Dane

A. V.

Schneider

B. H.

(1998). Program integrity in primary and early secondary prevention: Are implementation effects out of control? Clinical Psychology Review, 18(1), 23–45. https://doi.org/10.1016/S0272-7358(97)00043-3

14.

Doabler

C. T.

Clarke

(2012). Quality of explicit mathematics instruction [Unpublished observation instrument]. Center on Teaching and Learning, University of Oregon.

15.

Doabler

C. T.

Clarke

Kosty

Fien

Smolkowski

Liu

Baker

(2021a). Measuring the quantity and quality of explicit instructional interactions in an empirically validated tier 2 kindergarten mathematics intervention. Learning Disability Quarterly, 44(1), 50–60. https://doi.org/10.1177/0731948719884921

16.

Doabler

C. T.

Clarke

Kosty

Smolkowski

Kurtz-Nelson

Fien

Baker

S. K.

(2019). Building number sense among English learners: A multisite randomized controlled trial of a Tier 2 kindergarten mathematics intervention. Early Childhood Research Quarterly, 47, 432–444. https://doi.org/10.1016/j.ecresq.2018.08.004

17.

Doabler

C. T.

Clarke

Kosty

Turtura

J. E.

Sutherland

Maddox

S. A.

Smolkowski

(2021b). Using direct observation to document “practice-based evidence” of evidence-based mathematics instruction. Journal of Learning Disabilities, 51(1), 20–35. https://doi.org/10.1177/0022219420911375

18.

Fogarty

Oslund

Simmons

Davis

Simmons

Anderson

Clemens

Roberts

(2014). Examining the effectiveness of a multicomponent reading comprehension intervention in middle schools: A focus on treatment fidelity. Educational Psychology Review, 26, 425–449. https://doi.org/10.1007/s10648-014-9270-6

19.

Fredricks

J. A.

Blumenfeld

P. C.

Paris

A. H.

(2004). School engagement: Potential of the concept, state of the evidence. Review of Educational Research, 74(1), 59–109.

20.

Fuchs

L. S.

Newman-Gonchar

Schumacher

Dougherty

Bucka

Karp

K. S.

Woodward

Clarke

Jordan

N. C.

Gersten

Jayanthi

Keating

Morgan

(2021). Assisting students struggling with mathematics: Intervention in the elementary grades (WWC 2021006). National Center for Education Evaluation and Regional Assistance, Institute of Education Sciences, U.S. Department of Education. http://whatworks.ed.gov/

21.

Gersten

Beckmann

Clarke

Foegen

Marsh

Star

J. R.

Witzel

(2009). Assisting students struggling with mathematics: Response to Intervention (RtI) for elementary and middle schools (NCEE 2009-4060). National Center for Education Evaluation and Regional Assistance, Institute of Education Sciences, U.S. Department of Education. http://ies.ed.gov/ncee/wwc/publications/practiceguides/

22.

Ginsburg

H. P.

Baroody

A. J.

(2003). Test of early mathematics ability (TEMA-3) (3rd ed.). ProEd.

23.

Kwan Lo

Foon Hew

(2021). Student engagement in mathematics flipped classrooms: Implications of journal publications from 2011 to 2020. Frontiers in Psychology, 12, Article 672610. https://doi.org/10.3389/fpsyg.2021.672610

24.

Lekwa

A. J.

Reddy

L. A.

Schernoff

E. S.

(2019). Measuring teacher practices and student academic engagement: A convergent validity study. School Psychology, 34(1), 109–118. https://doi.org/10.1037/spq0000268

25.

Nelson

P. M.

Pulles

S. M.

Parker

D. C.

Klaft

(2020). Implementation fidelity for math intervention: Basic quality ratings to supplement adherence. School Psychology, 35(1), 72–79. https://doi.org/10.1037/spq0000338

26.

O’Donnell

C. L.

(2008). Defining, conceptualizing, and measuring fidelity of implementation and its relationship to outcomes in K–12 curriculum intervention research. Review of Educational Research, 78(1), 33–84. https://doi.org/10.3102/003465430731379

27.

Rosnow

R. L.

Rosenthal

(2003). Effect sizes for experimenting psychologists. Canadian Journal of Experimental Psychology, 57(3), 221–237. https://doi.org/10.1037/h0087427

28.

Sanetti

L. M. H.

Kratochwill

T. R.

(2009). Toward developing a science of treatment integrity: Introduction to the special series. School Psychology Review, 38(4), 445–459.

29.

Stains

Vickrey

(2017). Fidelity of implementation: An overlooked yet critical construct to establish effectiveness of evidence-based instructional practices. CBE Life Sciences Education, 16(1), Article rm1. https://doi.org/10.1187/cbe.16-03-0113

30.

Sutherland

Clarke

Kosty

D. B.

Baker

S. K.

Doabler

C. T.

Smolkowski

Fien

Goode

(2022). Investigating the interaction between teacher mathematics content knowledge and curriculum on instructional behaviors and student achievement. The Elementary School Journal, 123(2), 292–317. https://doi.org/10.1086/721877

31.

Van Dijk

Gage

N. A.

Grasley-Boy

(2019). The relation between classroom management and mathematics achievement: A multilevel structural equation model. Psychology in the Schools, 56, 1173–1186. https://doi.org/10.1002/pits.22254

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.01 MB