Balancing Internal and External Validity Using Precis-2 and Re-Aim: Case Exemplars

Abstract

The National Institutes of Health estimated that $3–$4 billion is spent supporting clinical trials annually, yet an average of 17 years is required for research evidence to be implemented into practice. Study designs that balance external and internal validity, based on the goals of the study and relative to the state of the science, may accelerate knowledge translation. The purpose of this case study was to evaluate two randomized control trials on the effectiveness-efficacy continuum using the PRagmatic Explanatory Continuum Indicator Summary and the Research Effectiveness Adoption Implementation Maintenance model. Findings provided insight into strategies that may lead to more balanced approaches to research design. Incorporating tools such as PRECIS-2 and RE-AIM when designing and implementing research interventions may accelerate knowledge translation to close the gap between scientific knowledge and clinical practice.

Keywords

knowledge translation randomized controlled trial pragmatic research research design

Get full access to this article

View all access options for this article.

References

Cartwright

(2007). Are RCTs gold standard? BioSocieties, 2(1), 11–20. https://doi.org.10.1017/S1745855207005029

Chalkidou

Tunis

Whicher

Fowler

Zwarenstein

(2012). The role for pragmatic randomized controlled trials (pRCTs) in comparative effectiveness research. Clinical Trials, 9, 436–446.

Corbett

C. F.

McPherson

Daratha

K. B.

Smith

C. L.

Wiser

M.S.

Vogrig

B. K.

Murphy

S. M.

Cantu

Dyck

D. G.

(2017). Personalized care planning intervention for patients with complex chronic conditions: A randomized clinical trial [Unpublished manuscript]. College of Nursing, University of South Carolina.

Curran

G. M.

Bauer

Mittman

Pyne

Stetler

(2012). Effectiveness-implementation hybrid designs: Combining elements of clinical effectiveness and implementation research to enhance public health impact. Medical Care, 50(3), 217–226. https://doi.org.10.1097/MLR.0b013e3182408812

Fiore

L. D.

Lavori

P. W.

(2016). Integrating randomized comparative effectiveness research with patient care. New England Journal of Medicine, 374, 2152–2158. https://doi.org/10.1056/NEJMra1510057

Friedenreich

C. M.

Neilson

H. K.

Farris

M. S.

Courneya

K. S.

(2016). Physical activity and cancer outcomes: A precision medicine approach. Clinical Cancer Research, 22(19), 4766–4775. https://doi.10.1158/1078-0432.CCR-16-0067

Gamerman

Cai

Elsaber

(2019). Pragmatic randomized clinical trials: Best practices and statistical guidance. Health Services and Outcomes Research Methodology, 19(1), 23–35.

Glasgow

R. E.

Vogt

T. M.

Boles

S. M.

(2011). Evaluating the public health impact of health promotion interventions: The RE-AIM framework. American Journal of Public Health, 89(9), 1322–1327.

Greene

Hibbard

J. H.

Sacks

Overton

Parrotta

C. D.

(2015). When patient activation levels change, health outcomes and costs change, too. Health Affairs, 34(3), 431–437.

10.

Guo

Logan

H. L.

Glueck

D. H.

Muller

K. E.

(2013). Selecting a sample size for studies with repeated measures. BMC Medical Research Methodology, 13, 1–8. https://doi.org/10.1186/1471-2288-13-100

11.

Kumar

Shivarama

(2017). Knowledge diffusion to knowledge dissemination: A theoretical study. International Journal of Multidisciplinary Studies, 3(7), 1–11.

12.

Lauer

Kurilla

Atkinson

(2018, July 3). The NCATS trial innovation network: A resource supporting high quality and cost effective clinical trials available to you. https://nexus.od.nih.gov/all/2018/07/03/the-ncats-trial-innovation-network-a-resource-supporting-high-quality-and-cost-effective-clinical-trials-available-to-you/

13.

Launois

Trouiller

J. B.

Cabout

(2018). How to measure real-world effectiveness? Annales Pharmaceutiques Francais, 76(6), 421–435. https://doi.org/10.1016/j.pharma.2018.07.003

14.

Lipman

P. D.

Loudon

Dluzak

Moloney

Messner

Stoney

C. M.

(2017). Framing the conversation: Use of PRECIS-2 ratings to advance understanding of pragmatic trial design domains. Trials, 18, 532. https://doi.org/10.1186/s13063-lauer017-2267-y

15.

Littleton-Kearney

(2018). Pragmatic clinical trials at the National Institute of Nursing Research. Nursing Outlook, 66(5), 470–472.

16.

Loudon

Treweek

Sullivan

Cheesbrough

G. F.

Donnon

Thorpe

K. E.

Zwarenstein

(2015). The PRECIS-2 tool: Designing trials that are fit for purpose. BMJ, 350, h2147. https://doi.org/10.1136/bmj.h2147

17.

Miller

C. J.

Smith

S. N.

Pugatch

(2020). Experimental and quasi-experimental designs in implementation research. Psychiatry Research, 283, 1–7. https://doi.org/10.1016/j.psychres.2019.06.027

18.

Morris

Z. S.

Wooding

Grant

(2011). The answer is 17 years, what is the question: Understanding time lags in translational research. Journal of the Royal Society of Medicine, 104(12), 510–520. https://doi.org/10.1258/jrsm.2011.110180

19.

Olson

Oudshoorn

(2019). Knowledge translation: A concept analysis. Nursing Forum, 1–8. https://doi.org/10.1111/nuf.12410

20.

Pinto

B. M.

Papandonatos

G. D.

Goldstein

M. G.

(2013). A randomized trial to promote physical activity among breast cancer patients. Health Psychology, 32(6), 616–626.

21.

PRECIS-2. (2016). PRECIS-2. https://www.precis-2.org/

22.

PRECIS-2. (2017). PRECIS-2. https://www.precis-2.org

23.

RE-AIM. (2018). RE-AIM. www.re-aim.org/

24.

RE-AIM. (2019). RE_AIM. http://www.re-aim.org/

25.

Schwartz

Lellouch

(1967). Explanatory and pragmatic attitudes in therapeutical trials. Journal of Chronic Disease, 20(8), 637–648.

26.

Tabak

R. G.

Padek

M. M.

Kerner

J. F.

Strange

K. C.

Proctor

E. K.

Dobbins

M. J.

Colditz

C. A.

Chambers

D. A.

Brownson

R. C.

(2017). Dissemination and implementation science training needs: Insights from practitioners and researchers. American Journal of Preventive Medicine, 52(3), S322–S329. https://doi.org/10.1016/j.amepre.2016.10.005

27.

Thorpe

K. E.

Zwarenstein

Oxman

A. D.

Treweek

Furberg

C. D.

Altman

D. G.

Tunis

Bergel

Harvey

Magid

D. J.

Chalkidou

(2009). A pragmatic-explanatory indicator summary (PRECIS): A tool to help trial designers. Journal of Clinical Epidemiology, 62(5), 464–475.

28.

Wasan

A. D.

(2014). Efficacy vs effectiveness and explanatory vs pragmatic: Where is the balance point in pain medicine research. Pain Medicine, 15(4), 539–540.