Multiply adjusted comparisons: A meta-analysis method to compare single-arm clinical-trial data to literature results regarding a competitor

Abstract

Prospective randomized controlled trials are difficult to obtain if a promising new therapy has to be tested against seemingly obsolete alternatives. One method to address this problem is to compare the results of (multicentre) trials to literature results. However, previous treatment-era changes and population-dependent results complicate objective comparisons. The presented approach describes a method to objectify such comparisons in cases in which individual raw data regarding a new therapy have to be compared to summary results regarding a conventional alternative published in the literature. The chosen example is the introduction of bovine neck veins as a substitute for dysfunctional human pulmonary valves, and the conventional therapeutic alternative is pulmonary-artery homografts. Literature research, subgroup identification, filtering, endpoint remodelling, weighting and, if necessary, confidence-limit calculation yield adjusted comparisons. These individual comparisons are then aggregated, first by article and then over several articles (similar to meta-analyses), resulting in a differentiated panel of answers (Multiply Adjusted Comparisons). In situations in which extensive raw data regarding a new therapeutic alternative but no randomized controlled trials and no raw data from previous studies using the conventional therapeutic alternative are available, the proposed method identifies the best evidence and is by far superior to unadjusted direct comparisons or gut feelings.

Keywords

Meta-analysis evidence-based medicine non-randomized controlled trials statistical model

Get full access to this article

View all access options for this article.

References

Freedman

. Equipoise and the ethics of clinical research. N Engl J Med 1987; 317: 141–145.

Sarikouch

Horke

Tudorache

et al.

Decellularized fresh homografts for pulmonary valve replacement: a decade of clinical experience. Eur J Cardiothorac Surg 2016; 50: 281–290.

Gehan

Statistical methods for survival time studies. In: Staquet

(ed). Cancer therapy: prognostic factors and criteria of response, New York, NY: Raven Press, 1975, pp. 7–35.

Breymann

Blanz

Wojtalik

et al.

European Contegra multicentre study: 7-year results after 165 valved bovine jugular vein graft implantations. Thorac Cardiovasc Surg 2009; 57: 257–269.

Cox

. The analysis of binary data, London, UK: Chapman and Hall, 1970, pp. 33–36.

Schwarzer

. Meta: An R package for meta-analysis. R News 2007; 7: 40–45. https://cran.r-project.org/doc/Rnews/Rnews_2007-3.pdf .

Fleiss

. The statistical basis of meta-analysis. Stat Meth Med Res 1993; 2: 121–145.

Feier

Collart

Ghez

et al.

Risk factors, dynamics, and cutoff values for homograft stenosis after the Ross procedure. Ann Thorac Surg 2005; 79: 1669–1675.

Tatebe

Nagakura

Boyle

Jr et al.

Right ventricle to pulmonary artery reconstruction using a valved homograft. Circ J 2003; 67: 906–912.

10.

Brown

Ruzmetov

Rodefeld

et al.

Right ventricular outflow tract reconstruction with an allograft conduit in non-Ross patients: risk factors for allograft dysfunction and failure. Ann Thorac Surg 2005; 80: 655–664.

11.

Perron

Moran

Gauvreau

et al.

Valved homograft conduit repair of the right heart in early infancy. Ann Thorac Surg 1999; 68: 542–548.

12.

Bando

Danielson

Schaff

et al.

Outcome of pulmonary and aortic homografts for right ventricular outflow tract reconstruction. J Thorac Cardiovasc Surg 1995; 109: 509–518.

13.

Mohammadi

Belli

Martinovic

et al.

Surgery for right ventricle to pulmonary artery conduit obstruction: risk factors for further reoperation. Eur J Cardiothorac Surg 2005; 28: 217–222.

14.

Tweddell

Pelech

Frommelt

et al.

Factors affecting longevity of homograft valves used in right ventricular outflow tract reconstruction for congenital heart disease. Circulation 2000; 102: 130–135.

15.

Hawkins

Bailey

Dillon

et al.

Midterm results with cryopreserved allografts valved conduits from the right ventricle to the pulmonary arteries. J Thorac Cardiovasc Surg 1992; 104: 910–916.

16.

Karamlou

Ungerleider

Alsoufi

et al.

Oversizing pulmonary homograft conduits does not significantly decrease allograft failure in children. Eur J Cardiothorac Surg 2005; 27: 548–553.

17.

Dearani

Danielson

Puga

et al.

Late follow-up of 1095 patients undergoing operation for complex congenital heart disease utilizing pulmonary ventricle to pulmonary artery conduits. Ann Thorac Surg 2003; 75: 399–411.

18.

Forbess

Shah

St Louis

et al.

Cryopreserved homografts in the pulmonary position: determinants of durability. Ann Thorac Surg 2001; 71: 54–59.

19.

Brown

Ruzmetov

Okada

et al.

Truncus arteriosus repair: outcomes, risk factors, reoperations, and management. Eur J Cardiothorac Surg 2001; 20: 221–227.

20.

LeBlanc

Russell

Sett

et al.

Intermediate follow-up of right ventricular outflow tract reconstruction with allograft conduits. Ann Thorac Surg 1998; 66: 174–178.

21.

Niwaya

Knott-Craig

Lane

et al.

Cryopreserved homograft valves in the pulmonary position: risk analyses for intermediate-term failure. J Thorac Cardiovasc Surg 1999; 117: 141–147.

22.

Boethig

Thies

Hecker

et al.

Mid term course after pediatric right ventricular outflow tract reconstruction: a comparison of homografts, porcine xenografts and Contegras. Eur J Cardiothorac Surg 2005; 27: 58–66.

23.

Raja

Pozzi

. Ross operation in children and young adults: the Alder Hey case series. BMC Cardiovasc Disord 2004; 4: 3–3.

24.

Dittrich

Alexi-Meskishvili

Yankah

et al.

Comparison of porcine xenografts and homografts for pulmonary valve replacement in children. Ann Thorac Surg 2000; 70: 717–722.

25.

Meyns

Jashari

Gewillig

et al.

Factors influencing the survival of cryopreserved homografts. The second homograft performs as well as the first. Eur J Cardiothorac Surg 2005; 28: 211–216.

26.

Lange

Weipert

Homann

. Performance of allografts and xenografts for right ventricular outflow tract reconstruction. Ann Thorac Surg 2001; 71: 365–367.

27.

Tierney

Gersony

Altmann

et al.

Pulmonary position cryopreserved homografts: durability in pediatric Ross and non-Ross patients. J Thorac Cardiovasc Surg 2005; 130: 282–286.

28.

Gerestein

Takkenberg

JJM

Oei

FBS

et al.

Right ventricular outflow tract reconstruction with an allograft conduit. Ann Thorac Surg 2001; 71: 911–918.

29.

Homann

Haehnel

Mendler

et al.

Reconstruction of the RVOT with valved biological conduits: 25 years experience with allografts and xenografts. Eur J Cardiothorac Surg 2000; 17: 624–630.

30.

Kanter

Budde

Parks

et al.

One hundred pulmonary valve replacements in children after relief of right ventricular outflow tract obstruction. Ann Thorac Surg 2002; 73: 1801–1806.

31.

Bielefeld

Bishop

Campbell

et al.

Reoperative homograft right ventricular outflow tract reconstruction. Ann Thorac Surg 2001; 71: 482–488.

32.

Urban

Sinzobahamvya

Brecher

et al.

Truncus arteriosus: ten-year experience with homograft repair in neonates and infants. Ann Thorac Surg 1998; 66: 183–188.

33.

Stark

Bull

Stajevic

et al.

Fate of subpulmonary homograft conduits: determinants of late homograft failure. J Thorac Cardiovasc Surg 1998; 115: 506–516.

34.

Sinzobahamvya

Wetter

Blaschszok

et al.

The fate of small-diameter homografts in the pulmonary position. Ann Thorac Surg 2001; 72: 2070–2076.

35.

Hazekamp

Grotenhuis

Schoof

et al.

Results of the Ross operation in a pediatric population. Eur J Cardiothorac Surg 2005; 27: 975–979.

36.

Naftel

. Do different investigators sometimes produce different multivariable equations from the same data? J Thorac Cardiovasc Surg 1994; 107: 1528–1529.