Permutation-based global rank test with adaptive weights for multiple primary endpoints

Abstract

Multiple efficacy endpoints are investigated in clinical trials, and selecting the appropriate primary endpoints is key to the study's success. The global test is an analysis approach that can handle multiple endpoints without multiplicity adjustment. This test, which aggregates the statistics from multiple primary endpoints into a single statistic using weights for the statistical comparison, has been gaining increasing attention. A key consideration in the global test is determination of the weights. In this study, we propose a novel global rank test in which the weights for each endpoint are estimated based on the current study data to maximize the test statistic, and the permutation test is applied to control the type I error rate. Simulation studies conducted to compare the proposed test with other global tests show that the proposed test can control the type I error rate at the nominal level, regardless of the number of primary endpoints and correlations between endpoints. Additionally, the proposed test offers higher statistical powers when the efficacy is considerably different between endpoints or when endpoints are moderately correlated, such as when the correlation coefficient is greater than or equal to 0.5.

Keywords

Multiple endpoints global test pairwise comparison permutation test small clinical trial

Get full access to this article

View all access options for this article.

References

Whicher

Philbin

Aronson

. An overview of the impact of rare disease characteristics on research methodology. Orphanet J Rare Dis 2018; 13: 14.

International Conference on Harmonisation E9 Expert Working Group. ICH harmonised tripartite guideline for statistical principles for clinical trials. 1998.

Tariot

Solomon

Morris

, et al. A 5-month, randomized, placebo-controlled trial of galantamine in AD. The Galantamine USA study group. Neurology 2000; 54: 2269–2276.

Peskind

Potkin

Pomara

, et al. Memantine treatment in mild to moderate Alzheimer disease: a 24-week randomized, controlled trial. Am J Geriatr Psychiatry 2006; 14: 704–715.

Van Der Ploeg

Clemens

Corzo

, et al. A randomized study of alglucosidase alfa in late-onset Pompe’s disease. N Engl J Med 2010; 362: 1396–1406.

European Medicines Agency, Committee for Human Medicinal Products. Guideline on multiplicity issues in clinical trials (draft). 2017.

U.S. Department of Health and Human Services Food and Drug Administration. Multiple endpoints in clinical trials guidance for industry draft guidance. 2022.

Ristl

Urach

Rosenkranz

, et al. Methods for the analysis of multiple endpoints in small populations: a review. J Biopharm Stat 2019; 29: 1–29.

Sankoh

D’Agostino

Huque

. Efficacy endpoint selection and multiplicity adjustment methods in clinical trials with inherent multiple endpoint issues. Stat Med 2003; 22: 3133–3150.

10.

Pocock

Geller

Tsiatis

. The analysis of multiple endpoints in clinical trials. Biometrics 1987; 43: 487–498.

11.

Bang

Keating

. Adalimumab: a review of its use in rheumatoid arthritis. BioDrugs 2004; 18: 121–139.

12.

Butler

Packer

Greene

, et al. Heart failure endpoints in cardiovascular outcome trials of SGLT2 inhibitors in patients with type 2 diabetes: a critical evaluation of clinical and regulatory issues. Circulation 2019; 140: 2108–2118.

13.

Tang

Gnecco

Geller

. Design of group sequential clinical trials with multiple endpoints. J Am Stat Assoc 1989; 84: 775–779.

14.

Attarian

Vallat

Magy

, et al. An exploratory randomised double-blind and placebo-controlled phase 2 study of a combination of baclofen, naltrexone and sorbitol (pxt3003) in patients with Charcot-Marie-tooth disease type 1a. Orphanet J Rare Dis 2014; 9: 199.

15.

O’Brien

. Procedures for comparing samples with multiple endpoints. Biometrics 1984; 40: 1079–1087.

16.

Huang

Tilley

Woolson

, et al. Adjusting O’Brien’s test to control type I error for the generalized nonparametric Behrens–Fisher problem. Biometrics 2005; 61: 532–539.

17.

Ramchandani

Schoenfeld

Finkelstein

. Global rank tests for multiple, possibly censored, outcomes. Biometrics 2016; 72: 926–935.

18.

Liu

, et al. A rank-based test for comparison of multidimensional outcomes. J Am Stat Assoc 2010; 105: 578–587.

19.

Minas

Rigat

Nichols

, et al. A hybrid procedure for detecting global treatment effects in multivariate clinical trials: theory and applications to fMRI studies. Stat Med 2012; 31: 253–268.

20.

Zhang

Liu

Tang

, et al. A cluster-adjusted rank-based test for a clinical trial concerning multiple endpoints with application to dietary intervention assessment. Biometrics 2019; 75: 821–830.

21.

Zhao

Lake

. A flexible multi-domain test with adaptive weights and its application to clinical trials. Pharm Stat 2020; 19: 315–325.

22.

Tian

Wei

. Combining dependent tests for linkage or association across multiple phenotypic traits. Biostatistics 2003; 4: 223–229.

23.

Uno

Tian

Claggett

, et al. A versatile test for equality of two survival functions based on weighted differences of Kaplan–Meier curves. Stat Med 2015; 34: 3680–3695.

24.

Wei

Lachin

. Two-sample asymptomatically distribution-free tests for incomplete multivariate observations. J Am Stat Assoc 1984; 79: 653–661.

25.

Good

. Permutation tests. A practical guide to resampling methods for testing hypotheses. New York: Springer, 2000.

26.

Mielke

Berry

KJ Jr

. Permutation methods: a distance function approach. New York: Springer, 2007.

27.

Lehmann

Romano

. Testing statistical hypotheses. New York: Springer, 2022.

28.

Peto

. Asymptotically efficient rank invariant test procedures. J R Stat Soc A Stat 1972; 135: 185–207.

29.

Oller

Gómez

. A generalized Fleming and Harrington’s class of test for interval-censored data. Can J Stat 2012; 40: 501–516.

30.

Beck

Wang

MTY

Intzandt

, et al. Sensory focused exercise improves anxiety in Parkinson’s disease: a randomized controlled trial. PLoS One 2020; 15: e0230803.

31.

Sakate

Fukagawa

Takagaki

, et al. Trends of clinical trials for drug development in rare diseases. Curr Clin Pharmacol 2018; 13: 199–208.

32.

Xiang

Jiang

Yan

, et al. Current status and trend of clinical development of orphan drugs in China. Orphanet J Rare Dis 2022; 17: 294.

33.

Miller

Fermaglich

Maynard

. Using four decades of FDA orphan drug designations to describe trends in rare disease drug development: substantial growth seen in development of drugs for rare oncologic, neurologic, and pediatric-onset diseases. Orphanet J Rare Dis 2012; 16: 265.

34.

Sakushima

Takeda

Aoi

. Orphan drug designation and development in Japan: 25 years of experience and assessment. Nat Rev Drug Discov 2021; 20: 893–894.

35.

Janssen

. Studentized permutation test for non-i.i.d. hypotheses and the generalized Behrens-Fischer problem. Stat Probab Lett 1997; 36: 9–21.

36.

Noguchi

Konietschke

Marmolejo-Ramos

, et al. Permutation tests are robust and powerful at 0.5% and 5% significance levels. Behav Res Methods 2021; 53: 2712–2724.

37.

Buyse

. Generalized pairwise comparisons of prioritized outcomes in the two-sample problem. Stat Med 2010; 29: 3245–3257.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.01 MB

0.25 MB