Landscape of Phase II Trials in Alzheimer’s Disease

Abstract

Background:

Drug development in Alzheimer’s disease (AD) over the past two decades has had high rates of failure. Novel trial designs, such as adaptive designs, have the potential to improve the efficiency of drug development in AD.

Objective:

To evaluate the design characteristics, temporal trends, and differences in design between sponsor types in phase II trials of investigational agents in AD.

Methods:

Phase I/II, II, and II/III trials for AD with drug or other biological interventions registered from December 1996 to December 2021 in ClinicalTrials.gov were included. Descriptive statistics were used to summarize trial characteristics. Linear, logistic, and multinomial regression models assessed temporal trends and differences between sponsor types in design characteristics.

Results:

Of N = 474 trials identified, randomized parallel group design was the most common design (72%). Only 12 trials (2.5%) used an adaptive design; adaptive features included early stopping rules, model-based dose-finding, adaptive treatment arm selection, and response adaptive randomization. The use of non-randomized parallel-group and open-label single arm designs increased over time. No temporal trend in the use of adaptive design was identified. Trials sponsored by industry only were more likely to use a randomized parallel-group design and have a larger estimated sample size than trials with other sponsor types.

Conclusion:

Our systematic review showed that very few phase II trials in AD used an adaptive trial design. Innovation and implementation of novel trial designs in AD trials can accelerate the drug development process.

Keywords

Adaptive designs Alzheimer’s disease novel trial designs phase II trials systematic review

INTRODUCTION

Alzheimer’s disease (AD) is a neurodegenerative disease that causes loss of memory and other cognitive abilities [1]. More than 55 million people are living with dementia worldwide, and an estimated 6.5 million people in United States age 65 and older are living with AD in 2022 [2, 3]. The worldwide prevalence of AD is expected to triple from 50 to 150 million by 2050 [3 –5]. To date, therapeutic options are limited [5]. There are currently only seven drugs, which may delay clinical decline or help lessen the AD symptoms, approved by the U.S. Food and Drug Administration (FDA) for AD [5]. The two most recently approved drugs, lecanemab and aducanumab, are the first agents to address the underlying biology of AD [5, 6]. However, none of these are curative or can stop its progression [1, 3]. It is crucial to identify and develop new treatments for AD, and to test efficacy and safety rigorously, through well-designed clinical trials.

A variety of trial designs have been used in AD trials. The traditional trial design used to assess the efficacy of new treatments is the double-blind, placebo-controlled, randomized parallel group design [4 , 8]. Participants are randomized to the placebo group or treatment group. Other designs used in AD trials include: futility designs, staggered start/delayed withdrawal designs, time-to-onset designs, and others [7]. Nonetheless, the standard design remains the most commonly used. Given the high failure rate of AD drug development, innovations in trial designs are critical to shortening the development cycle for AD treatments [9].

Novel adaptive designs have also been used in neurodegenerative disorders to increase the flexibility of a trial and efficiency of clinical development [8 , 10–12]. According to FDA guidance on adaptive trials, an adaptive design is defined as “a clinical trial design that allows for prospectively planned modifications to one or more aspects of the design based on accumulating data from subjects in the trial” [13]. Adaptive features may include: 1) early termination for efficacy, futility or both; 2) adaptations to treatment arm selection (including adaptive dose finding); 3) adaptations to the sample size; 4) adaptations to the patient population (including adaptive enrichment); 5) adaptations to patient allocation; and 6) adaptations to endpoint selection (Box 1) [13]. van Eijk et al. (2018) [11] reviewed clinical trials in neurodegenerative disorders using group sequential trial designs and identified the reduction in sample size and the total trial duration by using the adaptive design. For the phase II trial of BAN2401, a monoclonal antibody targeting amyloid protofibrils, a Bayesian adaptive proof-of-concept trial design was used to identify optimal dose. The trial’s adaptive features included response adaptive randomization and early termination of the study for futility or a signal for success [14]. This design allowed investigators to gain the trial efficiency by avoiding unnecessary patient exposures to an ineffective treatment.

Between 2004 to 2022, drug development in AD had only a 2% success rate in achieving regulatory approval [15]. Only two agents (aducanumab and oligomannate) were approved compared to 98 unique compounds that failed in phase II or phase III testing. (Lecanemab was recently approved in June 2023.) One potential reason for failure could be due to lack of clear results in phase II to initiate phase III testing [15]. Adaptive designs in clinical research became more attractive to investigators with the aims of increase in flexibility and efficiency of trials [16]. It has been shown that the use of adaptive designs can be more reliable and efficient in the early phase of clinical drug development [11 , 16]. Hatfield et al. [17] also identified that recent clinical trials registered on ClinicalTrials.gov used adaptive designs most frequently in phase II trials in oncology. Increasing the use of adaptive designs in phase II development can improve efficiency to make accurate “go/no-go” decisions to phase III testing.

In this study, we conducted a systematic review of trial designs focusing on phase II trials in AD registered on ClincialTrials.gov. This systematic review will: 1) describe the trial designs and characteristics in phase II interventional trials in AD, 2) identify temporal trends in the design of AD trials, and 3) compare the trial characteristics among sponsor types in AD trials.

MATERIALS AND METHODS

Data source

ClinicalTrials.gov is a database of privately and publicly funded clinical studies conducted around the world, with over 413,591 registered trials from 220 countries. Trials conducted in the U.S. must be registered on ClinicalTrials.gov; trials conducted outside of the U.S. may but are not required to be registered. Trial records were accessed on August 20, 2021. Search filters were used to select the trials which met our inclusion/exclusion criteria. Trials were included if they were classified as “interventional” trials and the conditions or diseases were reported as “Alzheimer’s Disease”. The study phase was required to be reported as Phase I/II, Phase II, or Phase II/III, and the first posted date on ClinicalTrials.gov was before July 1, 2021. Only “drug” (e.g., small molecules) or “biological” interventions were included; trials of other intervention types such as behavioral, combination product, device, dietary supplement, procedure, and radiation were excluded. Our study focused on reviewing phase II drug or biologic agents given the high failure rate of past AD drug trials; future work will expand our investigation to phase III trials and other intervention types. Open-label extension trials were identified by manually reviewing trials with the study status “enrolling by invitation” or the trial record contains the term “extension” on ClinicalTrials.gov. These open-label extension trials were excluded from analysis.

Data collection

For each trial, available discrete data fields were directly downloaded from ClinicalTrials.gov including NCT ID (primary key), trial title, study phase (phase I/II, phase II, or phase II/III), sponsor (industry only/other), study status, first posted date, and trial completion date. Additional trial characteristics were manually abstracted from the clinicaltrials.gov record including study design (randomized parallel, randomized crossover, open-label single arm, etc.), use of adaptive design, adaptive feature(s) (early stopping for futility/efficacy, adaptive dose finding, etc.), number of arms, use of randomization, randomization ratio, blinding, and estimated sample size. If the requisite trial characteristics were not listed or were unclear on the trial record, a PubMed search for publications related to the trials based on their NCT ID was performed. The manually abstracted dataset was merged with the downloaded dataset to generate the dataset for analysis.

Data were abstracted by two investigators (A.L. and D.S.) and then cross-checked for accuracy by a third investigator (C.M.). In addition, cross-tabulations were used to identify inconsistencies between fields. Inconsistencies were settled through discussion.

Statistical methods

Trial characteristics were summarized using descriptive statistics. Proportions and frequencies were used for categorical variables, while medians and ranges were used for continuous variables. To investigate temporal trends in trial characteristics, trials were categorized into five time periods based on the year of trial registration (first posted date): (1 = 1999–2004, 2 = 2005–2009, 3 = 2010–2014, 4 = 2015–2019, 5 = 2020–2021). To test the temporal trend in the estimated sample size, linear regression was used, treating year groups of trial registration as a continuous predictor. For binary trial characteristics (Adaptive Design (Y/N), randomization (Y/N), study sponsor (industry only versus other [NIH, other federal, all others]), logistic regression was used treating year groups of trial registration as a continuous predictor. For multi-category trial characteristics, multinomial logistic regression was used treating year groups as a continuous predictor. Comparison of characteristics between trial sponsor types (industry only versus other) was conducted with chi-squared tests or two-sample t-tests. Two-sided p-values <0.05 were considered statistically significant. Statistical analyses were performed using the nnet package version 7.3–17 [18] in R version 4.0.2 [19].

RESULTS

Figure 1 presents the flow diagram of the trial search. Among the 2,155 trials that were identified, 1,681 trials did not meet our inclusion criteria, yielding a total of N = 474 trials eligible to be analyzed. A majority of trials (81%) were single phase II studies, while 11% and 8% were dual phase I/II and phase II/III studies, respectively (Table 1). Over half (56%) of the studies were complete at the time of data collection; 65 (13%) trials were actively recruiting participants. The year of trial registration ranged from 1999 to 2021. Fifty-three percent of trials were sponsored by industry only; the remaining trials had other sponsors.

Fig. 1

Flow diagram for trials included from clinicaltrials.gov.

Table 1

Characteristics of N = 474 phase II clinical trials in Alzheimer’s disease from clinicaltrials.gov

Trial Characteristics		N (%)
Study design	Open-label single arm design	72/474 (15)
	Randomized parallel group design	339/474 (72)
	Randomized crossover design	27/474 (6)
	Non-randomized parallel group design	23/474 (5)
	Group sequential design	4/474 (0.8)
	Others^*	9/474 (2)
Use of adaptive design	Yes	12/474 (2.5)
	No	462/474 (97.5)
Adaptive design feature	Early stopping for efficacy	1/12 (8)
	Early stopping for futility	3/12 (25)
	Adaptive dose finding	3/12 (25)
	Adaptations to treatment arm selection	2/12 (17)
	Adaptations to patient allocation based on outcome data	1/12 (8)
	Unknown	2/12 (17)
Trial phase	Phase I/II	50/474 (11)
	Phase II	385/474 (81)
	Phase II/III	39/474 (8)
Study status	Active, not recruiting	33/474 (7)
	Completed	265/474 (56)
	Enrolling by invitation	7/474 (2)
	Not yet recruiting	17/474 (4)
	Recruiting	65/474 (13)
	Terminated	50/474 (11)
	Withdrawn	11/474 (2)
Number of arms	1	66/459 (14)
	2	211/459 (46)
	3	89/459 (20)
	≥4	93/459 (20)
Number of control arms	0	106/459 (23)
	1	321/459 (70)
	2	23/459 (5)
	3	5/459 (2)
Number of intervention arms	1	265/458 (58)
	2	101/458 (22)
	3	60/458 (13)
	≥4	32/458 (7)
Use of randomization	Yes	379/474 (80)
	No	94/474 (20)
Randomization ratio	Equal	125/380 (33)
	Unequal	46/380 (12)
Blinding	Single-blind	7/380 (2)
	Double-blind	97/380 (26)
	Triple-blind	57/380 (15)
	Quadruple-blind	204/380 (54)
Primary outcome(s)	Efficacy outcome measure	335/464 (72)
	Safety outcome measure	32/464 (7)
	Efficacy and safety outcome measure	97/464 (21)
Sponsor Type	Industry	252/474 (53)
	Others	222/474 (47)
Year of Trial Registration	1999–2004	27/474 (6)
	2005–2009	115/474 (24)
	2010–2014	131/474 (28)
	2015–2019	154/474 (32)
	2020–2021	47/474 (10)
Estimated sample size	Median (Range)	106.5 (5–2,935)
	N	438
	0 –100	218/438 (50)
	101 –200	96/438 (22)
	201 –300	51/438 (12)
	301 –400	25/438 (6)
	401 –500	26/438 (6)
	501 –600	8/438 (2)
	>600	14/438 (3)
Actual sample size	Median (Range)	80.5 (0–2,218)
(enrolled to date)	N	414
	0 –100	234/414 (57)
	101 –200	78/414 (19)
	201 –300	35/414 (8)
	301 –400	27/414 (7)
	401 –500	20/414 (5)
	501 –600	9/414 (2)
	>600	11/414 (3)
Time Duration (in months)^**		26.14 (1.02–119.90)
		N = 285

^*Other designs include: Factorial design (4 trials), dose finding design (2), non-randomized crossover design (1), and unknown design (2). ^**The calculation of time duration was only restricted to trials with completed, terminated, and withdrawn study status. Trials with missing trial completion date or negative calculated time duration were excluded.

Design characteristics

The most common design was the standard randomized parallel-group design (n = 339/474 trials; 72%) (Table 1). Other frequently used designs included the open-label single arm design (15%), randomized crossover (6%), and non-randomized parallel-group design (5%). A majority of trials (80%) were randomized and most (n = 393/459; 86%) had two or more arms. Among 380 randomized trials with available information regarding the randomization ratio, a majority (33%) had equal allocation across arms. The median target sample size was 106.5 participants (range = 5–2,935).

Only 12 out of 474 (2.5%) trials used an adaptive design (Tables 1 and 2). Of these, four included early stopping rules for efficacy or futility; three used model-based dose finding designs; two were platform trials which allowed adaptations to treatment arm selection; one trial with response adaptive randomization allowed adaptations to patient allocation based on outcome data; and two trials had unspecified adaptive features.

Table 2

Listing of N = 12 trials with adaptive features

Adaptive Feature	NCT ID	Study Name	Study Agent	Registration Date	Phase	Sponsor(s)
Early stopping for futility	NCT00895895	Study Comparing 3 Dosage Levels Of SAM-531 In Outpatients with Mild/Moderate AD	Drug: PlaceboDrug: SAM-531 1.5 mgDrug: SAM-531 3.0 mgDrug: SAM-531 5.0 mgDrug: Donepezil	5/8/2009	Phase II	Pfizer
	NCT01852110	Efficacy and Safety of MK-7622 as Adjunct Therapy in AD	Drug: MK-7622Drug: PlaceboDrug: AChEI	5/13/2013	Phase II	Merck Sharp &Dohme Corp.
	NCT03061474	Nicotinamide as an Early AD Treatment	Drug: NicotinamideDrug: Placebo Comparator	2/23/2017	Phase II	University of California, Irvine
Early stopping for efficacy	NCT01354691	Safety and Efficacy of Ladostigil in Mild to Moderate AD	Drug: ladostigil hemitartrate Drug: placebo	5/17/2011	Phase II	Avraham Pharmaceuticals Ltd
Adaptive dose finding	NCT00555204	Safety and Efficacy of ABT-089 in Adults with Mild-Moderate AD	Drug: ABT-089Drug: placebo	11/8/2007	Phase II	Abbott
	NCT02244541	Phase IIa Dose Finding, PK/PD and 12 Month Exploratory Efficacy Study of ANAVEX2-73 in Patients With AD	Drug: ANAVEX2-73 OralDrug: ANAVEX2-73 Intravenous	9/19/2014	Phase II	Anavex Life Sciences Corp.
	NCT03919162	Efficacy and Safety of PQ912 in Patients with Early AD	Drug: PQ912Other: Placebo	4/18/2019	Phase II	Vivoryon Therapeutics N.V.; Alzheimer’s Disease Cooperative Study (ADCS); National Institute on Aging (NIA)
Adaptations to treatment arm selection	NCT01760005	Master Protocol DIAN-TU001: An Opportunity to Prevent Dementia.	Drug: GantenerumabDrug: SolanezumabDrug: Matching Placebo (Gantenerumab)Drug: Matching Placebo (Solanezumab)	1/3/2013	Phase II/Phase III	Washington University School of Medicine; Eli Lilly and Company; Hoffmann-La Roche; Alzheimer’s Association; National Institute on Aging (NIA); Avid Radiopharmaceuticals; Accelerating Medicines Partnership (AMP)
	NCT04795466	Study of the Efficacy and Safety of Various Anti-inflammatory Agents in Participants with Mild Cognitive Impairment or Mild AD	Biological: CanakinumabOther: Placebo	3/12/2021	Phase II	Novartis PharmaceuticalsNovartis
Adaptations to patient allocation based on outcome data	NCT01767311	Safety, Tolerability, and Efficacy of Lecanemab in Subjects with Early AD	Drug: Lecanemab 2.5 mg/kg Drug: Lecanemab 5.0 mg/kg Drug: Lecanemab 10 mg/kgDrug: Placebo	1/14/2013	Phase II	Eisai Inc.
Unspecified adaptive feature	NCT03069014	LM11A-31-BHS in Mild-moderate AD Patients	Drug: 400 mg LM11A-31-BHS Drug: 800 mg LM11A-31-BHS Drug: Placebos	3/3/2017	Phase I/Phase II	PharmatrophiX Inc.National Institute on Aging (NIA)
	NCT00582855	Effect of AQW051 in Patients with Memory Impairment	Drug: AQW051Drug: Placebo	12/28/2007	Phase II	Novartis PharmaceuticalsNovartis

Temporal trends in trial design

The use of non-randomized parallel-group (Odds Ratio [OR] = 1.76; 95% confidence interval [CI] = 1.15–2.71; p = 0.010) and open-label single arm designs increased over time (OR = 1.58; 95% CI = 1.23–2.03; p≤0.001), relative to the standard randomized parallel-group design (Fig. 2A). The use of randomization decreased over time (OR = 0.64; 95% CI = 0.51–0.80; p≤0.001; Fig. 2B). The proportion of trials with industry only sponsors decreased over time (OR = 0.71; 95% CI = 0.59–0.84; p≤0.001), relative to other sponsor types (Fig. 2C). Relative to standalone phase II studies, dual phase I/II studies increased over time (OR = 1.60; 95% CI = 1.19–2.15; p = 0.002), whereas dual phase II/III studies showed no clear trend (OR = 1.09; 95% CI = 0.80–1.49; p = 0.58; Fig. 2D). The estimated sample size per trial also showed no clear temporal trend (p = 0.58; Fig. 2E). Of the 12 trials employing adaptive designs, there was no clear temporal trend for use thereof (OR = 1.00; 95% CI = 0.59–1.72; p = 1; Fig. 2F).

Fig. 2

Temporal trends in trial characteristics. A) Study design; B) Use of randomization; C) Sponsor type; D) Study phase; E) Estimated sample size per trial; and F) Number of adaptive trials. ^* N = 27, 115, 131, 154, and 47 trials were registered in 1999–2004, 2005–2009, 2010–2014, 2015–2019, and 2020–2021, respectively.

Design characteristics by sponsor type

Industry-only sponsored trials were more likely to use a randomized parallel-group design, compared to trials with other sponsor types (p = 0.004; Table 3). Industry only sponsored trials had larger estimated sample sizes on average compared to trials with other sponsors (p≤0.001), and single phase II studies were more likely to be used in industry only sponsored trials (p = 0.0065). Use of randomization differed significantly by sponsor type (p = 0.04). There was no significant difference in the use of adaptive features by sponsor type (p = 0.34).

Table 3

Comparison of trial characteristics by sponsor type

Sponsor Type
Trial characteristic	Category	Industry Only	Other	p
Design	Non-randomized parallel assignment	7 (2.78%)	16 (7.21%)	0.004
	Open-label single arm	33 (13.10%)	39 (17.57%)
	Other	5 (1.98%)	8 (3.60%)
	Randomized crossover	9 (3.57%)	18 (8.11%)
	Randomized parallel group	198 (78.57%)	141 (63.23%)
Use of Randomization	Randomized	211 (83.73%)	168 (76.02%)	0.04
	Not randomized	41 (16.27%)	53 (23.98%)
Study phase	Phase I/II	18 (7.14%)	32 (14.41%)	0.0065
	Phase II	218 (86.51%)	167 (75.23%)
	Phase II/III	16 (6.35%)	23 (10.36%)
Use of adaptive features	Yes	8 (3.17%)	4 (1.80%)	0.34
	No	244 (96.83%)	218 (98.20%)
Median (range) Estimated sample size		160 (15; 2935)	70 (5; 2000)	<0.0001

DISCUSSION

Drug development for AD has faced high rates of failure, with only three new agents [15] for primary disease progression approved by the U.S. Food and Drug Administration (FDA) since 2003. Current agents under clinical development target a wide range of novel disease mechanisms, including amyloid, tau, inflammation, and synaptic plasticity [4]. Of the 143 agents in 172 ongoing trials for AD in 2022, over half the agents (82/143; 57%) and trials (94/172; 55%) are in middle (phase II) development. Our analysis of temporal trends in trial characteristics suggest more AD are testing novel mechanisms of action in earlier phases of development. More recently registered trials were more likely to use a non-randomized parallel assignment or open-label single arm design, incorporate dual phase I/phase II designs, and include non-industry (academia, government) sponsors. However, the increasing use of non-randomized designs may be a worrying trend as these designs provide less rigorous evidence and may be prone to bias.

Overall, we confirmed that a large majority of trials still use the “standard” randomized parallel-group design, though their relative use is decreasing over time. However, only a very small proportion (2.5%) of phase II AD trials employed adaptive designs. Adaptive designs are most commonly used in oncology trials [17]. A 2020 systematic review identified that 15% of pediatric oncology phase I trials in the United States used model-based dose finding designs [20]. Reviews from other therapeutic areas also showed infrequent use of adaptive designs. For randomized trials for kidney dialysis, for example, only an average of 1.82% trials used adaptive designs.

We did not find a significant temporal trend in the use of adaptive designs in AD trials. This contrasts with evidence from certain other disease entities suggesting that the use of adaptive designs have increased over time. Across all disease areas, the number of adaptive trials increased from 11 to 38 per 10,000 registered trials from 2001 to 2013 [17]. More recently, the use of adaptive master protocol designs have increased dramatically, particularly in cancer and infectious disease trials [21]. However, these trends are not uniform across all therapeutic areas. No significant trend in the use of adaptive designs was observed in pediatric oncology phase I trials [20]. For dialysis trials, the proportion of adaptive trials actually decreased from 6.12% in 2009 to 0.43% in 2019 [22].

We identified only 12 AD trials with adaptive features; the type of adaptation varied between trials. Early termination for futility or efficacy was the most common (n = 4/12; 33%), followed by adaptive dose finding (25%), adaptations to treatment arm selection (25%), and adaptations to patient allocation based on outcome data (8%). Notably, none of the 12 AD trials included adaptations to the patient population (adaptive enrichment) or sample size re-estimation. Hatfield et al. reported that for phase II trials across all diseases, group sequential designs (early stopping), and adaptive dose selection designs were the most common adaptation [17]. A more recent review of 142 adaptive phase II and phase III trials identified the most common adaptations were: seamless phase II/III (57% of trials), group sequential (21%), biomarker adaptive (20%), and adaptive dose-finding (16%) [23].

Table 4

Overview of common adaptive features in clinical trials based on U.S. Food and Drug Administration (FDA) guidance

Adaptive Feature	Description	Benefits	Challenges	References/Example Trials
Early termination for efficacy, futility, or both	Allow for planned interim analyses of data with pre-specified criteria for stopping the trial, e.g., group sequential designs	•Provide flexibility of size and duration of trial•Provide ability to terminate the trial early for efficacy or futility	•Require careful control of type 1 error rate•Require rapid data entry for interim analyses	NCT00895895
Adaptations to treatment arm selection	Allow modifications to the treatment arm based on interim results, e.g., platform design, continual reassessment method	•Provide substantial evidence of effectiveness•Increased accuracy for phase I dose finding trials	•Require multiple therapies/pharmaceutical companies•Require large upfront investment during design phase	NCT01760005PMID: 28679092PMID: 2350571
Adaptations to the sample size	Allow modifications to the sample size based on interim results (i.e., interim estimates of the treatment effect, treatment assignment information), e.g., sample size re-estimation	•Can ensure trial maintains adequate power if true magnitude of treatment effect is less than originally hypothesized.	•Without proper adjustment, can inflate the Type 1 error probability•Require additional consideration in trial integrity in the presence of sample size adaptation	PMID: 29854926, 9921605
Adaptations to the patient population	Allow adaptive modifications to the patient population based on interim results, e.g., adaptive enrichment design	•Provide greater power over non-adaptive fixed sample design in the overall population.	•Modification should be motivated by results from early-phase trials and/or biologic plausibility	PMID: 23525452, 29696195
Adaptations to patient allocation	Allow adaptations based on comparative baseline characteristic data or comparative outcome data, e.g., response-adaptive randomization	•Assign higher proportion of patients to more promising treatment arms•Can minimize variance of test statistics, shorten trial duration, reduce sample size and/or increase power	•Require careful control of type 1 error rate•Require rapid data entry to determine new patient allocation ratios•More suitable for trials with short-term outcomes	NCT01767311PMID: 37324576
Adaptations to endpoint selection	Allow modification to the choice of primary endpoint based on comparative interim results, e.g., adaptive endpoint selection	•Allows flexibility of endpoint based on interim results	•Adaptation rule should be pre-specified•Recommend early discussion with regulatory agencies	PMID: 24751788, 25778935

These findings motivate the need to design more trials with adaptive features to improve the efficiency of AD drug development (Box 1). Trials with early stopping rules for futility can reduce trial resources spent on agents that are unlikely to succeed. Conversely, trials with adaptive sample size re-estimation can allow investigators to modify the overall sample size based on observed interim estimates of design parameters (e.g., effect size) to ensure the final analysis will be well-powered [24, 25]. Given the heterogeneity of AD, trials that can adaptively enrich for patients more likely to respond to treatment will be an effective strategy [26, 27]. Model-based dose finding methods [28, 29] can improve the accuracy of identifying the optimal dose compared to traditional designs [30], thus improving the chance for the agent to achieve a therapeutic effect in phase II development. Adaptive platform designs can streamline the AD drug development pipeline by establishing common a trial infrastructure to test multiple agents [31, 32]. Finally, response-adaptive randomization can adaptively assign more patients to more promising treatment arms [33].

However, a number of challenges and barriers to conducting more adaptive trials need to be addressed [13, 34]. Adaptive trials are more complex to design and conduct. Rapid data entry is required for interim analyses. Adaptive modifications require careful control of the type 1 error rate to account for multiple testing. Prior to conducting adaptive trials, pre-planned modifications need to be carefully specified in the trial protocol. Funding, regulatory, and communication challenges can also occur when conducting adaptive trials [34]. A recent mixed methods study examining the attitudes and opinions towards adaptive trials among different trial stakeholders identified that there is variable understanding of adaptive trials among stakeholders (more limited understanding by clinicians and greater perceived understanding by regulators [35]). Participants identified that adaptive trials have the potential for improved efficiency depending the situation and that more education on adaptive designs is needed.

In order to increase the use of adaptive designs in AD trials, we first need to raise the awareness of adaptive designs among the AD clinical research community, including clinicians, statisticians, regulators, pharmaceutical companies, research ethics boards, funding agencies, and patient support groups. By sharing the benefits of adaptive designs over traditional designs with all stakeholders, we can encourage study teams to implement these designs, where appropriate and feasible.

Second, we need to develop user-friendly, accessible software to aid the design and conduct of these complex trials. Often, to design adaptive trials, investigators and statisticians need to perform statistical simulations to assess the operating characteristics of the design across a wide range of potential parameters. While there are free, open-source packages available in R, these programs generally require programming knowledge and may not be accessible by non-statisticians [36 –38]. Commercial software include a point-and-click, interactive interface, but these programs are typically expensive to license and may not be accessible to all investigators and institutions [39, 40]. There are relatively few interactive, web-based platforms available to design adaptive trials [36, 41].

Third, we need to develop designs tailored to the needs to AD trials. A majority of adaptive designs (master protocols, group sequential designs, response-adaptive randomization) were developed by cancer statisticians for oncology trials. For example in cancer trials, response-adaptive randomization works well for a binary endpoint (e.g., best overall response) measured over relatively short time-periods (e.g., 1–2 months) post-randomization. This allows for sufficient efficacy data to be accrued in order to update the randomization ratio on a frequent basis. In comparison, AD trials typically measure continuous participant cognitive, behavioral, or symptom outcome scores repeatedly over a longer follow-up period, making response-adaptive randomization more challenging to implement. We thus need to develop new designs or modify existing designs to address the distributional and logistical challenges for conducting AD trials.

Our study is constrained by the completeness and accuracy of trial records reported on clinicaltrials.gov. Data elements from structured fields in clinicaltrials.gov were generally well-populated; data missingness ranged from 0% to 7.6% (Table 1). As prior studies have identified, relying solely on the information available in these records may lead to an underestimation of the rate of adaptive designs [17]. To ensure accurate estimates, we searched for publications referencing the trial’s NCT ID to confirm and/or augment the trial design characteristics for each trial. We also performed searches by keyword, such as “adaptive” or “Bayesian”, in clinicaltrials.gov, to ensure that we accurately captured all potential adaptive designs. Further, our study focused on trials registered on U.S. based clinicaltrials.gov; results based on trials registered in other trial registries (e.g., European Union Drug Regulating Authorities Clinical Trials Database [EuDRACT]) may differ.

In summary, our study identifies the urgent need to modernize the design of AD trials. Adaptive designs have already improved the efficiency of clinical development in cancer, infectious diseases, and other therapeutic areas. The current AD drug development pipeline is looking for early signals of efficacy among candidate drugs primarily in Phase II trials. This presents an opportunity to introduce adaptive features to increase the efficiency of phase II trials. All stakeholders must work together to add adaptive designs to our clinical trials “toolbox” in order to more rapidly bring new AD treatments from bench to bedside.

Footnotes

ACKNOWLEDGMENTS

The authors would like to acknowledge the Centre for Complex Interventions team and Biostatistics Core Services team at the Centre for Addiction and Mental Health (CAMH) for their thoughtful discussion and contributions for this study.

FUNDING

Funding for this study was provided by the CAMH Discovery Fund and the Centre for Complex Interventions at CAMH.

CONFLICT OF INTEREST

Tarek K. Rajji has received research support from Brain Canada, Brain and Behavior Research Foundation, BrightFocus Foundation, Canada Foundation for Innovation, Canada Research Chair, Canadian Institutes of Health Research, Centre for Aging and Brain Health Innovation, National Institutes of Health, Ontario Ministry of Health and Long-Term Care, Ontario Ministry of Research and Innovation, and the Weston Brain Institute. Tarek K. Rajji also received for an investigator-initiated study in-kind equipment support from Newronika, and in-kind research online accounts from Scientific Brain Training Pro, and participated in 2021 and 2022 in an advisory activity for Biogen Canada Inc. Tarek K. Rajji is also an inventor on the United States Provisional Patent No. 17/396,030 that describes cell-based assays and kits for assessing serum cholinergic receptor activity.

All other authors have no conflict of interest to report.

DATA AVAILABILITY

The datasets were directly downloaded from ClinicalTrials.gov including NCT ID (primary key), trial title, study phase, sponsor, study status, first posted date, and trial completion date. The data supporting the findings of this study are available upon reasonable request from the corresponding author.

References

Scheltens

, Blennow

, Breteler

, de Strooper

, Frisoni

, Salloway

, Van der Flier

(2016) Alzheimer’s disease. Lancet 388, 505–517.

World Health Organization, Dementia, https://www.who.int/news-room/fact-sheets/detail/dementia

(2022) 2022 Alzheimer’s disease facts and figures. Alzheimers Dement 18, 700–789.

Cummings

, Lee

, Nahed

, Kambar

, Zhong

, Fonseca

, Taghva

(2022) Alzheimer’s disease drug development pipeline: 2022. Alzheimers Dement (N Y) 8, e12295.

Alzheimer’s Association, Medications for Memory, Cognition and Dementia-Related Behaviors. https://www.alz.org/alzheimers-dementia/treatments/medications-for-memory

Alzheimer’s Association, Lecanemab Approved for Treatment of Early Alzheimer’s Disease. https://www.alz.org/alzheimers-dementia/treatments/lecanemab-leqembi

Cummings

, Gould

, Zhong

(2012) Advances in designs for Alzheimer’s disease clinical trials. Am J Neurodegener Dis 1, 205–216.

Shan

, Banks

, Miller

, Ritter

, Bernick

, Lombardo

, Cummings

(2018) Statistical advances in clinical trials and clinical research. Alzheimers Dement (N Y) 4, 366–371.

Shen

, Preskorn

, Dragalin

, Slomkowski

, Padmanabhan

, Fardipour

, Sharma

, Krams

(2011) How adaptive trial designs can increase efficiency in psychiatric drug development: A case study. Innov Clin Neurosci 8, 26–34.

10.

Finger

, Berry

, Cummings

, Coleman

, Hsiung

, Feldman

, Boxer

(2018) Adaptive crossover designs for assessment of symptomatic treatments targeting behaviour in neurodegenerative disease: A phase 2 clinical trial of intranasal oxytocin for frontotemporal dementia (FOXY). Alzheimers Res Ther 10, 102.

11.

van Eijk

RPA

, Nikolakopoulos

, Ferguson

, Liu

, Eijkemans

MJC

, van den Berg

(2018) Increasing the efficiency of clinical trials in neurodegenerative disorders using group sequential trial designs. J Clin Epidemiol 98, 80–88.

12.

Berry

(2011) Adaptive clinical trials: The promise and the caution. J Clin Oncol 29, 606–609.

13.

U.S. Food and Drug Administration (2019) Adaptive Designs for Clinical Trials of Drugs and Biologics Guidance for Industry. https://www.fda.gov/regulatory-information/search-fda-guidance-documents/adaptive-design-clinical-trials-drugs-and-biologics-guidance-industry

14.

Satlin

, Wang

, Logovinsky

, Berry

, Swanson

, Dhadda

, Berry

(2016) Design of a Bayesian adaptive phase 2 proof-of-concept trial for BAN2401, a putative disease-modifying monoclonal antibody for the treatment of Alzheimer’s disease. Alzheimers Dement (N Y) 2, 1–12.

15.

Kim

, Lee

, Ong

, Gold

, Kalali

, Sarkar

(2022) Alzheimer’s disease: Key insights from two decades of clinical trial failures. J Alzheimers Dis 87, 83–100.

16.

Chow

, Chang

(2008) Adaptive design methods in clinical trials - a review. Orphanet J Rare Dis 3, 11.

17.

Hatfield

, Allison

, Flight

, Julious

, Dimairo

(2016) Adaptive designs undertaken in clinical research: A review of registered clinical trials. Trials 17, 150.

18.

Venables

, Ripley

, Venables

, Masw

(2002) Modern applied statistics with S, Springer, New York.

19.

R Core Team.(2022) R: A language and environment for statistical computing. https://www.R-project.org

20.

Nader

, Neel

, Shulman

, Ma

, Bourgeois

, DuBois

(2020) Landscape of phase 1 clinical trials for minors with cancer in the United States. Pediatr Blood Cancer 67, e28694.

21.

Park

JJH

, Siden

, Zoratti

, Dron

, Harari

, Singer

, Lester

, Thorlund

, Mills

(2019) Systematic review of basket trials, umbrella trials, and platform trials: A landscape analysis of master protocols. Trials 20, 572.

22.

Judge

, Murphy

, Reddin

, Cormican

, Smyth

, O’Halloran

, O’Donnell

(2021) Trends in adaptive design methods in dialysis clinical trials: A systematic review. Kidney Med 3, 925–941.

23.

Bothwell

, Avorn

, Khan

, Kesselheim

(2018) Adaptive design clinical trials: A review of the literature and ClinicalTrials.gov. BMJ Open 8, e018320.

24.

Cui

, Hung

, Wang

(1999) Modification of sample size in group sequential clinical trials. Biometrics 55, 853–857.

25.

Wang

, Chow

(2021) Sample size re-estimation in clinical trials. Stat Med 40, 6133–6149.

26.

Devi

, Scheltens

(2018) Heterogeneity of Alzheimer’s disease: Consequence for drug trials? . Alzheimers Res Ther 10, 122.

27.

Fisher

, Rosenblum

, Alzheimer’s Disease Neuroimaging Initiative (2018) Stochastic optimization of adaptive enrichment designs for two subpopulations. J Biopharm Stat 28, 966–982.

28.

O’Quigley

, Pepe

, Fisher

(1990) Continual reassessment method: A practical design for phase 1 clinical trials in cancer. Biometrics 46, 33–48.

29.

Yuan

, Hess

, Hilsenbeck

, Gilbert

(2016) Bayesian optimal interval design: A simple and well-performing design for phase I oncology trials. Clin Cancer Res 22, 4291–4301.

30.

Iasonos

, Wilton

, Riedel

, Seshan

, Spriggs

(2008) A comprehensive comparison of the continual reassessment method to the standard 3+3 dose escalation scheme in Phase I dose-finding studies. Clin Trials 5, 465–477.

31.

Woodcock

, LaVange

(2017) Master protocols to study multiple therapies, multiple diseases, or both. N Engl J Med 377, 62–70.

32.

Bateman

, Benzinger

, Berry

, Clifford

, Duggan

, Fagan

, Fanning

, Farlow

, Hassenstab

, McDade

, Mills

, Paumier

, Quintana

, Salloway

, Santacruz

, Schneider

, Wang

, Xiong

, DIAN-TU

Pharma Consortium for the Dominantly Inherited Alzheimer Network

(2017) The DIAN-TU Next Generation Alzheimer’s prevention trial: Adaptive design and disease progression model. Alzheimers Dement 13, 8–19.

33.

Robertson

, Lee

, Lopez-Kolkovska

, Villar

(2023) Response-adaptive randomization in clinical trials: From myths to practical considerations. Stat Sci 38, 185–208.

34.

Pallmann

, Bedding

, Choodari-Oskooei

, Dimairo

, Flight

, Hampson

, Holmes

, Mander

, Odondi

, Sydes

, Villar

, Wason

JMS

, Weir

, Wheeler

, Yap

, Jaki

(2018) Adaptive designs in clinical trials: Why use them, and how to run and report them. BMC Med 16, 29.

35.

Meurer

, Legocki

, Mawocha

, Frederiksen

, Guetterman

, Barsan

, Lewis

, Berry

, Fetters

(2016) Attitudes and opinions regarding confirmatory adaptive clinical trials: A mixed methods analysis from the Adaptive Designs Accelerating Promising Trials into Treatments (ADAPT-IT) project. Trials 17, 373.

36.

Jaki

, Pallmann

, Magirr

(2019) The R Package MAMS for designing multi-arm multi-stage clinical trials. J Stat Softw 88, 1–25.

37.

Keaven

(2022) gsDesign: Group Sequential Design. R package version 3.4.0. https://CRAN.R-project.org/package=gsDesign

38.

Wathen

(2022) OCTOPUS, R package version 1.3.0.3. https://github.com/kwathen/OCTOPUS

39.

Cytel Inc. (2020) EAST 6. https://www.cytel.com/software/east/

40.

NCSS LLC PASS 14 Power Analysis and Sample Size Software.ncss.com/software/pass

41.

Yuan

, Lee

, Integrated platform for designing clinical trials, trialdesign.org 6