Clinical trial simulation studies can be used to assess the impact of many aspects of trial design, conduct, analysis and decision making on trial performance metrics. Simulation studies can play a vital role in improving the efficiency of the drug development process within the pharmaceutical industry, but only if they are well designed and conducted.
It is imperative therefore that a protocol or simulation plan is developed, documenting how the simulation study is to be conducted, analysed and reported. This article emphasises the specific considerations necessary for designing good quality simulation studies. These include defining data generation processes, data analytic methods, decision criteria and also determining the presentation of results for all intended audiences.
With clinical trial simulations becoming a vital part of the drug development process, the protocol for clinical trial simulations may in future become part of the regulatory peer review process. More rigour in the planning and execution of simulation studies will ensure that the design, analysis and decision-making process for the subsequent clinical trial is based on credible evidence that can be independently verified.
ThallPF. Bayesian clinical trial design in a cancer centre. Chance2001; 14: 23–28.
2.
LipkovichIDuanYYAhmedS. Multiple imputation compared with restricted pseudo-likelihood and generalized estimating equations for analysis of binary repeated measures in clinical studies. Pharmaceutical Statistics2005; 4(4)267–285.
3.
SomervilleMWilsonTKochGWestfallP. Evaluation of a weighted multiple comparison procedure. Pharmaceutical Statistics2005; 4(1)7–13.
4.
US Food and Drug Administration, Center for Drug Evaluation and Research, Center for Biologics Evaluation and Research. Guidance for industry: population pharmacokinetics. US Food and Drug Administration, Rockville, MD; 1999.
5.
US Food and Drug Administration. Critical path initiative white paper: innovation or stagnation? challenge and opportunity on the critical path to new medical products. US Food and Drug Administration, Rockville, MD; 2004.
6.
LeePIDLeskoLJ. KimkoHCDuffullSBClinical trial simulation (CTS): a regulatory clinical pharmacology perspective. Simulation for designing clinical trials: a pharmacokinetic-pharmacodynamic modelling perspective (drugs & the pharmaceutical sciences)2003New York: Marcel Dekker, 201–210.
7.
BonatePGillespieWRLuddenTRubinDBStanskiD. HolfordNHGHaleMKoHCSteimerJ-LSheinerLBPeckCCSimulation in drug development: good practices. Draft publication of the Centre for Drug Development Science (CDDS)1999San Francisco: University of California, 1–18.
8.
LalondeRLKowalskiKGHutmacherMM. Model-based drug development. Clinical Pharmacology and Therapeutics2007; 82(1)21–32.
9.
MoritaSSakamotoJ. Application of an adaptive design to a randomized phase II selection trial in gastric cancer: a report of the study design. Pharmaceutical Statistics2006; 5(2)109–118.
10.
SmithMKJonesIMorrisMFGrieveAPTanK. Implementation of a Bayesian adaptive design in a proof of concept study. Pharmaceutical Statistics2006; 5(1)39–50.
11.
HolfordNHGKimkoHCMonteleoneJPRPeckCC. Simulation of clinical trials. Annual Review of Pharmacology and Toxicology2000; 40: 209–234.
12.
BurtonAAltmanDGRoystonPHolderRL. The design of simulation studies in medical statistics. Statistics in Medicine2006; 25(24)4279–4292.
13.
RiggsMMGodfreyCJGastanguayMR. EtteEIWilliamsPJClinical trial simulation: efficacy trials. Pharmacometrics – the science of quantitative clinical pharmacology2007Chichester: Wiley, 881–900.
14.
BurmanCFHamrenBOlssonP. Modelling and simulation to improve decision-making in clinical development. Pharmaceutical Statistics2005; 4(1)47–58.
15.
WilliamsPJEtteEI. KimkoHCDuffullSBDetermination of model appropriateness in simulation for designing clinical trials. Simulation for designing clinical trials: a pharmacokinetic-pharmacodynamic modelling perspective (drugs & the pharmaceutical sciences)2003New York: Marcel Dekker, 74–103.
16.
KowalskiKGFrenchJLSmithMKHutmacherMM. A model-based framework for quantitative decision making in drug development. In: Proceedings of the American Conference on Pharmacometrics2008Tuscon, Arizona.
17.
SmithMKFrenchJKowalskiKEwyW. Enhanced quantitative decision making – reducing the likelihood of incorrect decisions. In: Proceedings of the 18th Annual Population Approach Group in Europe (PAGE) meeting2009St. Petersburg, Russia.
18.
KowalskiKGOlsonSRemmersAEHutmacherMM. Modeling and simulation to support dose selection and clinical development of SC-75416, a selective COX-2 inhibitor for the treatment of acute and chronic pain. Clinical Pharmacology and Therapeutics2008; 83(6)857–866.
19.
KimkoHCDuffullSB. KimkoHCDuffullSBIntroduction to simulation for design of clinical trials. Simulation for designing clinical trials: a pharmacokinetic-pharmacodynamic modelling perspective (drugs & the pharmaceutical sciences)2003New York: Marcel Dekker, 1–16.
20.
BonatePL. EtteEIWilliamsPJClinical trial simulation: theory. Pharmacometrics – the science of quantitative clinical pharmacology2007Chichester: Wiley, 851–871.
21.
WilliamsPJLaneJR. EtteEIWilliamsPJModeling and simulation: planning and execution. Pharmacometrics – the science of quantitative clinical pharmacology2007Chichester: Wiley, 873–880.
22.
KimkoHCDuffullSB. Simulation for designing clinical trials: a pharmacokinetic-pharmacodynamic modelling perspective (drugs & the pharmaceutical sciences)2003New York: Marcel Dekker.
23.
GelmanACarlinJBSternHSRubinDB. Bayesian data analysis20042. Florida, USA: Chapman & Hall/CRC.
24.
HolfordNGH. KimkoHCDuffullSBInput-output models. Simulation for designing clinical trials: a pharmacokinetic-pharmacodynamic modelling perspective (drugs & the pharmaceutical sciences)2003New York: Marcel Dekker, 17–30.
25.
WestfallPHTsaiKOgenstadSTomoiagaAMoseleySLuYG. Clinical trials simulation: a statistical approach. Journal of Biopharmaceutical Statistics2008; 18(4)611–630.
26.
LittleRJARubinDB. Statistical analysis with missing data1987New York: John Wiley and Sons.
27.
GirardP. Clinical trial simulation: a tool for understanding study failures and preventing them. Basic & Clinical Pharmacology & Toxicology2005; 96(3)228–234.
28.
HoffmanDKringleRLockwoodGTurpaultSYowEMathieuG. Nonlinear mixed effects modelling for estimation of steady state attainment. Pharmaceutical Statistics2005; 4(1)15–24.
29.
R Development Core Team. R: a language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria; 2004.
30.
StroustrupB. The C++ Programming Language (Special edn)2000Reading, MA: Addison-Wesley.
31.
SmithMKPughRFrancoisR. MSToolkit – an R library for simulating and evaluating clinical trial designs and scenarios. In: Proceedings of the 18th Annual Population Approach Group in Europe (PAGE) meeting2009St. Petersburg, Russia.
32.
ChienJYFriedrichSHeathmanMAde AlwisDPSinhaV. Pharmacokinetics/pharmacodynamics and the stages of drug development: role of modeling and simulation. The AAPS Journal2005; 7(3)E544–E559.
33.
O'HaganAStevensJWCampbellMJ. Assurance in clinical trial design. Pharmaceutical Statistics2005; 4(3)187–201.
34.
IsukapalliSSRoyAGeorgopoulosPG. EtteEIWilliamsPJPhysiologically based pharmacokinetic modeling: inhalation, ingestion, and dermal absorption. Pharmacometrics – the science of quantitative clinical pharmacology2007Chichester: Wiley, 1069–1106.
35.
EtteEILockwoodPMillerRMandemaJ. MillardSPKrauseAAnalysis of analgesic trials. Applied statistics in the pharmaceutical industry2001New York: Springer, 237–266.
36.
NestorovIAGrahamGDuffullSBAaronsL. KimkoHCDuffullSBModel-based integration for clinical trial simulation and design. Simulation for designing clinical trials: a pharmacokinetic-pharmacodynamic modelling perspective (drugs & the pharmaceutical sciences)2003New York: Marcel Dekker, 313–325.
37.
MandemaJWangW. KimkoHCDuffullSBUse of modeling and simulation to optimise dose-finding strategies. Simulation for designing clinical trials: a pharmacokinetic-pharmacodynamic modelling perspective (drugs & the pharmaceutical sciences)2003New York: Marcel Dekker, 289–312.
38.
SmithMKMarshallS. A Bayesian design and analysis for dose-response using informative prior information. Journal of Biopharmaceutical Statisitics2006; 16(5)695–709.
39.
ChanPLSNuttJGHolfordNHG. Levodopa slows progression of Parkinson's disease: external validation by clinical trial simulation. Pharmaceutical Research2007; 24(4)791–802.
40.
ZhouYHLuciniM. Gaining acceptability for the Bayesian decision-theoretic approach in dose-escalation studies. Pharmaceutical Statistics2005; 4(3)161–171.
41.
KongLKochGLiuTWangH. Performance of some multiple testing procedures to compare three doses of a test drug and placebo. Pharmaceutical Statistics2005; 4(1)25–35.
42.
DonnerAHauckWWZouGY. The impact of missing values in the concentration-time curve on the assessment of bioequivalence. Pharmaceutical Statistics2005; 4(2)91–99.
43.
FedorovVV. Theory of optimal experiments1972New York: Academic Press.
44.
AtkinsonACDonevANTobiasR. Optimum experimental designs, with SAS2007Oxford: Oxford University Press.
45.
RetoutSDuffullSMentreF. Development and implementation of the population Fisher information matrix for the evaluation of population pharmacokinetic designs. Computer Methods and Programs in Biomedicine2001; 65(2)141–151.
46.
ParmigianiG. Modeling in medical decision making: a Bayesian approach2002Chichester: Wiley.
