Predicting missing quality of life data that were later recovered: an empirical comparison of approaches

Abstract

Background and Purpose The aim was to compare simple imputation, multiple imputation, and modeling approaches to deal with ‘missing’ quality of life data. Data were obtained from five clinical trials, which employed a reminder system for follow-up questionnaires. Previous studies have compared imputation strategies by artificially removing data according to prespecified mechanisms. Our approach differs from previous study as actual collected data are utilized.

Methods Data obtained by reminder were initially treated as missing. These missing values were imputed using a variety of simple and multiple imputation strategies. The trials were analyzed using the imputed datasets, and the resulting treatment effects compared to analyses using the full dataset including responses following reminders. A repeated measures model was also carried out on the available data and the pattern mixture models were employed. The accuracy of the different strategies was assessed by calculating the bias seen in the calculated treatment difference compared to the actual observed treatment difference.

Results Baseline carried forward or last value carried forward were shown to be the best simple imputation methods in this setting. Multiple imputation using a regression model or predictive mean match model tended to provide treatment difference estimates with the least bias when compared to the actual observed data. Pattern mixture models did not perform well. Overall, the multiple imputation procedures were generally the least biased approaches.

Limitations A number of imputation and modeling procedures have been investigated but this list is not exhaustive. All the example datasets come from the same data source and perhaps studies from additional disease areas would have been useful. However, we feel the results are generalizable to other quality of life outcomes and clinical areas.

Conclusions Multiple imputation is recommended for missing quality of life data as it makes the assumption of missing at random which in the quality of life setting is more plausible than the assumption of missing completely at random for which most simple imputation methods are based. Pattern mixture models can be complex and did not perform well in this setting. Clinical Trials 2010; 7: 333—342. http://ctj.sagepub.com

Get full access to this article

View all access options for this article.

References

Fairclough DL Design and Analysis of Quality of Life Studies in Clinical Trials . Chapman and Hall, Boca Raton , 2002 .

Fielding S. , Fayers PM , McDonald A. , et al. Simple imputation methods were inadequate for missing not at random (MNAR) quality of life data. Health Qual Life Outcomes 2008; 6: 57.

Fielding S. , Fayers PM , Ramsay CR Investigating the missingness mechanism in quality of life data: a comparison of approaches. Health Qual Life Outcomes 2009 ; 7: 57.

Cook NR An imputation method for non-ignorable missing data in studies of blood pressure . Stat Med 1997; 16: 2713-28.

Donders AR , van der Heijden GJ , Stijnen T. , Moons KG Review: a gentle introduction to imputation of missing values. J Clin Epidemiol 2006; 59: 1087-91.

Hunsberger S. , Murray D. , Davis CE , Fabsitz RR Imputation strategies for missing data in a school-based multi-centre study: the Pathways study . Stat Med 2001; 20: 305-16.

Huson LW , Chung J. , Salgo M. Missing data imputation in two phase III trials treating HIV1 infection . J Biopharm Stat 2007; 1: 159-72.

Liu G. , Gould AL Comparison of alternative strategies for analysis of longitudinal trials with dropouts. J Biopharm Stat 2002 ; 12: 207-26.

Morita S. , Kobayashi K. , Eguchi K. , et al. Analysis of incomplete quality of life data in advanced stage cancer: a practical application of multiple imputation. Qual Life Res 2005; 14: 1533-44.

10.

Myers WR Handling missing data in clinical trials: an overview. Drug Inf J 2000; 34: 525-33.

11.

Patrician PA Multiple imputation for missing data. Res Nurs Health 2002; 25: 76-84.

12.

Tang L. , Song J. , Belin TR , Unutzer J. A comparison of imputation methods in a longitudinal randomized clinical trial . Stat Med 2005; 24: 2111-28.

13.

Fayers PM , Machin D. Quality of Life: Assessment, Analysis and Interpretation. Wiley, Chichester, 2001.

14.

Molenberghs G. , Kenward MG Missing Data in Clinical Studies . Wiley, New York, 2007.

15.

Little RJA , Rubin DB Statistical Analysis with Missing Data (2nd edn). Wiley, New York, 2002.

16.

Rubin DB Multiple Imputation for Nonresponse in Surveys. John Wiley & Sons, Inc, New York, 1987.

17.

Carpenter JR , Kenward MG Missing data in randomised controlled trials - a practical guide. November 2007 Available at: http://www.pcpoh.bham.ac.uk/publichealth/methodology/docs/invitations/Final_Report_RM04_JH17_mk.pdf (accessed 28 November 2007).

18.

Fay RE When are inferences from multiple imputations valid? In: Proceedings of the Survey Research Methods Section of the American Statistical Association, Alexandria, VA, 1992, pp. 227-32.

19.

SAS Institute Inc. SAS/STAT 9.1 User’s guide. 2004.

20.

Royston P. Multiple imputation of missing values: update of ice. Stata J 2005; 5: 188-201.

21.

Brown H. , Prescott R. Applied Mixed Models in Medicine. Wiley, Chichester, 1999.

22.

Little RJA. A class of pattern-mixture models for normal incomplete data. Biometrika 1994; 81: 471-83.

23.

Curran D. , Molenberghs G. , Thijs H. , Verbeke G. Sensitivity analysis for pattern mixture models. J Biopharm Stat 2004; 14: 125-43.

24.

Ware JR , Snow KK , Kosinski M. , Gandek B. SF-36 Health Survey Manual and Interpretation Guide. The Health Institute, Boston, MA, 1993 .

25.

Brooks R. with the EuroQoL Group. EuroQoL: the current state of play. Health Policy 1996; 37: 53-72.

26.

Grant A. , Wileman SM , Ramsay C. , et al. The effectiveness and cost-effectiveness of minimal access surgery amongst people with gastro-oesophageal reflux disease - a UK collaborative study. The REFLUX trial. Health Technol Assess 2008; 12: 1-204.

27.

Avenell A. , Campbell MK , Cook JA , et al. Effect of multivitamin and multimineral supplements on morbidity from infections in older people (MAVIS trial): pragmatic, randomised, double blind, placebo controlled trial. BMJ 2005; 331: 324-29.

28.

Grant AM , Avenell A. , Campbell MK , et al. Oral vitamin D3 and calcium for secondary prevention of low-trauma fractures in elderly people (Randomised Evaluation of Calcium Or vitamin D, RECORD): a randomised placebo-controlled trial. Lancet 2005; 365: 1621-28.

29.

The KAT trial group. The Knee Arthroplasty Trial (KAT) design features, baseline characteristics and two-year functional outcomes after alternative approaches to knee replacement . J Bone Joint Surg Am 2009; 91: 134-41.

30.

Langston AL , Campbell MK , Fraser WD , et al. Randomised trial of intensive bisphosphonate treatment versus symptomatic management in Paget’s disease of bone. J Bone Miner Res 2010; 25: 20-31.

31.

Fayers PM , Machin D. Quality of Life: The Assessment, Analysis and Interpretation of Patient-reported Outcomes (2nd edn). Wiley, UK, 2007.