Outcome measures for multiple sclerosis clinical trials: relative measurement precision of the Expanded Disability Status Scale and Multiple Sclerosis Functional C omposite

Abstract

We compared the relative measurement precision (RMP) of the Expanded Disability Status Scale (EDSS) and the Multiple Sclerosis Functio nal C omposite (MSFC) for discriminating between groups of patients known to differ in their extent of multiple sclerosis (MS). A total of 133 patients were rated with the EDSS and MSFC and had magnetic resonance imaging (MRI) scans. Patients were grouped on the basis of MRI appearances (T1- and T2-weighted lesion loads, parenchymal and ventricular fractions - T1LL, T2LL, PF, VF, respectively) and RMP was determined using the method of group differences. For each MRI parameter, the total sample was arranged in ascending order of magnitude and divided into two, three, four and five similar sized groups. For each division (two, three, four or five groups), EDSS and MSFC scores for the groups were compared using parametric (paired samples t-tests, one-way A NOVA) and nonparametric (Wilcoxon’s rank-sum test, Kruskal -Wallis analysis of variance) statistical methods and RMP was estimated. The EDSS and MSFC were correlated substantially (r = -0.64). Relative to the MSFC, the EDSS had inferior measurement precision regardless of the number of groups into which the total sample was divided, or the statistical method. However, the RMP of the EDSS compared with the MSFC varied from 2% to 86%. Results suggest the MSC F is better than the EDSS for detecting differences between groups of patients, defined by these MRI markers of MS. However, the finding that both scales correlated weakly with MRI markers, indicated that they are limited as predicto rs of MS patho logy as defined by MRI. A n explanatio n for this well-established clinical -MRI paradox is that rating scales and MRI measure fundamentally different manifestations of MS.

Keywords

EDSS health measurement MS functional co mposite psychometrics quality of life measurement rating scales

Get full access to this article

View all access options for this article.

References

Kurtzke JF. Rating neurological impairment in multiple sclerosis: an expanded disability status scale (EDSS) . Neurology 1983; 33: 1444-1452 .

Vickrey BG , Hays RD , Harooni R , Myers LW , Ellison GW. A health-related quality of life measure for multiple sclerosis . Qual Life Res 1995; 4: 187-206 .

LaRocca NG , Ritvo PG , Miller DM , Fischer JS , Andrews H , Paty DW. ‘Quality of life’ assessment in multiple sclerosis clinical trials: current status and strategies for improving multiple sclerosis clinical trial design. In Goodkin DE , Rudick R eds. Multiple sclerosis: advances in clinical trial design, treatment and future perspectives. London: Springer-Valag , 1996: 145-160.

Cella DF , Dineen K , Arnason B , Reder A , Webster KA , Karabatsos G et al. Validation of the Functional Assessment of Multiple Sclerosis quality of life instrument . Neurology 1996; 47: 129-139 .

Rudick R , Antel J , Confavreux C , Cutter G , Ellison G , Fischer J et al. Recommendations from the National Multiple Sclerosis Society Clinical Outcomes Assessment Task Force . Ann Neurol 1997; 42: 379-382 .

Sharrack B , Hughes RAC. The Guy’s Neurological Disability Scale (GNDS): a new disability measure for multiple sclerosis . Mult Scler 1999; 5: 223-233 .

Pfennings LEMA , Cohen L , Van der Ploeg HM , Bramsen I , Polman CH , Lankhorst GJ et al. A health-related quality of life questionnaire for multiple sclerosis patients . Acta Neurol Scand 1999; 100: 148-155 .

Ford HL , Gerry E , Tennant A , Whalley D , Haigh R , Johnson MH. Developing a disease-specific quality of life measure for people with multiple sclerosis . Clin Rehabil 2001; 15: 247-258 .

Hobart JC , Lamping DL , Fitzpatrick R , Riazi A , Thompson AJ. The Multiple Sclerosis Impact Scale (MSIS-29): a new patient-based outcome measure . Brain 2001; 124: 962-973 .

10.

McDowell I , Jenkinson C. Development standards for health measures . J Health Services Res Policy 1996; 1: 238-246 .

11.

Lohr KN , Aaronson NK , Alonso J , Burnam MA , Patrick DL , Perrin EB et al. Evaluating quality of life and health status instruments: development of scientific review criteria . Clin Therapeut 1996; 18: 979-992 .

12.

Fitzpatrick R , Davey C , Buxton MJ , Jones DR. Evaluating patient-based outcome measures for use in clinical trials . Health Technology Assessment 1998; vol. 2, no. 14.

13.

van der Putten JJMF , Hobart JC , Freeman JA , Thompson AJ. Measuring change in rehabilitation: comparison of the responsiveness of the Barthel Index and the Functional Independence Measure . J Neurol Neurosurg Psychiatry 1999; 66: 480-484 .

14.

Hobart JC , Lamping DL , Freeman JA , Langdon DW , McLellan DL , Creenwood RJ , Thompson AJ. Evidence-based measurement: which disability scale for neurological rehabilitation ? Neurology 2001; 57: 639-644 .

15.

Cutter GR , Baier ML , Rudick RA , Cookfair DL , Fischer JS , Petkau J et al. Development of a multiple sclerosis functional composite as a clinical trial outcome measure . Brain 1999; 122: 871-882 .

16.

Whitaker JN , McFarland HF , Rudge P , Reingold SC. Outcomes assessment in multiple sclerosis trials: a critical analysis . Mult Scler 1995; 1: 37-47 .

17.

Nunnally JCJ. Introduction to psychological measurement. New York: McGraw-Hill , 1970.

18.

Fischer JS , Jak AJ , Kniker JE , Rudick RA , Cutter GR. Administration and scoring manual for the Multiple Sclerosis Functional Composite (MSFC). New York: Demos Vermande , 1999.

19.

Fischer JS , Cohen JA , Cutter GR , Mertz LA , Bolibrush DM , Skaramagas TT et al. Intra- and inter-rater reliability of the Multiple Sclerosis Functional Composite (MSFC) . Neurology 1999; 52(suppl 2): A548-A548 .

20.

Fischer JS , Cutter GR , Rudick RA , Reingold SC for the National MS Society Clinical Outcomes Assessment Task Force . The Multiple Sclerosis Functional Composite (MSFC); an integrated approach to MS clinical outcome assessment . Mult Scler 1999; 5: 244-250 .

21.

Miller DM , Rudick RA , Cutter G , Baier M , Fischer JS. Clinical significance of the Multiple Sclerosis Functional Composite: relationship to patient-reported quality of life . Arch Neurol 2000; 57: 1319-1324 .

22.

Kalkers NF , de Groot V , Lazeron RHC , Killestein J , Ader HJ , van Walderveen MAA et al. MS Functional Composite: relation to disease phenotype and disability strata . Neurology 2000; 54: 1233-1239 .

23.

Kalkers NF , Bergers L , de Groot V , Lazeron RHC , van Walderveen MAA , Uitdehaag BMJ , et al. Concurrent validity of the MS Functional Composite using MRI as a biological disease marker . Neurology 2001; 56: 215-219 .

24.

Rudick R , Cutter G , Baier M , Fisher E , Dougherty D , Wein-stock-Guttman B et al. Use of the Multiple Sclerosis Functional Composite to predict disability in relapsing MS . Neurology 2001; 56: 1324-1330 .

25.

Stewart AL , Ware JE Jr eds. Measuring functioning and well-being: the Medical Outcomes Study approach. Durham, NC: Duke University Press , 1992.

26.

McHorney CA , Ware JE Jr , Rogers W , Raczek AE , Lu JFR. The validity and relative precision of MOS short- and long-form health status scales and Dartmouth COOP charts . Med Care 1992; 30: M5253-M5265 .

27.

McHorney CA , Ware JE Jr , Raczek AE. The MOS 36-Item Short-Form Health Survey (SF-36): II. Psychometric and clinical tests of validity in measuring physical and mental health constructs . Med Care 1993; 31: 247-263 .

28.

Kenny D , Judd C. Consequences of violating the independence assumptions in analysis of variance . Psychol Bull 1986; 99: 422-431 .

29.

Pearson ES. The analysis of variance in cases of non-normal variation . Biometrika 1931; 23: 114-133 .

30.

Boneau CA. The effects of violations of assumptions underlying the t test . Psychol Bull 1960; 57: 49-64 .

31.

Havlicek LL , Peterson NL. Effect of the violation of assumptions upon significance levels of the Peasron r . Psychol Bull 1977; 84: 373-377 .

32.

Havlicek LL , Peterson NL. Robustness of the t test: a guide for researchers on effect of violations of assumptions . Psychol Reports 1974; 34: 1095-1114 .

33.

Havlicek LL , Peterson NL. Robustness of the Pearson correlation against violations of assumptions . Percept Motor Skills 1976; 43: 1319-1334 .

34.

Johnson JW , Den Heyer K. On the enduring untruth about measurement and parametric statistics . Can Psychol 1980; 21: 134-135 .

35.

Gaito J. Measurement scales and statistics: resurgence of an old misconception . Psychol Bull 1980; 87: 564-567 .

36.

Gaito J , Yokubynas R. An empirical basis for the statement that measurement scale properties (and meaning) are irrelevant in statistical analyses . Bull Psychonomic Soc 1986; 24: 449-450 .

37.

Liang MH , Larson MG , Cullen KE , Schwartz JA. Comparative measurement efficiency and sensitivity of five health status instruments for arthritis research . Arthr Rheuma 1985; 28: 542-547 .

38.

Miller DH , Grossman RI , Reingold SC , McFarland HF. The role of magnetic resonance techniques in understanding and managing multiple sclerosis . Brain 1998; 121: 3-24 .

39.

Filippi M , Horsfield MA , Hajnal JV , Narayana PA , Udupa JK , Yousry TA et al. Quantitative assessment of magnetic resonance imaging lesion load in multiple sclerosis . J Neurol Neurosurg Psychiatry 1998; 64: 588-593 .

40.

Lycklama a Nijeholt GJ , van Walderveen MAA , Castelijns JA , van Waesberghe JHTM , Polman C , Scheltens P et al. Brain and spinal cord abnormalities in multiple sclerosis: correlation between MRI parameters, clinical subtypes and symptoms . Brain 1998; 121: 687-697 .

41.

Hobart JC , Freeman JA , Thompson AJ. Kurtzke scales revisited: the application of psychometric methods to clinical intuition . Brain 2000; 123: 1027-1040 .

42.

Ciccarelli O , Brex PA , Thompson AJ , Miller DH. Disability and lesion load in MS: a reassessment using MS functional composite and 3D fast FLAIR . J Neurol 2002; 249: 18-24 .

43.

Nunnally JC , Bernstein IH. Psychometric theory, third edition. New York: McGraw-Hill , 1994.

44.

Kurtzke JF. On the evaluation of disability in multiple sclerosis . Neurology 1961; 11: 656-694 .

45.

Cronbach U , Meehl PE. Construct validity in psychological tests . Psychol Bull 1955; 52: 281-302 .

46.

Campbell DT , Fiske DW. Convergent and discriminant validation by the multitrait-multimethod matrix . Psychol Bull 1959; 56: 81-105 .