Content Validation of Clinician-Reported Items for a Severity Measure for CDKL5 Deficiency Disorder

Abstract

CDKL5 deficiency disorder (CDD) results in early-onset seizures and severe developmental impairments. A CDD clinical severity assessment (CCSA) was previously developed with clinician and parent-report items to capture information on a range of domains. Consistent with US Food and Drug Administration (FDA) guidelines, content validation is the first step in evaluating the psychometric properties of an outcome measure. The aim of this study was to validate the content of the clinician-reported items in the CCSA (CCSA-Clinician). Eight neurologists leading the USA CDD Center of Excellence clinics were interviewed using the “think aloud” technique to critique 26 clinician-reported items. Common themes were aggregated, and a literature search of related assessments informed item modifications. The clinicians then participated in 2 consensus meetings to review themes and finalize the items. A consensus was achieved for the content of the CCSA-Clinician. Eight of the original items were omitted, 11 items were added, and the remaining 18 items were revised. The final 29 items were classified into 2 domains: functioning and neurologic impairments. This study enabled refinement of the CCSA-Clinician and provided evidence for its content validity. This preliminary validation is essential before field testing and further validation, in order to advance the instrument toward clinical trial readiness.

Keywords

CDKL5 deficiency disorder clinical severity outcome measure think aloud content validity

Get full access to this article

View all access options for this article.

References

Jakimiec

Paprocka

Smigiel

. CDKL5 deficiency disorder—a complex epileptic encephalopathy. Brain Sci. 2020;10:107.

Fehr

Wilson

Downs

, et al. The CDKL5 disorder is an independent clinical entity associated with early-onset encephalopathy. Eur J Hum Genet. 2013;21(3):266–273.

Hagebeuk

Van den Bosshe

de Weerd

. Respiratory and sleep disorders in female children with atypical Rett syndrome caused by mutations in the CDKL5 gene. Dev Med Child Neurol. 2013;55(5):480–484.

Mangatt

Wong

Anderson

, et al. Prevalence and onset of comorbidities in the CDKL5 disorder differ from Rett syndrome. Orphanet J Rare Dis. 2016;11(39):39.

Demarest

Olson

Moss

, et al. CDKL5 deficiency disorder: relationship between genotype, epilepsy, cortical visual impairment, and development. Epilepsia. 2019;60(8):1733–1742.

Muller

Helbig

Jansen

, et al. Retrospective evaluation of low long-term efficacy of antiepileptic drugs and ketogenic diet in 39 patients with CDKL5-related epilepsy. Eur J Paediatr Neurol. 2016;20(1):147–151.

Fehr

Wong

Chin

, et al. Seizure variables and their relationship to genotype and functional abilities in the CDKL5 disorder. Neurology. 2016;87(21):2206–2213.

US Department of Health and Human Services, Food and Drug Administration (FDA), Center for Drug Evaluation and Research (CDER), Center for Biologics Evaluation and Research (CBER), Center for Devices and Radiological Health (CDRH). Guidance for Industry: Patient-Reported Outcome Measures: Use in Medical Product Development to Support Labeling Claims. Silver Spring, MD: Food and Drug Administration, US Department of Health and Human Services; 2009.

Demarest

Pestana-Knight

Olson

, et al. Severity assessment in CDKL5 deficiency disorder. Pediatr Neurol. 2019;97:38–42.

10.

Brod

Tesler

Christensen

. Qualitative research and content validity: developing best practices based on science and experience. Qual Life Res. 2009;18(9):1263–1278.

11.

Leidy

Vernon

. Perspectives on patient-reported outcomes. Content validity and qualitative research in a changing clinical trial environment. Pharmacoeconomics. 2008;26(5):363–370.

12.

Epstein

Williams

Reddihough

, et al. Content validation of the Quality of Life Inventory—Disability. Child. 2019;45(5):654–659.

13.

Charters

. The use of think-aloud methods in qualitative research: an introduction to think-aloud methods. Brock Educ. 2003;12:68–82.

14.

Ericsson

Simon

. Verbal reports as data. Psychol Rev. 1980;87:215–251.

15.

Charters

. The use of think-aloud methods in qualitative research: an introduction to think-aloud methods. Brock Educ J. 2003;12(2):68–82.

16.

Nowell

Norris

White

Moules

. Thematic analysis: striving to meet the trustworthiness criteria. Int J Qual Methods. 2017;16:1–13.

17.

Kremer

HPH

, Group HS. Unified Huntington’s disease rating scale: reliability and consistency. Mov Disord. 1996;11(2):136–142.

18.

Teixeira

Maia

Cardoso

. UFMG Sydenham’s Chorea Rating Scale (USCRS): reliability and consistency. Mov Disord. 2005;20(5):585–591.

19.

Battini

Olivieri

Di Pietro

, et al. Movement Disorder-Childhood Rating Scale: a sensitive tool to evaluate movement disorders. Pediatr Neurol. 2015;53:73–77.

20.

Barker

. Assessment of muscle tone in pediatrics. Secondary Assessment of muscle tone in pediatrics 2013. https://www.ideasforot.com/?page_id=228.

21.

Munde

Vlaskamp

Ruijssenaars

Nakken

. Determining alertness in individuals with profound intellectual and multiple disabilities: the reliability of an observation list. Educ Train Autism Dev Disabil. 2011;46(1):116–123.

22.

Munde

Vlaskamp

Ruijssenaars

AJJM

Nakken

. Alertness in individuals with profound intellectual and multiple disabilities: a literature review. Res Dev Disabil. 2009;30:462–480.

23.

National Institute of Neurological Disorders and Stroke. All disorders. https://www.ninds.nih.gov/Disorders/All-Disorders. Published 2019. Accessed August 1, 2020.

24.

Colvin

Fyfe

Leonard

, et al. Describing the phenotype in Rett syndrome using a population database. Arch Dis Child. 2003;88(1):38–43.

25.

Downs

Stahlhut

Wong

, et al. Validating the Rett Syndrome Gross Motor Scale. PLoS One. 2016;11(1):e0147555.

26.

Neul

Fang

Barrish

, et al. Specific mutations in methyl-CpG-binding protein 2 confer different severity in Rett syndrome. Neurology. 2008;70(16):1313–1321.

27.

Neul

Glaze

Percy

, et al. Improving treatment trial outcomes for Rett syndrome: the development of Rett-specific anchors for the Clinical Global Impression Scale. J Child Neurol. 2015;30(13):1743–1748.

28.

Hou

Bhattacharya

Pradana

Tarquinio

. Assessment of a clinical trial metric for Rett syndrome: critical analysis of the Rett Syndrome Behavioural Questionnaire. Pediatr Neurol. 2020;107:48–56.

29.

Adams

Seltzer

Dobyns

Paciorkowski

. Phenotype differentiation of FOXG1 and MECP2 disorders: a new method for characterization of developmental encephalopathies. J Pediatr. 2016;178:233–240.e10.

30.

Mitter

Pringsheim

Kaulisch

, et al. FOXG1 syndrome: genotype-phenotype association in 83 patients with FOXG1 variants. Genet Med. 2018;20(1):98–108.

31.

Humphrey

Ploubidis

Yates

Steinberg

Bolton

. The Early Childhood Epilepsy Severity Scale (E-Chess). Epilepsy Res. 2008;79(2-3):139–145.

32.

Purusothaman

Ryther

Bertrand

, et al. Developing the Pediatric Refractory Epilepsy Questionnaire: a pilot study. Epilepsy Behav. 2014;37:26–31.

33.

Nguyen

Foster

Paciorkowski

, et al. Reliability and validity of the Wolfram Unified Rating Scale (WURS). Orphanet J Rare Dis. 2012;7:89.

34.

WHO Multicentre Growth Reference Study Group. WHO Motor Development Study: windows of achievement for six gross motor development milestones. Acta Paediatr Suppl. 2006;450:86–95.

35.

Fehr

Leonard

, et al. There is variability in the attainment of developmental milestones in the CDKL5 disorder. J Neurodev Disord. 2015;7(1):2.

36.

Black

Murphy

Lamping

, et al. Consensus development methods: a review of best practice in creating clinical guidelines. J Health Serv Res Policy. 1999;4(4):236–248.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.03 MB