Content Validity of Patient-Reported Outcome Instruments used with Pediatric Patients with Facial Differences

Abstract

Objective:

The aim of this systematic review was to identify patient-reported outcome (PRO) instruments used in research with children/youth with conditions associated with facial differences to identify the health concepts measured.

Design:

MEDLINE, EMBASE, CINAHL, and PsycINFO were searched from 2004 to 2016 to identify PRO instruments used in acne vulgaris, birthmarks, burns, ear anomalies, facial asymmetries, and facial paralysis patients. We performed a content analysis whereby the items were coded to identify concepts and categorized as positive or negative content or phrasing.

Results:

A total of 7,835 articles were screened; 6 generic and 11 condition-specific PRO instruments were used in 96 publications. Condition-specific instruments were for acne (four), oral health (two), dermatology (one), facial asymmetries (two), microtia (one), and burns (one). The PRO instruments provided 554 items (295 generic; 259 condition specific) that were sorted into 4 domains, 11 subdomains, and 91 health concepts. The most common domain was psychological (n = 224 items). Of the identified items, 76% had negative content or phrasing (e.g., “Because of the way my face looks I wish I had never been born”). Given the small number of items measuring facial appearance (n = 19) and function (n = 22), the PRO instruments reviewed lacked content validity for patients whose condition impacted facial function and/or appearance.

Conclusions:

Treatments can change facial appearance and function. This review draws attention to a problem with content validity in existing PRO instruments. Our team is now developing a new PRO instrument called FACE-Q Kids to address this problem.

Keywords

content validity facial differences patient-reported outcome instruments

Get full access to this article

View all access options for this article.

References

Alikhan

Ibrahimi

O.A.

Eisen

D.B.

Congenital melanocytic nevi: where are we now? Part I. Clinical presentation, epidemiology, pathogenesis, histology, malignant transformation, and neurocutaneous melanosis. J Am Acad Dermatol. 2012; 67: 1–17.

American Academy of Dermatology. Acne. Available at https://www.aad.org/media-resources/stats-and-facts/conditions/acne. Accessed March 1, 2015.

Black

Patient reported outcome measures could help transform healthcare. Brit Med J. 2013; 346: 167.

Brod

Tesler

L.E.

Christensen

T.L.

Qualitative research and content validity: developing best practices based on science and experience. Qual Life Res. 2009; 18: 1263–1278.

Broder

H.L.

McGrath

Cisneros

G.J.

Questionnaire development: face validity and item impact testing of the Child Oral Health Impact Profile. Community Dent Oral. 2007; 35: 8–19.

Broder

H.L.

Wilson-Genderson

Reliability and convergent and discriminant validity of the Child Oral Health Impact Profile (COHIP Child's version). Community Dent Oral. 2007; 35: 20–31.

Eckstein

D.A.

R.L.

Akinbiyi

Silver

Taub

P.J.

Measuring quality of life in cleft lip and palate patients: currently available patient-reported outcomes measures. Plast Reconstr Surg. 2011; 128: 518–526.

Edwards

T.C.

Huebner

C.E.

Connell

F.A.

Patrick

D.L.

Adolescent quality of life, part I: conceptual and measurement model. J Adolescence. 2002; 25: 275–286.

Edwards

T.C.

Patrick

D.L.

Topolski

T.D.

Aspinall

C.L.

Mouradian

W.E.

Speltz

M.L.

Approaches to craniofacial-specific quality of life assessment in adolescents. Cleft Palate Cran J. 2009; 42: 19–24.

10.

Falco

N.A.

Eriksson

Facial nerve palsy in the newborn: incidence and outcome. Plast Reconstr Surg. 1990; 85: 1–4.

11.

Fattah

Borschel

Manktelow

Bezuhly

Zuker

Facial palsy and reconstruction. Plast Reconstr Surg. 2012; 129: 340–352.

12.

Fayed

Schiariti

Bostan

Cieza

Klassen

Health status and QOL instruments used in childhood cancer research: deciphering conceptual content using World Health Organization definitions. Qual Life Res. 2011; 20: 1247–1258.

13.

Fett

Werth

V.P.

Update on morphea: part I. Epidemiology, clinical presentation, and pathogenesis. J Am Acad Dermatol. 2011; 64: 217–228.

14.

Friedman

J.M.

Epidemiology of neurofibromatosis type 1. Am J Med Genet. 1999; 89: 1–6.

15.

Girman

C.J.

Hartmaier

Thiboutot

Johnson

Barber

DeMuro-Mercon

Waldstreicher

Evaluating health-related quality of life in patients with facial acne: development of a self-administered questionnaire for clinical trials. Qual Life Res. 1996; 5: 481–490.

16.

Government of Canada. Canadian Institutes of Health Research. Available at http://www.cihr-irsc.gc.ca/e/193.html. Accessed August 11, 2016.

17.

Jokovic

Locker

Stephens

Kenny

Tompson

Guyatt

Validity and reliability of a questionnaire for measuring child oral-health-related quality of life. J Dent Res. 2002; 81: 459–463.

18.

Kilcline

Frieden

I.J.

Infantile hemangiomas: how common are they? A systematic review of the medical literature. Pediatr Dermatol. 2008; 25: 168–173.

19.

Landgraf

J.M.

Abetz

Ware

J.E.

The CHQ: A User's Manual. Boston, MA: HealthAct; 1999.

20.

Layton

A.M.

Seukeran

Cunliffe

W.J.

Scarred for life?

Dermatology. 1997; 195: 15–21.

21.

Lewis-Jones

M.S.

Finlay

A.Y.

The Children's Dermatology Life Quality Index (CDLQI): initial validation and practical use. Brit J Dermatol. 1995; 132: 942–949.

22.

Luquetti

D.V.

Heike

C.L.

Hing

A.V.

Cunningham

M.L.

Cox

T.C.

Microtia: epidemiology and genetics. Am J Med Genet. 2012; 158: 124–139.

23.

Martin

A.R.

Lookingbill

D.P.

Botek

Light

Thiboutot

Girman

C.J.

Health-related quality of life among patients with facial acne—assessment of a new acne-specific questionnaire. Clin Exp Dermatol. 2001; 26: 380–385.

24.

Moher

Liberati

Tetzlaff

Altman

D.G.

The PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Brit Med J. 2009; 339: 2535.

25.

Mokkink

L.B.

Terwee

C.B.

Patrick

D.L.

Alonso

Stratford

P.W.

Knol

D.L.

Bouter

L.M.

De Vet

H.C.

The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res. 2010; 19: 539–549.

26.

Monahan

Seder

Patel

Alder

Grud

O'Gara

Hemifacial microsomia: etiology, diagnosis and treatment. J Am Dent Assoc. 2001; 132: 1402–1408.

27.

Motley

R.J.

Finlay

A.Y.

Practical use of a disability index in the routine management of acne. Clin Exp Dermatol. 1991; 17: 1–3.

28.

Patrick

D.L.

Burke

L.B.

Gwaltney

C.J.

Leidy

N.K.

Martin

M.L.

Molsen

Ring

Content validity—establishing and reporting the evidence in newly developed patient-reported outcomes (PRO) instruments for medical product evaluation: ISPOR PRO good research practices task force report: part 1—eliciting concepts for a new PRO instrument. Value Health. 2011a; 14: 967–977.

29.

Patrick

D.L.

Burke

L.B.

Gwaltney

C.J.

Leidy

N.K.

Martin

M.L.

Molsen

Ring

Content validity—establishing and reporting the evidence in newly developed patient-reported outcomes (PRO) instruments for medical product evaluation: ISPOR PRO good research practices task force report: part 2—assessing respondent understanding. Value Health. 2011b; 14: 978–988.

30.

Patrick

D.L.

Topolski

T.D.

Edwards

T.C.

Aspinall

C.L.

Kapp-Simon

K.A.

Rumsey

N.J.

Strauss

R.P.

Thomas

C.R.

Measuring the quality of life of youth with facial differences. Cleft Palate Cran J. 2007; 44: 538–547.

31.

PROMIS. Domain frameworks PROMIS Pediatric Self- and Proxy-Reported Health. Available at http://nihpromis.net/(X(1)S(an1jgz0whyvrnjdy3x3m0d4f)/measures/domainframework2. Accessed March 1, 2015.

32.

Rapp

S.R.

Feldman

S.R.

Graham

Fleischer

A.B.

Brenes

Dailey

The Acne Quality of Life Index (Acne-QOLI). Am J Clin Dermatol. 2006; 7: 185–192.

33.

Ravens-Sieberer

Auquier

Erhart

Gosch

Rajmil

Bruil

Power

Duer

Cloetta

Czemy

. The KIDSCREEN-27 quality of life measure for children and adolescents: psychometric results from a cross-cultural survey in 13 European countries. Qual Life Res. 2007; 16: 1347–1356.

34.

Ravens-Sieberer

Bullinger

KINDL^R questionnaire for measuring health-related quality of life in children and adolescents revised version manual. Available at http://kindl.org/cms/impressum. Accessed March 1, 2015.

35.

Ren

Zhao

Wang

Development and validation of a multidimensional quality of life questionnaire for congenital aural atresia. Acta Oto Laryngol. 2012; 132: 708–714.

36.

Roberts

R.M.

Shute

Children's experience of living with a craniofacial condition: perspectives of children and parents. Clin Child Psychol. 2010; 16: 317–334.

37.

Roberts

R.M.

Shute

Living with a craniofacial condition: development of the Craniofacial Experiences Questionnaire (CFEQ) for adolescents and their parents. Cleft Palate Cran J. 2011; 48: 727–735.

38.

Rumsey

Harcourt

Visible difference amongst children and adolescents: issues and interventions. Dev Neurorehabil. 2007; 10: 113–123.

39.

Spinks

Wasiak

Cleland

Beben

Macpherson

A.K.

Ten-year epidemiological study of pediatric burns in Canada. J Burn Care Res. 2008; 29: 482–488.

40.

Tan

Fung

K.Y.

Khan

Condensation and validation of a 4-item index of the Acne-QoL. Qual Life Res. 2006; 15: 1203–1210.

41.

U.S. Department of Health, and Human Services. Guidance for industry patient-reported outcome measures: use in medical product development to support labeling claims. Available at http://www.ispor.org/workpaper/FDA%20PRO%20Guidance.pdf. Accessed March 1, 2015.

42.

U.S. Food and Drug Administration. Clinical outcome assessment qualification program. Available at http://www.fda.gov/Drugs/DevelopmentApprovalProcess/DrugDevelopmentToolsQualificationProgram/ucm284077.htm. Accessed March 1, 2015.

43.

van Baar

M.E.

Essink-Bot

M.L.

Oen

I.M.

Dokter

Boxma

Hinson

M.I.

Van Loey

N.E.

Faber

A.W.

van Beeck

E.F.

Reliability and validity of the Dutch version of the American Burn Association/Shriners Hospital for Children Burn Outcomes Questionnaire (5-18 years of age). J Burn Care Res. 2006; 27: 790–802.

44.

Varni

J.W.

Seid

Rode

C.A.

The PedsQL™: measurement model for the pediatric quality of life inventory. Med Care. 1999; 37: 126–139.

45.

Verrips

E.G.

Vogels

T.G.

Koopman

H.M.

Theunissen

N.C.

Kamphuis

R.P.

Fekkes

Wit

J.M.

Vanhorick

S.P.V.

Measuring health-related quality of life in a child population. Eur J Public Health. 1999; 9: 188–193.

46.

Waters

Davis

Ronen

Rosenbaum

Livingston

Saigal

Quality of life instruments for children and adolescents with neurodisabilities: how to choose the appropriate instrument. Dev Med Child Neurol. 2009; 51: 660–669.

47.

Wilkie

A.O.M.

Craniosynostosis: genes and mechanisms. Hum Mol Genet. 1997; 6: 1647–1656.