Developing and Establishing Content Validity of Vignettes for Health Care Education and Research

Abstract

The use of vignettes in research and education is well documented. Documentation of how vignettes are developed and content validity is established, however, are rare. The purpose of this paper is to describe a method for development and establishing content validity of vignettes that can be used to assess student performance and research participant outcomes. This three-phase method was designed to validate seven vignettes for a future research project. Content validity index survey and expert panel interviews were used to inform improvements in validity. Findings showed that clinical vignettes were improved with respect to content relevance (from 0.93 to 0.96) and importance (from 0.68 to 0.93). Developing validated vignettes is essential when used to measure outcomes in education and in research. This three-phase method of vignette development and validation is feasible and effective in improving content validity of vignettes and can be used in other education and research projects.

Keywords

Case studies vignettes content validity index expert panel

Get full access to this article

View all access options for this article.

References

Bailey

Daoust

Doyon-Trottier

Daughin-Pierre

Gravel

(2010). Validation and properties of the verbal numeric scale in children with acute pain. Pain, 149, 216–221.

Betschart

Zumstein

Bentivoglio

Engeler

Schmid

H-P.

Abt

(2017). Readability assessment of online patient education materials provided by the European Association of Urology. International Urology and Nephrology, 49, 2111–2117.

Brauer

P. M.

Hanning

R. M.

Arocha

J. F.

Royall

Goy

Grant

Dietrich

Martino

Horrocks

(2009). Creating case scenarios or vignettes using factorial study design methods. Journal of Advanced Nursing, 65(9), 1937–1945.

Elo

Kyngas

(2008). The qualitative content analysis process. Journal of Advanced Nursing, 62(1), 107–115.

Evans

S. P.

Roberts

M. C.

Keeley

J. W.

Blossom

J. B.

Amaro

C. M.

Garcia

A. M.

Odar Stough

Canter

K. S.

Robles

Reed

G. M.

(2015). Vignette methodologies for studying clinicians’ decision-making: Validity, utility, and application in ICD-11 field studies. International Journal of Clinical and Health Psychology, 15, 160–170.

Fishman

S. M.

Young

H. M.

Lucas Arwood

Chou

Herr

Murinson

B. B.

Watt-Watson

Carr

D. B.

Gordon

D. B.

Stevens

B. J.

Bakerjian

Ballantyne

J. C.

Courtenay

Djukic

Koebner

I. J.

Mongoven

J. M.

Paice

J. A.

Prasad

Singh

. . . Strassel

S. A

. (2013). Core competencies for pain management: results of an interprofessional consensus summit. Pain Medicine, 14, 971–981.

Fonteyn

M. E.

Vettese

Lancaster

D. R.

Bauer-Wu

(2008). Developing a codebook to guide content analysis of expressive writing transcripts. Applied Nursing Research, 21(3), 165–168.

Graneheim

U. H.

Lundman

(2004). Qualitative content analysis in nursing research: concepts, procedures and measures to achieve trustworthiness. Nurse Education Today, 24(2), 105–112.

Herr

St. Marie

B. J.

Gordon

D. B.

Paice

J. A.

Watt-Watson

Stevens

B. J.

Bakerjian

Young

H. M.

(2015). An interprofessional consensus of core competencies for prelicensure education in pain management: Curriculum application for nursing. Journal of Nursing Education, 54(6), 317–327.

10.

Herskovitz

M. J.

(1950). The hypothetical situation: A technique of field research. Southwestern Journal of Anthropology, 6, 32–40.

11.

Hoeger Bement

M. K.

St Marie

B. J.

Nordstrom

T. M.

Christensen

Mongoven

J. M.

Koebner

I. J.

Fishman

S. M.

Sluka

K. A

. (2014). An interprofessional consensus of core competencies for prelicensure education in pain management: Curriculum application for physical therapy. Physical Therapy, 94(4), 451–465.

12.

Hughes

Huby

(2002). The application of vignettes in social and nursing research. Methodological Issues in Nursing Research, 37(4), 382–386.

13.

Jackson

Harrison

Swinburn

Lawrence

(2015). Using a qualitative vignette to explore a complex public health issue. Qualitative Health Research, 25(10), 1395–1409.

14.

Jenkins

Bloor

Fischer

Berney

Neale

(2010). Putting it in context: The use of vignettes in qualitative interviewing. Qualitative Research, 10(2), 175–198.

15.

LaFond

C. M.

Van Hulle Vincent

Lee

Corte

Hershberger

P. E.

Johnson

Park

C. G.

Wilkie

D. J.

(2015). Development and validation of a virtual human vignette to compare nurses’ assessment and intervention choices for pain in critically ill children. Simulation in Healthcare, 10(1), 1–15.

16.

Lanza

M. L.

(1988). Development of a vignette—A data collection instrument about patient assault. Western Journal of Nursing Research, 10(3), 346–351.

17.

Lebet

R. M.

Asaro

L. A.

Zuppa

A. F.

Curley

M. A. Q.

(2018). Face and content validity of variables associated with the difficult-to-sedate child in the paediatric intensive care unit: A survey of paediatric critical care clinicians. Australian Critical Care, 31, 167–173.

18.

Leicher

Mulder

R.H.

(2018). Development of vignettes for learning and professional development. Gerontology & Geriatrics Education, 39(4), 464–480.

19.

Lowcock

Warwick-Booth

Grewal

Underwood

(2017). Using vignettes in qualitative research: Examples from health promotion research. SAGE Research Methods Cases in Health. https://doi.org/10.4135/9781526403711

20.

Lynn

M. R.

(1986). Determination and quantification of content validity. Nursing Research, 35(6), 382–385.

21.

Mayan

M. J.

(2001). An introduction to qualitative methods: A training module for students and professionals. Qual Institute Press, International Institute for Qualitative Methodology.

22.

McCrow

Battie

Sullivan

Fick

D. M.

(2013). Development and review of vignettes representing older people with cognitive impairment. Geriatric Nursing, 34(2), 128–137.

23.

Moll

Zanhour

Patten

Stuart

MacDermid

(2017). Evaluating mental health literacy in the workplace: Development and psychometric properties of a vignette-based tool. Journal of Occupational Rehabilitation, 27(4), 601–611.

24.

Nygren

Oltedal

(2015). Constructing a vignette for qualitative comparative family research. Journal of Comparative Social Work, 10(1), 1–14.

25.

Paddam

Barnes

Langdon

(2010). Constructing vignettes to investigate anger in multiple sclerosis. Nurse Researcher, 17(2), 60–73.

26.

Polit

D. F.

Beck

C. T.

(2006). The content validity index: Are you sure you know what’s being reported? Critique and recommendations. Research in Nursing & Health, 29(5), 489–497.

27.

Randhawa

Jiwa

Oremus

(2015). Identifying the components of clinical vignettes describing Alzheimer’s disease or other dementias: A scoping review. BMC Medical Informatics & Decision Making, 15(1), 1–9.

28.

Rodrigues

I. B.

Adachi

J. D.

Beattie

K. A.

MacDermid

J. C.

(2017). Development and validation of a new tool to measure the facilitators, barriers and preferences to exercise in people with osteoporosis. BMC Musculoskeletal Disorders, 18, 540–549.

29.

Sandelowski

(1995). Qualitative analysis: What it is and how to begin. Research in Nursing & Health, 18(4), 371–375.

30.

Schigelone

A. S.

Fitzgerald

J. T.

(2004). Development and utilization of vignettes in assessing medical students’ support of older and younger patients’ medical decisions. Evaluation Health Professions, 27(3), 265–284.

31.

Stacey

Brière

Robitaille

Fraser

Desroches

Légar

(2014). A systematic process for creating and appraising clinical vignettes to illustrate interprofessional shared decision making. Journal of Interprofessional Care, 28(5), 453–459.

32.

Van Hulle Vincent

Wilkie

D. J.

Wang

. (2011). Pediatric nurses’ beliefs and pain management practices: An intervention pilot. Western Journal of Nursing Research, 33(6), 825–845.

33.

Zamanian

Heydari

(2012). Readability of texts: State of the art. TPLS Theory and Practice in Language Studies, 2(1), 43–53.