Checking IN : Development,Acceptability,and Feasibility of a Pediatric Electronic Distress Screener

Abstract

Objective:

Chronic illness in children and adolescents is associated with significant stress and risk of psychosocial problems. In busy pediatric clinics, limited time and resources are significant barriers to providing mental health assessment for every child. A brief, real-time self-report measure of psychosocial problems is needed.

Methods:

An electronic distress screening tool, Checking IN, for ages 8–21 was developed in three phases. Phase I used semistructured cognitive interviews (N = 47) to test the wording of items assessing emotional, physical, social, practical, and spiritual concerns of pediatric patients. Findings informed the development of the final measure and an electronic platform (Phase II). Phase III used semistructured interviews (N = 134) to assess child, caregiver and researcher perception of the feasibility, acceptability, and barriers of administering Checking IN in the outpatient setting at four sites.

Results:

Most patients and caregivers rated Checking IN as “easy” or “very easy” to complete, “feasible” or “somewhat feasible,” and the time to complete the measure as acceptable. Most providers (n = 68) reported Checking IN elicited clinically useful and novel information. Fifty-four percent changed care for their patient based on the results.

Conclusions:

Checking IN is a versatile and brief distress screener that is acceptable to youth with chronic illness and feasible to administer. The summary report provides immediate clinically meaningful data. Electronic tools like Checking IN can capture a child’s current psychosocial wellbeing in a standardized, consistent, and useful way, while allowing for the automation of triaging referrals and psychosocial documentation during outpatient visits.

Implications for Impact Statement

Manifestations of psychosocial distress may be missed by health care providers in the outpatient setting and opportunities for referrals lost. A multiphase study guided the development of Checking IN, a brief and interactive electronic screening measure designed to identify concerns common to pediatric patients. Checking IN was found to be feasible, acceptable, and clinically meaningful and has the potential to identify distress in children receiving treatment for a chronic condition, enhance communication with the treatment team, and lead to better clinical outcomes.

Get full access to this article

View all access options for this article.

References

Anderson

L. M.

Papadakis

J. L.

Vesco

A. T.

Shapiro

J. B.

Feldman

M. A.

Evans

M. A.

, & Weissberg-Benchell

(2020). Patient-reported and parent proxy-reported outcomes in pediatric medical specialty clinical settings: A systematic review of implementation. Journal of Pediatric Psychology, 45(3), 247–265. 10.1093/jpepsy/jsz082

Barrera

Alexander

Shama

Mills

Desjardins

, & Hancock

(2018). Perceived benefits of and barriers to psychosocial risk screening in pediatric oncology by health care providers. Pediatric Blood & Cancer, 65(12), Article e27429. 10.1002/pbc.27429

Bradford

N. K.

Bowers

Chan

R. J.

Walker

Herbert

Cashion

Condon

, & Yates

(2021). Documentation of symptoms in children newly diagnosed with cancer highlights the need for routine assessment using self-report. Cancer Nursing, 44(6), 443–452. 10.1097/NCC.0000000000000849

Compas

B. E.

Jaser

S. S.

Dunn

M. J.

, & Rodriguez

E. M.

(2012). Coping with chronic illness in childhood and adolescence. Annual Review of Clinical Psychology, 8(1), 455–480. 10.1146/annurev-clinpsy-032511-143108

Deighton

Croudace

Fonagy

Brown

Patalay

, & Wolpert

(2014). Measuring mental health and wellbeing outcomes for children and adolescents to inform practice and policy: A review of child self-report measures. Child and Adolescent Psychiatry and Mental Health, 8(1), Article 14. 10.1186/1753-2000-8-14

De Los Reyes

, & Kazdin

A. E.

(2005). Informant discrepancies in the assessment of childhood psychopathology: A critical review, theoretical framework, and recommendations for further study. Psychological Bulletin, 131(4), 483–509. 10.1037/0033-2909.131.4.483

Gilleland Marchak

Halpin

S. N.

Escoffery

Owolabi

Mertens

A. C.

, & Wasilewski-Masker

(2021). Using formative evaluation to plan for electronic psychosocial screening in pediatric oncology. Psycho-Oncology, 30(2), 202–211. 10.1002/pon.5550

Horowitz

L. M.

Wharff

E. A.

Mournet

A. M.

Ross

A. M.

McBee-Strayer

J. P.

Lanzillo

E. C.

White

Bergdoll

Powell

D. S.

Solages

Merikangas

K. R.

Pao

, & Bridge

J. A.

(2020). Validation and feasibility of the ASQ among pediatric medical and surgical inpatients. Hospital Pediatrics, 10(9), 750–757. 10.1542/hpeds.2020-0087

Huang

I. C.

Revicki

D. A.

, & Schwartz

C. E.

(2014). Measuring pediatric patient-reported outcomes: Good progress but a long way to go. Quality of Life Research, 23(3), 747–750. 10.1007/s11136-013-0607-2

10.

Jibb

L. A.

Nathan

P. C.

Stevens

B. J.

Seto

Cafazzo

J. A.

Stephens

Yohannes

, & Stinson

J. N.

(2015). Psychological and physical interventions for the management of cancer-related pain in pediatric and young adult patients: An integrative review. Oncology Nursing Forum, 42(6), E339–E357. 10.1188/15.ONF.E339-E357

11.

Kazak

A. E.

Abrams

A. N.

Banks

Christofferson

DiDonato

Grootenhuis

M. A.

Kabour

Madan-Swain

Patel

S. K.

Zadeh

, & Kupst

M. J.

(2015). Psychosocial assessment as a standard of care in pediatric cancer. Pediatric Blood & Cancer, 62(S5), S426–S459. 10.1002/pbc.25730

12.

Kazak

A. E.

Barakat

L. P.

Askins

M. A.

McCafferty

Lattomus

Ruppe

, & Deatrick

(2017). Provider perspectives on the implementation of psychosocial risk screening in pediatric cancer. Journal of Pediatric Psychology, 42(6), 700–710. 10.1093/jpepsy/jsw110

13.

Kazak

A. E.

Hwang

W. T.

Chen

F. F.

Askins

M. A.

Carlson

Argueta-Ortiz

, & Barakat

L. P.

(2018). Screening for family psychosocial risk in pediatric cancer: Validation of the Psychosocial Assessment Tool (PAT) version 3. Journal of Pediatric Psychology, 43(7), 737–748. 10.1093/jpepsy/jsy012

14.

Kovacs

(1981). Rating scales to assess depression in school-aged children. Acta Paedopsychiatrica, 46(5–6), 305–315. https://www.ncbi.nlm.nih.gov/pubmed/7025571

15.

Lai

J. S.

Beaumont

J. L.

Kupst

M. J.

Peipert

J. D.

Cella

Fisher

A. P.

, & Goldman

(2020). Symptom burden trajectories experienced by patients with brain tumors. Cancer, 126(14), 3341–3351. 10.1002/cncr.32879

16.

Lai

J. S.

Cella

Kupst

M. J.

Holm

Kelly

M. E.

Bode

R. K.

, & Goldman

(2007). Measuring fatigue for children with cancer: Development and validation of the pediatric Functional Assessment of Chronic Illness Therapy-Fatigue (pedsFACIT-F). Journal of Pediatric Hematology/Oncology, 29(7), 471–479. 10.1097/MPH.0b013e318095057a

17.

Leahy

A. B.

, & Steineck

(2020). Patient-reported outcomes in pediatric oncology: The patient voice as a gold standard. JAMA Pediatrics, 174(11), Article e202868. 10.1001/jamapediatrics.2020.2868

18.

Leahy

A. B.

Schwartz

L. A.

Reeve

B. B.

Bekelman

J. E.

Aplenc

, & Basch

E. M.

(2021). Electronic symptom monitoring in pediatric patients hospitalized for chemotherapy. Cancer, 127(16), 2980–2989. 10.1002/cncr.33617

19.

Lovibond

P. F.

, & Lovibond

S. H.

(1995). The structure of negative emotional states: Comparison of the Depression Anxiety Stress Scales (DASS) with the Beck Depression and Anxiety Inventories. Behaviour Research and Therapy, 33(3), 335–343. 10.1016/0005-7967(94)00075-U

20.

Mack

J. W.

McFatrich

Withycombe

J. S.

Maurer

S. H.

Jacobs

S. S.

Lin

Lucas

N. R.

Baker

J. N.

Mann

C. M.

Sung

Tomlinson

Hinds

P. S.

, & Reeve

B. B.

(2020). Agreement between child self-report and caregiver-proxy report for symptoms and functioning of children undergoing cancer treatment. JAMA Pediatrics, 174(11), Article e202861. 10.1001/jamapediatrics.2020.2861

21.

Martin

S. R.

Zeltzer

L. K.

Seidman

L. C.

Allyn

K. E.

, & Payne

L. A.

(2020). Caregiver-child discrepancies in reports of child emotional symptoms in pediatric chronic pain. Journal of Pediatric Psychology, 45(4), 359–369. 10.1093/jpepsy/jsz098

22.

McCarthy

M. C.

Wakefield

C. E.

DeGraves

Bowden

Eyles

, & Williams

L. K.

(2016). Feasibility of clinical psychosocial screening in pediatric oncology: Implementing the PAT2.0. Journal of Psychosocial Oncology, 34(5), 363–375. 10.1080/07347332.2016.1210273

23.

Muris

Simon

Lijphart

Bos

Hale

III Schmeitz

, & The International Child and Adolescent Anxiety Assessment Expert Group (ICAAAEG) . (2017). The Youth Anxiety Measure for DSM-5 (YAM-5): Development and first psychometric evidence of a new scale for assessing anxiety disorders symptoms of children and adolescents. Child Psychiatry and Human Development, 48(1), 1–17. 10.1007/s10578-016-0648-1

24.

Nijhof

L. N.

van Brussel

Pots

E. M.

van Litsenburg

R. R. L.

van de Putte

E. M.

van Montfrans

J. M.

, & Nijhof

S. L.

(2021). Severe fatigue is common among pediatric patients with primary immunodeficiency and is not related to disease activity. Journal of Clinical Immunology, 41(6), 1198–1207. 10.1007/s10875-021-01013-7

25.

Ownby

K. K.

(2019). Use of the distress thermometer in clinical practice. Journal of the Advanced Practitioner in Oncology, 10(2), 175–179. https://www.ncbi.nlm.nih.gov/pubmed/31538028

26.

Sansom-Daly

U. M.

, & Wakefield

C. E.

(2013). Distress and adjustment among adolescents and young adults with cancer: An empirical and conceptual review. Translational Pediatrics, 2(4), 167–197. 10.3978/j.issn.2224-4336.2013.10.06

27.

Saunders

Sim

Kingstone

Baker

Waterfield

Bartlam

Burroughs

, & Jinks

(2018). Saturation in qualitative research: Exploring its conceptualization and operationalization. Quality & Quantity, 52(4), 1893–1907. 10.1007/s11135-017-0574-8

28.

Schepers

S. A.

Sint Nicolaas

S. M.

Haverman

Wensing

Schouten van Meeteren

A. Y. N.

Veening

M. A.

Caron

H. N.

Hoogerbrugge

P. M.

Kaspers

G. J. L.

Verhaak

C. M.

, & Grootenhuis

M. A.

(2017). Real-world implementation of electronic patient-reported outcomes in outpatient pediatric cancer care. Psycho-Oncology, 26(7), 951–959. 10.1002/pon.4242

29.

Sheffler

L. C.

Hanley

Bagley

Molitor

, & James

M. A.

(2009). Comparison of self-reports and parent proxy-reports of function and quality of life of children with below-the-elbow deficiency. The Journal of Bone and Joint Surgery. American Volume, 91(12), 2852–2859. 10.2106/JBJS.H.01108

30.

Simons

L. E.

Sieberg

C. B.

Conroy

Randall

E. T.

Shulman

Borsook

Berde

Sethna

N. F.

, & Logan

D. E.

(2018). Children with chronic pain: Response trajectories after intensive pain rehabilitation treatment. The Journal of Pain, 19(2), 207–218. 10.1016/j.jpain.2017.10.005

31.

Takeuchi

E. E.

Keding

Awad

Hofmann

Campbell

L. J.

Selby

P. J.

Brown

J. M.

, & Velikova

(2011). Impact of patient-reported outcomes in oncology: A longitudinal analysis of patient-physician communication. Journal of Clinical Oncology, 29(21), 2910–2917. 10.1200/JCO.2010.32.2453

32.

Theunissen

N. C.

Vogels

T. G.

Koopman

H. M.

Verrips

G. H.

Zwinderman

K. A.

Verloove-Vanhorick

S. P.

, & Wit

J. M.

(1998). The proxy problem: Child report versus parent report in health-related quality of life research. Quality of Life Research, 7(5), 387–397. 10.1023/A:1008801802877

33.

Varni

J. W.

Seid

, & Rode

C. A.

(1999). The PedsQL: Measurement model for the pediatric quality of life inventory. Medical Care, 37(2), 126–139. 10.1097/00005650-199902000-00003

34.

Varni

J. W.

Thissen

Stucky

B. D.

Liu

Magnus

DeWitt

E. M.

Irwin

D. E.

Lai

J. S.

Amtmann

, & DeWalt

D. A.

(2015). Item-level informant discrepancies between children and their parents on the PROMIS(®) pediatric scales. Quality of Life Research, 24(8), 1921–1937. 10.1007/s11136-014-0914-2

35.

Wakefield

C. E.

McLoone

Goodenough

Lenthen

Cairns

D. R.

, & Cohn

R. J.

(2010). The psychosocial impact of completing childhood cancer treatment: A systematic review of the literature. Journal of Pediatric Psychology, 35(3), 262–274. 10.1093/jpepsy/jsp056

36.

Weaver

M. S.

, & Wiener

(2021). Symptom screening via screen: Real-time electronic tracking of pediatric patient-reported outcomes. Cancer, 127(16), 2877–2879. 10.1002/cncr.33614

37.

Wiener

Baird

Crum

Powers

Carpenter

Baker

K. S.

MacMillan

M. L.

Nemecek

Lai

J. S.

Mitchell

S. A.

, & Jacobsohn

D. A.

(2014). Child and parent perspectives of the chronic graft-versus-host disease (cGVHD) symptom experience: A concept elicitation study. Supportive Care in Cancer, 22(2), 295–305. 10.1007/s00520-013-1957-6

38.

Wiener

Battles

Zadeh

Widemann

B. C.

, & Pao

(2017). Validity, specificity, feasibility and acceptability of a brief pediatric distress thermometer in outpatient clinics. Psycho-Oncology, 26(4), 461–468. 10.1002/pon.4038

39.

Willis

(2010). Cognitive interviewing: A tool for improving questionnaire design. Sage.

40.

Wolfe

Orellana

Cook

E. F.

Ullrich

Kang

Geyer

J. R.

Feudtner

Weeks

J. C.

, & Dussel

(2014). Improving the care of children with advanced cancer by using an electronic patient-reported feedback intervention: Results from the PediQUEST randomized controlled trial. Journal of Clinical Oncology, 32(11), 1119–1126. 10.1200/JCO.2013.51.5981