Abstract
Purpose:
Over 87,000 adolescents and young adults (AYAs) are diagnosed with cancer in the United States each year. Improvement in outcomes in the AYA population has lagged that of both younger and older patients. This decrement may be attributable to several factors, including insufficient supportive care services. Our team modified the Needs Assessment & Service Bridge (NA-SB) tool, utilizing an iterative approach with patient and clinician stakeholders to meet the needs of the AYA population at a large Midwestern Cancer Center.
Methods:
We recruited a 10-member AYA Advisory Board (AB) from our Cancer Center patients, and met five times over 9 months to discuss supportive care and the NA-SB. We recruited a multidisciplinary group of oncology clinicians to assess content validity and conducted interviews with nine clinician stakeholders to discuss implementation.
Results:
The AB generated a 59-item–modified NA-SB, retaining most of the original NA-SB items and adding several more. Five items with concerns for relevance and/or clarity were revised to create the final 58-item–modified NA-SB. Priorities for implementation were identified by AB and clinician stakeholders.
Conclusions:
The modified NA-SB thoroughly reflects supportive care needs of our Midwestern AYA cancer survivors. When implemented, the tool may facilitate patient-care team communication and provide data to prioritize development of new supportive care resources. AYA cancer survivors have unique supportive care needs that are insufficiently addressed by current care models; using the modified NA-SB may help address those needs, leading to improved AYA outcomes.
Introduction
Approximately 87,050
Cancers diagnosed during this complex developmental period have a profound impact on emotional function, behavioral issues, interpersonal relationships, and social factors during and after active treatment.5,10,11 At the time of diagnosis, AYA life plans are often derailed, adding to the stress of an already serious health situation.12,13 Disruptions in everyday life contribute to psychological distress, and negatively impact cancer care and quality of life.14–17
Over one-third of AYA cancer survivors have experienced at least one unmet service need, including practical support (insurance/financial planning, peer support) and health care needs (physical therapy, mental health services) associated with poorer quality of life.18–20 Oncology practices may lack infrastructure emphasizing assessment of AYA cancer survivors' supportive care needs. A majority of cancer survivors report their psychosocial care needs went unmet because their provider did not discuss them and patients were unaware of available support services. 15 However, these needs are modifiable with psychoeducational interventions, case management, peer support, and other services.21–24
Investigators have begun to address this problem by developing tools to systematically assess AYA cancer survivors' supportive care needs. Clinton-McHarg et al 25 developed and tested psychometric properties of the Cancer Needs Questionnaire-Young People (CNQ-YP), designed to capture unmet physical, psychological, and social needs of AYA cancer survivors. Haines et al 26 refined the CNQ-YP through an iterative user-centered design process. A key feature of the resulting Needs Assessment & Service Bridge (NA-SB) is the organization of items within categories that map to clinical resources. 26
While Haines et al 26 described the development of NA-SB, no further evaluations of the tool have been published. Evaluation in different settings is necessary since NA-SB was designed at an National Cancer Institute (NCI)-designated comprehensive cancer center with a well-established AYA oncology program, which is present in only half of NCI-designated cancer centers. 27 Further, resources available to AYA cancer survivors likely differ geographically, including distance from oncology providers. Regional variation in cancer care across the United States is common in adult age groups and likely impacts AYAs.28–30
We endeavored to obtain Midwest U.S. patient and clinician stakeholders' recommendations regarding how best to revise and administer NA-SB at our center. We intentionally included rural cancer survivors as well as AYAs on active treatment to address prior under-representation of these populations.25,26 Our aims were to incorporate AYA cancer survivors' modifications of NA-SB, analyze the content validity of the modified NA-SB with clinicians, and identify considerations for NA-SB implementation.
Phase 1: AYA Stakeholder Assessment and Recommendations
Methods
This project was reviewed and approved by the Health Sciences Institutional Review Board at the University of Wisconsin-Madison, and met criteria for exempt human subjects research (study No. 2021-0436).
Design, setting, and sample
We used a stakeholder focus group design and an iterative process centered on perceptions of NA-SB and recommendations for its modification and implementation. A 10-member AYA Advisory Board (AB) was recruited from patients seen at a Midwestern NCI-designated Comprehensive Cancer Center who responded to a supportive care needs assessment survey. Survey participants were adults (19–39 years old) who had been diagnosed with cancer between the ages of 15 and 39 years.
To be eligible for the AB, participants had to speak English, have an internet-connected device, and agree to participate in secure virtual group meetings. Recruitment focused on AYAs diagnosed with either breast cancer or sarcoma. We included both a more prevalent AYA diagnosis (breast cancer) and a less common diagnosis known to be associated with high supportive care needs31,32 (sarcoma) to incorporate a broad spectrum of lived patient experiences.
Purposive sampling was used to select a diverse AB, aiming for representation of ∼40% patients with sarcomas, 25% males, 40% non-White, 50% on active treatment, and 25% rural residents. The study's project manager reviewed a study information sheet explaining consent details with all potential participants. The original intention was to have 12 AB members but due to difficulty confirming two participants, the final AB was convened with 10 members. Consent was implied by participating in the AB meetings.
Procedure
A series of four 90-minute AB meetings were held over consecutive months through secure videoconferencing. Each meeting was led by the primary investigator (PI) and a trained group facilitator following an agenda and facilitator's guide. AB meetings were designed to maximize member participation through keeping cameras on and using tools including visual thumbs up/down voting, embedded polls, collaborative digital whiteboards, and directly calling on all participants. AYA AB members received a US$75 gift card after each meeting.
Data collection
Throughout AB meetings, our team focused on understanding if existing NA-SB content was appropriate and inclusive of all AYA cancer patient needs and how items could be redesigned. Specific goals of each meeting are detailed in Table 1.
Goals of Each Advisory Board Meeting
AYA, adolescent and young adult; CVI, content validity index; NA-SB, Needs Assessment & Service Bridge.
Analyses
AB meetings were audiorecorded, transcribed verbatim, and transcripts were analyzed using directed content analysis. 33 Concurrent with AB meetings, two team members (C.L.-M. and K.E.M.) independently read and coded each transcript. A deductive approach was used in categorizing NA-SB item content. An inductive approach was used for all other transcript content. The researchers developed initial codes after the first AB meeting and revised them for analysis of subsequent meeting transcripts through an iterative process.
Results
A total of 10 AYA cancer survivors participated in AB meetings (Table 2).
Characteristics of Adolescent and Young Adult and Clinician Stakeholders
NP, Nurse Practitioner; PA, Physician Assistant.
Recruitment targets were met for all variables except race and patients actively receiving therapy. In meeting 1, AB members generated a list of 37 unique supportive care needs. At meeting 2, AB members used a collaborative whiteboard to map those needs to the nine existing NA-SB resource categories and create a list of needs that crossed multiple categories (Supplementary Fig. S1). AB members clarified and added new supportive care needs, resulting in a total of 44 unique needs.
At meeting 3, AB members discussed implementation of NA-SB in the clinical setting. They desired flexibility around where the assessment is completed (e.g., at home or in clinic). They recommended the initial assessment be completed with a clinician present to help explain items. AB members noted the timing of administration should maximize clinicians' detection of their evolving needs without being burdensome to the patient, occur both during and after treatment, align with changes in treatment and pivotal events (e.g., disease recurrence, transition between clinics), and consider patient preference for assessment intervals whenever possible. AB members wanted the tool to be available digitally, integrated within the electronic medical record (EMR).
Further, AB members wanted all supportive care needs to be assessed, even if few or no related resources were known. They wanted to make their health care teams aware of their needs to improve communication and increase future identification of resources.
At meeting 4, AB members voted to retain 51 of the original NA-SB items, reword 4 of the original items, and add 18 new items. Items were largely retained within original NA-SB categories. AB members endorsed introductory text for NA-SB, explaining the purpose of the assessment and the option to skip items by marking “Not applicable” for an entire category. During the course of this project, Haines et al. [personal communication] revised NA-SB response options, indicating “I want more help/information about this concern,” “I have enough help with/information about this concern,” or “Not applicable.” AB members expressed a preference for these updated response options.
Finally, AB members endorsed revising the order of supportive care needs categories presented on the tool. Based on their input, a 59-item–modified NA-SB (version 1) was created for further stakeholder evaluation (Supplementary Fig. S2).
Phase 2: Clinician Stakeholder Evaluation
Methods
Design, setting, and sample
A mixed-methods approach was used to obtain evaluations from an expert panel of clinician stakeholders, including a content validity survey and interviews about NA-SB implementation. Oncology professionals were recruited from the same Midwest NCI-designated Comprehensive Cancer Center as the AYA AB. We sought a minimum of 12 experts involved in the direct care or supervision of care for AYA patients across multiple disciplines. All potential participants received a study information sheet explaining consent details. Consent was implied by completing the survey and participating in an interview.
Procedure
Clinicians were invited to participate in a content validity index (CVI) survey of the modified NA-SB (version 1). Clinicians rated the relevance and clarity of each NA-SB item using a 4-point scale (relevance: 1—not relevant, 2—somewhat relevant, 3—quite relevant, 4—highly relevant; clarity: 1—not clear, 2—somewhat clear, 3—quite clear, 4—highly clear), and provided comments about irrelevant or unclear items. Clinicians were also asked to indicate knowledge of existing resources for each need (yes, no, unsure).
Upon completion of the CVI, clinicians indicated willingness to participate in a 60-minute interview about NA-SB implementation in clinical practice. We targeted 10 clinician stakeholder interviews representing diverse disciplines. Investigators developed a semi-structured interview guide from AYA AB members' ideas around implementation, including questions about the utility of the modified NA-SB and considerations for use of the tool in practice. The project manager conducted individual clinician interviews. Participants received a US$75 gift card for their effort.
Analyses
Survey data were analyzed using Polit's CVI approach. 34 The item-level CVI (I-CVI) was computed as the proportion of “quite relevant” or “highly relevant” responses for each item. Item clarity was computed as the average of clarity ratings. The research team established a priori decision rules for relevance and clarity scores. An item was retained if its I-CVI was ≥70%. The research team discussed items with an I-CVI of 21% to 69% and a consensus decision was made to retain, revise or drop the item. Items with I-CVI of ≤20% were deleted. Items with a clarity index of ≤3 were revised to improve clarity. Descriptive statistics (n, %) were computed to summarize clinicians' knowledge of resources for each supportive care need.
Interviews were recorded, transcribed verbatim, and analyzed using thematic analysis. 35 Using NVivo version 2020 (QSR International), investigators (C.L.-M. and K.E.M.) independently read and coded transcripts and created initial themes and sub-themes. All members of the research team reviewed and provided input on themes and resolved coding disagreements. To ensure credibility of qualitative findings, coding was conducted using a systematic approach.
Coders and study team members represented different oncology disciplines, facilitating researcher triangulation with data analysis and interpretation. To support confirmability, each member involved in coding data documented a memo for each transcript, facilitating bracketing of previous experiences and biases. To support dependability, documents detailing each step were maintained in a web-based platform.
Results
Content validity survey
A total of 23 AYA clinical experts completed the survey (Table 2). A summary of item clarity and relevance scores is provided in Table 3. One item fell below the 70% relevance threshold, and two additional items were noted as borderline (<80%). All items achieved an average clarity score of 3; however, three items were identified as having borderline clarity scores (including the single item with poor relevance). These five items were marked for further discussion with the AYA AB.
Clinician Ratings of Item Relevance and Clarity of Modified Needs Assessment & Service Bridge, Version 1 (N = 23)
One clinician survey had sporadic missing responses, resulting in a variable denominator of 22 or 23. Item 10 was subsequently revised to read, How to connect with and support other people in my age group with cancer; Item 30 was subsequently revised to read, Talking to me about changes in my treatment, both planned and unplanned.
Clinicians' knowledge of existing supportive care resources varied, ranging from 20% to 95% for each item. The greatest proportion of clinicians identified supportive care resources for feeling depressed, anxious, worried, scared, or helpless (95%), managing treatment side effects (78%–80%), and nutrition (78%). Few clinicians were aware of resources for childcare during cancer appointments (20%), taking part in social activities (22%), or talking about moving from pediatric to adult cancer care (24%). Encouragingly, resources were identifiable by at least one clinician for each NA-SB item.
Clinician stakeholder interviews
Nine clinicians (Table 2) were interviewed, including three physicians, two advanced practice nurses, two social workers, a psychologist, and an administrator. Qualitative analyses yielded 25 codes and 3 themes; see Table 4 for detailed descriptions of themes and exemplar quotations. Clinicians shared their perspectives highlighting tension between current clinical limitations and a future state workflow to support NA-SB implementation. They agreed that a comprehensive needs assessment is important to provide adequate care for AYA oncology patients while expressing concerns about the practicality of implementation, including how to create a system to meet the needs of patients built on shared accountability.
Qualitative Findings from Clinician Stakeholder Interviews (N = 9)
Phase 3: AYA Advisory Board Endorsement
After clinician data were collected, the AYA AB was reconvened to review and edit the five items with low relevance and/or clarity ratings. AB members then endorsed a final 58-item–modified NA-SB (version 2) (Supplementary Fig. S3).
Discussion
Midwestern AYA cancer survivors endorsed most of the original NA-SB items and identified new supportive care needs. Several new NA-SB items may reflect unique challenges faced by rural AYA cancer survivors and those currently on treatment. For example, AB members identified problems finding support for living in their (rural) area with cancer, and the ability to travel to visit friends and family. Our AB members highlighted concerns about transitioning from pediatric to adult cancer care, which may be a greater challenge for those treated at centers without a formal AYA program.
In addition, our AB members strongly endorsed including an item addressing AYAs' ability to communicate with and support each other, perhaps reflecting a lack of institutional peer support. New and revised NA-SB items largely demonstrated good content validity. Only a single item generated by our AYA AB had a lower than desired I-CVI requiring modification.
Clinicians' awareness of supportive care resources was mixed. While some resources may be built into cancer care services or EMR-integrated referral systems across age groups, clinicians may be unaware of resources for concerns uniquely experienced by AYAs, such as transitions from pediatric to adult care.
Of the 24 supportive care needs for which less than half of the clinician sample knew of existing resources, 13 (54%) represented new or revised items developed by our AB members for the modified NA-SB. This finding demonstrates that AYA cancer survivors experience varied supportive care needs, which may differ from those clinicians commonly anticipate. Variability in knowledge of existing resources emphasizes the need for clinician education.
Implementation of supportive care needs assessment is an ongoing challenge. With respect to structure and administration of the NA-SB, AYA cancer survivors prioritized flexibility over uniformity, reflecting on their broad range of supportive care needs across the survivorship trajectory. AB members wanted options for when, where, and how the assessment was completed, as well as the ability to skip needs categories not currently relevant to them. One point of consistency was the importance of having a clinician available to clarify items and answer questions during the initial NA-SB assessment.
Clinician stakeholders similarly addressed flexibility in implementation. They valued assessment throughout the course of treatment but struggled to endorse a standard approach that would fit current practice models and work across clinical settings. Despite a lack of consensus on specific workflows, there was agreement that the implementation process requires accountability. Clinicians suggested leveraging EMR systems to ensure the assessment was completed and reviewed, with appropriate referrals provided.
Communication outlining who is accountable for follow-up is necessary to promote trust in the assessment. Themes in clinicians' comments about ensuring accountability resonate with a major design goal of the original NA-SB: to directly map resources to each supportive care need. Implementing NA-SB may serve two related and synergistic purposes: to identify and address needs of AYA patients and to gather data about needs of the AYA population served and the institution's capacity to meet those needs. Even in cancer treatment centers with dedicated AYA programs, substantive barriers to implementation of specialized AYA care have been described. 36
To our knowledge, this is the first project to modify NA-SB for a clinical setting outside of where it was originally developed. A primary strength of this project was eliciting both AYA survivor and clinician stakeholder perspectives. Further, the iterative approach allowed for identification and refinement of supportive care needs items. The AB drew upon both their personal experiences and knowledge of other AYA oncology patients, creating an extensive list of supportive care needs and remained engaged across several months of meetings, allowing critical reflection on and discussion of a variety of opinions and experiences.
Another strength was the diverse group of clinician stakeholders, including representation from various health professions, direct care providers and administrators, in pediatric and adult oncology, incorporating multiple viewpoints. Moreover, the experts constituted a large panel for the purposes of evaluating content validity. 34
Study limitations
Although the AYA AB represented a large swath of our Midwestern patient population, we did not meet inclusion targets for non-White AYA cancer survivors, nor those receiving active therapy, despite attempts to include patients from these demographic categories. Arguably, people with the most difficulty coordinating participation on the AB may be those facing the greatest challenges.
Future research is necessary to understand barriers that prevented non-White AYA cancer survivors from participating on the AB, and if/how they relate to cancer survivorship. All AYA AB members were diagnosed with either sarcoma or breast cancer, and although these two patient populations represent common AYA tumors, we may have heard differing perspectives had we included patients with other types of tumors. We did not repeat the clinician CVI to evaluate items on the final modified NA-SB, nor did we establish scale CVI.
Clinical implications
Cancer survivorship is a complex and highly variable experience for AYAs. Through AYA and clinician stakeholder engagement, we modified NA-SB to meet the needs of our patient population while gaining insight about implementing this tool in clinical practice. Clinical leaders should engage AYA and clinician stakeholders to design sustainable workflows that adequately capture the range of AYA needs and promote cross-continuum accountability to ensure needs are met.
Further, centers should match personnel and resources with implementation workflows and anticipated AYA needs. Other centers, whether they have an AYA oncology program or not, can learn from this experience how best to meet the needs of their AYA patients, contributing to improved psychosocial well-being and survival.
Footnotes
Acknowledgments
The authors thank the members of our Adolescent and Young Adult Advisory Board for their time, dedication, and thoughtfulness throughout this process, representing a diverse array of cancer survivors at all stages of their personal journeys. They acknowledge the tremendous contributions of Project Manager Diana Gutierrez-Meza as well as Susan Tierney, LCSW.
Authors' Contributions
All authors contributed to the study conception and design. Material preparation, data collection and analysis were performed by C.L.-M. and K.E.M. The first draft of the article was written by C.L.-M., K.E.M., and K.K., and all authors commented on previous versions of the article. All authors read and approved the final article.
Author Disclosure Statement
The authors have no relevant financial or nonfinancial interests to disclose.
Funding Information
This project was supported by a Clinical & Community Outcomes Research Award, cosponsored by the University of Wisconsin-Madison Institute for Clinical and Translational Research (National Institutes of Health Clinical and Translational Science Awards grant number 1UL1TR002373) and the Wisconsin Partnership Program. The project was cofunded by the University of Wisconsin Carbone Cancer Center (P30CA014520).
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
