Abstract
Purpose:
Reasons for the relatively low rates of adolescent and young adults (AYA) enrollment in cancer clinical trials in the United States require further empirical examination. In addition to structural factors such as lack of access and insurance barriers, attitudes toward clinical trials may be important to consider. This study aimed to evaluate and validate the Pediatric Research Participation Questionnaire (PRPQ)—a measure of attitudes to clinical trials adapted for AYA (15–29) with cancer and their caregivers.
Methods:
One hundred twenty-four AYA and 94 caregivers completed the PRPQ-AYA and measures of clinical trial knowledge and developmental/emotional maturity. Factor analysis evaluated the PRPQ-AYA structure, interitem reliability was computed, and Pearson correlations examined associations of validation measures with factor scores and computed scores reflecting perceived barriers, perceived benefits, and decision balance.
Results:
Confirmatory factor analysis did not confirm the prior PRPQ factor structure. Exploratory factor analysis suggested a new four-factor structure for: AYA (1) trust/mistrust, (2) barriers/costs, (3) support for participation, and (4) incentives; and caregivers (1) trust/access, (2) mistrust/costs, (3) support for participation, and (4) risks to AYA. Factor scores and barriers, benefits, and decision balance scores demonstrated acceptable interitem reliability and were significantly correlated with clinical trial knowledge and emotional maturity in the expected direction.
Conclusion:
PRPQ-AYA factor structure for AYA and caregivers varied and should be interpreted cautiously due to limited power. Simple solutions of perceived benefits, perceived barriers, and decision balance were reliable and valid and provide important information to address and engage AYA through the clinical trial informed consent process.
Introduction
Survival of adolescent and young adults (AYA) with a history of cancer is low relative to older and younger populations1,2 due, in part, to reduced participation in therapeutic clinical trials.3–6 The AYA Committee of Children's Oncology Group has designated lack of clinical trial enrollment as a priority area for research initiatives. 2 Few empirical studies have addressed this issue, 7 but the limited literature and expert opinion outline factors that may influence enrollment, including limited access to trials for AYA, limited acceptability of available trials, and lack of fit between open trials and the needs of AYA.7,8 Effective communication about cancer clinical trials among AYA, primary caregivers, and health care providers may increase AYA understanding of their illness and implications of treatment choices for health-related quality of life and their involvement in treatment.9,10 Furthermore, decision-making abilities of AYA and adults may be similar when AYA are well-informed and treatment options are framed from an appropriate cognitive/developmental perspective.11–14 In this study, we evaluate a measure for assessing AYA and caregiver attitudes to cancer clinical trials for utilization by health care providers to inform efforts to enhance AYA engagement in the clinical trial decision-making process. 15
The medical community encourages, and AYA and their primary caregivers value, inclusion of pediatric patients in treatment decision-making.16,17 However, cancer and its treatment significantly affect and often delay achievement of development milestones, 18 resulting in increased or renewed reliance of AYA on family for support and reduced well-being.14,19,20 The process of AYA taking primary responsibility for treatment decision-making is gradual, and parents frequently remain involved through their child's young adulthood.17–19 Complicating efforts to engage AYA in clinical trial decision-making, physicians generally perceive younger AYA as not capable of meaningful participation in cancer clinical trial discussions,14,21 and recently diagnosed AYA often endorse the belief that decisions are best left to their medical team. 22 Yet, parent–child collaboration in clinical trial decision-making is consistent with positive family relationships and AYA emotional maturity, and AYA who are involved in decisions may be more engaged throughout treatment. 23
A limited literature connects attitudes toward clinical trials to decision-making processes. Caregivers are not satisfied with the cancer clinical trial consent process, finding the decision difficult to make and they have insufficient time to ask questions or consider options.24,25 Deficiencies in understanding are prevalent among parents who agree to enroll their child on a cancer clinical trial,24,26 and adolescent decision-makers need help distinguishing cancer clinical trials from standard treatment.27–29 AYA with cancer note additional barriers to enrollment (e.g., lack of family support, fear of toxicity, lack of concordance with their values, and a preference for standard therapy).7,30,31 However, AYA also endorse benefits of clinical trial participation such as helping themselves and others.32,33
Our own qualitative research evaluating Phase III clinical trial decision-making experiences confirms these findings. 15 AYA perceived that they had no role or a minor role in clinical trial enrollment decisions. They conveyed a sense of resignation for relying on their caregivers for decision-making. In contrast, caregivers viewed decision-making as, at least in part, the responsibility of AYA while acknowledging caregivers' primary role in the final decision. Health care providers felt challenged to maintain the attention of AYA, provide balanced information and minimize coercion, and respond to preexisting developmental issues and family structure during the informed consent meeting.
This study evaluates the validity of the Pediatric Research Participation Questionnaire (PRPQ)-AYA, a modification of the PRPQ 34 with a reduced item pool specific to attitudes to cancer clinical trials, to identify areas for improved decision-making processes for AYA with cancer and their caregivers. 15 Using factor analyses, 35 we anticipated that the factor structure of the PRPQ-AYA 14 would be similar to, and confirm, the factor structure for the initial PRPQ developed for youth with health disparity conditions (sickle cell disease and asthma). 34 Furthermore, related to construct validity, we expected that cancer clinical trial knowledge, age/developmental status, and emotional maturity would be associated with PRPQ-AYA subscales based on the factor structure and summary scores reflecting perceived benefits, perceived barriers, and decision balance, which were also expected to demonstrate interitem reliability. Together with decision support interventions, 36 if validated, the PRPQ-AYA can serve as an important tool to systematically assess attitudes to engage AYA in cancer clinical trial decision-making.
Methods
Participants and procedures
Participants were AYA with a history of cancer and their caregivers identified through cancer registries and recruited from the Children's Hospital of Philadelphia and the Hospital of the University of Pennsylvania (see Fig. 1 for CONSORT diagram for AYA). AYA were 15–29 years old, diagnosed with cancer at age 15 or older, and not in palliative care. AYA could be on active treatment or have completed treatment. Caregivers were the parents/legal guardians of consented AYA. Caregivers and AYA were excluded if they were not literate in English. Of AYA, 221 were approached for participation, 187 (85%) consented, and 124 (66%) completed the study. The most cited reason for declining to participate was “not interested” (82%), and reasons for not completing the questionnaire includes “lost to follow-up/unable to recontact” (89%). For caregivers, 136 were approached for participation, 127 (93%) consented, and 94 (74%) completed the study. Of the 94 caregivers, 67 had participating AYA. The most cited reasons for declining was too busy (44%) and not interested (33%). Subsequent to IRB approval, potential participants were approached by telephone or during outpatient oncology appointments. Following consent/assent procedures, AYA and caregivers completed separate questionnaires using a secure, web-based survey system (REDCap) and received a $25 gift card (AYA) or a $10 gift card (caregivers).

CONSORT diagram: Adolescent and young adults.
Measures
PRPQ-AYA,15,34 a modification of the PRPQ, assesses perceived barriers and benefits of cancer clinical trial participation at the patient, family, health care system, community, and societal levels based on social ecology. The original PRPQ was developed for youth with health disparity conditions (sickle cell disease and asthma) and their caregivers with input from local sickle cell and public health community agencies and medical experts. This measure was composed of 38 questions focused on medical and psychosocial research using True/False response options. It was field-tested before validation. Exploratory factor analysis of the identified four-factor structures for caregivers (N = 224) (direct benefit; mistrust of research/researchers; trust in safety of research; opportunity/cost) and for AYA (N = 76) (mistrust/no perceived benefit; safety; direct benefits/practical considerations; social support for research participation); factor analysis of the child version was not evaluable. 34
To modify the PRPQ 34 for AYA with cancer and their caregivers, using qualitative methods, we assessed AYA, caregiver, and provider interpretation of PRPQ questions, perceived relevance of questions to their cancer clinical trial decision-making experience, and suggestions for modified wording. 15 Semistructured interviews were audiotaped and detailed notes recorded. Using discussion and consensus, the team reviewed audiotapes, notes, and summaries for each question and the overall measure to inform systematic modifications to the PRPQ. Findings suggested that the PRPQ is relevant for evaluating attitudes to cancer clinical trials, but indicated the need for revised items and response set. For the PRPQ-AYA, 20 questions were removed (e.g., “This study could provide information about my child's health I would rather not know about”), modified (e.g., “The government sometimes exposes research participants to medicine and procedures known to be harmful to one's health” changed to “Clinical trials sometimes expose research participants to medicine and procedures known to be harmful to one's health”), or added (e.g., “The following people would support my decision to participate in research: outside physician/pediatrician”), resulting in a 34-item scale for AYA and for their caregivers using a 5-point Likert response format (Strongly Disagree–Strongly Agree). AYA and caregiver forms vary only in terms of language for caregiver (e.g., my child) or AYA (e.g., my).
Knowledge about Clinical Trials 37 is a 25-item measure answered true/false assessing participant understanding of clinical trials developed for adult oncology patients in a study evaluating use of National Cancer Institute (NCI)'s educational materials. For this sample, split-half reliability for % correct was moderate for AYA (r = 0.75) and Caregivers (r = 0.68).
AYA completed three measures of developmental and emotional maturity. (1) Developmental Tasks Questionnaire-YA version (8 items) 38 evaluates the extent of achieving and degree of importance of developmentally appropriate tasks (e.g., independence from parents and establishing own identity). Total score for developmental tasks achieved, answered as “Not Yet,” “Working on it,” and “Already achieved,” was used to reflect developmental maturity in the analyses. (2) Emotion Regulation Questionnaire (ERQ) 39 is a 10-item self-report measure assessing cognitive reappraisal and expressive suppression used to modify emotional expression. Items were rated on a 7-point Likert scale (Strongly Disagree–Strongly Agree) with higher summary scores indicating greater cognitive reappraisal or expressive suppression. (3) Consideration of Future Consequences Scale 40 is a 12-item self-report measure used to evaluate time perspective/future orientation by assessing the extent to which AYA consider the potential distant outcomes of their current behaviors and the extent to which they are influenced by these potential outcomes using a 5-point Likert scale. A higher total score indicated greater time perspective/future orientation. In this sample, reliability was adequate for three developmental/emotional maturity subscales (α = 0.67–0.82), and higher scores indicated higher developmental and emotional maturity for each of the three measures.
Statistical analyses
To validate the factor structure identified in the previous PRPQ study 34 (a four-factor structure of Risks/Mistrust, Benefits, Support, and Opportunity/Cost), confirmatory factor analysis (CFA) was conducted on caregiver and AYA versions of the PRPQ. Goodness of fit of the hypothesized model was assessed by various fit indices, adjusted goodness of fit index (AGFI), comparative fit index (CFI), and root mean square error of approximation (RMSEA). 41 Indications of good model fit are AGFI ≥0.9, CFI ≥0.9, and RMSEA <0.06. 41
Because a significant misfit was discovered, exploratory factor analyses (EFA) were conducted to identify alternative factor structure for AYA and their caregivers. 35 The Scree plot was used to determine the number of factors extracted, and the oblique promax rotation was used to allow the factors to correlate with one another. We sequentially removed items with low factor loadings and repeated the analyses until all the items had a loading of ≥0.35 on at least one factor. We also sequentially removed cross-loaded items (i.e., loaded ≥0.35 on two factors and the difference between two loadings is <0.2). Following finalization of the factor analyses, reliabilities of each factor were confirmed using Cronbach's alpha, using a range of 0.70–0.95 as acceptable. 42 Summated subscales, used in subsequent correlation analyses, were generated based on the identified factor structure by summing the Likert responses for each item loading on each factor with reverse coding for items with a negative loading. In addition, continuous scores were calculated from PRPQ items reflecting perceived benefits with a higher score suggesting positive attitudes and from PRPQ items reflecting perceived barriers with a higher score suggesting negative attitudes. A Decision Balance score was computed by converting the benefits and barriers scores to z scores and then subtracting the barriers z score from the benefits z score. 43 Positive valence reflects more positive attitudes to clinical trials, and negative valence reflects more negative attitudes. Interitem reliability was also computed for these scales.
Pearson correlation was used to evaluate the association of subscales based on factor analysis, perceived benefits, perceived barriers and decision balance with cancer clinical trial knowledge, AYA age, developmental status, and emotional maturity. There were minimal missing data—7 AYA and 10 caregivers were excluded from the factor analyses. The sample sizes were based on the conservative estimate required for CFA. 44 All analyses were performed in SAS 9.3, and a two-sided p-value <0.05 was considered statistically significant.
Results
Participants
AYA (N = 124) had a mean age of 22 years and self-identified as Non-Hispanic/Latino (94%) and White (78%) (Table 1). AYA gender and education level were evenly distributed. Mean age at diagnosis was 19.34 years, and most AYA had a leukemia or lymphoma (51%) and were off cancer treatment (73%). Caregivers (N = 94) were mostly female (84%) with a mean age of 51.19 years and self-identified as Non-Hispanic/Latino (96%) and White (85%).
Participant Demographics
AYA, adolescent and young adults.
Factor analyses
In CFA, data for this study had poor fit to the previous PRPQ models. 34 The CFA model for caregivers had AGFI of 0.55, CFI of 0.61, and RMSEA of 0.13, and the CFA model for AYA had AGFI of 0.58, CFI of 0.51, and RMSEA of 0.13. EFA for AYA (n = 87) identified a four-factor structure (Table 2): (1) trust/mistrust, (2) barriers/costs, (3) support for participation, and (4) incentives. Kaiser-Meyer-Olkin Measure (KMO) of Sampling Adequacy for the final model is 0.78, suggesting that 78% of variance in the 29 items were explained by the 4 factors. EFA for caregiver (n = 117) suggested a four-factor structure (Table 3): (1) trust/access, (2) mistrust/costs, (3) support for participation, and (4) risks to AYA. KMO for this model is 0.74.
Adolescents and Young Adults with Cancer Exploratory Factor Analysis (N = 117)
Final Patient 4-factor model is shown below with 29 items retained (originally 34 items). Seventy-eight percent of covariance explained by 4 factors. Bold values represent factor loadings >0.35.
Modified PRPQ items for cancer.
Original PRPQ items.
New items.
Items removed due to small factor loadings or cross loadings:
I would be more likely to participate in a clinical trial if the researcher from the clinical trial is from the same racial group as me. b
Clinical trials will eventually lead to a cure or improved treatments, both for trial participants and for future patients with cancer. c
Participating in a clinical trial gives us a chance to give back. b
Families don't get enough time to make an informed decision about clinical trial enrollment. c
The hospital has researchers and other members of the community review clinical trials to make sure they are safe. b
PRPQ, Pediatric Research Participation Questionnaire.
Caregiver Exploratory Factor Analysis (N = 87)
Final Caregiver 4-factor model is shown below with 27 items retained (originally 34 items). Seventy-four percent of covariance explained by 4 factors. Bold represents factor loadings >0.35.
Original PRPQ items.
Modified PRPQ items for cancer.
New items.
Items removed due to small factor loadings or cross loadings:
It would make me uncomfortable if my child's health care team wanted us to enroll in a clinical trial because the health care team will treat my child differently if we do not enroll. a
It would make me uncomfortable if my child's health care team wanted us to enroll in a clinical trial because the health care team will view my child only as a “guinea pig” if we enroll. a
I think more families would participate in clinical trials if the researcher provided child care. a
Clinical trials will eventually lead to a cure or improved treatments, both for trial participants and for future patients with cancer. c
We would be more likely to participate in a clinical trial if we know exactly what we will be asked to do. a
Participating in a clinical trial gives us a chance to give back. a
Families don't get enough time to make an informed decision about clinical trial enrollment. c
Validation analyses
Interitem reliability
Acceptable reliability 42 was identified for the PRPQ factors for AYA (α = 0.86 for Factor 1, α = 0.86 for Factor 2, α = 0.88 for Factor 3, and α = 0.88 for Factor 4) and caregivers (α = 0.88 for Factor 1, α = 0.80 for Factor 2, α = 0.86 for Factor 3, and α = 0.76 for Factor 4). Acceptable reliability was also confirmed for PRPQ scale scores for AYA-perceived benefits (α = 0.86) and barriers (α = 0.83) and caregivers-perceived benefits (α = 0.79) and barriers (α = 0.79).
Pearson correlations
PRPQ-AYA factor scores and computed scales were correlated with each other (Supplementary Tables S1 and S2). For AYA, trust/mistrust (Factor 1) was significantly positively correlated with cancer clinical trial knowledge and emotional maturity (reappraisal and consideration of future consequences), and support for participation (Factor 3) was significantly negatively correlated with emotion suppression (Table 4). AYA perceived benefits were significantly correlated with knowledge and emotional maturity (reappraisal, suppression, and consideration of future consequences) in the expected direction of greater knowledge and more maturity linked to higher perceived benefits. AYA perceived benefits were not significantly associated with age or developmental maturity. AYA perceived barriers were not significantly associated with any of the variables of interest. AYA decision balance was significantly associated with knowledge and emotional maturity (reappraisal) in the expected direction of more positive attitudes linked to greater knowledge and more maturity; decision balance was not significantly associated with age, developmental maturity, or emotional maturity (consideration of future consequences and suppression).
Pearson Correlations of PRPQ-AYA Factor Scores and Scale Scores with Validation Measures for AYA
There were no significant correlations with age of AYA or developmental milestones achieved.
p < 0.05; **p < 0.01.
For caregivers, access/trust (Factor 1) was significantly positively correlated with AYA age, and mistrust/costs (Factor 2) were significantly negatively correlated with knowledge (Table 5). None of the other caregiver factor scores or caregiver perceived benefits was associated with knowledge. However, greater knowledge correlated with fewer perceived barriers and more positive attitudes toward clinical trials, and older AYA age correlated with more perceived benefits.
Pearson Correlations of PRPQ-AYA Factor Scores and Scale Scores with Validation Measures for Caregivers
p < 0.05; **p < 0.01.
Discussion
The literature on the challenges of limited clinical trial enrollment for AYA has focused on structural and societal barriers to participation in clinical trials and its impact on development of effective cancer therapies.1–3,8 However, AYA and their families' decision-making around cancer clinical trials, engagement of AYA, and the role of attitudes to enrollment have only recently been recognized as important components of efforts to increase AYA participation in cancer clinical trials.45,46 This study of AYA drawn from pediatric and adult cancer centers contributes to this emerging literature and suggests next steps in this important area of study. Separate four-factor structures of the PRPQ-AYA for AYA and their caregivers were identified although these scales must be interpreted with caution, as power was limited for the planned factor analyses. In contrast, findings from this study support scoring the PRPQ-AYA by summarizing perceived benefits, perceived barriers, and decision balance; these scores correlated with knowledge of clinical trials and emotional maturity for AYA and their caregivers. More research on the PRPQ-AYA is required to evaluate its utility in improving clinical trial informed consent communication and fostering positive decision-making processes for AYA.
We acknowledge that power was limited, but the factor analyses provide interesting hypotheses for future study. CFA did not support the same factor structure for AYA with cancer and their caregivers as for youth with health disparity conditions and their caregivers. This is not surprising given that important demographic (race/ethnicity, SES) and disease-related (diagnosed at birth and prior exposure to medical research) differences may shape perceptions of clinical trial research over time.47,48 It should be noted, however, that similar themes were reflected, including mistrust, social support for participation in trials, and risks (caregivers) and incentives (AYA). Furthermore, although the factors for AYA and their caregivers had some parallels (support for participation in research), caregiver responses converged around assessment of risks and evaluation of the extent to which they had trust in the provider and the institution offering the trial while AYA prioritized costs and incentives. These differences are consistent with our prior qualitative study 15 and may reflect the ways in which AYA and caregiver values differentially influence clinical trial enrollment decision processes. 49 Patterns of decision-making vary—from collaborative to the caregiver or AYA being the primary decision-maker—highlighting the importance of incorporating differing valuations of clinical trials around issues of benefit, risk, and incentives into the informed consent discussion process. 15
Summing perceived benefits and perceived barriers on the PRPQ-AYA, as well as computing decision balance, provided psychometrically stronger and relevant information. These variables were associated with cancer clinical trial knowledge and with AYA emotional maturity, suggesting that increased knowledge can improve understanding of benefits of clinical trial enrollment. Findings from this study are consistent with but extend to those of two recent studies of AYA decision-making around cancer clinical trial enrollment in important ways.45,46 In prior studies, young adult survivors reported perceived benefits and barriers related to safety of trials. 46 Furthermore, barriers to enrollment include support from the family or peer group, assessment of impact of trial enrollment on goals, and health status. 45 In contrast, our results highlight the importance of accounting for trust/mistrust in research and researchers, incentives and practical considerations for participation, and community support for cancer research. PRPQ. AYA responses also underscore the need to account for attitudes of others involved in decision-making, including caregivers.
An important finding from this study on AYA clinical trial decision-making is that emotional maturity, not age or developmental milestones achieved, plays a role in understanding perceived barriers and benefits of cancer clinical trial enrollment. This is consistent with an extensive body of research in developmental science, with emerging data from neuroscience, demonstrating the role of cognitive and emotional development in understanding AYA readiness for decision-making. 50 Children's Oncology Group and American Academy of Pediatrics provide children to be involved in medical decision-making to the extent they are capable,16,27 but research has primarily focused on limits related to age or cognitive developmental level.9,22 Although assessment of emotional maturity is more involved than use of age, it is a critical factor in readiness to participate in decisions about treatment in meaningful ways. Feasibility studies integrating this factor in planning for clinical trial communication can be undertaken.
AYA research is complicated by the challenges of obtaining sufficiently large diverse samples to address the study aims. There was sufficient power for correlation analyses, but sample size was more limited for CFA and dyadic analysis (AYA-caregiver pairs). The sample is representative of AYA in our cancer centers, but studies from multiple sites that oversample ethnic minority AYA and survey AYA closer in time to the clinical trial decision are necessary. We intended to assess differences by prior enrollment on a clinical trial. However, self-reported rates of participation were inconsistent and lower than the documented percentage of AYA exposed to cancer clinical trials in our centers, highlighting potential lack of understanding of clinical trials versus standard treatment.
Newly diagnosed AYA and their caregivers are given extensive complicated information on diagnosis, treatment, and clinical trials in the intense emotional context of diagnosis with short time allotted for decision-making, 27 often resulting in miscomprehension.26,27 Factors contributing to AYA clinical trial enrollment are multiple and nuanced, 51 and increased understanding of knowledge and attitudes to cancer and cancer clinical trials for AYA and their caregivers and their contribution to decision-making is a critical component to address this issue. Based on results of this study, use of PRPQ-AYA computed summary scales to reflect perceived barriers and benefits to clinical trial participation may serve to identify relevant attitudes that can be addressed. Additional research to further evaluate validity and reliability of the PRPQ-AYA, specifically the factor structure, closer to the informed consent process is needed.
Footnotes
Acknowledgments
This work was supported by a grant from the Children's Hospital of Philadelphia Center for Childhood Cancer Research/Alex's Lemonade Stand Foundation to L.P.B.
Disclaimer
Portions of this article were presented in a poster discussion session at the 2017 World Congress of the International Society of Pediatric Oncology, Washington, DC.
Author Disclosure Statement
No competing financial interests exist.
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
