Abstract
Partner abuse (PA) is associated with significant morbidity and mortality worldwide. Health care practitioners regularly encounter patients experiencing PA and require comprehensive education on how to respond. This study describes the creation and validation of a new measure of readiness to encounter patients experiencing PA for health care practitioners and students.
Initial item development and content validation were informed by expert feedback. Psychometric properties were assessed using data collected from Australian health care students, using Principal Components Analysis (PCA) and Confirmatory Factor Analysis (CFA). Internal consistency, inter-scale correlations, and test–retest analysis were performed.
An initial pool of 67 items was reduced to 48 following content validation by 5 experts as a measure of construct validity. A total of n = 926 responses were collected, which were randomly split into two groups to perform a PCA and CFA. The PCA resulted in a 31-item version, which was further reduced to a 27-item version following the CFA, containing four factors. Internal consistency and test–retest analyses demonstrated good reliability.
The produced scale is a 27-item measure of readiness to encounter patients experiencing PA, which has demonstrated good psychometric properties with a sample of Australian health care students. Results indicate that self-efficacy and Emotional-readiness are a large component of readiness. The scale may be used to measure the readiness of a cohort, or as a pre and post-intervention measure, and results may provide insight into the educational needs of a cohort.
Keywords
Introduction
Partner abuse (PA; also called intimate partner violence) is a major health issue associated with significant morbidity and mortality worldwide (García-Moreno, 2013). Health care practitioners are believed to regularly encounter patients with injuries and illnesses caused by or contributed to by PA (Black, 2011). Calls have been made for increased education for health care students and practitioners, which aims to increase their readiness to recognize and refer patients experiencing PA to specialist care and advocacy (World Health Organization [WHO], 2013). Despite these calls, current evidence indicates health care students and practitioners rarely receive any meaningful PA education (Bravo et al., 2019; Sawyer et al., 2016), and evaluations of educational interventions often focus on knowledge and do not measure impacts on confidence and skills (Sawyer et al., 2016). A key barrier to reporting on the outcomes of educational interventions in many health care professions is the lack of validated outcome measures designed for use specifically with their practitioners and students. To assist with identification of effective educational interventions it would be useful to develop a scale that is designed for use with any health care practitioner or student from any discipline.
There are several scales with reported psychometric properties that have been used to measure PA educational intervention outcomes in some health care cohorts. The Physician REadiness to Manage Intimate partner violence patients Scale (PREMIS; Short et al., 2006), and the scale created by Maiuro et al. (2000), demonstrated good psychometric properties when used with U.S. physician groups (Maiuro et al.’s with nurses as well). The psychometric properties of a modified version of the PREMIS were measured with a cohort of U.S. health care students including dental, nursing, social work, and medical, with the authors identifying six of the original eight subscales and varied internal consistency subscales (Cronbach’s alpha between .46–.91; Connor et al., 2011). A recent study of the PREMIS when delivered to Australian paramedic students found the scale did not demonstrate robust properties, only identifying five of the original eight subscales, most of which demonstrated low internal consistency (Cronbach’s alpha between .47 and .80; Sawyer et al., 2019).
The above-mentioned scales were designed for use primarily with practicing physicians, rather than for any health care practitioner or student group. Additionally, they were created before the introduction of the first major clinical guidelines for health care practitioners to respond to PA in 2014 (WHO, 2013), meaning items were generated before the current conceptual underpinning for the health care sector’s response to PA was produced. Likewise, it has been noted that while these scales are measures of practitioner readiness they were not published along with a theoretical foundation for the construct of “readiness” they were measuring (Leung et al., 2017a).
The authors of the more recently developed General practitioners’ Perceived Readiness to identify and respond to Intimate Partner abuse Scale (GRIPS; Leung et al., 2017a) noted that self-reporting knowledge, attitudes, and behaviors framework may not encompass aspects of readiness such as Emotional- and Motivational-readiness. The authors cited qualitative work with GPs which indicated that these aspects of readiness are central to a practitioner’s willingness to act on their suspicions of PA, and therefore critical to assess and measure when attempting to define the “readiness” of a person or workforce (Leung et al., 2017a). Additionally, it is known from qualitative research with health care practitioners that a major barrier to discussing PA with patients is feeling underprepared or lacking confidence (Sprague et al., 2012), and therefore these aspects of readiness should be considered in an outcome measures of overall readiness.
There is a clear need for increased PA education for all health care students and practitioners (García-Moreno et al., 2015) and the accurate measurement of the efficacy of educational interventions should be prioritized. It is timely to create a new scale designed to be applicable to all health care students and practitioners, and which is informed by a robust conceptual underpinning of the concept of readiness, and the health care sector’s framework for responding to PA. This study aims to create a psychometrically sound scale, which can be used with all health care student and practitioner populations, to assess their readiness to encounter patients experiencing PA.
Methods
Study Design
Initial items were developed and tested for construct validity, following which initial psychometric testing was performed with a sample of Australian health care students.
Initial Item Development
Before creation of initial items, the concept of “readiness” required clear definition. The creators of the GRIPS performed an initial study which explored this concept with regards to the health care response to PA to inform their own scale development (Leung et al., 2017b). In this study, the authors used qualitative data from General Practitioners to help define the term “readiness,” finding that the concept could be defined as a “…psychological state that indicates the extent to which an individual is cognitively, motivationally, and emotionally inclined to embrace and respond to a phenomenon” (Leung et al., 2017b). The authors found that terms “readiness” and “preparedness” were distinct, and they identified six individual constructs that made up the terms (refer to Table 1). Preparedness was defined as holding the required knowledge, resources, and skills to respond when encountering a patient experiencing PA (Leung et al., 2017b). Items in the present study were generated with this definition as the theoretical underpinning for “readiness” in the context of a health care practitioner responding to PA.
The World Health Organization’s (WHO, 2013) clinical guidelines were used to provide the theoretical basis for the knowledge, attitudes, and skills which a health care practitioner should hold in regards to PA. This allowed us to generate items that would theoretically measure an individual’s readiness for the actual tasks that a health care practitioner would be expected to undertake when encountering a patient experiencing PA.
When developing items terms were chosen which would be answerable by both students and practitioners, meaning items were worded without reference to current practice behaviors or previous clinical patient contact. Items were designed to be understandable and relevant to international cohorts, by ensuring use of internationally recognizable terms and concepts.
The term “partner abuse” was chosen over “intimate partner violence,” as anecdotal evidence from previous education delivered to Australian health care practitioners and students indicated that few people understood the meaning of the term intimate partner violence, while the term partner abuse was generally understood. Preference was therefore given to the term partner abuse, as the term that the intended users of the scale would be more likely to understand.
An initial pool of 67 items was developed and then presented to a panel of five family violence experts for face and content validation. Experts were chosen from prominent Australian family violence researchers working across several different universities and health care sectors. The experts made comments on the appropriateness and clarity of items and suggested changes, based on which a final version of 48 items was derived which included items from each of the six constructs previously identified by Leung et al. (2017a).
Readiness and Preparedness Constructs Identified by Leung et al. (2017b) (11).
Initial Scale Development and Psychometric Testing
Instrumentation.
The pool of 48 items was delivered to participants with data used for psychometric evaluation. Items were both positively and negatively scored and were answered on a 7-point-Likert scale, anchored by strongly agree (7) and strongly disagree (1), with neutral (4) as the central point. Higher scores were intended to align with higher readiness (after reverse scoring negatively scored items).
In addition to scale items, students also input their age, sex, the name of their degree, and their current year level, and they were asked to estimate the number of hours of previous education and training they had received concerning family violence within or outside of their course. The term “family violence” was used instead of “partner abuse” when estimating hours of training as students would generally receive education on the entire concept of family violence, rather than just PA, and it would be difficult for respondents to estimate the hours dedicated to PA as opposed to other family violence presentations (such as child abuse and neglect or elder abuse).
Participants.
Participants were health care students undertaking a range of undergraduate and graduate degrees at a large Australian university. Recruitment took place between March and October 2018. Students were recruited in person immediately before or after normally scheduled lectures or workshops. Students were asked to respond to the items online using internet-capable devices. As an incentive participants were offered the opportunity to be entered into a random draw to win one of four $50 gift cards. Participation was voluntary and anonymous.
Statistical analyses.
SPSS version 24 was used for all analyses.
Tests of validity.
The dataset was randomly divided into two equal-sized groups, with group one being used for a PCA (Sample 1) and group two being used for a CFA (Sample 2). Given no a priori assumptions were established regarding the association between items and factors a PCA was undertaken over a traditional Exploratory Factor Analysis (DeCoster, 1998). As per Rubin (1976), where missing data were encountered surveys with items missing completely at random were retained, and questionnaires with non-random or greater than 10 missing items were excluded for the PCA. All data with missing values were subsequently deleted for the CFA. Reverse scored items were recoded so that higher scores on all items referred to preferred responses. The Kaiser–Meyer–Olkin (KMO) measure was used to define sampling adequacy, with a score above .70 considered adequate (Kaiser, 1974). Bartlett’s test for sphericity was estimated to test the null hypothesis that no variables are significantly correlated. The variable to case ratio was measured, with acceptance set at a minimum of 10:1 (Nunnally, 1994). The minimum r value for correlations between items was set at .3, which is considered the minimum correlational size to indicate an effect (Pett et al., 2003).
To investigate the latent variable structure generated from the PCA, a maximum likelihood CFA using AMOS (version 22.0; IBM, AMOS Development, Meadville, PA, United States) was performed to test the model-to-data fit. During the analysis, all factors were allowed to co-vary. Missing answers to any items in the SPSS dataset were replaced by estimated means (Meyers et al., 2016). Non-distributed data were also assessed to examine univariate outliers. Influential multivariate outliers were identified by calculation of the Mahalanobis distance and were accordingly deleted from the dataset. For a model to have an acceptable fit, a number of indices are required including the comparative fit index (CFI) ≥ .95, adjusted goodness-of-fit index (AGFI) ≥ .95, root mean square error of approximation (RMSEA) ≤ 0.06, Tucker–Lewis Index ≥ .95, and standardized root mean residual (SRMR) ≤ 0.06 (Hair et al., 1998).
Tests of reliability.
Cronbach’s alpha coefficient was used to assess internal consistency within identified subscales as a measure of reliability. Spearman’s rank coefficients were calculated between subscales and hours of training to determine the association between length of training and subscale results. Pearson’s correlation coefficient r was computed to assess the test–retest reliability based on the results of the 36 participants who were re-administrated the questionnaire after a two-week period.
Ethical Considerations
Ethical approval was granted by the respective University Human Research Ethics Committee.
Results
Demographics
A total of N = 944 responses were received from across eight different health care professions. Eighteen records were removed due to incomplete responses, leaving n = 926 records. The data were randomly split into two groups, with sample 1 (n = 464) used in the PCA and sample 2 (n = 462) in the CFA. Table 2 presents demographic data of participants.
Participant Demographics.
Item Reduction
PCA.
Using sample 1 (n = 464) a PCA was conducted on the 48 scale items using varimax rotation, as this assumes no correlation between the variables (Pett et al., 2003). The KMO measure verified the sampling adequacy for the analysis, the result was a KMO = .936, described as “marvelous” according to Kaiser, and above the acceptable limit to conduct factor analysis (Kaiser, 1974). Bartlett’s test of sphericity indicated that correlations between items were sufficiently large for PCA, x2(465) = 7562.618, p < .001. Variable to case ratio was above 9:1 but below the ideal sample size of 10:1, though this is still eligible for PCA (Pett et al., 2003).
An initial analysis was run to obtain eigenvalues for each construct in the data. Four constructs had eigenvalues over Kaiser’s criterion of 1. The scree plot demonstrated inflections that would justify retaining four factors (Tabachnick & Fidell, 2007). A Parallel Analysis was performed which showed only three factors with eigenvalues exceeding the corresponding criterion values for a randomly generated data matrix of the same size (48 variables × 464 respondents; Ledesma & Valero-Mora, 2007). Given the large sample size, and the convergence of the scree plot, four factors were retained as these theoretically and practically made clinical sense. Seventeen items not loading on the four factors were removed from the final solution resulting in 31 items being retained. The four-factor solution explained a total of 55.67% of the variance, component contributions are presented in Table 3. The rotated solution demonstrated the presence of multi-dimensionality. Intercorrelations between items are presented in Appendix 1.
Principal Component Analysis Matrix (Sample 1).
Note. h2: Communality; rit: Corrected item-total correlations; SD: Standard deviation;
Factor 1 included items pertaining to Self-efficacy, which is the individual’s confidence in their abilities;
Factor 2 included items pertaining to Emotional-readiness, which is the individual’s comfort in discussing PA and responding to disclosures;
Factor 3 included items pertaining to Motivational-readiness, which is the individual’s belief that responding to PA is the role of a health care provider; and
Factor 4 included items pertaining to PA knowledge, including understanding of the nature of PA, belief in common myths, and how a patient may present to a health care service.
CFA.
Using sample 2 data (n = 462) a CFA was conducted using the 4-factor 31-item scale identified in the PCA.
A maximum-likelihood CFA was performed to test the underlying latent variable structure of the scale. Standardized regression weights on each item were >.40, and modification indices were used to guide the iterative process. Following the PCA results the 31 items of the scale that loaded on the four factors were tested as a 4-factor model. These data did not fit the proposed 4-factor model. The x2 value for the overall model was (709.01) = 366 (p < .0001) demonstrating a poor fit between the hypothesized model and model data (p > .05). Examination of other suggested model-fit indices suggested by Brown (2014) still demonstrated a poor model fit, with CFI = .926, AGFI = .854, RMSEA (90% confidence interval [CI]) = .0523 (.048, .057), SRMR = .097, and TLI = .920.
A review of the modification indices and a total of six iterations suggested allowing covariance between four items: item 2 “I know what questions to ask patients who I suspect might be experiencing partner abuse,” item 24 “I am concerned about the welfare of patients,” item 36 “If a patient wants my help with partner abuse they will usually initiate the conversation,” and item 48 “Everyone has the right to live without violence or abuse”. With these paths being constrained improved model fit was produced in each index except AGFI, which failed to reach .095: CFI = .955, AGFI = .892, RMSEA (90% CI) = .044 (.039, .049), and SRMR = .087 (refer to Figure 1). Based on these data the four items were removed with the resulting 4-factor 27-item version representing the most psychometrically sound version, which is named the READIness to encounter PA patients Scale (The READI Scale) and is the version which should be used in subsequent research.

Notes. e = error.
Test–retest Analysis
Thirty-six students provided data for test–retest analysis. As can be seen from Table 4, using the final 27-item version, the scale demonstrated good test–retest reliability (r = .777, p < .0). The Self-efficacy and Emotional-readiness factors demonstrated strong positive test–retest reliability (r = .774 and r = .736 respectively, both significant at p < .01). Both the Motivational-readiness and PA knowledge subscales demonstrated acceptable positive test–retest reliability (r = .516 and r = .582 respectively, both significant at p < .01).
Test–retest Results.
Note. *p < .01.
Correlations
As can be seen from Table 5, using the final 27-item version, the total mean score had a strong correlation with Self-efficacy (r = .918, p < .01), and moderate correlation with hours of training (r = .502, p < .01) and Emotional-readiness (r = .788, p < .01). Hours of training had a moderate correlation with Self-efficacy (r = .525, p < .01). There was a moderate correlation between Self-efficacy and Emotional-readiness (r = .608, p < .01), and the Motivational-readiness and PA knowledge subscales had a low correlation (r = .349, p < .01).
Correlation Matrix (Sample 2).
Notes. *Correlation is significant at the .05 level (2-tailed).
**Correlation is significant at the .01 level (2-tailed).
Discussion
This study aimed to create a new scale to measure the readiness of health care practitioners and students to encounter patients experiencing PA. The resultant scale, the READI Scale, comprises 27 items and 4 subscales and takes approximately 7 minutes to complete. Results indicate that the READI Scale has demonstrated good reliability and validity when delivered to a cohort of Australian health care students. Following will be a discussion of key results and implications for future practice.
Factor Analysis
While items were created which were intended to measure readiness over six constructs, the factor analysis delivered only a four-factor solution. Items created to measure the “Communication” and “Attitudinal-readiness” domains were not included in the final four-factor solution. Some of the items intended to measure these two domains did load into the Self-efficacy and Motivational-readiness subscales and were therefore included in those subscales. Neither of the Communication or Attitudinal-readiness domains was found when different items were developed and presented to a GP practitioner cohort as part of the psychometric validation of the GRIPS (Leung et al., 2017a), though again some items were retained as part of other subscales. These two domains were identified as important through research with practicing GPs (Leung et al., 2017b), and appear to be important aspects of an individual’s ability to respond to PA, and so it is unclear why they were not derived. Potentially health care students and practitioners view these constructs as important, but more aligned with self-efficacy and Motivational-readiness, which is why they were incorporated into these subscales.
The Self-efficacy subscale had a very strong correlation with overall readiness (r = .918), and in the PCA it accounted for 31.55% of the variance of the scale. Similar results were found by the authors of the GRIPS (Leung et al., 2017a). Likewise, the Emotional-readiness subscale was also high (r = .788, 11.47% of variance). Conversely, the subscales pertaining to Motivational-readiness and PA knowledge both had moderate correlations with overall readiness, and only accounted for a minor percentage of the scale. This indicates that students view their own self-efficacy and comfort in responding to PA as far greater components of their overall readiness than their knowledge or attitudes around their role. This may indicate that students feel readiness as less about the requirements of their role, and more about their own feelings and perceptions of their abilities. This gives further credence to research which has theorized that improving the readiness of practitioner cohorts should emphasize skills based training, where participants can practice their approach to the patient and gain feedback on their performance (Sawyer et al., 2016).
Furthermore, low self-efficacy has been identified as a major barrier for health care practitioners to discuss PA with patients (Sprague et al., 2012). An emphasis on improving self-efficacy in educational interventions, rather than knowledge or role clarity, maybe the key step in creating confident and competent future practitioners. When examining the correlation between hours of training and the identified subscales it can be seen that the largest correlation is with the Self-efficacy subscale, demonstrating that as the hours of training increases so does an individual’s self-efficacy. This indicates that educational interventions can have a positive impact on self-efficacy, and further research may benefit from examining the impact of different methods of educational intervention to determine the highest impact on overall self-efficacy.
Validity and reliability.
The developed scale has demonstrated content validity, as measured through feedback from family violence experts. Hours of training show good correlations with scale total score, as well as the subscales Self-efficacy and Emotional-readiness. It is expected that as hours of training increase, provided the training is effective, a student’s belief and confidence in their abilities (Self-efficacy and Emotional-readiness) should increase. Therefore, this demonstrates validity of the scale total score and these two subscales.
Correlations of hours of education with Motivational-readiness and Partner-abuse-knowledge, while significant, were weak, which may indicate poor validity of these subscales. However, while it would also be expected that both Motivational-readiness and partner-abuse-knowledge should increase with hours of education, both these subscales returned high results regardless of total hours of education (i.e., students with no education still reported high results). Therefore, there was little possibility of statistical improvement with increased hours of training. It is possible that the health care students studied began their training with a strong belief that they should be responding to PA as part of their role (Motivational-readiness), and felt they had good overall knowledge (partner-abuse-knowledge), and therefore any education was unlikely to significantly impact this, though this cannot be derived from the data we collected. This may suggest these subscales lack the capacity to differentiate between high and low scorers, or that the education had little impact on knowledge, or that students did not accurately report their knowledge. Further research with a wider group of health care students may provide greater insight into the validity of these two subscales.
The developed scale has shown good reliability. The internal consistency, as measured through Cronbach’s alpha, demonstrated close relations between the items within the scale and subscales. The test–retest analysis demonstrates that the scale shows good reliability over time, though further analysis over longer periods would assist in this measure. Therefore, we conclude that in this study, the scale has demonstrated good reliability.
Implications for future practice.
The developed scale, as created for use with all student and practicing health care practitioners, has shown good psychometric properties when delivered to a cohort of Australian health care students. This scale can be used by educators to ensure that cohorts have been appropriately educated and trained to respond to patients experiencing PA. Results from the delivery of this scale may be used to identify training needs, and the impact of educational interventions. Results may also inform the enhancement of educational interventions. The scale has not been validated for use with a practitioner cohort, and we suggest a psychometric evaluation should be performed prior to its use in such populations.
Limitations.
This study was limited in that it did not measure readiness in all health care student populations, and future research to validate the scale in a wider range of cohorts would be useful, in particular nutrition and dietetics, dentistry, and midwifery. This study did include practitioners, and should therefore it should undergo psychometric evaluation in practitioner populations before use outside of student cohorts. Likewise, the scale was developed for use in international populations, however, this validation only included students studying in Australia. The scale has not be validated against actual performance, and so it is not yet clear if readiness, as measured through this scale, will be an accurate measure of actual performance on a task.
Conclusions
This research has created a new 27 item scale, named the READI Scale, which can measure the readiness of health care cohorts to encounter patients experiencing PA. The scale has shown good psychometric properties with a cohort of Australian health care students and is underpinned by a sound conceptual basis for both the concept of readiness, and the health care sector’s expected response to PA. Results demonstrate that four factors makeup readiness in student cohorts and that self-efficacy is a major factor, indicating that educational interventions that emphasize improvements in self-efficacy may lead to the greatest gains in readiness. The scale can be used to measure the readiness of a cohort, and may be useful as a pre and post measure to determine the effect of an intervention. The READI Scale will allow evaluation of PA educational interventions in the health care sector, which may assist with building an effective health care workforce capable of early identification of PA, leading to increased referrals and a reduction in the overall duration and impact of PA in society.
Supplemental Material
Supplemental material for this article is available online It is also available at https://www.acu.edu.au/about-acu/faculties-directorates-and-staff/faculty-of-health-sciences/school-of-nursing-midwifery-and-paramedicine/research/readiscale
Supplemental Material for A New Scale of Readiness for Health Care Students to Encounter Partner Abuse by Simon Sawyer, Glenn Melvin, Angela Williams, Brett Williams, in Journal of Interpersonal Violence
Footnotes
Authors’ Note
Glenn Melvin is also affiliated with Deakin University, Burwood, Victoria, Australia. The READI Scale is free to access and use, please email Dr Simon Sawyer (
Declaration of Conflicting Interests
Funding
The author(s) received no financial support for the research, authorship, and/or publication of this article.
Author Biographies
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
