Abstract
Introduction
There has been a steady proliferation of evidence supporting the use of telepractice to deliver outpatient-based clinical services across the continuum of care (Theodoros et al., 2008). Patients have identified a preference for telepractice over traditional face-to-face care models in many settings due to increased flexibility and convenience (Burns et al., 2017). This positive consumer support helped drive the establishment of therapeutic efficacy for the use of synchronous telepractice (videoconferencing) across a range of clinical areas – including the assessment and rehabilitation services provided by allied health and nursing for patients with chronic disease (Burns et al., 2017; Holland, 2013; Hwang et al., 2017; Jaglal et al., 2013; Kamei, 2013; Jones et al., 2014; Palsbo, 2007; Theodoros, 2011; Ward & Burns, 2014). Collectively, these telepractice models have demonstrated promising results related to patient satisfaction and uptake, improved service efficiency and cost savings, presenting opportunities to benefit both patients and health services alike.
Despite the documented benefits of telepractice-assisted models of care in allied health, and the advantages of their implementation, the uptake of telepractice models in clinical practice has remained slow (particularly, prior to the COVID-19 pandemic), and methods for facilitating implementation are inconsistent. Research has identified a number of potential barriers to the clinical utilisation of telepractice services by health practitioners, including clinicians’ age and experience with technology, self-efficacy, education and training, as well as operational factors such as management support, network coverage, privacy and security and resource issues (Jang-Jaccard et al., 2014; Rani Sood et al., 2016). Staff confidence and perceptions are also integral to the successful implementation of telepractice, as clinicians are responsible for promoting the use of telepractice by selecting and referring suitable patients (Brewster et al., 2014; Nicholson et al., 2013; Wade et al., 2014). To this end, it is increasingly recognised that targeting staff skills and confidence in using telepractice technology, as well as fostering a positive culture towards telepractice at the organisational level, is key to facilitating successful establishment and ultimate sustainability of clinical telepractice services (Burns & Wall, 2017; Edirippulige, 2010).
Appropriate education and training of staff has shown to be integral to the uptake of telepractice, especially for patient-related interventions (Edirippulige & Armfield, 2017; Taylor et al., 2015). Despite this, there is limited research evidence surrounding the development and evaluation of telepractice training programs and their impact on changes in staff skills, confidence and perceptions of telepractice-based services, or the uptake and/or implementation of telepractice into routine clinical care (Guise & Wiig, 2017). The aim of the current study was therefore to develop, implement and evaluate a telepractice training package for clinicians at an acute secondary teaching hospital. The ultimate objective of this work is to support and promote the uptake of videoconferencing-based telepractice service delivery models to provide services to outpatients across a variety of areas and to develop a sustainable and skilled health workforce with a positive culture towards telepractice models of care in the future.
Method
Design
Prospective mixed-method cohort study.
Participants
Clinicians from the Chronic Disease, Physiotherapy and Speech Pathology departments were recruited via purposive sampling from an acute secondary teaching hospital (Queensland Health) in Queensland, Australia. The hospital provides a variety of post-acute outpatient services to a regional metro area which also includes local islands (rural). These three departments were targeted for recruitment as the efficacy for the use of telepractice-based services in their outpatient clinics had already been established within the literature (Chan et al., 2016; Conlan et al., 2016; Keck & Doarn, 2014; Gellis et al., 2012). Participants were eligible for recruitment if they were employed by the departments at the time of recruitment (July to September 2017) and their role description involved outpatient services, home-based services or a combination of both. Participants were excluded if they were unavailable to complete the training package in full. Ethical approval was gained by the relevant institutional committee (HREC/17/QPAH/484). All participants provided written informed consent before participating.
Procedure
The telepractice training package was developed by the research team in consultation with local experts during March–June 2017 and delivered to staff across multiple in-service sessions from October 2017–March 2018. Details of the training package are provided below. Following training, participants were encouraged and supported to implement telepractice into their clinics as appropriate during a 6-month period. Implementation was driven by each department who established local processes for patient selection, scheduling and utilisation of telepractice-assisted outpatient services.
Details of Intervention
The training package was designed based on previous research which had identified crucial elements that promoted the successful establishment and sustainable use of telepractice services for outpatient services (Burns & Wall, 2017). The package involved training and/or implementation planning across three key aspects: (1) staff skills; (2) resources, infrastructure and operational planning; and (3) organisational culture. To target staff skills, all participants completed selected online training modules which included video demonstrations and written resources related to the provision of clinical services via videoconferencing.
Regarding training for resources, infrastructure and operationalisation, participants received a one-hour introductory session and a two-hour focused session on equipment setup (Cisco Jabber, The Portal and Pexip software), led by a telehealth service coordinator with expertise in establishing telepractice models across the health service. Following this, participants proceeded to simulation training which involved role-playing with mock clinical scenarios specific for each participant’s clinical caseload to provide experience in managing environmental set up, etiquette and technical issues within a controlled environment. Simulation training lasted 1–2 hours and was conducted in small groups (2–4 participants) with support provided by a clinician with telepractice experience or a ‘telepractice champion’.
Finally, to target organisational culture, strategies were employed to foster a positive team/department culture towards the use of telepractice for clinical care during the training period. This included (a) the establishment of telepractice ‘champions’ within each department to support/drive adoption of telepractice within the clinical areas; (b) regular communication/updates at departmental meetings by the research team, telepractice champions and the telehealth service coordinator; and (c) embedding the ongoing completion of telepractice training for new staff as part of each department’s strategic objectives.
Evaluation Measures
Evaluation of participants’ self-reported skills and perceptions towards using telepractice was completed in the form of written surveys at three time points: baseline, immediately post-training and 6 months post-training. The baseline and immediately post training survey consisted of 25 questions (yes/no, multi-select and Likert scale) related to participants’ demographics, clinical skills/knowledge, confidence and perceptions of the utility of telepractice (specifically videoconferencing) for outpatient care. In addition, 6 open-ended questions were used to ascertain perceived barriers/facilitators towards using telepractice for patient consultations. The post-implementation survey (6-months post-training) had an additional question related to clinician involvement with the delivery of telepractice since completing the training package. Unique identifier codes were used to match participants’ responses to questionnaires over time. Occasions of service (OOS) conducted via telepractice during the 6 month implementation period were also retrieved via review of hospital and health service statistics.
Data Analysis
Data was analysed using intention-to-treat methods. Participant demographics and OOS data were analysed descriptively. To accommodate missing survey data at the post-training time points as a result of participant attrition, mixed-effects ordered logistic regression was used to explore the impact of training (represented by time point) on participants’ knowledge, confidence and perceptions of telepractice – first at the univariable level and then subsequently in a multivariate analysis controlling for potential interaction factors. For all multivariable analyses, profession (allied health vs. nursing staff vs. other staff) and department (Speech Pathology vs. Chronic Disease vs. Physiotherapy) were forced into the model as fixed interaction effects, with participant ID entered as a random effect, to control for individual variability. Model fit was checked using the Akaike information criterion (AIC). Statistical significance was set at p < .05. Thematic analysis of open-ended responses was undertaken using plain content analysis.
Results
Participant demographics (n = 41).
Impact of Training on Skills/Knowledge and Confidence
Multivariable analysis of perceived knowledge and confidence in use of telepractice – effect of time.
Impact of Training on Staff Perceptions of Telepractice
Summary of perceptions of telepractice by time point.
Effect of interaction factors (profession) on perceptions of telepractice.
AH: allied health; NS: nursing staff; Other: Aboriginal and Torres Strait Islander health worker/allied health assistant. Bold type indicates statistical significance (p < 0.05)
Experience and Use of Telepractice-Based Services Post-Training
In regards to exposure and experience with telepractice, mixed-ordered logistic regression analyses demonstrated a significant effect of time, with participants’ reporting significantly higher levels of experience with telepractice for clinical purposes from baseline to immediately post-training (Z = 3.13, p = .002) and further significant increases from immediately post to 6 months post-training (Z = 0.84, p < .001). Despite the self-reported increase in experience during the implementation period, translation to OOS was variable. The Chronic Disease department recorded 10 telepractice OOS during the implementation period (compared to five in the previous 12 months). Physiotherapy and Speech Pathology departments had nil recorded telepractice OOS during the implementation period.
Factors Affecting Implementation: Perceived Enablers and Barriers
Effect of training program on staff reported experience in use of telepractice.
Content analysis of perceived enablers to telepractice.
Enablers
Enablers for telepractice uptake/implementation centred around (a) training and practice; (b) perceived benefits to patient care by improving access; and (c) resources and support.
At the post-training survey, the most frequently cited enabler for clinicians to use telepractice was the training package itself (n = 11). Participants (n = 5) specifically commented on the positive value of the simulation training to ‘role play’ and ‘troubleshoot’ in a practical scenario to improve their skills and confidence.
Across the three surveys, participants also reported that improving access to services for patients, including reduced travel time, was a motivator to offer telepractice services. They commented that the ability to increase the intensity of treatment and improve treatment continuity justified the use of telepractice. Finally, participants reported that a range of support mechanisms assisted the implementation of telepractice services. Access to experienced clinicians/champions available for support was perceived as valuable, as was printed resources and support via the Statewide Telehealth Service Desk. Comments were also made about the support and encouragement from management being an enabling factor.
Barriers
Barriers to successful implementation were related to (a) staff knowledge and training; (b) staff confidence; (c) client factors; and (d) infrastructure and resources. At baseline, participants reported a lack of training (n = 15) and experience (n = 8); however, encouragingly, by the post-training surveys, the number of respondents nominating training/experience as a barrier had reduced (n = 2 and n = 3 respectively). Similarly, participants (n = 8) initially reported their confidence in the use of telepractice as another limiting factor to implementation. As per their knowledge and training, a lack of confidence was reported by nil participants immediately post-training; minimal to no participants as a barrier to using telepractice post-training.
Content analysis of perceived barriers to telepractice.
Discussion
This study demonstrated that a comprehensive telepractice training package can improve staff skills and confidence in the use of telepractice. The training package has been shown to be applicable to a range of disciplines working across a spectrum of outpatient services – yielding significant increases in knowledge and confidence across departments and professions that were sustained up to 6 months post-training. It can be hypothesised that knowledge and confidence may be intrinsically linked, and that knowledge even without real-world application does increase confidence in the use of telepractice. This is further confirmed by the work of Honey and Wright (2018) who found initial use of telehealth, hands-on training, specialty experience, mentorship and technological know-how as important factors in nurses’ self-assessment of telehealth confidence. This appears to have wider implications for telepractice training package design and highlights the importance of building on this body of evidence.
Perceptions towards the use of telepractice for clinical care was not impacted by training but was significantly impacted by profession. Specifically, analysis of interaction factors in the multivariable modelling demonstrated that nursing staff were significantly less accepting of telepractice than allied health professionals. This is the first known study to compare and find these disparate perceptions, specifically between nursing and allied health staff. Brewster et al. (2014) investigated staff acceptance of telepractice and found that nursing staff in particular were concerned about the impact of telepractice on their relationships with patients, as well as the nature of their caring role. It was suggested that these factors are likely to impact on clinical autonomy and credibility, especially where staff do not view telehealth as necessary or sufficiently beneficial. Greenhalgh and colleagues (2017) also suggested additional challenges with chronic disease nursing role or task complexity impacting on telepractice implementation. Although the simulation sessions in the current study were discipline-specific, the introductory sessions and written resources were multidisciplinary in nature, which may have contributed to nursing participants feeling less prepared or willing to convert their outpatient services to a videoconferencing-based model. Further investigation into the relative contribution of profession on long-term telepractice uptake and the causes of profession-specific barriers is warranted.
This research also provides further insight into the complex nature of telepractice uptake and associated behaviour change beyond that of highlighting the importance of training. Whilst the varied methods of training employed in this study helped to address some barriers to telepractice implementation (specifically knowledge and confidence), it did not directly correlate with improved telepractice uptake across the 6 months post-training. This stands in accordance with Edirippulige and Armfield (2017) who stated that despite a growing literature base, substantial financial investment and policy changes within governments, the integration of telehealth into routine clinical care has been limited. It is acknowledged that the follow-up window for recording telepractice OOS (6 months) may have been too short to be responsive to instigating clinical practice change in complex clinical settings. Investigating longer term uptake (>12 months following training) was not within the scope of the current study, however is warranted to explore factors underpinning the delayed time between knowledge consolidation and telepractice implementation.
Limitations and Future Directions
A number of limitations to the current study are acknowledged. Firstly, the sample size of participants decreased throughout the study period from 41 to 23 (56%), chiefly due to standard staff turnover rates across the three departments. This demonstrates the recurring challenges associated with maintaining effective training of the clinical workforce. Additionally, clinicians noted difficulty in identifying suitable patients for telepractice, which did not improve post-training or implementation. This was further confounded as clinicians reported a low throughput of eligible patients which reduced motivation to implement the service. Clinicians also reported infrastructure challenges which did not improve post-training, including patient access to the internet/appropriate hardware and clinicians’ own connectivity issues. It should be acknowledged however, that at the time of writing this report, the health service has changed dramatically with a large-scale uptake of telepractice in response to the COVID-19 pandemic (current study conducted prior to COVID-19). It can be hypothesised that this is likely to have increased the throughput of eligible patients (through increased technology literacy), increased patient-led demand and overall acceptance of telehealth. Whilst we acknowledge that connectivity (especially in rural areas) remains a challenge, technology is likely to be rapidly upscaled to meet the demand.
Other departments within the health service also increased utilisation of telepractice in response to the COVID-19 pandemic. Because staff within these other departments had not participated in a structured training package, in order to respond to the urgent need for change, staff were required to learn how to deliver services via telepractice as they were delivering care via this modality. There may be benefit in future studies to compare the difference in effect on confidence, skills and knowledge when completing a structured training program versus an immersive learn-as-you-go model.
Conclusion
In summary, this study provides valuable insights into the impact of a multidisciplinary telepractice training package in improving knowledge, skills and clinician confidence. This study also provides further evidence to support the use of complex and varied strategies to support sustainability across these domains. Furthermore, supporting and maintaining a positive telepractice culture within organisations as well as addressing real and perceived client factors appear integral to telepractice uptake.
Footnotes
Acknowledgement
We would like to acknowledge Dr Clare Burns for her expert consultation in the development of training resources.
Declaration of conflicting interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship and/or publication of this article.
Funding
The author(s) received no financial support for the research, authorship and/or publication of this article.
