Abstract
Background
Research has identified that virtual simulations may be effective in developing non-technical skills including communication, teamwork and decision making. However, little is known about how participants perceive learning non-technical skills via engagement in virtual simulation.
Aims
The aim of this research was to investigate participant perceptions and the learning experiences when engaging in virtual simulations focused on developing non-technical skills.
Method
A descriptive exploratory approach was used. An online voluntary survey collected qualitative extended responses from participants after each virtual simulation. Ethics approval was obtained for the research and guidelines adhered to throughout the study.
Results
A total of 675 responses were obtained. Participants perceive that engaging with the virtual simulation made them aware of non-technical skills including communication, teamwork, decision making, critical thinking and problem solving, and, to a lesser extent, situational awareness. Additional categories of learning, clinical practice and limitations were identified.
Conclusions
Engaging in virtual simulation can develop awareness of non-technical skills, as well as confidence and vigilance in practice and mindfulness of a person-centred approach to healthcare. Engaging in virtual simulation may support change in the professional performance of the participants through role modelling and learning through error.
Keywords
Introduction
Patient safety is at the forefront of healthcare and is an important construct in clinical practice for health professionals, managers, organisations, patients and families. A critical component of patient safety, considered important in error reduction, is non-technical skills. Non-technical skills are the cognitive, social and interpersonal skills required for safe and competent clinical performance (Flin et al., 2013). Non-technical skills include categories of communication, teamwork, decision making, situational awareness, leadership, coping with stress and managing fatigue. Failures in non-technical skills such as leadership, situation awareness, team working and decision making are linked to adverse events and medical error, resulting in unintentional, but at times serious harm to patients and contributing to patient death (Uramatsu et al., 2017).
Simulation is suggested to provide a robust and effective strategy to successfully develop non-technical skills (Unsworth et al., 2014). However, there are challenges in implementing simulations using traditional face-to-face approaches in clinical and educational settings. Simulation facilities and resources can be costly to build, maintain and run (Kelly et al., 2016). Face-to-face simulation is reported to be resource intensive regarding faculty, equipment and space (Bonnetain et al., 2010), with challenges described in scheduling activities (Andreatta et al., 2010). Additionally, there is limited opportunity for repetition of learning experiences across large numbers of learners (Liaw et al., 2016). Finally, although physiological responses in many human patient simulators can be repeated (Cumin et al., 2015), there are concerns over consistency of learning experiences and assessment of performance (Manz et al., 2013; Peterson et al., 2017), particularly when implementing multiple, simultaneous simulation experiences across large student cohorts.
Virtual simulation is suggested to provide a more sustainable approach that is flexible and reproducible and can be disseminated across large numbers of learners (Cant and Cooper, 2014). Virtual simulation provides a safe learning environment (Duff et al., 2016), permitting access to essential, but at times unavailable, clinical situations for practice and learning (Posel et al., 2009) and supports individual or team-based interactions (Cant and Cooper, 2014). In this paper, virtual simulation represents simulation activities with which learners engage via a computer screen, which involves videos of human actors as characters in real-world clinical encounters.
Traditionally, virtual simulation has been used to develop diagnostic and clinical reasoning in nursing students (Forsberg et al., 2016); however, advancements in technology, internet speed and educational methodologies (Cant and Cooper, 2014) have seen the development of virtual simulation to address more diverse areas of learning. Recent research has suggested that virtual patient simulations may be effective in developing non-technical skills, including communication, teamwork and decision making (Peddle et al., 2016). Some studies address elements of non-technical skills, such as teamwork training, communication and situation awareness; however no paper addresses the comprehensive suite of non-technical skill categories identified as critical components of safe and competent practice for health professionals. Additionally, the focus of the published research relates to the effectiveness of the resources in developing identified learning outcomes. No paper focuses on the learning experiences and perceptions of the participants engaging in virtual simulation to develop non-technical skills.
Research question
The aims of this research are to address the gap in the literature, explore participant learning experiences and investigate participants' perceptions of engaging in virtual simulation to develop non-technical skills. This research posed the following question: What are participant experiences and perceptions of engaging in virtual simulation activities to develop non-technical skills?
Virtual Simulated Patient Resource
The Virtual Simulated Patient Resource (VSPR, www.vspr.net.au) is web based and provides health professionals an opportunity to engage in virtual simulations to develop foundational knowledge, skill, attitudes and practice of non-technical skills. The VSPR enables participant-centred learning via constructivist approaches. Learning is an active process where the participant uses reflection and constructs knowledge based on past and current experiences (Rogers, 2011). Using a ‘choose your own adventure game’ approach, the virtual simulations present a patient narrative, portraying consequences of actions and decisions via a branching design (Bearman, 2003). Learners engage in the simulation as themselves. Based on cues presented in video vignettes of realistic clinical situations and characters, participants make decisions to advance the simulation. Feedback is inherent in the patient's clinical outcome, with debriefing concluding the simulation activity. The virtual simulations provided in VSPR, in the form of virtual patients, present a unique, holistic approach to the development of non-technical skills, as they aim to develop all categories of non-technical skills including teamwork, communication, leadership, situation awareness, decision making, coping with fatigue and managing stress. The VSPR site comprises seven virtual simulation scenarios. The virtual simulations have established learning outcomes (International Nursing Association for Clinical Simulation and Learning (INACSL) Standards Committee, 2016b) and enable facilitation to meet established best-practice criteria (INACSL Standards Committee, 2016a).
Method
Design
A qualitative descriptive exploratory approach was used to investigate participant experiences when engaging with the virtual simulations in the VSPR.
Data collection
An online, anonymous, voluntary survey collected extended qualitative responses from participants who engaged with the virtual simulation. The use of qualitative surveys with open-ended questions is deemed appropriate for investigation into new and emerging areas (Ahrweiler et al., 2014). Immediately after each simulation, participants were invited to take part in the research. In this study, the use of an open-ended survey immediately following the simulation aimed to capture the dominant reactive thinking of each participant to highlight their individual learning experience (Schiek and Ullrich, 2017). Participants were informed that their responses were anonymous, and responded to one open-ended question: What are your thoughts about the (scenario title) scenario? Data were automatically collated and stored on the server. Participants could respond to the survey multiple times after each simulation.
Research setting
The VSPR is a freely available web-based program accessed via registration on its website. Registration is open to all individuals with no limitation. During registration, participants used a tick-box approach to consent to be involved in research that uses anonymised data.
Population and sample
Recruitment to the study was not conducted. Participants who registered on the VSPR website between implementation in December 2013 and December 2017 and had consented to participate in the research comprised the study sample. During registration, participants recorded demographic details including level of education, specifying year if undergraduate, university or clinical venue and profession. Due to the anonymity of the data collected, it was not possible to identify the demographics of the participants in the sample relative to survey responses.
Data analysis
Data were analysed using inductive thematic analysis. Thematic analysis was selected to ensure participant voices were heard in this new area of research (Clarke and Braun, 2017). Data were downloaded from the website in CSV files and converted to Word documents for uploading into NVivo for analysis (QSR International, Version 11). Two research assistants independently undertook the inductive thematic data analysis. Data were read and re-read, with interesting factors identified as codes in NVivo. Final categories and subcategories were determined by review and discussion of the analyses with the author. To ensure they were grounded in the data, the author checked all final categories and sub-categories against coded passages.
Findings
Of the 9449 users who registered on the site between December 2013 and December 2017, 1892 consented to participate in research; of those registered, 376 accounts were inactive. A representation of current participants who registered and consented to take part in the research by profession is presented in Figure 1; level of education, including year if undergraduate student, is presented in Figure 2; and country of access is shown in Figure 3.
Participants by profession. Participants by level of education. Country of origin.


Number of responses per scenario.
Non-technical skills
Non-technical skills (n = 117, 20%).
Learning
Learning (n = 256, 43%).
Clinical practice
Clinical practice (n=139, 23%).
Barriers to and limitations for learning (n = 81, 14%).
Discussion
This study sought to investigate participant learning experiences and perceptions regarding the use and impact of virtual simulation, designed for health professionals learning non-technical skills. Participants detailed that learning via engagement with the virtual simulation developed awareness of non-technical skills including teamwork, communication, decision making, critical thinking and problem solving, with some reporting of situational awareness. A further three categories were recognised in the data: learning, clinical practice and limitations for learning.
Overwhelmingly, participants viewed the experience of engaging in the virtual simulation to develop non-technical skills as positive, with 25% of all statements coded to this sub-category. Participants stated they enjoyed the interactive experience of the ‘choose you own adventure game’, indicating the activity was interesting, enjoyable and creative. Many participants stated that the virtual simulation was ‘useful’ and ‘worthwhile’ for learning non-technical skills and was relevant to their practice. The learning experience when engaging with the virtual simulation was enjoyable and applicable and motivated learners to participate, which, in accordance with prior research, supports engagement in virtual environments and enhances learning (Alexander, 2018; Budhai, 2017).
Participant engagement in the virtual simulations was enhanced by active participation and experiential learning approaches (Budhai, 2017). Active participation involves placing participants in meaningful activities, requiring them to think about what they are seeing and hearing and the decisions they are making (Budhai, 2017). In the virtual simulation, participants are required to choose a course of action to advance the simulation, enabling active participation. Moreover, the use of realistic clinical situations, environments and characters supports experiential learning. The findings of this study suggest that the ability of the virtual simulation to enable learners ‘to go beyond the confines of the online classroom and connect their learning to the real world’ (Budhai, 2017: 2) may further promote learning related to non-technical skills.
The ability of participants to see consequences of decisions was emphasised as a positive element in learning non-technical skills via the virtual simulation. It is proposed that learning via error, partnered with feedback, results in more effective learning (Metcalfe, 2017). For learning by error to be effective, participants need to understand where the error was made, what the correct answer is and why (Metcalfe, 2017). Engaging in the virtual simulation enables participants to go back and repeat the activity and identify where the mistake happened, supporting clarification and understanding of the situation and correction of learning. Moreover, learning via errors can make participants more vigilant in practice, promoting transfer of learning to practice, supporting safe and competent patient care (Reime et al., 2016).
Responses to the virtual simulation ranged from participants finding the approach to be ‘a bit tricky’ and challenging to complete, to ‘Yeah it was good, fairly easy though…’. The variety of responses aligns with the range of participants registered on the site from novice undergraduate health professional students to experienced, expert practitioners (Benner, 1984). Novice learners tend to be rule bound, hence identifying cues and using discretionary judgement when situations deviate from the norm can be challenging (Benner, 1984). The lack of clinical experience may make it difficult for the novice learner to identify cues and use discretionary judgement as they are rule bound (Benner, 1984). Conversely, expert practitioners with vast clinical experience can easily and readily identify cues and acquire an intuitive grasp of the clinical situation as a whole (Benner, 1984). Accordingly, experts who have more flexibility in adapting skills to meet the needs of a clinical situation may find the learning activity ‘a bit easy’. Nevertheless, some participants who stated the simulation was ‘easy’ qualified that engaging in the virtual simulation remained a good learning experience. The findings of this study suggest that the virtual simulation may be useful across the learning continuum to clarify and reinforce knowledge, skills and attitudes related to non-technical skills. Further research is required to investigate the association between the level of learner and the perceived degree of complexity of the virtual simulation.
The findings of this research reinforce the importance of role modelling in health professional education, in developing a professional identity, professional behaviours, (Sternszus and Cruess, 2016) and confidence in clinical performance (Jack et al., 2017). Participants indicated that the portrayal of a ‘real’ clinical practice environment in the virtual simulation enabled them to understand the setting. The ability of the virtual simulation to depict the imperfect reality of practice, including exemplars of ‘good practice’, facilitated role modelling of expected behaviours in the clinical practice setting. Some participants clarified that this role modelling assisted them to translate the learning into practice. Additionally, participants suggested that engaging with the virtual simulations clarified practice related to procedural or technical skills. The ability of the virtual simulation to clarify technical skills and develop a clearer understanding of correct procedural steps and techniques may improve confidence and competence ‘with consequent, positive flow on effects on patient outcomes’ (Rivière et al., 2017: 1).
An interesting feature identified by some participants was the development of an awareness of the patient, family and significant others at the centre of care following engaging with the virtual simulation. The virtual simulation made participants aware of seeing the person and the significance of involving patients in all healthcare decisions. Person-centred care ‘places people as equal partners in addressing their individual healthcare needs’ (Hardy, 2015: 519). Being aware of the person at the centre of the care episode ensures that care is person centred, meeting the needs of the individual and enhancing positive and appropriate care outcomes (Hardy, 2015). Engaging with the virtual simulation should enhance participants’ awareness of the person at the centre of the care situation and promote more effective care interactions between the person in need of care and the health professional (Hardy, 2015). This finding reinforces previous research that identifies narrative approaches in virtual simulation, depicts the patient story and enables participants to experience the psychosocial aspects of a patient encounters (Bearman, 2003).
There were limitations identified by the participants that may have negatively affected learning. Some participants identified a lack of instruction and orientation to the activity, including how to engage with the simulation and what it was they, as participants, had to do. Participants identified that the options presented to advance the simulation were limited or not correct and the wording of some questions was confusing. The lack of orientation and the confusion during the learning activity may trigger learners to disengage and undermine learning (D’Mello et al., 2014). However, confusion is also suggested to be a positive emotion in learning when the participant is faced with a complex task (D’Mello et al., 2014). Due to the large numbers of novice learners (Figure 2), D’Mello et al. (2014) suggest that confusion would be the norm rather than an exception. One aspect that participants suggested would add to the learning experience was the provision of detailed feedback in the form of report or evaluation of performance at the end of the simulation. Although providing feedback is deemed important for learning as it provides a process during which learners obtain information about their performance, act on that information and generate improved work (Boud, 2015), participants in the present study reported learning from engaging in the virtual simulation without detailed feedback. However, the provision of a written summary may help participants understand ‘why they got it wrong’, which is important in learning by error (Metcalfe, 2017). The items identified above may warrant further consideration in order to mitigate interruptions in the learning process.
Strengths and limitations of the study
The broad open-ended survey question enables the dominant thinking of the participant to be captured immediately following the learning experience. Data were collected over a prolonged period and present continued observations. Independent data coding and use of discussion and consensus to identify categories strengthen findings and add credibility. Additionally, triangulation of data from multiple sources and a data audit, consisting of checking final categories against coded passages, adds credibility to the data analysis process. Participants have the option to consent to participate in studies with no impact of their access to the courses.
Although the results are drawn from a large population, the anonymous nature of the survey responses precludes generalisation of findings or further analysis. Additionally, the experience of the participants, including academic and clinical, has considerable variation and it is unknown whether participants completed the activity individually or in groups, which may impact participant perceptions. Participants may have responded to the survey more than once for each simulation activity, which may result in data arising from dominant participants and not being representative of the population. The use of a single question does not enable deeper exploration of interesting factors. Moreover, it is important to note that the author led the development, design and authorship of the virtual simulation project.
Recommendations
When implementing virtual simulations to develop non-technical skills, the findings of this study suggest virtual simulations require active participation and need to be underpinned by experiential learning. Virtual simulations should depict authenticity in the scenario, characters and setting and be appropriate to the learning needs of the participant audience. Participants should be able to experience consequences of decisions with feedback, to identify not only what the error was, but also why it occurred. Virtual simulation should provide exemplars and depict best practice for role modelling. Finally, virtual simulation needs to ensure clarity in instruction, wording of questions and suitable options to progress the simulation and limit confusion.
Conclusion
The findings of this study suggest that participating in the virtual simulation from VSPR is a positive and engaging learning experience, useful in developing awareness of non-technical skills including communication, teamwork, decision making, situational awareness, critical thinking and problem solving. Findings also suggest that engaging in virtual simulation may support development of clinical performance and confidence of participants through role modelling and learning through error. An unexpected finding of the study is the development of awareness of a person-centredness in participants, which may support the inclusion of the patient as a member of the healthcare team. Finally, addressing some identified limitations may further improve the learning experiences of participants when engaging with virtual simulations in VSPR.
Further research is required to explore the learning experiences of expert practitioners and the application of the virtual simulation in continuing professional development settings. Additionally, the ability of participants to transfer learning developed from engaging with the virtual simulation to practice in the clinical setting in patient care interactions requires deeper exploration.
Key points for policy, practice and/or research
Virtual simulation supports development of awareness of non-technical skills including communication, teamwork, decision making, critical thinking and problem solving and situational awareness. Learning in the virtual simulation is supported by interactive, engaging activities that portray realistic situations and characters that are relevant for practice, enabling participants to feel present in the situation and experience consequences of actions and visualisation of situations. Engaging in virtual simulation enables participants to develop confidence in their own practice by providing an insight into real clinical practice, exemplars of good practice and clarification of procedural and technical information, while emphasising the patient at the centre of care. Limitations for learning include lack of clear feedback and orientation, unclear and confusing questions, and limited options and instructions.
Footnotes
Declaration of conflicting interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Ethical permission
Ethics approval was obtained for the research and guidelines adhered to throughout the study (ethics approval ID number: CF12/3958 – 2012001891). The facility for ethics approval was Monash University.
Funding
The author(s) received no financial support for the research, authorship, and/or publication of this article.
