Spanish-Speaking Therapists Increasingly Switch to Telepsychology During COVID-19: Networked Virtual Reality May Be Next

Abstract

Background:

Social distancing restrictions imposed due to the Novel Coronavirus 2019 (COVID-19) pandemic resulted in a rapid shift in the delivery of psychological interventions from in-person to telehealth. Much of the research on this transition has been conducted with English-speaking mental health providers, leaving a gap in understanding related to how this shift has impacted Spanish-speaking treatment providers.

Methods:

Fifty non-U.S. Spanish-speaking therapists completed a survey related to their use of telecommunication modalities; client population characteristics; professional, ethical, and legal/regulatory issues; and telehealth training and practice. Participants completed the survey at one time point and retrospectively described their use of telehealth both pre-pandemic and during the pandemic.

Results:

Most of the 50 Spanish-speaking therapists surveyed reported using telepsychology 58% before COVID-19 versus 84% during the COVID-19 pandemic (χ² = 5.76, p < 0.05). Compared with pre-pandemic, the number of hours therapists spent using telepsychology per week increased significantly for early adopter therapists (those who began using telehealth before the pandemic began) (Z = −3.18, p = 0.001) and also for late adopter therapists who only began using telehealth during the pandemic (Z = −3.74, p < 0.001). Many therapists reported equity issues. Most participants also reported ethical and regulatory concerns regarding security/confidentiality or Health Insurance Porability and Accountability Act.

Conclusions:

The rapid adoption of technology to deliver therapy during COVID-19 has spurred growing pains for Spanish-speaking therapists and their underserved clients, and more research is needed to better understand and improve the therapists' adoption of these technologies with diverse patient populations.

Introduction

The Novel Coronavirus 2019 (COVID-19) pandemic prompted mental health providers to shift treatment delivery from face-to-face to remote telehealth. The impacts of this rapid shift have been well documented in the United States^1

–4 (e.g., treatment for chronic pain and psychological problems). However, much less is known about how COVID-19 has impacted the use of telepsychology in underserved Spanish-speaking countries,⁵ leaving a gap in our understanding of how COVID-19 impacted Spanish-speaking treatment providers use of telepsychology.

While traditional face-to-face therapeutic services may have been impacted by COVID-19, the implementation of new technologies may mitigate disruptions in treatment delivery. For example, immersive virtual reality (VR) is a powerful new computer technology that therapists can use to help treat their patients by being able to meet as avatars, potentially increasing acceptance/dissemination of teletherapy, increasing compliance with homework assignments, improving therapeutic outcomes, and reducing costs.^6

–12

During VR mindfulness, participants wear a VR helmet that blocks their view of the real world, reducing distractions, and helps draw participant's attention into the mindfulness practice session. For example, in Mindfulness RiverWorld, patients float slowly above a three-dimensional computer-generated river, while observing sights and sounds and bringing their attention back to the river when their mind wanders (with audio instructions helping train them how to practice mindfulness). Our early case studies have shown that practicing mindfulness while in immersive VR resulted in large reductions in negative emotions and a large increase in positive emotions of patients with borderline personality disorder,¹³ severe burn injuries,¹⁴ and a severe spinal injury patient coping with recently being paralyzed after falling several stories out of a building.¹⁵ Preliminary results from controlled studies have also shown significant reductions in anxiety in patients with generalized anxiety disorder¹⁶ after treatment with a mindfulness-based treatment including VR mindfulness.

The current survey of non-U.S. Spanish-speaking therapists compares therapists' use, training with, and perceived benefits of online therapy before versus during COVID-19. We hypothesized that there would be a significant increase in the use of telepsychology during social isolation, and we predicted that the results would also indicate areas in need of improvement in terms of therapists' knowledge about rules and regulations of using telehealth. Regarding the impact of the COVID-19 pandemic on the therapists, we predicted that Spanish-speaking therapists would report feeling significantly more burned out during the pandemic than they felt before COVID-19.

Methods

Participants

A sample of 50 Spanish-speaking mental health professionals (e.g., licensed clinical psychologists, social workers, mental health counselors) were recruited to complete an online survey study on their use and experience with technology. Respondents were included if they were: (a) Spanish-speaking mental health professionals in Spain and/or Latin America and (b) provided mental health care (e.g., clinical therapy or clinical counseling services, or clinical social workers). Potential participants were informed about the nature of the survey, and 50 therapists anonymously clicked “continue to survey.” To ensure anonymity, participants were not asked to disclose personal information and were assured that no personal data would be collected that could potentially identify them, such as e-mail addresses. The current investigation was approved by the institutional review board at the University of Washington, Seattle, and was preregistered at ClinicalTrials.gov Identifier: NCT04360850.

Procedure

Prospective mental health professionals were recruited by invitation and were provided with a link to a secure online survey. These invitations were distributed to an unknown number of therapists via closed social media professional groups and electronic mailing lists from different boards, federations, and institutions associated with the mental health field, as well as peer-to-peer invitation. The online survey took ∼10–15 min to complete. The time frame of data collection was from April 24, 2020, to May 18, 2020. The researchers subsequently downloaded the de-identified data from www.limesurvey.org to analyze at the University of Washington, Seattle.

Instruments

The survey used in the current study was adapted and translated into Spanish by Sampaio et al.¹ who adapted from a 28-item survey by Glueckauf et al.¹⁷ The current survey focused on evaluating four key domains of using telehealth to deliver clinical services by Spanish-speaking professional psychologists before the COVID-19 pandemic: providers' use of telecommunication modalities; client population characteristics; professional, ethical, and legal/regulatory issues; and telehealth training and practice. Some questions were adapted to assess “before pandemic” versus “during pandemic” changes in clients' needs and therapists' attitudes and behavior toward using telepsychology to conduct therapy sessions, and five new questions were added regarding the therapists' self-ratings of burnout, use of mindfulness and VR devices, the therapists' interest in VR mindfulness for self-treatment to reduce the therapists stress levels, and how much they are volunteering telehealth support.

In the current study, Spanish-speaking therapists filled out the survey at one time point and were retrospectively reporting on their therapy practices before the pandemic versus during the pandemic. The survey started with a demographic section (e.g., age, gender, ethnicity), followed by 29 True False/multiple-choice questions regarding current professional status (e.g., primary profession, work setting) and previous education (e.g., time since graduation). Respondents were asked about their: (a) use of telepsychology before versus during the COVID-19 pandemic (e.g., “Have you been working with telehealth/telepsychology before the Novel Coronavirus pandemic started”); (b) changes in their recruitment and retention of patients before and during COVID-19; (c) types of telecommunication modalities used in clinical practice before versus during the COVID pandemic, and types of populations and settings; (d) therapists' burnout associated with delivering therapy before versus during COVID-19 (according to Freudenberger's¹⁸ definition of burnout); (e) therapists' ethical and legal/regulatory concerns related to delivery of telepsychology services; (f) therapists' views on education and training needed to use telepsychology in clinical practice; and (g) therapists interest in using immersive VR therapy (VR mindfulness) for self-treatment to help reduce the therapists stress in the future. The survey ends with an open answer section allowing professionals to comment about any other relevant information regarding the survey topics.

Data Analysis Strategy

Parametric and nonparametric statistics (t-tests, McNemar's test, and Wilcoxon signed-rank test) were used for within- and between-subject paired and independent comparisons. IBM SPSS¹⁹ was used to conduct data analyses.

Results

Sample Characteristics

The mean (M) age of the respondents was 39.48 years (standard deviation [SD] = 12.10 years, range = 22–78 years) from Spain and Latin America. Participants were 78% female. Ethnic background was predominantly Hispanic/Latino (60%), as well as Caucasian (36%) and middle Eastern (2%). The primary work settings were private practice (36%), university (24%), mental health clinic (18%), hospital (14%), group practice (4%), and public health (4%). The therapists' countries of origin were Spain (28%), Ecuador (20%), Mexico (20%), Argentina (14%), Columbia (10%), Chile (8%), Peru (8%), Uruguay (6%), and Portugal (2%).

Most therapists had worked a number of years since obtaining their highest academic degree (M = 13.82 years, SD = 11.25 years, range = 22–78 years) and had worked several years since licensure (M = 12.32 years, SD = 11.71 years).

Preference and Use of Telepsychology Before Versus During COVID-19

According to within-subject paired comparisons, the percentage of Spanish-speaking therapists using telepsychology was 58% before COVID-19 versus 84% during the COVID-19 pandemic, a statistically significant increase during the pandemic (χ² = 5.76, p < 0.05). Overall, the Spanish-speaking therapists surveyed reported no change in specific training about telehealth, 24% before COVID-19 versus 24% during COVID-19 (χ² = 0, not significant [NS]). Of the 50 respondents, 29 (58%) were early adopters and 21 respondents (42% of the Spanish-speaking therapist surveyed) only started using telehealth during the pandemic (late adopters).

As shown in Figures 1 and 2, descriptive statistics were used in an exploratory comparison of the characteristics of early adopters (29/50) versus late adopters (21/50). Early adopters showed little change in the categories of patients they treated before versus during COVID-19. As shown in Figure 1, nearly all (i.e., 95% before COVID-19 and 95% during COVID-19) of early adopters were treating adults, and many (25% before COVID-19 and 25% during COVID-19) were treating adolescents. Early adopter therapists (who were using telepsychology before COVID-19 began) reported a small decrease in treating elderly patients during COVID-19 and reported small increases in treating children, couples, and groups during COVID-19.

Fig. 1.

Percent increase in telepsychology during pandemic (for early adopter therapists).

Fig. 2.

Percent increase in telepsychology during pandemic (for late adopter therapists).

Late adopters showed much greater increases in the use of telehealth during COVID-19. For the survey questions shown in Figure 2, the percentage of late adopters treating adult patients increased from 19% before COVID-19 to 80% during COVID-19. Similarly, the percentage of late adopters treating adolescent patients increased from 10% before COVID-19 to 48% during COVID-19. Late adopter therapists showed small increases during COVID-19 in all other patient categories: children, adolescents, adults, elderly, family therapy, couples, and groups.

The survey also measured what different types of telepsychology technologies therapists were using before versus during COVID-19, for early and late adopters. As shown in Figure 3, before COVID-19, early adopter therapists were primarily using Skype, WhatsApp, personal phone calls, e-mails, and text messages to communicate with their patients before COVID-19, but the frequency of use of each of these technologies dropped during COVID-19. During COVID-19, for early adopters, the only technology that increased during COVID-19 was Zoom and Zoom Pro. So early adopters shifted from Skype, WhatsApp, and phone calls to predominant use of Zoom and Zoom Pro. As shown in Figure 4, late adopters showed a much different pattern of use of telepsychology technologies than early adopters. Before the pandemic, most therapists who were late to use telepsychology (i.e., late adopters) used phones, e-mails, and texts to communicate with their patients (if they used tele-technologies at all). However, during COVID-19, late adopters reported large increases in use of Skype, WhatsApp, Zoom, and phones during COVID-19. Interestingly, as shown in Table 1, 20% of early adopters reported using VR to treat their patients before COVID-19 began, and a large number of therapists (84%) expressed interest in trying immersive VR mindfulness to reduce their own stress in the future.

Fig. 3.

The most frequent modes of telecommunication used during teletherapy (for early adopters).

Fig. 4.

The most frequent modes of telecommunication used during teletherapy (for late adopters).

Table 1.

Therapists' Ethical and Regulatory Concerns About Using Telepsychology and Telepsychology Training Needs

	YES, %	UNSURE, %	NO, %
Survey on professional, ethical, and legal regulatory issues on telehealth training and practice (N = 50)
Does your malpractice carrier cover you for delivering telehealth services?	12	46	42
Do you think it is ethical for licensed mental health professionals to deliver services online or via other telehealth technologies?	92	0	8
Do you believe it is legal to practice over state lines or national borders using telecommunications technology if you call yourself a “coach”?	30	36	34
Do you think it is legal for licensed professionals to provide services online to someone who is located in a state or country in which you are NOT licensed?	28	34	42
Do you think mental health practitioners should undergo any training about: [The technical issues of telehealth]	94	0	6
Do you think mental health practitioners should undergo any training about: [Clinical, legal, and/or ethical issues in telehealth]	98		2
Do you think the average mental health professional can effectively screen for “at risk” clients (dangerous to self or others) using telehealth technology?	54	28	18
Are you aware of any state or federal law/s or regulation/s that govern the delivery of counseling services provided online or via other telehealth technologies?	30	14	56
Are you certified to work with telepsychology/telehealth? (Please remember that this survey is anonymous and that most places do not require certification in telepsychology/telehealth to practice it)	30	—	70
Did your Undergraduate or Graduate University program offer telepsychology/telehealth specific classes or content?	16	6	78
Do you think that it would be helpful for professionals to have training on telepsychology/telehealth as a part of their professional Undergraduate university program or Graduate University program?	96	—	4
What are your concerns about telehealth? (select all that apply)
Security/confidentiality or HIPAA compliance	62	—	38
Equipment costs	10	—	90
Licensure issues	42	—	58
Lack of personal training or education in this area	40	—	60
Lack of direction from my professional association	12	—	88
Lack of available education or training programs in this area	34	—	66
Lack of supporting research	26	—	74
Inability to handle emergency situations	36	—	64
Tried online therapy practice and decided it was not for me	0	—	100
Don't know how to get started with online practice	2	—	98
Don't understand issues involved with online practice	4	—	96
Don't have any concerns?	12	—	88
Have you been volunteering your services online to help people through the novel-coronavirus pandemic?	24	—	76

HIPAA, Health Insurance Porability and Accountability Act.

Forty-four percent of the 50 therapists reported a reduction in requests from current clients and 26% reported an increase in requests for therapy services from current clients during COVID-19, and 30% stayed the same before versus during the pandemic. Similarly, 38% of the 50 therapists reported a reduction in requests from new clients and 28% reported an increase in requests for therapy services from new clients during COVID-19, and 34% stayed the same before versus during the pandemic. As discussed next, early and late adopters ended up spending the same number of hours per week using telehealth during the pandemic.

Number of Hours Per Week Using Telepsychology

On average, overall (i.e., N = 50), the number of hours per week the therapist spent using telepsychology increased from 3.09 h/week (SD = 7.24) to 11.48 h/week (SD = 10.83) during the pandemic, which was a significant increase (Z = −4.82, p < 0.001). As shown in Figure 5, compared with pre-pandemic, the number of hours therapists spent using telepsychology per week increased significantly for early adopter therapists (Z = −3.18, p = 0.001) and also for late adopter therapists (Z = −3.74, p < 0.001).

Fig. 5.

Number of hours per week the therapist used telepsychology.

Attitudes Toward Telepsychology Before Versus During COVID-19

The following four Wilcoxon signed-rank related samples comparisons are shown in Figure 6. On a 0 to 10 scale, therapists reported becoming more comfortable using telepsychology during the pandemic (before COVID-19: M = 6.24, SD = 2.60 vs. during COVID-19: M = 7.60, SD = 1.73; Z = −4.26, p < 0.001). Therapists also became more confident providing telepsychology without an initial in-person assessment (before COVID-19: M = 5.18, SD = 2.46 vs. during COVID-19: M = 6.90, SD = 2.21; Wilcoxon signed-rank test with Z = −4.19, p < 0.001).

Fig. 6.

Wilcoxon signed-rank paired comparisons of therapists' comfort, confidence, burnout, and use of mindfulness, and percentage of therapists using telepsychology before versus during the pandemic.

Burnout, Mindfulness, and VR Mindfulness

On our single item 0–10 graphic rating scale measure, Spanish-speaking therapists reported a 16% increase in feeling burned out during the COVID-19 pandemic (before the pandemic: M = 4.94, SD = 1.98 vs. during the pandemic: M = 5.92, SD = 2.45; Z = −2.71, p = 0.007).

Therapists reported a small increase in their own personal mindfulness practices during the pandemic (before the pandemic: M = 1.36 h/week, SD = 1.69 h vs. during the pandemic: 2.04 h/week, SD = 2.50 h; Wilcoxon signed-rank test with Z = −2.12, p = 0.03). The therapists surveyed reported high treatment effectiveness using telepsychology. How effective do you think your telepsychology/telehealth services are? (0 = Not effective at all, 10 = Extremely effective) (M = 7.54, SD = 1.82).

Most respondents (84%) reported that they would use VR mindfulness for their own wellness for at least 1 h/week. Of those 84% responding yes, therapists estimated that they would practice 3.83 h (SD = 3.83 h) of VR mindfulness per week (Fig. 7).

Fig. 7.

Mindfulness RiverWorld, image by bigenvironments.com, copyright Hunter Hoffman, www.vrpain.com

Professional, Ethical, and Legal/Regulator Issues and Telepsychology Training Needs

Therapists' ethical and regulatory concerns about using telepsychology were also assessed (Table 1). Most participants reported concerns regarding security/confidentiality or Health Insurance Porability and Accountability Act (HIPAA) Compliance and inability to handle emergency situations. Respondents identified a need for increased specialized training and education in the future.

Equity Issues

Therapists raised a number of equity issues in the open-ended questions/comment section of our survey. Many Spanish-speaking patients have lost their jobs and insurance benefits during COVID-19 and cannot continue to pay for therapy sessions, particularly among underserved lower income patients. Many patients do not have the required technology (i.e., tablets, computer) and relied on phone calls. Other inequities therapists mentioned in the comment section include not having privacy for sessions (living in small houses with other family members, making it hard to speak freely to the therapist), not having proper access to technology, noisy neighbors, and difficulty in treating children. One therapist said that telehealth gave them a headache; one therapist reported that new patients were hesitant to sign up in case it was an online scam. Therapists commented that telehealth is very difficult with children, many patients suffering from addiction have abandoned their treatment, and emotion activation techniques are difficult online. Immunosuppressed patients were very grateful to get treatment without risking exposure to the virus, but some hospitals wanted in-person treatments to continue despite the dangers. One therapist said that they are treating patients who live further away than usual. Another therapist mentioned the lack for a legal framework for recording online sessions.

Discussion

The current study describes the implementation of telehealth and its impact on treatment delivery among non-U.S. Spanish-speaking therapists before and during the COVID-19 pandemic. There are several noteworthy outcomes from this study. For one, most Spanish-speaking therapists who responded to the current Spanish version of the survey were already using telehealth before the COVID-19 pandemic began. Both “early” and “late” adopters reported a large and statistically significant increase in the number of hours of telepsychology per week during COVID-19. Therapists reported becoming significantly more comfortable using telepsychology during the pandemic, and they became more confident providing telepsychology without an initial in-person assessment, but more burned out. Nearly all (98%) Spanish-speaking respondents recommended increasing training for therapists in college and just in time training. Finally, there was a small but significant increase in the number of hours per week the therapists practiced mindfulness. We describe the implications of these findings below.

The Spanish-speaking therapists mentioned a number of inequities in the open-ended comment section. The rapid adoption of technology to deliver therapy has spurred growing pains for Spanish-speaking therapists and their clients, and more research is needed to better understand and improve the adoption of these technologies with underserved populations. Therapist respondents identified a nearly unanimous need for increased specialized training and education in the future. Based on these and other results, updating/reducing regulatory restrictions on telehealth is also recommended. The following Telehealth COVID-19 report provides policy recommendations for future expansion of telehealth access to underserved Spanish-speaking Latino patients (https://latino.ucla.edu/wp-content/uploads/2020/05/Telehealth-COVID-19-Report.pdf).

There are disparities in telemedicine access for Spanish-speaking patients during the COVID-19 crisis,²⁰ but getting more contact information from Spanish-speaking patients (e.g., e-mail and medical portal activation) may increase their access to telemedicine. Taking that idea one step further, we recommend showing patients how to set up their cell phones and/or home computer and/or VR system and practicing telehealth communications with patients who are currently only “in person,” to make it easier for them to use telehealth. If they have a laptop or cell phone, they can bring those devices to the clinic to practice using telepsychology technologies (once patients and therapists get vaccinated and in-person visits become safer).

Future Directions: Immersive VR Telepsychology

The current results show a large increase in therapists' use of computer-augmented clinical therapy in Spanish-speaking therapists during COVID-19. The current survey suggests that immersive VR technology is beginning to be adopted into mainstream clinical practice in Spain and Latin America. For example, in the current survey, before the COVID-19 pandemic, 20% of the early adopter therapists indicated that they had used VR technology to help treat their patients. Furthermore, a large number of respondents (84%) expressed interest in trying immersive VR mindfulness to reduce their own stress. These results provide early indications that Spanish-speaking therapists are beginning to use VR to help their patients, a trend we predict will increase substantially in the future, as the use of VR becomes more mainstream and widely adopted by the general public, for example, for entertainment.²¹

Most therapeutic immersive VR experiences to date have been single user, with the patient receiving VR in the therapist's office while getting therapeutic guidance from the therapist who was traditionally also in the same room with the patient. During VR therapy (e.g., exposure therapy for spider phobia), patients put on a VR helmet and interact with objects in the virtual world (e.g., a virtual spider), while getting instructions and encouragement from their therapist. But, to date, most VR therapy patients have been alone in the single player virtual world. The therapist was not wearing a VR helmet. The therapist could watch what the patient was seeing and doing, via a two-dimensional computer monitor, but the therapist was in the real world, the patient was in the virtual world. In the future, with networked immersive VR becoming more widely available, secure, and inexpensive, therapists and patients in different physical locations can in theory “meet” and “be there together” in a shared computer-generated world designed for multiuser therapy sessions, including one-on-one sessions and group therapy sessions.²² Future studies may explore the use of new multimodal clinical telepsychology therapy treatment approaches that include networked shared immersive VR technology.

Limitations

The current study has several limitations to consider when interpreting these results. For one, this survey asked participants to retrospectively assess many items pre- and peri-COVID. Future studies should integrate multiple time points to assess change in desired variables. Most survey participants were identified as female, which may or may not accurately reflect the demographics, attitudes, and behaviors of Spanish-speaking therapists. The current study used an original single-item burnout rating that has not yet been validated. Although other studies have shown single-item burnout ratings to be valid,²³ future studies should also include traditional measures of burnout in which the validity and reliability have already been established. Although survey questionnaires are a valuable exploratory descriptive method, the use of more refined interviews and self-report measures as well as randomized controlled clinical and laboratory follow-up studies are needed to better understand the research topics addressed in the current study, and to test new treatments for reducing the psychological consequences of the COVID-19 pandemic. Sampaio et al.¹ evaluated for the first time the psychometrics of the current survey instrument. Based on their exploratory factor analyses, they recommended that for future studies, all items and response choices of surveys should use interval or ratio scales, or at the very least, ordinal, avoiding nominal categories and particularly avoiding multiple choices questions.²⁴

Conclusions

In conclusion, this online survey provided insight into the changes in telepsychology adoption and changes in Spanish-speaking therapists' attitudes and behavior toward using telepsychology to conduct therapy sessions in response to the COVID-19 pandemic. The current results indicate that there has been a significant increase in the use of telepsychology to conduct psychotherapy during the COVID-19 pandemic by mental health professionals in Spain and Latin American countries and now that they are using telepsychology regularly, most therapists surveyed now feel more comfortable using telepsychology with their patients, even without an initial “in person” assessment. However, a number of therapists still had ethical, training, and personal concerns regarding the use of telepsychology, and gaps in therapists' knowledge on these topics were evident, indicating a strong need for increased telepsychology training for therapists in the future. The current study also identified a significant increase in therapists' self-ratings of burnout during COVID-19, suggesting that Spanish-speaking therapists could benefit from additional training on their own stress coping skills during a crisis (e.g., practicing mindfulness while in a computer-generated virtual world,^{13

–16,25,26} and a number of other coping strategies could also be valuable). Finally, COVID-19 will likely increase the number of therapists needed in Spain and Latin American countries, and worldwide,²⁷ to help mitigate the long-term psychological and economic consequences of the pandemic.^28,29 If there is a growing gap between the number of patients and the availability of highly trained therapists, and economic considerations during a damaged economy, computer-augmented therapy may be a cost-reducing way to help increase dissemination of effective psychological stress reduction treatments to underserved patient populations. Research and development of “COVID-19 therapy” is needed (e.g., improving the user experience to reduce dropouts³⁰).

Footnotes

Disclosure Statement

M.S. is a co-owner of https://www.mindovermattersinstitute.com/mariana-sampaio-mhc-msw-cpp. C.W. receives consulting fees from Mindstrong Health and Lyra Health. H.G.H. is a scientific advisor to BehaVR.com.

Funding Information

Mariana and Sampaio worked on this project pro bono. During preparation of this article, Hunter G. Hoffman was supported by charitable funds from the Mayday Fund and by NIH R01 GM042725 to Dave Patterson; Maria Vicenta Navarro Haro was supported by Gobierno de Aragón (Group reference: S31_20D) and by Feder 2014–2020 “Construyendo Europa desde Aragón”; and Bruno De Sousa is a professor at the University of Coimbra.

References

Sampaio

, Haro

MVN

, De Sousa

, Melo

, Hoffman

. Therapists make the switch to telepsychology to safely continue treating their patients during the COVID-19 pandemic. Virtual reality telepsychology may be next. Front Virtual Real 2021; 1:576421.

Pierce

, Perrin

, Tyler

, McKee

, Watson

. The COVID-19 telepsychology revolution: A national study of pandemic-based changes in

U.S

. mental health care delivery. Am Psychol, 2021; 76:14–25.

Eccleston

, Fisher

, Howard

, et al. Delivering transformative action in paediatric pain: A Lancet Child & Adolescent Health Commission. Lancet Child Adolesc Health, 2021; 5:47–87.

Tauben

, Langford

, Sturgeon

, et al. Optimizing telehealth pain care after COVID-19. Pain, 2020; 161:2437–2445.

Hincapié

, Gallego

, Gempeler

, Piñeros

, Nasner

, Escobar

. Implementation and usefulness of telemedicine during the COVID-19 pandemic: A scoping review. J Prim Care Community Health, 2020; 11:2150132720980612.

Boeldt

, McMahon

, McFaul

, Greenleaf

. Using virtual reality exposure therapy to enhance treatment of anxiety disorders: Identifying areas of clinical adoption and potential obstacles. Front Psychiatry, 2019; 25;10:773.

Difede

, Cukor

, Wyka

, et al. D-cycloserine augmentation of exposure therapy for post-traumatic stress disorder: A pilot randomized clinical trial. Neuropsychopharmacology, 2014; 39:1052–1058.

Difede

, Hoffman

. Virtual reality exposure therapy for world trade center post-traumatic stress disorder: A case report. Cyberpsychol Behav, 2002; 5:529–535.

García-Palacios

, Hoffman

, Carlin

, Furness

, Botella

. Virtual reality in the treatment of spider phobia: A controlled study. Behav Res Ther, 2002; 40:983–993.

10.

Hoffman

HG.

Virtual-reality therapy. Sci Am, 2004; 291:58–65.

11.

Rizzo

, Bouchard

, eds. Virtual reality for psychological and neurocognitive interventions. New York: Springer, 2019.

12.

Rizzo

, Shilling

. Clinical Virtual Reality tools to advance the prevention, assessment, and treatment of PTSD. Eur J Psychotraumatol, 2017; 8:1414560.

13.

Navarro-Haro

, Hoffman

, García-Palacios

, et al. The use of virtual reality to facilitate mindfulness skills training in dialectical behavioral therapy for borderline personality disorder: A case study. Front Psychol, 2016; 7:1573.

14.

Gomez

, Hoffman

, Bistricky

, et al. The use of virtual reality facilitates Dialectical Behavior Therapy^® “Observing Sounds and Visuals” mindfulness skills training exercises for a Latino patient with severe burns: A case study. Front Psychol, 2017; 8:1611.

15.

Flores

, Linehan

, Todd

, Hoffman

. The use of virtual reality to facilitate Mindfulness skills training in Dialectical behavioral therapy for spinal cord injury: A case study. Front Psychol, 2018; 9:531.

16.

Navarro-Haro

, Modrego-Alarcón

, Hoffman

HG et al

. Evaluation of a mindfulness-based intervention with and without Virtual Reality Dialectical Behavior Therapy^® mindfulness skills training for the treatment of generalized anxiety disorder in primary care: A pilot study. Front Psychol, 2019; 10:55.

17.

Glueckauf

, Maheu

, Drude

. Survey of psychologists' telebehavioral health practices: Technology use, ethical issues, and training needs. Profess Psychol Res Pract, 2018; 49:205–219.

18.

Freudenberger

HJ.

Staff burnout. J Soc Issues, 1974; 30:159–165.

19.

IBM Corp. Released 2019. IBM SPSS Statistics for Windows, Version 26.0. Armonk, NY: IBM Corp., 2019.

20.

Blundell

, Kroshinsky

, Hawryluk

, Das

. Disparities in telemedicine access for Spanish-speaking patients during the COVID-19 crisis. Pediatr Dermatol, 2020. [Epub ahead of print]; DOI: 10.1111/pde.14489.

21.

Bailenson

JN.

Experience on demand: What virtual reality is, how it works, and what it can do. New York: W.W. Norton, 2018.

22.

Dilgul

, Hickling

, Antonie

, Priebe

, Bird

. Virtual Reality Group therapy for the treatment of depression: A qualitative study on stakeholder perspectives. Front Virtual Real, 2021; 1:609545

23.

Dolan

, Mohr

, Lempa

Using a single item to measure burnout in primary care staff: A psychometric evaluation. J Gen Intern Med 2015;30;582–587.

24.

McDonald

RP.

Test theory: A unified treatment. Mahwah, NJ: Erlbaum, 1999.

25.

Navarro-Haro

, López-del-Hoyo

, Campos

, et al. Meditation experts try Virtual Reality Mindfulness: A pilot study evaluation of the feasibility and acceptability of Virtual Reality to facilitate mindfulness practice in people attending a Mindfulness conference. PLoS One, 2017; 12:e0187777.

26.

Navarro-Haro

, Harned

, Korslund

, et al. Predictors of adoption and reach following Dialectical Behavior Therapy Intensive Training^TM . Community Ment Health J, 2019; 55:100–111.

27.

World Health Organization. Mental Health and Psychosocial Considerations During COVID-19 Outbreak. 2020. Available at https://www.who.int/publications/i/item/WHO-2019-nCoV-MentalHealth-2020. (last accessed June 17, 2021 ).

28.

Pfefferbaum

, North

. Mental health and the Covid-19 pandemic. N Engl J Med, 2020; 6:510–512.

29.

Singh

, Roy

, Sinha

, Parveen

, Sharma

, Joshi

. Impact of COVID-19 and lockdown on mental health of children and adolescents: A narrative review with recommendations. Psychiatry Res, 2020; 293:113429.

30.

Wilks

, Yin

, Zuromski

. User experience affects dropout from internet-delivered dialectical behavior therapy. Telemed J E Health, 2020; 26:794–797.