Abstract
Abstract
Telepsychotherapy is a cutting-edge intervention that shows great promise in the mental health care field. However, the possibility of developing a high-quality therapeutic alliance is often doubted when psychotherapy is provided remotely. This study assesses the development of a therapeutic alliance in individuals with posttraumatic stress disorder who were treated either by videoconference therapy or a face-to-face therapy. Forty-six participants with PTSD received cognitive behavioral therapy, 17 of them by videoconference and 29 in person. A variety of questionnaires evaluating the quality of the therapeutic relationship were administered at five different times during treatment. Each session was also assessed by the therapist and the participant immediately afterwards. The results indicate that a therapeutic alliance can develop very well in both treatment conditions and that there is no significant difference between the two. Certain clinical and practical implications are discussed.
Introduction
In a setting in which access to mental health care for the whole population remains a concern, telepsychotherapy offered by videoconference constitutes an interesting option for providing and supporting certain services remotely.6,7 However, some clinicians believe that the therapeutic alliance is at risk due to the rather unconventional nature of this kind of intervention, and thus they remain hesitant to use psychotherapy remotely. In fact, psychologists seem to spontaneously adopt a negative attitude toward this kind of service because, in their view, videoconferencing is likely to compromise the therapist's warmth, sensitivity, empathy, and understanding. 8
Nevertheless, one of the advantages of videoconferencing is that it constitutes a technology that enables individuals to see and hear each other in real time on a computer monitor or video screen. As a result, this technology is the one that most closely resembles a traditional face-to-face consultation. 7 Despite this advantage, it is important to consider the impact of this medium on the therapeutic relationship. Currently, the literature shows that the therapeutic alliance does not appear to be compromised by videoconferencing. Indeed, the few studies that evaluated this concern with several different psychopathologies show that there is no significant difference in the quality of the therapeutic alliance between traditional and videoconferencing therapies.9–12 Moreover, videoconferencing does not appear to compromise the scope or depth of the topics discussed in therapy or the emotions that clients feel. 11
Despite these results, the number of studies on the topic remains limited, and consequently the generalizability of the results is doubtful. Further, specific variables involved in videoconferencing that could have an impact on the therapeutic relationship have yet to be explored. For example, the level of comfort with remote communication or the initial perception of telepsychotherapy could harm the therapeutic relationship. More importantly, it is essential to consider the sense of presence felt when new technologies are used to provide therapy. 13 The sense of presence refers to the subjective experience of being in a specific place, whereas in reality, the individual is physically somewhere else. 13 It is therefore plausible to hypothesize that the absence of one of these conditions in a videoconference could potentially interfere with the development of a high-quality therapeutic alliance.
Psychotherapy provided by videoconference could benefit a great number of individuals with mental health problems, including the victims of traumatic events. To date, cognitive behavior therapy remains the therapeutic approach of choice in the case of acute or chronic posttraumatic stress disorder (PTSD).14,15 Because the therapeutic alliance seems to constitute a significant element in the process of change, 1 it is an important aspect to consider when psychotherapy is provided by videoconference, and especially to victims of trauma. Indeed, victims of trauma may sometimes adopt a defensive interpersonal style, characterized by mistrust. The creation of a therapeutic atmosphere that allows trauma victims to feel safe is therefore important in order to foster nonthreatening contact, which in turn promotes the healing of relational problems triggered by a traumatic experience. 16
The objective of this study is to assess the impact of cognitive behavior therapy for PTSD, administered by videoconference or face to face, on the development of a quality therapeutic alliance. In addition, an exploratory assessment of the relationship between certain variables specific to the context of videoconferencing is undertaken. The variables being assessed include the individual's comfort with remote communication, the sense of presence felt during a videoconference, the individual's initial perception of the videoconference, and the quality of the therapeutic alliance.
Methodology
Participants
Forty-six participants with a primary diagnosis of PTSD took part in this study. There were 29 participants in the face-to-face control condition and 17 in the videoconference condition. The smaller number of participants in the videoconference condition was due to the difficulty with recruiting participants in the remote location used, which is approximately 200 kilometers from Montreal. Participants in the face-to-face condition were recruited and treated in Montreal, while participants in the videoconference condition were recruited partly in the remote location (12 participants) and partly in Montreal (5 participants). As a result, the treatment protocol did not permit random assignment of participants to the two treatment conditions. The trauma that the participants experienced varied in nature (e.g., car accident or other kind of accident, war, armed robbery, physical or sexual aggression). All participants in the study were between 18 and 65 years old. Participants with a secondary diagnosis of schizophrenia, an organic brain disorder (e.g., dementia), a severe personality disorder, an intellectual disability, substance abuse/dependency, or a physical condition that would contraindicate participation in the study, especially in the videoconferencing condition (e.g., epilepsy or vision problems), were excluded from the study.
Treatment
All participants received cognitive behavior therapy over a period of 16 to 25 weeks depending on the type of trauma they experienced and the severity of the disorder. Therapy sessions took place for 1 hour each week. The therapy consisted of four separate modules, including a psychoeducational module on PTSD, training on anxiety management, imaginary and in vivo exposure to avoided situations, and strategies to prevent a relapse. 17 A treatment integrity rating chart for PTSD was used to ensure that the therapy provided respected the protocol.
Therapists
The treatment was administered by several psychologists who were trained in cognitive behavior therapy and had an average of 5 years of experience. The therapists treated participants in both conditions, thus making it possible to mitigate the impact of individual therapeutic style on the development of an alliance. None of the therapists had any experience with the use of videoconferencing before the beginning of treatment. A technician remained available in case needed, and a short training session on the use of videoconferencing was given to each therapist.
Measurement instruments
A diagnosis of PTSD was established using a semistructured diagnostic interview, the Structured Clinical Interview for DSM-IV (SCID). 18 Then the French versions of several questionnaires were used to evaluate the quality of the therapeutic relationship as well as other variables. The questionnaires used were chosen because of their good psychometric properties.
Working Alliance Inventory (WAI). 19
This is a self-administered questionnaire that assesses the quality of the therapeutic relationship between the client and the therapist. The questionnaire is divided into three subscales (goal, task, and bond) and there is a total score for alliance. The WAI is based on Bordin's tripartite model. 5
Session Evaluation Questionnaire (SEQ). 20
This questionnaire was completed following each therapy session by both the therapist and the client. It examines the participant's and the therapist's subjective impression of the therapeutic session, their respective assessments of the session, and the perceived competence of the therapist. The SEQ is divided into five bipolar subscales measuring depth (power and perceived value of the session), smoothness (degree of comfort, ease and security felt during the session), positivity (feeling of confidence and satisfaction), arousal (feeling of being stimulated, excited and making progress), and evaluation of the therapist. 20
Distance Communication Comfort Scale (DCCS). 21
This self-report questionnaire contains 27 statements relating to the comfort level with three different types of communication: face-to-face, by videoconference, and by telephone.
Videoconferencing Telepresence Scale (VTS). 22
This questionnaire includes eight statements that assess to what extent participants had the impression of “being with” the therapist during their most recent videoconferencing session. For each question, participants must indicate the extent of their agreement with a statement by using a percentage scale (0–100%).
Videoconference Therapy Questionnaires (VT-Q and VTSessions-Q). 23
The VT-Q has four items that assess people's perception of the application of videoconferencing to psychological treatment (e.g., “I would be more comfortable getting psychotherapy if the consultations were face-to-face”). The VTSessions-Q consists of six items rated on a 6-point scale (ranging from totally disagree to totally agree) and includes statements such as the following: “I feel better now that I have talked with my therapist,” “The videoconferencing system bothered me.”
Table 1 shows when the different questionnaires were administered. It is interesting to note that several questionnaires were administered before the start of in vivo exposure and then at the end of exposure. In vivo exposure may constitute a critical step in the development of the therapeutic alliance by activating and treating the negative emotions felt during exposure to avoided situations. It is therefore desirable to examine the effect of distance in this regard.
Pre-Tx, pretreatment; S1, Session 1; S5, Session 5; Pre-Exp., preexposure; Post-Exp., postexposure; Post-Tx, posttreatment.
Results
Preliminary analyses
Preliminary statistical analyses were carried out to ensure the equivalence of participants in the face-to-face and videoconference conditions. Independent t tests for age and nonparametric chi-squares for sex, education, and marital status revealed that the two groups were not statistically different for the four variables. Mean age for the two groups was 42 years old. There were 11 women and 6 men in the videoconference condition and 16 women and 13 men in the face-to-face condition.
T tests were also conducted to ensure that the two groups were equivalent in terms of the severity and frequency of PTSD symptoms, as measured by the Modified PTSD Symptom Scale (MPSS). 24 The results do not show any significant difference between the groups. Finally, it is important to determine whether the intervention is effective. The results obtained on the MPSS show a significant decline in the severity and frequency of PTSD symptoms between the beginning and the end of therapy in both treatment conditions: F(1, 42) = 42.61, p < 0.0001. No significant difference was observed between the two conditions in this regard. 25
Primary analyses
Working Alliance Inventory
A repeated-measures analysis of variance (ANOVA) was completed to compare WAI scores for the two treatment conditions at the five different moments of evaluation (after sessions 1 and 5, before and after in vivo exposure, and at the end of treatment). The analyses do not reveal a significant interaction effect, suggesting that there is no significant difference in alliance development between the two conditions. In addition, the results show a significant effect of time for the overall WAI score, F(4, 176) = 15.79, p < 0.0001; for the task, F(4, 172) =10.78, p < 0.0001; for the bond subscales, F(4, 176) = 9.924, p < 0.0001; and for both treatment conditions. More detailed analyses using a posteriori contrasts revealed significant linear and quadratic trends for the overall score: linear, F(1, 44) = 22.95, p < 0.0001; quadratic, F(1, 44) = 23.11, p < 0.0001; and for the two subscales: task, linear trend, F(1, 43) = 17.51, p < 0.0001; task, quadratic trend, F(1, 43) = 15.42, p < 0.0001; bond, linear trend, F(1, 44) = 20.07, p < 0.0001; bond, quadratic trend, F(1, 44) = 6.47, p < 0.05). A simple effects analysis of the means revealed a continuous progression in therapeutic alliance over time, with a slight decline posttreatment, explaining the quadratic effect. However, this posttreatment decline was not significant.
Despite a significant effect of time at the five points of measurement, a significant effect of time between the beginning and end of in vivo exposure for the overall score and the bond, as well as task subscores, was not found. Nor was a significant difference found between the two treatment conditions, suggesting that videoconferencing does not appear to have an impact on alliance, even at critical anxiety provoking moments.
The data for the goal subscale of the WAI was not normally distributed because of a considerable ceiling effect. In fact, more than one quarter of participants obtained a score of 27 or more out of 28 on this subscale at all times of measure. The data at the five moments of evaluation were therefore dichotomized, with the value 0 being assigned to scores of less than 26.5 and the value 1 to scores from 26.5 to 28 (maximum score). Nonparametric chi-squares revealed that there was no significant difference between the two treatment conditions for this subscale at any of the moments of measure. However, a significant increase with time was observed in both conditions. Table 2 shows the means (percentage for the goal subscale) and standard deviations for the overall score and the three WAI subscales for the five points of measure.
VC, videoconference; FF, face to face.
Session Evaluation Questionnaire
In order to examine the relationship between therapists' evaluations and those of their clients, correlations between each of the SEQ subscales were investigated for both treatment conditions. All the correlations for the face-to-face condition proved to be significant except for the therapist evaluation subscale. The following scores were obtained: r = 0.459, p < 0.05 for depth; r = 0.579, p < 0.01 for smoothness; r = 0.615, p < 0.001 for positivity; r = 0.472, p < 0.01 for arousal; and r = 0.184, p = 0.348 for therapists' evaluations. However, it should be noted that in the therapist evaluation subscale, the scores for questionnaires completed by clients were not distributed normally. Because of a strong ceiling effect, the scores for this subscale were dichotomized (score of 0 to 6.90 = 0 and score of 6.91 to 7 = 1).
As for the videoconference condition, the results showed a significant positive correlation for only one subscale (r =0.520, p < 0.05). Thus, there is a gap between therapists' and clients' perceptions of the meetings but also between how each person felt following the meeting and the therapist's evaluation score. An analysis of the means shows that clients generally assessed videoconference therapy meetings as being more meaningful than therapists did. For example, the clients were more likely to perceive the meetings as being full, powerful, special, and valuable. In addition, the clients evaluated the therapists more positively than the therapists did themselves in both treatment conditions. In the videoconference condition, it was also found that the therapists considered the meetings to be smoother (e.g., comfortable, pleasant, gentle, easy, and relaxed) than the clients did. The therapists also considered that their own arousal level during the meetings was higher than participants' arousal. In fact, the therapists were more likely than the clients to say they felt energetic, stimulated, active, and excited during the sessions. Nevertheless, correlation comparisons were calculated in both treatment conditions for all subscales. The results make it possible to determine that there is no significant difference between correlations in the two treatment conditions (p > 0.05 for all five subscales 26 ). Thus, although certain correlations between the clients' and the therapists' perceptions are not significant in the videoconference condition, the difference from the face-to-face condition remains too minimal to be significant.
Questionnaires related to videoconferencing
Finally, on an exploratory basis, correlations were conducted between the total score on the WAI and three different questionnaires related to videoconferencing: the DCCS, VTS, and VT-Q and VTSessions-Q. For the VTS, only the total scores were used. The results obtained do not reveal a significant correlation between the WAI and the VT-Q (pretreatment). However, significant correlations were found between the WAI and the VTS before and after in vivo exposure as well as at posttreatment. Significant correlations were also observed between the WAI and the VTSessions-Q at all moments of measure and between the WAI and the DCCS (videoconferencing subscale only) posttreatment. Table 3 shows the results from the correlations between the WAI and the different questionnaires, as a function of moment of measure.
**p < 0.01; *p < 0.05.
Pre-Exp., preexposure; Post-Exp., postexposure; Pre-Tx, pretreatment; Post-Tx, posttreatment; VC, videoconference; FF, face to face.
In order to better identify the predictive power of each variable, linear regression analyses were calculated for the WAI and the correlated variables based on the significant moments of measure. All of the basic regression assumptions were verified and respected. The results of the analyses done on preexposure and postexposure reveal a significant general model at both measurement times, with the following multiple correlation coefficients: preexposure, adjusted R2 = 0.525, F(2, 11) = 7.08, p < 0.05; postexposure, adjusted R2 = 0.703, F(2, 12) = 15.21, p < 0.01. Posttreatment, the VTS and DCCS constitute the two variables that correlate with the WAI. Once again, the general model is significant, with the following correlation coefficient: adjusted R2 = 0.418, F(2, 14) = 6.03, p < 0.05. Table 4 shows all the significant results of the regression analyses for each moment of measure. We see that the VTSessions-Q explains more of the variance than the VTS for both preexposure and postexposure. Once the treatment is completed, the VTS explains more of the variance than the DCCS (21% and 15%, respectively).
**p < .01; *p < .05.
Single variance: Preexposure = 26%; Postexposure = 32%; Posttreatment = 36%.
Common variance: Preexposure = 27%; Postexposure = 39%; Posttreatment = 6%.
Discussion
The results show that telepsychotherapy does not negatively affect the development of a therapeutic alliance in individuals with PTSD. These results substantiate the data from earlier studies on this subject.10–12 In fact, therapeutic alliances developed similarly, and markedly, in both the videoconference and face-to-face treatment conditions. Interestingly, the avoided situations treated during in vivo exposure did not appear to alter the quality of the therapeutic alliance in either treatment condition.
Another important point is that the alliance clearly does not appear to be negatively affected by certain variables associated with videoconferencing. For example, participants' initial comfort level with remote communication had no effect on the development of a therapeutic alliance during treatment. Similarly, participants' initial perception of telepsychotherapy meetings was not related to the development of an alliance. Thus, people who are not accustomed to this type of technology could successfully receive videoconferencing therapy despite their initial discomfort or prejudices concerning this type of communication. Interestingly, certain client variables, (e.g., a defensive attitude toward therapy and a lack of psychological preparation)27,28 that have been found to be associated with the development of an unsatisfactory therapeutic alliance in traditional therapy do not seem to have this negative impact on videoconferencing. It would have been interesting to examine the therapists' attitudes toward videoconferencing and find out whether an initial negative attitude on their part can affect the development of the therapeutic relationship. In fact, studies of therapists' characteristics that can have a negative impact on the therapeutic alliance show that therapists who are uncertain, critical, or tense are likely to undermine the development of the therapeutic relationship. 29 Thus, therapists who show this kind of attitude because videoconferencing is being used could harm the therapeutic alliance.
It was also found that the sense of presence felt during the videoconference and the perception of the session (complete immediately after the session) may be related to the therapeutic alliance. Measuring the differential impact of these two variables reveals that perception of the most recent session is a more powerful predictor of alliance than is the sense of presence felt. However, the sense of presence has more impact on the therapeutic alliance after the treatment is completed. According to Bouchard et al., 9 the feeling of a strong sense of presence could greatly facilitate the creation of a therapeutic bond.
One of the major strengths of this research is the use of a control group in the face-to-face condition, which allowed for the comparison of the results. In terms of limitations, technical problems occurred with the videoconferencing sessions. These problems were essentially the result of intermittent line breaks due to power outages, tests on the line by the technology center, or power surges on the transmission line when several systems were connected at the same time. For all these reasons, the sessions were sometimes abruptly interrupted or, in some cases, unable to even start. Although these problems occurred only occasionally, such sudden, unforeseen interruptions could potentially result in ruptures in the therapeutic alliance. 30 In general, these technical problems lasted only a few minutes, and the sessions were completed appropriately. If this was not the case, the therapists were also able to complete the sessions with their clients by telephone. It should also be noted that a resource person was always available on site if needed for technical support.
It is also important to mention that there is a slight time lapse in dialogue during videoconferencing, which may make communications less fluid. Further, certain subtle nonverbal signals might not be detected during a videoconference, either because one cannot always see an individual's entire body or because of slight interference in the image quality. Finally, during particularly difficult moments, the therapist may feel limited in his or her tangible ability to assist the client (e.g., by handing a tissue to a client who is crying). All of these characteristics could have damaged the development of a therapeutic alliance. However, it appears that these factors were not important enough to have a significant impact on the establishment of a quality relationship.
The results of this study are very promising for the health care system, especially for its beneficiaries. Despite the apprehension that distance could affect the therapeutic alliance and the presence of certain limitations associated with the videoconferencing system, it was found that the therapeutic relationship did not appear to be damaged and that it remained completely comparable to the kind of alliance that can develop during more conventional face-to-face treatments. Thus, it must be acknowledged that videoconferencing is a completely viable, attractive method of administering specialized health care services to individuals who would not otherwise have access to them. In light of the potential advantages of videoconferencing, various technical obstacles can be overlooked in order to improve access to health care and specialized services. Although the advances in technology allow videoconference systems to become increasingly more effective and reliable, it would be unrealistic and undesirable to substitute traditional services with this medium. Above all, the goal of videoconferencing is to ensure that services are made readily and quickly available. Of course, more studies are required in order to further evaluate the impact and effectiveness of videoconferencing.
Footnotes
Acknowledgments
This study was conducted thanks to a grant from the Social Sciences and Humanities Research Council of Canada (SSHRCC) and to research and infrastructure funding obtained from the Canada Research Chairs, the Canadian Institutes of Health Research, and the Canada Foundation for Innovation. We also thank the Centre de recherche Fernand-Séguin and the trauma studies center at Hôpital Louis-H. Lafontaine, the Centre hospitalier Pierre-Janet, and the cyberpsychology laboratory at the Université du Québec en Outaouais for their ongoing support throughout the project.
Disclosure Statement
The authors have no conflict of interest.
