Abstract
During the past decades, little research has investigated the effects of immersion scheduling on the psychology classroom. Therefore, we sought to compare academic performance of students in 2-week immersion psychology courses to that of students in traditional 16-week courses. In Study 1, students who received instruction in a 2-week immersion course significantly outperformed their cohorts in a traditional 16-week course. In order to address potential limitations in the first study, in Study 2, we controlled for individual differences variables (e.g., cumulative grade point average), and results indicated significantly higher academic performance for students in the 2-week immersion course. In both studies, students in the immersion courses consistently evaluated the courses and their instructors significantly higher than those students in the 16-week courses. In light of our results and in contrast to critics, immersion courses may be useful and effective when teaching psychology.
Between 1995 and 1999, a number of researchers and national committees set to work on efforts to address scheduling and retention issues in secondary as well as higher education (Boyer Commission on Educating Undergraduates in the Research University, 1998; Kojaku, Nunez, & Malizio, 1998; Muraskin, 1998; U.S. Department of Education, 2001). As a result, there was a large push for immersion scheduling in both secondary and higher education (Lawerence & McPherson, 2000). The immersion course is defined as an educational schedule, in which students experience one course at a time by engaging in learning activities within extended blocks of time (Petrowsky, 1996; van Scyoc & Gleason, 1993). However, with this push came a backlash by many others who claimed that immersive courses are less effective than traditional formats (e.g., Daniel, 2000; Scott, 2003).
Although immersion scheduling has a history of selective use in higher education and is becoming increasingly popular in some universities (Davies, 2006), a review of the literature revealed a startling absence of rigorous empirical studies addressing academic achievement outcomes, particularly in psychology. As studies have demonstrated that immersion scheduling may increase college retention (e.g., Soldner, Lee, & Duby, 2000), academic self-concept (e.g., Richmond & Krank, 2007), and critical thinking (Burton & Nesbit, 2008; Jonas, Weimer, & Herzer, 2004; Mims, 1983; Richmond & Krank, 2007), we thought it is important to investigate the effects immersion scheduling has on the teaching and learning of psychology.
Currently, there have been only two studies that have specifically investigated the effects of the immersion scheduling in the psychology classroom. Ray and Kirkpatrick (1983) investigated the effects on knowledge and anxiety in two course lengths (15 vs. 3 weeks) for a human sexuality course; interestingly, they found no academic advantage between the two course lengths. In contrast, Anastasi (2007) found across different psychology courses (e.g., memory, research methods, and effective thinking), students in 2- to 5-week immersion courses sometimes had higher academic performance compared to students in traditional 16-week courses. Specifically, Anastasi found that the academic performance in the summer immersion sections only existed in certain courses and certain assignments (e.g., exam scores in a critical thinking course and research methods course). Unfortunately, this research was aggregated across different immersion course formats (e.g., 2, 3, and 5 weeks) and is difficult to assess which type of immersion course improved academic performance. Consequently, we sought to investigate the effect immersion scheduling had across courses, across levels of courses (e.g., first year to senior), and within only one type of immersion format (i.e., 2-week long course with no other course at the same time).
Beyond student academic performance, student ratings of instructors (SRIs) are widely used to determine instructor and course effectiveness (Heckert, Latier, Ringwald, & Silvey, 2006) and can be influenced in part by student engagement (Handlesman, Briggs, Sullivan, & Towler, 2005), professor–student rapport (Berglund et al., 2013; Ryan, Wilson, & Pugh, 2011), course size (Heckert et al., 2006), and course objectives (Gump, 2004). In the immersion literature, Anastasi (2007) is the only study to investigate the impact immersion scheduling may have on one aspect of SRIs. Anastasi found that students perceived the rigor of both immersion and traditional course formats as the same. Unfortunately, Anastasi’s measure of SRIs was a single measure, and the reliability and validity were not reported. Because SRIs may provide an assessment of the intended variables (i.e., course and instructor effectiveness) as well as identify possible mediating and moderating variables such as student engagement, which is important to study within the context of comparing immersion and traditional scheduling formats, we investigated the effects of immersion scheduling on SRIs.
Given the limited research in this area, in two separate studies, we sought to improve this area of research in several ways. First, in the few studies in psychology (e.g., Anastasi, 2007; Ray & Kirkpatrick, 1983), there seems to be conflicting evidence of the efficacy of immersion scheduling, and we sought to clarify these inconsistencies by initially comparing the two schedule formats on academic performance (Study 1) and then replicating this study to check for consistent results (Study 2). Second, in past studies (Anastasi, 2007; Burton & Nesbit, 2008; Richmond & Krank, 2007), 2- to 5-week and 3-week immersion courses were combined. In Studies 1 and 2, we were interested to see whether academic gains could be made in only a 2-week immersion course. Third, Anastasi reported no difference in perceived course rigor but did not report additional ratings from SRIs, so for both Studies 1 and 2, we sought to test whether course format differentially changed SRIs. Finally, in Study 2, we choose to replicate the findings of Study 1 on the effects immersion scheduling had on academic performance.
Based on our review of literature, for both Studies 1 and 2, we were interested in assessing these overarching research questions: (1) Are there academic performance benefits to teaching in a 2-week immersion course over that of teaching in a traditional 16-week course? (2) Are instructors viewed more or less favorably (as measured by SRIs) in a 2-week immersion course when compared to a traditional 16-week course?
Study 1
Method
Participants
There were 155 undergraduate psychology students who participated in this study; 61 students in 2-week immersion courses and 94 students in traditional 16-week courses. Participants were selected from six sections of three different sophomore- and junior-level psychology courses (cognitive development and learning, human development, and social psychology). Three instructors each taught one specific course in the 2-week immersion format and the same course in the traditional 16-week format. The sample consisted of 69.7% females. Although not directly measured, psychology students in our department typically consist of 1.2% American Indian, 2.7% Asian or Pacific Islander, 5.3% African American, 13.2% Hispanic, 70.8% White, and 6.1% declaring other.
Both course formats were virtually the same, with the exception of distribution of course instructional time. Both course formats required a total of 45 hr of instructional time. The traditional 16-week course format was delivered twice a week, for 1 hr and 15 min per meeting for a total of 45 instructional hours. Traditional 16-week courses were in the fall or spring traditional semester only. The 2-week immersion courses met 5 days per week for 4.5 hr per day, for a total of 45 instructional hours, and occurred between the spring and fall semesters during the university’s winter break. Students were only allowed to take one course over this time period. Consequently, both course formats were not offered simultaneously. Additionally, all students select to enroll in either format based on their own personal needs and are not required to take an immersion course. In both course formats, students often take the course for a required major course, minor course, and/or elective. Because this is a matched-pair design (i.e., each instructor taught both in the immersion and 16-week format), each instructor used the same teaching method, covered the same material, and used the same assessments for both the 2-week immersion and traditional 16-week courses. For example, both course formats were required to do quizzes, exams, and writing assignments (e.g., term papers and theory synthesis papers). Additionally, students in both types of courses engaged in collaborative writing and presentation assignments (e.g., a group theory paper and presentation of how cognitive development applies to K–12 classroom).
Materials and Measures
To assess our research question, each instructor collected course quizzes and test scores for each of their courses for research purposes after the course ended. Questions were multiple-choice, true/false, or fill in the blank. For each instructor, the test items for the 2-week immersion and traditional 16-week courses were identical. Averaged over the six courses, there were 150 questions (range = 55–207). The proportion for total correct answers of test and quiz questions was computed for each participant in each course, resulting in one measure of student academic performance for the course. To assess SRIs, we used the formal policy and procedures outlined by our university. Our university’s measure for SRIs loosely follows the guidelines set forth by Seldin (2006). These were four questions using a 1 (very poor) to 6 (excellent) response range. The exact wording of all four questions appears in Table 1.
Descriptive Statistics and Inferential Statistics of Course Evaluations for Study 1.
Note. aThere were different sample sizes for both the immersion courses (N = 59) and the 16-week courses (N = 85) on the four student evaluation questions. The Likert-type scale was anchored on 1 = very poor to 6 = excellent.
Procedures. This study was a post facto assessment of six psychology courses. As stated previously, each instructor taught the same course in the 2-week immersion and traditional 16-week course. After each semester ended, each instructor collected quiz and exam items and computed the percentage of correct overall for each student.
Results
To examine student performance, we conducted an independent t-test between the immersion and 16-week courses. Results indicate that students in the 2-week immersion courses (M = 84.33%, SD = 9.53%) performed significantly higher than students in the traditional 16-week courses (M = 75.58%, SD = 10.26%), t(153) = 5.33, p <. 001, d = .88. For SRIs, four independent t-tests were conducted. On all four questions, students in the immersion courses rated their courses and instructors significantly higher than the traditional courses (see Table 1 for descriptive data). As indicated in Table 1, all four t-tests produced large effect sizes.
Brief Discussion
We sought to answer two research questions. First, we were interested in investigating whether there were academic performance benefits to teaching in a 2-week immersion course over that of teaching in a traditional 16-week course. The results indicate that there was significantly higher student academic performance in the immersion courses. As Anastasi (2007) suggests, there may be several explanations for findings such as ours, in that students in immersion courses may be at an unjust advantage. Specifically, it may be argued that our results are a product of course size (i.e., immersion courses were smaller than the traditional courses). Becker, Sommer, Bee, and Oxley (1973) suggested that when courses are smaller, there is increased participation, which may lead to higher academic performance. However, we contend that students academically perform almost 10% higher because of reduced interference effects (see Roediger & Karpicke, 2006; Tulving & Psotka, 1971). Interference occurs either prospectively or retrospectively and occurs when new learning interferes with the recall of old learning or when old learning interferes with encoding of new learning. In the context of Study 1, we suggest that in a normal 16-week semester, often full-time students take four to five courses, which creates greater cognitive load, whereas in our 2-week immersion course, they typically only take one course. Thus, the amount of cognitive load is reduced, and there is far less potential for interference of any type.
Second, we assessed whether instructors were viewed more or less favorably (as measured by SRIs) in a two-week immersion course when compared to a traditional 16-week course. For all four SRI questions (Table 1), students consistently perceived instructors and the course in the 2-week immersion course as more positive than the same instructor in the traditional 16-week course. It is our opinion that students may rate instructors who teach the 2-week immersion courses higher because the immediate longer exposure (5–6 hr per day) over a short period of time (2 weeks) allows for a concentrated interaction between students and instructors that may increase student–teacher rapport.
Even though the difference between the two course formats had a large effect size, Study 1 was not without limitations that needed to be addressed, as they may restrict the generalization of results. First, selection effects could be at play in the Study 1 sample (see Beins & McCarthy, 2012; Campbell & Stanley, 1963; Nesselroade & Thompson, 1995). For example, course size, individual instructor differences, demographic differences, student collegiate grade point average (GPA), and higher education experience (e.g., total credits completed at this level) may impact student learning. Second, in light of the inconsistent findings in previous studies (e.g., Anastasi, 2007; Ray & Kirkpatrick, 1983), even though the results of Study 1 begin to establish a pattern indicating immersion courses may have positive effects on academic performance, we sought to replicate Study 1’s findings with an even larger sample size across several different types of psychology courses at several levels of the psychology curriculum while controlling for individual differences. In addition to improving Study 1 based on the limitations, we decided to add a more in-depth measure of SRIs with a particular focus on how students compared the course to other courses they have completed. For example, we assessed their perceived effort, intellectual challenge, grade expectations, and course involvement when compared to other courses and, as such, we were able to gain a deeper insight into the perceptions of these two course formats.
Based on strengthening Study 1, we sought to answer the following research questions: (1) After controlling for course size, overall students’ collegiate GPA, and education experience (e.g., total credits completed), is there a difference in students’ academic performance between 2-week immersion and traditional 16-week course?
(2) Is there a difference in students’ perception of teacher effectiveness, student involvement in the course, and students’ course ratings between 2-week immersion and traditional 16-week courses?
Study 2
Method
Participants
From the fall semester of 2006 to the spring semester of 2010, 957 undergraduate student participants enrolled in 12 sections of five different lower and upper division courses of psychology. Six instructors each taught one course in the 2-week immersion format and the same course in the 16-week traditional format. Both course formats required the same amount of instructional time (45 hr) and covered the same material. As was the case in Study 1, both course formats were identical in course structure (e.g., writing assignments, tests, quizzes, collaborative projects, instructional time, etc.) with the exception of course length. See Table 2 for descriptive data pertaining to the student participants and courses.
Demographic and Descriptive Data for Study 2.
Note. GPA = grade point average.
Procedure and Measures
This study was a post facto program assessment of our department’s psychology courses taught in both the immersion (2 weeks) and traditional (16 weeks) format. We obtained anonymous data on the variables described subsequently from our university’s Office of Institutional Research (OIR). There were four main variables (see Table 2 for descriptive demographic data). First, we requested and received standard demographic data (e.g., gender, ethnicity, and age) from OIR. Second, to assess academic performance, we received the final course grades for each student aggregated by format of course length (i.e., 2 vs. 16 weeks). Third, we collected individual differences variables to use as covariate measures to control for possible confounds. Specifically, based on work by Olani (2009), we collected data on university cumulative GPA as a measure of prior academic performance and by proxy a measure of performance goal motivation. Additionally, Rau and Durand (2000) suggest that when students progress in their higher education, they tend to select courses either personally or academically relevant to them, which is positively related to their GPA. We attempted to control for this selection bias by collecting data on the total credits that the students completed at our institution and using it as a covariate. As class size has been suggested as a mediator of student learning (Gilmore, Swerdik, & Beehr, 1980), we collected data on the number of students enrolled in each course.
Finally, to assess course evaluations and teacher effectiveness, we used the university’s SRI form. This form is divided into two sections. The first section consisted of the same questions used in Study 1 (see Table 3), which is loosely based on Selvin (2006). The second section of the form used a 7-point Likert-type scale, ranging from 1 = much lower to 7 = much higher to assess students’ perception of expected course grade, the amount of effort put into the course, the amount of effort to succeed in the course, and the student’s involvement in the course (e.g., doing assignments and attending class) when compared to other courses. Refer to Table 3 for a complete list of the questions and descriptive data.
Descriptive Data for SRIs for Study 2.
Note. SRIs = student ratings of instructors. aThere were different sample sizes for both the immersion courses (N =109) and the 16-week courses (N =478) on the four student evaluation questions. bThere were different sample sizes for both the immersion courses (N = 74) and the 16-week courses (N = 204) on the four-student evaluation questions. The Likert-type scale was anchored on 1 = very poor to 6 = excellent.
Results
To examine academic performance differences between the two course types, while controlling for the effect of cumulative GPA, course size, and total credits completed at the university, we first ran three independent samples t-tests 1 on each of the three covariates. Results indicate significant differences for all three covariates (i.e., course size, cumulative GPA, and total credits completed); specifically, students in the 2-week immersion courses had significantly higher academic performance over that of traditional 16-week course students, t(927) = 4.86 p < .001, d = 0.44; significantly smaller course size than traditional 16-week courses, t(927) = 16.46, p < .001, d = 1.49; and significantly more total credits completed than traditional 16-week course students, t(927) = 9.76, p <.001, d = 0.83.
To control for individual differences between students in the 2-week immersion course and the traditional 16-week course, we conducted an analysis of covariance on student academic performance, and results indicated a significant main effect of the between-factor course type, F(1, 898) = 41.53 p < .001, ηp 2 = .044, after covariates were considered. Even after adjusting for the covariates, students in the 2-week immersion courses had significantly higher academic performance than students in the traditional 16-week courses, F(4, 898) = 299.76, p <. 001, ηp 2 = .57. The covariate of cumulative GPA and total credits completed significantly influenced the dependent variable of academic performance, F(1, 898) = 903.79 and 7.87, p <. 001, ηp 2 = .50 and .01, respectively. However, the covariate of course size did not influence academic performance, F(1, 898) = .34, p >.05, ηp 2 < .001.
Two one-way multivariate analyses of variance (MANOVAs) were conducted to examine the effect of scheduling type on students’ perceptions of (1) teacher effectiveness and course content; and (2) students’ perceptions of effort and involvement in the course, for a sample of 587 students. For the first MANOVA, the dependent variables included the students’ rating of the course as a whole, the course content, the instructor’s contribution to the course, and the instructor’s effectiveness in teaching the subject matter. This gave us a total of four dependent variables. The results of the MANOVA show an overall significant difference between 2-week immersion courses and traditional 16-week courses in instructor evaluations, Wilks’
To examine whether scheduling type had an effect on evaluations of the course in comparison to other courses the student had taken, a one-way MANOVA was conducted. Specifically, questions on the student rating form included the amount of effort put into the course relative to other courses; do you expect your grade to be (higher than/lower than other courses); the intellectual challenge presented was (higher/lower than other courses); and the effort to succeed in the course was (higher/lower than other courses). A one-way MANOVA was conducted to examine the effect of 2-week immersion versus traditional 16-week courses on students’ course evaluations for a sample of 278
2
students. The results of the MANOVA show an overall significant difference between scheduling type in instructor evaluations, Wilks’
Brief Discussion
To assess our research question centered on the effects immersion scheduling has on academic performance, the data suggest that after controlling for selection effects (i.e., Nesselroade & Thompson, 1995) of cumulative GPA and total credits completed, students in immersion courses can perform just as well or better than students in standard length courses. Again, counter to Ray and Kirkpatrick (1983) and in support of Anastasi (2007), we found consistent results across various psychology courses supporting the use of immersion courses. As in Study 1, students may perform better in immersion courses primarily because of the lack of interference effects as previously discussed (see Roediger & Karpicke, 2006; Tulving & Psotka, 1971). That is, in a normal semester, often full-time students take four to five courses, whereas in our 2-week immersion course, they can take only one course. Thus, there is far less potential for interference and competing cognitive demand.
SRIs were utilized as a measure of course and instructor effectiveness per the suggestion of Heckert, Latier, Ringwald, and Silvey (2006). A large body of research has shown several factors may mediate or moderate the ratings students give of teachers and courses, such as engagement, student–teacher rapport, course size, and course objectives (Berglund et al., 2013; Gump, 2004; Handlesman et al., 2005; Heckert et al., 2006). Inconsistent with Anastasi’s (2007) finding of no difference in 1 SRI item (i.e., course rigor) between the two course types, we found that students in the 2-week immersion courses rated the course and instructor more highly than students in the traditional 16-week courses even with the same instructor. Specifically, students in the 2-week immersion courses rated their instructors as more effective and as contributing more to the course than students in traditional 16-week courses. These students also rated the course as better, and in comparison to other courses. In the 2-week immersion courses, students expected a higher grade, put in more effort to succeed, and felt that more of the time per week they spent on the course was valuable to their education. However, students did indicate that the 2-week immersion course was no different than a 16-week course in intellectual demand. This last point is important to note because it provides some evidence that the courses were equivalent.
Overall, we contend that students may rate the 2-week immersion course and instructors more highly than students in the traditional 16-week course because the condensed format allows for a large amount of interaction between students and instructors in a very short time span (2 weeks), which may bolster student–teacher rapport. Berglund et al. (2013) found the rapport between teachers and their students was the strongest predictor of teacher effectiveness ratings on SRIs, such that teachers were perceived to be more effective when they had better rapport with their students (see Benson, Cohen, & Buskist, 2005; Wilson, Ryan, & Pugh, 2010 for further examples). Our results indicate that immersion courses may promote, expedite, and -solidify student–teacher rapport, thus improving students’ perception of teacher effectiveness and overall course ratings. Furthermore, since students are only enrolled in one course during immersion scheduling, most of their time and effort is devoted to this single course, which may make their involvement in the course more salient when completing the student evaluations of course and instructor.
General Discussion and Conclusions
Throughout both studies, we consistently found students in the immersion format significantly academically outperformed their 16-week cohort who received instruction from that same instructor with the same course content. As we have argued, the immersion instructional format may be beneficial because there are fewer competing cognitive demands, and we suggest that, when possible, psychology departments may want to consider incorporating this instructional format more often. We also argue that when students academically perform higher in the immersion format, it may be due to developing a quicker and more established rapport with their instructors, which has demonstrated to increase academic performance (Wilson et al., 2010). Tentatively, based on our findings, psychology departments may consider using more immersion courses to increase student academic performance.
Additionally, throughout both studies, we consistently observed that students in the 2-week immersion course produced higher SRIs over that of the traditional 16-week course. Because of course length and time spent per day in class—everyday—we contend that students and instructors develop a heightened rapport. And as student–instructor rapport is purported as significantly contributing to student evaluations of instructor and course, the immersion format, when applicable, may be more beneficial to developing student–instructor rapport.
There are several instructional implications to our findings. First, our results counterclaims that immersion courses provide only “superficial” coverage of material and cannot provide the same content as traditional courses due to the reduced time period in which the course takes place (Wlodkowski, 2003). Second, if—as a psychology instructor—the course objective is to promote students’ basic knowledge and comprehension of course material and to have students think critically about course material, which Ormrod (2006) and Shell and Kleen (1992) suggest is critical in higher education, then it seems that immersion course may be an important modality of teaching. Finally, our Study 2 findings replicate the results of Study 1, implying that immersion courses are a practical option for both college administrators and students who may face obstacles such as decreased resources and course scheduling.
Alongside the educational implications of Studies 1 and 2, there are a few limitations. First, we did not study long-term retention (e.g., 6-month delay) of academic performance. Some may argue that retention rates are lower in immersion courses; however, Seamon (2004) suggests that most researchers do not track performance over time, regardless of course format, due to the difficulties associated with this process. If possible, future researchers would do well to investigate the long-term effects on academic performance of immersion courses. Second, both studies lacked a randomized double-blind control design. However, we attempted to diminish this limitation by controlling for teacher characteristics, using a matched-instructor design, and an extremely large sample size (i.e., Study 2). Finally, in accordance with Dunn’s (2008) argument for vigor over rigor, we present an ecologically valid study that may be helpful to psychology instructors. Specifically, Dunn argues that random assignment is not always ethical or practical in classroom research. Also, Dunn argues that again the ethical implication of having a true control group is problematic.
As Davies (2006) states, Advantages of intensive formats [immersion] can be both pedagogical and logistical. They can accrue to both student and instructor. They revolve around increased motivation, commitment, and concentration, diversity of teaching methods, stimulation and enthusiasm, stronger relations among students, and flexibility. (p. 19)
Footnotes
Authors’ Note
The results of Study 1 were presented at the 2010 annual meeting of the American Psychological Association, San Diego, CA, USA. The results of Study 2 were presented at the 2011 annual meeting of the American Psychological Association, Washington, D.C, USA.
Declaration of Conflicting Interests
The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The authors received no financial support for the research, authorship, and/or publication of this article.
