Comparing Direct Versus Indirect Measures of the Pedagogical Effectiveness of Team Testing

Abstract

Direct measures (tests) of the pedagogical effectiveness of team testing and indirect measures (student surveys) of pedagogical effectiveness of team testing were collected in several sections of an undergraduate marketing course with varying levels of the use of team testing. The results indicate that although students perceived team testing to have a substantial impact on their learning, this pedagogy in fact had no impact on direct measures of learning. In an additional analysis, the performance of the team on the group test was best predicted by the best individual performance on the team. Possible explanations and directions for future research are discussed.

Keywords

assessment cooperative learning collaborative learning team testing student groups

Get full access to this article

View all access options for this article.

References

AACSB International. (2010). Eligibility procedures and accreditation standards for business accreditation. Retrieved from http://www.aacsb.edu/accreditation/business/STANDARDS.pdf

Abrami

P. C.

Leventhal

Perry

R. P.

(1982). Educational seduction. Review of Educational Research, 52, 446-464.

Bacon

D. R.

(2003). Assessing learning outcomes: A comparison of multiple-choice and short-answer questions in a marketing context. Journal of Marketing Education, 25, 31-36.

Bacon

D. R.

(2004). The contributions of reliability and pretests to effective assessment. Practical Assessment, Research & Evaluation, 9(3). Retrieved from http://PAREonline.net/getvn.asp?v=9&n=3

Bacon

D. R.

(2005). The effect of group projects on content- related learning outcomes. Journal of Management Education, 29, 248-267.

Bacon

D. R.

Bean

(2006). GPA in research studies: An invaluable but neglected opportunity. Journal of Marketing Education, 28, 35-42.

Bacon

D. R.

Paul

Johnson

Conley

(2008). Improving writing through the marketing curriculum: A longitudinal study. Journal of Marketing Education, 30, 217-225.

Bacon

D. R.

Stewart

K. A.

(2006). How fast do students forget what they learn in consumer behavior? A longitudinal study. Journal of Marketing Education, 28, 181-192.

Bacon

D. R.

Stewart

K. A.

Stewart-Belle

(1998). Exploring predictors of student team project performance. Journal of Marketing Education, 20, 63-71.

10.

Bargh

J. A.

Schul

(1980). On the cognitive benefits of teaching. Journal of Educational Psychology, 72, 593-604.

11.

Benek-Rivera

Mathews

V. E.

(2004). Active learning with Jeopardy: Students ask the questions. Journal of Management Education, 28, 104-118.

12.

Berry

Nyman

M. A.

(2002). Small-group assessment methods in mathematics. International Journal of Mathematical Education in Science and Technology, 33, 641-649.

13.

Billington

(1994). Effects of collaborative test taking on retention in eight third-grade mathematics classes. Elementary School Journal, 95(1), 23-31.

14.

Clayson

D. E.

(2009). Student evaluations of teaching: Are they related to what students learn? A meta-analysis and review of the literature. Journal of Marketing Education, 31, 16-30.

15.

Clayson

D. E.

Haley

D. A.

(1990). Student evaluations in marketing: What is actually being measured? Journal of Marketing Education, 12, 9-17.

16.

Cohen

P. A.

(1981). Student ratings of instruction and student achievement: A meta-analysis of multisection validity studies. Review of Educational Research, 51, 281-309.

17.

Dallmer

(2004). Collaborative test taking with adult learners. Adult Learning, 15(3/4), 4-7.

18.

Ebbinghaus

(1964). Memory: A contribution to experimental psychology. New York, NY: Dover. (Original work published 1885)

19.

Fraser

S. C.

Beaman

A. L.

Diener

Kelem

R. T.

(1977). Two, three, or four heads are better than one: Modification of college performance by peer mentoring. Journal of Educational Psychology, 69, 101-108.

20.

Gabbert

Johnson

D. W.

Johnson

R. T.

(1986). Cooperative learning, group-to-individual transfer, process gain, and the acquisition of cognitive reasoning strategies. Journal of Psychology, 120, 265-278.

21.

Hamer

L. O.

(2000). The additive effects of semistructured classroom activities on student learning: An application of classroom-based experiential learning techniques. Journal of Marketing Education, 22, 25-34.

22.

Heider

(1976). A conversation with Fritz Heider. In Harvey

J. H.

Ickes

W. J.

Kidd

R. F.

(Eds.), New directions in attribution research (Vol. 1, pp. 1-18). Hillsdale, NJ: Erlbaum.

23.

Hernandez

S. A.

(2002). Team learning in a marketing principles course: Cooperative structures that facilitate active learning and higher level thinking. Journal of Marketing Education, 24, 73-85.

24.

Johnson

D. W.

Johnson

R. T.

(2002). Social interdependence theory and university instruction: Theory into practice. Swiss Journal of Psychology, 61, 119-129.

25.

Karns

G. L.

(1993). Marketing student perceptions of learning activities: Structure, preferences and effectiveness. Journal of Marketing Education, 15(1), 3-10.

26.

Karns

G. L.

(2005). An update of marketing student perceptions of learning activities: Structure, preferences, and effectiveness. Journal of Marketing Education, 27, 163-171.

27.

Kennedy

E. J.

Lawton

Plumlee

E. L.

(2002). Blissful ignorance: The problem of unrecognized incompetence and academic performance. Journal of Marketing Education, 24, 243-252.

28.

Mallinger

(1998). Maintaining control in the classroom by giving up control. Journal of Management Education, 22, 472-483.

29.

McCorkle

D. E.

Reardon

Alexander

J. F.

Kling

N. D.

Harris

R. C.

Iyer

R. V.

(1999). Undergraduate marketing students, group projects, and teamwork: The good, the bad, and the ugly? Journal of Marketing Education, 21, 106-117.

30.

McIntyre

S. H.

Munson

J. M.

(2008). Exploring cramming: Student behaviors, beliefs and learning retention in the principles of marketing course. Journal of Marketing Education, 30, 226-243.

31.

Metcalf

L. E.

(2010). Creating international community service learning experiences in a capstone marketing projects course. Journal of Marketing Education, 32, 155-171.

32.

Michaelsen

L. K.

Black

R. H.

(1994). Building learning teams: The key to harnessing the power of small groups in higher education. In Kadel

Keehner

(Eds.), Collaborative learning: A sourcebook for higher education (Vol. 2, pp. 65-81). State College, PA: National Center for Teaching, Learning, and Assessment.

33.

Naftulin

D. H.

Ware

J. E.

Jr. Donnelly

F. A.

(1973). The Doctor Fox lecture: A paradigm of educational seduction. Journal of Medical Education, 48, 630-635.

34.

Nowak

L. I.

Miller

S. W.

(1996). Team testing increases performance. Journal of Education for Business, 71, 253-256.

35.

Nunnally

J. C.

(1978). Psychometric theory (2nd ed.). New York, NY: McGraw-Hill.

36.

Paladino

(2008). Creating an interactive and responsive teaching environment to inspire learning. Journal of Marketing Education, 30, 185-188.

37.

Pfaff

Huddleston

(2003). Does it matter if I hate teamwork? What impacts student attitudes toward teamwork. Journal of Marketing Education, 25, 37-45.

38.

Rao

S. P.

Collins

H. L.

DiCarlo

S. E.

(2002). Collaborative testing enhances student learning. Advances in Physiology Education, 26(1), 37-41.

39.

Revere

Elden

Bartsch

(2008). Designing group examinations to decrease social loafing and increase learning. International Journal for the Scholarship of Teaching and Learning, 2(1). Retrieved from http://academics.georgiasouthern.edu/ijsotl/v2n1/articles/Revere-Elden-Bartsch/Article_Revere-Elden-Bartsch.pdf

40.

Rusth

D. B.

(2000). Student teams and learning achievement. Journal of Business Education, 1, 18-23.

41.

Sax

(1997). Principles of educational and psychological measurement and evaluation (4th ed.). Belmont, CA: Wadsworth.

42.

Schaffer

C. M.

(1995). The use of the team learning approach in selected marketing courses. Marketing Education Review, 5, 41-50.

43.

Sitzmann

Ely

Brown

Bauer

(2010). Self-assessment of knowledge: A cognitive learning or affective measure? Academy of Management Learning & Education, 9, 169-191.

44.

Skilton

P. F.

Forsyth

White

O. J.

(2008). Interdependence and integration learning in student project teams: Do team project assignments achieve what we want them to? Journal of Marketing Education, 30, 57-65.

45.

Slavin

R. E.

(1988). Cooperative learning and student achievement. Educational Leadership, 46(2), 31-33.

46.

Slusser

S. R.

Erickson

R. J.

(2006). Group quizzes: An extension of the collaborative learning process. Teaching Sociology, 34, 249-262.

47.

Stark

(2006). Stop “going over” exams! The multiple benefits of team exams. Journal of Management Education, 30, 818-827.

48.

Strijbos

J. W.

(2000). A classification model for group-based learning. European Journal of Open and Distance Learning. Retrieved from http://www.eurodl.org/materials/contrib/2000/strijbos/strijbos.html

49.

Strong

J. T.

Anderson

R. E.

(1990). Free-riding in group projects: Control mechanisms and preliminary data. Journal of Marketing Education, 12(2), 61-67.

50.

Student profiles. (2011). Retrieved from http://www.du.edu/explore/studentprofiles.html

51.

Webb

N. J.

Grib

T. F.

(1967). Teaching process as a learning experience: The experimental use of student-led groups (Final Report No. HE-000-882). Washington, DC: Department of Health, Education, and Welfare.

52.

Williams

D. L.

Beard

J. D.

Rymer

(1991). Team projects: Achieving their full potential. Journal of Marketing Education, 13(2), 45-53.

53.

Zimbardo

P. G.

Butler

L. D.

Wolfe

V. A.

(2003). Cooperative college examinations: More gain, less pain when students share information and grades. Journal of Experimental Education, 71, 101-125.