Online Study Behavior of 100,000 Students Preparing for the SAT,ACT,and GRE

Abstract

Direct observation of student study behavior is possible when students use computer-based learning materials. Data recorded on the self-directed studying of more than 100,000 students using a Web-based tool to prepare for U.S. college admissions tests reveal several non-optimal behaviors. Students had a tendency to begin studying within days of the test, to neglect math and science preparation, and to prefer vocabulary drills and short answer verbal questions over questions on reading passages. High school students studying for college admissions showed a different pattern from older students studying for graduate school. A randomized experiment carried out online addressed the possible confound between student preference and Web site design. The data represent the largest sample of admissions test takers ever studied, while also representing the most fine-grained observation of high stakes study behavior ever reported. The relevance of these data for evaluating the causal effect of commercial coaching operations is discussed.

Get full access to this article

View all access options for this article.

References

Allalouf

Ben-Shakhar

(1998). The effects of coaching on the predictive validity of scholastic aptitude tests. Journal of Educational Measurement, 35, 33–47.

Briggs

D. C.

(2001). The effect of admissions test preparation: Evidence from NELS:88. Chance, 14, 2001.

Csikszentmihalyi

Larson

(1987). Validity and reliability of the experience-sampling method. Journal of Nervous and Mental Disease, 175, 526–536.

DerSimonian

Laird

N. M.

(1983). Evaluating the effect of coaching on SAT scores: A meta-analysis. Harvard Educational Review, 53, 1–15.

Kulik

J. A.

Bangert-Drowns

R. L.

Kulik

(1984). Effectiveness of coaching for aptitude tests. Psychological Bulletin, 95, 179–188.

Powers

D. E.

(1998). Preparing for the SAT 1: Reasoning Test: An update. (College Board Report No. 98-5). New York: College Entrance Examination Board.

Powers

D. E.

Rock

D. A.

(1999). Effects of coaching on SAT 1: Reasoning Test scores. Journal of Educational Measurement, 36, 93–118.

Powers

D. E.

Swinton

S. S.

(1984). Effects of self-study for coachable test item types. Journal of Educational Psychology, 76, 266–278.

Slack

W. V.

Porter

(1980). The scholastic aptitude test: A critical appraisal. Harvard Joumal Review, 50, 154–175.

10.

Stone

A. A.

Schwartz

J. E.

Shiffman

Marco

C. A.

Hickcox

Paty

Porter

L. S.

Cruise

L. J.

(1998). A comparison of coping assessed by ecological momentary assessment and retrospective recall. Journal of Personality and Social Psychology, 74, 1670–1680.

11.

Whalen

C. K.

Jamner

L. D.

Henker

Delfino

R. J.

Lozano

J. M.

(2002). The ADHD spectrum and everyday life: Experience sampling of adolescent moods, activities, smoking, and drinking. Child Development, 73, 209–227.