Pearls and Pitfalls in Evaluating a Student Assistance Program: A Five-Year Case Study

Abstract

This article presents data from a five-year evaluation-research case study of a large urban schools district's internal Student Assistance Program (SAP). The district employed specially trained and licensed school-based counselors to implement an internal SAP expanded to include tertiary prevention, and modeled after an employee assistance program established for adults. From the population of more than 10,000 students who received some type of program assistance for at-risk behaviors, a stratified random sample of 2,238 cases, over a five year period, were reviewed. Results indicate a statistically significant decline (p < .05) in students' drug use and a significant improvement in internal locus of control occurred each year. While not statistically significant, the average number of student discipline referrals was less than the year prior to program admission; however, there was no significant change in academic performance. A significant correlation between students' drug use and the amount of time in program, the type of assistance received, and the student's custody status was also found.

Get full access to this article

View all access options for this article.

References

Bamberg

, & Moser

(2007, March). Twenty years after Hines, Hungerford, and Tomera: A new meta-analysis of psycho-social determinants of pro-environmental behaviour Journal of Environmental Psychology, 27(1), 14–25.

Bear

G. G.

Manning

M. A.

, & Izard

C. E.

(2003). Responsible behavior: The importance of social cognition and emotion. School Psychology Quarterly, 18(2), 140–157.

Borders

L. D.

, & Drury

S. M.

(1992). Comprehensive school counseling programs: A review for policymakers and practitioners. Journal of Counseling and Development, 70, 487–498.

Center for Prevention Research and Development. (2005). Background research: Student assistance programs. Champaign, IL: Center for Prevention Research and Development, Institute of Government and Public Affairs, University of Illinois.

Collins

L. M.

Murphy

S. A.

, & Bierman

K. L.

(2004). A conceptual framework for adaptive preventive interventions. Prevention Science, 5(3), 185–196.

Duval County Public Schools. (2001). ZIP parent guide: Helping children make healthy choices (5th ed.). Duval County Public Schools: Author.

Elliott

D. S.

, & Mihalic

(2004). Issues in disseminating and replicating effective prevention programs. Prevention Science, 5(1), 47–53.

Fertman

Fichter

Schlesinger

Tarasevich

Wald

, & Zhand

(2001). Evaluating the effectiveness of student assistance programs in Pennsylvania. Journal of Drug Education, 31(4), 353–366.

Hantman

, & Crosse

(2003). Progress in prevention: Report on the national study of local educational activities under the safe and drug free schools and communities act (Report No. PES-2002–003). Rockville, MD: Westat, Inc. (ED Pubs, Education Publications Center, EA94052001).

10.

Herr

E. L.

(2001). The impact of national policies, economics, and school reform on comprehensive guidance programs. Professional School Counseling, 4, 236–245.

11.

Isaacs

M. L.

(2003). Data-driven decision making: The engine of accountability. Professional School Counseling, 6, 288–295.

12.

Johnson

, & Johnson

C. D.

(2003). Results-based guidance: A systems approach to student support programs. Professional School Counseling, 6, 180–184.

13.

Keene

K. M.

, & Stewart

N. R.

(1989). Evaluation: Rx for counseling program growth. The School Counselor, 37, 62–66.

14.

Kumpfer

Shur

Ross

Bunnell

Librett

, & Millward

(1993). Measurements in prevention: A manual on selecting and using instruments to evaluate prevention programs. Rockville, MD: Center for Substance Abuse Prevention.

15.

Lombana

J. H.

(1985). Guidance accountability: A new look and an old problem. The School Counselor, 32, 340–346.

16.

National Student Assistant Association. (2007). Student assistance program components. Downloaded April 9, 2007 from: NSAA Web site: http://www.nasap.org/sapcomponents.html

17.

National Commission on Drug-Free Schools. (1990). Toward a drug free generation: A nation's responsibility. Final Report, 1990.

18.

Pankratz

M. M.

, & Hallfors

D. D.

(2004). Implementing evidence-based substance use prevention curricula in North Carolina public school districts. Journal of School Health, 74, 353–358.

19.

Patel

, & Wibberley

(2003). Young Asians and drug use. Journal of Child Health Care, 6(1), 51–59.

20.

Percy

McAlister

Higgins

McCrystal

, & Thornton

(2005, February). Response consistency in young adolescents' drug use self-reports: A recanting rate analysis, Addiction, 100(2), 189–196.

21.

SAMHSA. (2007, January). Help is down the hall: A handbook on student assistance. Retrieved from http://www.nacoa.org/pdfs/SAP%20HANDBOOK.pdf

22.

Richter

, & Johnson

P. B.

(2001, Fall). Current methods of assessing substance use: A review of strengths, problems and developments Journal of Drug Issues, 31(4), 809–832.

23.

Scott

D. M.

Surface

J. L.

Friedli

, & Barlow

T. W.

(1999). Effectiveness of student assistance programs in Nebraska schools. Journal of Drug Education, 29(2), 165–174.

24.

Sink

C. A.

, & MacDonald

(1998). The status of comprehensive guidance and counseling in the United States. Professional School Counseling, 2, 88–94.

25.

Skiba

Monroe

, & Wodarski

J. S.

(2004). Adolescent substance use: Reviewing the effectiveness of prevention strategies. Social Work, 49, 343–353.

26.

Social Development Research Group. (2003). Retrieved October 14, 2003, from http://www.depts.washington.edu/sdrg/page2.html

27.

Stith

Pruitt

Dees

Fronce

Green

Som

, & Linkh

(2006). Implementing community-based prevention programming: A review of the literature [Electronic version]. The Journal of Primary Prevention, 27, 599–617.

28.

Student Assistance Programs. (2006). American School Counselor Association. Retrieved November 14, 2006, from http://www.schoolcounselor.org/content.asp?contentid=220

29.

Sudman

(2001, Summer). Examining substance abuse data collection methodologies Journal of Drug Issues, 31, 695–716.

30.

Trevisan

M. S.

(2000). The status of program evaluation expectations in state school counselor certification requirements. American Journal of Evaluation, 21, 81–94.

31.

U.S. Department of Education. (2007). Retrieved April 23, 2007 from http://www.ed.gov/parents/academic/help/succeed/partx2.html

32.

U.S. Department of Health and Human Services—Substance Abuse and Mental Health Services Administration. (2007). SAMHSA Model Programs. Retrieved April 23, 2007 from http://modelprograms.samhsa.gov/

33.

Wassef

Inghan

Lassiter-Collins

, & Mason

(1995). In search of effective programs to address student's emotional distress and behavioral problems—Part I: Defining the problem. Adolescence, 30(119), 523–538. Part II: Critique of school community based problems. Adolescence, 30(120), 757–777.

34.

Wassef

Inghan

Lassiter-Collins

, & Mason

(1996). In search of effective programs to address student's emotional distress and behavioral problems—Part III: Student assessment of school-based support groups. Adolescence, 31(121), 1–16.

35.

Wassef

Inghan

Lassiter-Collins

, & Mason

(1998). Effectiveness of one-year participation in school-based volunteer-facilitated peer support groups. Adolescence, 33(129), 91–97.

36.

Welch

Parke

R. D.

Widaman

, & O'Neil

(2001). Linkages between children's social and academic achievement. Journal of School Psychology, 39, 463–482.

37.

Wentzel

K. R.

(1996). Social and academic motivation in middle schools: Concurrent and long-term relations to academic effort. Journal of Early Adolescence, 16, 390–406.

38.

Williams

Griffin

K. W.

Macaulay

A. P.

West

T. L.

, & Gronewold

(2005). Efficacy of a drug prevention CD-ROM intervention for adolescents. Substance Use and Misuse, 40, 869–878.

39.

Wills

T. A.

, & Cleary

S. D.

(1997, January). The validity of self-reports of smoking: An analyses by race/ethnicity in a school sample of urban adolescents American Journal of Public Health, 87, 56–61.

40.

Wilson

, & Kolander

(2000). Drug abuse prevention: A school and community partnership. Sudbury, MA: Jones and Bartlett Publishers.