Examining a Short Form of the Positive Family Support Strengths and Needs Assessment

Abstract

The purpose of this study was to examine the psychometric properties of the parent-report short form of the Positive Family Support Strengths and Needs Assessment (PFS-SaNA). The PFS-SaNA is designed to reduce the time and burden of collaborative mental health screening. Parents of 245 students in the U.S. Northwest completed the screener at third, fourth, fifth, and seventh grade. The screener includes four items rated on a 4-point Likert-type scale. The screener demonstrated internal consistency, with Cronbach’s alpha ranging from 0.677 to 0.740 across waves. Furthermore, the screener demonstrated adequate concurrent and predictive validity with standard parent- and teacher-report mental health measurements. Lastly, receiver operating characteristic analysis was used to find optimal cut-off points for the screener at each grade. The screener shows adequate diagnostic accuracy against the Strengths and Difficulties Questionnaire. The use of the PFS-SaNA Short Form may help improve family-school collaboration in assessment and intervention planning in schools.

Keywords

family-school collaboration school mental health screening

Get full access to this article

View all access options for this article.

References

Bitsko

R. H.

Claussen

A. H.

Lichstein

Black

L. I.

Jones

S. E.

Danielson

M. L.

Hoenig

J. M.

Davis Jack

S. P.

Brody

D. J.

Gyawali

Maenner

M. J.

Warner

Holland

K. M.

Perou

Crosby

A. E.

Blumberg

S. J.

Avenevoli

Kaminski

J. W.

Ghandour

R. M.

. . .Meyer

L. N.

(2022). Mental health surveillance among children—United States, 2013–2019. MMWR Supplements, 71(2), 1–42. https://doi.org/10.15585/mmwr.su7102a1

Bronfenbrenner

(1996). The ecology of human development: Experiments by nature and design. Harvard University Press.

DeVellis

R. F.

(2017). Scale development: Theory and applications (4th ed.). Sage.

Dishion

T. J.

Garbacz

S. A.

Seeley

Kim

Stormshak

E. A.

Moore

Gau

Fosco

Falkenstein

. (2020). Translational research on evidence-based parenting support within public schools: Strategies, challenges and potential solutions. In Garbacz

S. A.

(Ed.), Establishing family-school partnerships in school psychology: Critical skills (pp. 223–244). Routledge.

Dowdy

Ritchey

Kamphaus

R. W.

(2010). School-based screening: A population-based approach to inform and monitor children’s mental health needs. School Mental Health, 2(4), 166–176. https://doi.org/10.1007/s12310-010-9036-3

Duong

M. T.

Bruns

E. J.

Lee

Cox

Coifman

Mayworm

Lyon

A. R.

(2021). Rates of mental health service utilization by children and adolescents in schools and other common service settings: A systematic review and meta-analysis. Administration and Policy in Mental Health and Mental Health Services Research, 48(3), 420–439. https://doi.org/10.1007/s10488-020-01080-9

Fan

Chen

(2001). Parental involvement and students’ academic achievement: A meta-analysis. Educational Psychology Review, 13(1), 1–22. https://doi.org/10.1023/A:1009048817385

Garbacz

S. A.

Beattie

Masser

DeGarmo

(2019). Initial validation of an elementary version of the Positive Family Support Strengths and Needs Assessment. Assessment for Effective Intervention, 45(1), 73–80. https://doi.org/10.1177/1534508418793514

Garbacz

S. A.

Herman

K. C.

Thompson

A. M.

Reinke

W. M.

(2017). Family engagement in education and intervention: Implementation and evaluation to maximize family, school, and student outcomes. Journal of School Psychology, 62, 1–10. https://doi.org/10.1016/j.jsp.2017.04.002

10.

Garbacz

S. A.

Lee

Hall

G. J.

Stormshak

E. A.

McIntyre

L. L.

(2021). Initiating family–school collaboration in school mental health through a proactive and positive strengths and needs assessment. School Mental Health, 13(4), 667–679. https://doi.org/10.1007/s12310-021-09455-5

11.

Glover

T. A.

Albers

C. A.

(2007). Considerations for evaluating universal screening assessments. Journal of School Psychology, 45(2), 117–135. https://doi.org/10.1016/j.jsp.2006.05.005

12.

Goodman

(1997). The Strengths and Difficulties Questionnaire: A research note. Journal of Child Psychology and Psychiatry, 38(5), 581–586. https://doi.org/10.1111/j.1469-7610.1997.tb01545.x

13.

Gresham

F. M.

Elliott

S. N

. (2008). Social skills improvement system: Rating scales. Pearson Assessments.

14.

Hirano

K. A.

Shanley

Garbacz

S. A.

Rowe

D. A.

Lindstrom

Leve

L. D

. (2018). Validating a model of motivational factors impacting involvement for parents of transition-age youth with disabilities. Remedial and Special Education, 39(1), 15–26. https://doi.org/10.1177/0741932517715913

15.

Hull

Boulton

Jones

Boaz

Sevdalis

(2022). Defining, conceptualizing, and evaluating pragmatic qualities of quantitative instruments measuring implementation determinants and outcomes: A scoping and critical review of the literature and recommendations for future research. Translational Behavioral Medicine, 12(11), 1049–1064. https://doi.org/10.1093/tbm/ibac064

16.

Humphrey

Kalambouka

Wigelsworth

Lendrum

Deighton

Wolpert

(2011). Measures of social and emotional skills for children and young people: A systematic review. Educational and Psychological Measurement, 71(4), 617–637. https://doi.org/10.1177/0013164410382896

17.

International Test Commission. (2013, October 8). ITC guidelines on test use. https://www.intestcom.org/files/guideline_test_use.pdf

18.

Kern

Mathur

S. R.

Albrecht

S. F.

Poland

Rozalski

Skiba

R. J.

(2017). The need for school-based mental health services and recommendations for implementation. School Mental Health, 9(3), 205–217. https://doi.org/10.1007/s12310-017-9216-5

19.

Kern

Weist

M. D.

Mathur

S. R.

Barber

B. R.

(2022). Empowering school staff to implement effective school mental health services. Behavioral Disorders, 47(3), 207–219. https://doi.org/10.1177/01987429211030860

20.

Kessler

R. C.

Berglund

Demler

Jin

Merikangas

K. R.

Walters

E. E.

(2005). Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the National Comorbidity Survey Replication. Archives of General Psychiatry, 62(6), 593–602. https://doi.org/10.1001/archpsyc.62.6.593

21.

Kruyen

P. M.

Emons

W. H. M.

Sijtsma

(2013). On the shortcomings of shortened tests: A literature review. International Journal of Testing, 13(3), 223–248. https://doi.org/10.1080/15305058.2012.703734

22.

Langer

D. A.

Wood

J. J.

Wood

P. A.

Garland

A. F.

Landsverk

Hough

R. L.

(2015). Mental health service use in schools and non-school-based outpatient settings: Comparing predictors of service use. School Mental Health, 7(3), 161–173. https://doi.org/10.1007/s12310-015-9146-z

23.

Mandrekar

J. N.

(2010). Receiver operating characteristic curve in diagnostic test assessment. Journal of Thoracic Oncology, 5(9), 1315–1316. https://doi.org/10.1097/JTO.0b013e3181ec173d

24.

Marrast

Himmelstein

D. U.

Woolhandler

(2016). Racial and ethnic disparities in mental health care for children and young adults: A national study. International Journal of Health Services, 46(4), 810–824. https://doi.org/10.1177/0020731416662736

25.

Moore

K. J.

Garbacz

S. A.

Gau

J. M.

Dishion

T. J.

Brown

K. L.

Stormshak

E. A.

Seeley

J. R.

(2016). Proactive parent engagement in public schools: Using a brief strengths and needs assessment in a multiple-gating risk management strategy. Journal of Positive Behavior Interventions, 18(4), 230–240. https://doi.org/10.1177/1098300716632590

26.

Morris

T. P.

White

I. R.

Royston

. (2014). Tuning multiple imputation by predictive mean matching and local residual draws. BMC Medical Research Methodology, 14, Article No. 75. https://doi.org/10.1186/1471-2288-14-75

27.

Olfson

Druss

B. G.

Marcus

S. C.

(2015). Trends in mental health care among children and adolescents. The New England Journal of Medicine, 372(21), 2029–2038. https://doi.org/10.1056/NEJMsa1413512

28.

Panchal

Salazar

Pablo

Franco

Moreno

Parellada

Arango

Fusar-Poli

(2023). The impact of COVID-19 lockdown on child and adolescent mental health: Systematic review. European Child & Adolescent Psychiatry, 32(7), 1151–1177. https://doi.org/10.1007/s00787-021-01856-w

29.

Perkins

N. J.

Schisterman

E. F.

(2006). The inconsistency of “optimal” cutpoints obtained using two criteria based on the receiver operating characteristic curve. American Journal of Epidemiology, 163(7), 670–675. https://doi.org/10.1093/aje/kwj063

30.

Plante

Vance

(1994). Selection of preschool language tests: A data-based approach. Language, Speech, and Hearing Services in Schools, 25(1), 15–24. https://doi.org/10.1044/0161-1461.2501.15

31.

Racine

McArthur

B. A.

Cooke

J. E.

(2021). Global prevalence of depressive and anxiety symptoms in children and adolescents during COVID-19. JAMA Pediatrics, 175(11), 1142–1150. https://doi.org/20.1001/jamapediatrics.2021.2482

32.

Raviv

Smith

Hurwitz

Gill

T. L.

Baker

Torres

S. A.

Bowen

I. E.

Cicchetti

(2022). Supporting school-community collaboration for the implementation of a multi-tiered school mental health program: The Behavioral Health Team model. Psychology in the Schools, 59(6), 1239–1258. https://doi.org/10.1002/pits.22683

33.

Reinke

W. M.

Herman

K. C.

Thompson

Copeland

McCall

C. S.

Holmes

Owens

S. A.

(2020). Investigating the longitudinal association between fidelity to a large-scale comprehensive school mental health prevention and intervention model and student outcomes. School Psychology Review, 50(1), 17–29. https://doi.org/10.1080/2372966X.2020.1870869

34.

Robin

Turck

Hainard

Tiberti

Lisacek

Sanchez

J.-C.

Müller

(2011). pROC: An open-source package for R and S+ to analyze and compare ROC curves. BMC Bioinformatics, 12(1), 77. https://doi.org/10.1186/1471-2105-12-77

35.

Sheridan

S. M.

Smith

T. E.

Moorman Kim

Beretvas

S. N.

Park

(2019). A meta-analysis of family-school interventions and children’s social-emotional functioning: Mode-rators and components of efficacy. Review of Educational Research, 89(2), 296–332. https://doi.org/10.3102/0034654318825437

36.

Smith

T. E.

Sheridan

S. M.

Kim

E. M.

Park

Beretvas

S. N.

(2020). The Effects of Family-school partnership interventions on academic and social-emotional functioning: A meta-analysis exploring what works for whom. Educational Psychology Review, 32(2), 511–544. https://doi.org/10.1007/s10648-019-09509-w

37.

Smolkowski

Seeley

J. R.

Gau

J. M.

Dishion

T. J.

Stormshak

E. A.

Moore

K. J.

Falkenstein

C. A.

Fosco

G. M.

Garbacz

S. A.

(2017). Effectiveness evaluation of the Positive Family Support intervention: A three-tiered public health delivery model for middle schools. Journal of School Psychology, 62, 103–125. https://doi.org/10.1016/j.jsp.2017.03.004

38.

Stone

L. L.

Otten

Engels

R. C. M. E.

Vermulst

A. A.

Janssens

J. M. A. M

. (2010). Psychometric properties of the parent and teacher versions of the Strengths and Difficulties Questionnaire for 4- to 12-year-olds: A review. Clinical Child and Family Psychology Review, 13(3), 254–274. https://doi.org/10.1007/s10567-010-0071-2

39.

Stormshak

E. A.

Dishion

T. J.

(2009). A school-based, family-centered intervention to prevent substance use: The Family Check-Up. The American Journal of Drug and Alcohol Abuse, 35(4), 227–232. https://doi.org/10.1080/00952990903005908

40.

van Buuren

Groothuis-Oudshoorn

. (2011). Mice: Multivariate imputation by chained equations in R. Journal of Statistical Software, 45(3), 1–67. https://doi.org/10.18637/jss.v045.i03

41.

Weist

M. D.

Splett

J. W.

Halliday

C. A.

Gage

N. A.

Seaman

M. A.

Perkins

K. A.

Perales

Miller

Collins

DiStefano

(2022). A randomized controlled trial on the interconnected systems framework for school mental health and PBIS: Focus on proximal variables and school discipline. Journal of School Psychology, 94, 49–65. https://doi.org/10.1016/j.jsp.2022.08.002

42.

Wolf

R. T.

Jeppesen

Gyrd-Hansen

The CCC2000 Study Group, & Oxholm

A. S.

(2019). Evaluation of a screening algorithm using the Strengths and Difficulties Questionnaire to identify children with mental health problems: A five-year register-based follow-up on school performance and healthcare use. PLOS ONE, 14(10), Article e0223314. https://doi.org/10.1371/journal.pone.0223314