Development and Validation of the 21st Century Collaboration Skills Scale for High School Students

Abstract

The Collaboration scales developed in previous research have been designed predominantly for university students, teachers, or organizational contexts. This study developed and validated a Collaboration Skills Scale for high school students within the Twenty-First Century Skills (TCS) framework. An initial item pool of 230 items from eight collaboration scales was refined to 53 items after content validity assessment and a pilot test with 45 students. An exploratory factor analysis conducted with 655 students from 16 schools in Punjab, Pakistan, refined the scale to 17 items distributed across five factors: communication, team support, learning orientation, participation, and conflict resolution. A confirmatory factor analysis with 1,155 students from 28 schools subsequently validated the factor structure which demonstrated an acceptable model-data fit. The scale demonstrates strong reliability and validity for assessing high school students’ collaboration skills. It offers educators, policymakers, and curriculum developers a robust tool to monitor collaboration competencies and align educational practices with the TCS framework.

Keywords

collaboration twenty-first century skills scale development high school students

Get full access to this article

View all access options for this article.

References

Alismail

H. A.

McGuire

(2015). 21st century standards and curriculum: Current research and practice. Journal of Education and Practice, 6(6), 150–154. https://files.eric.ed.gov/fulltext/EJ1083656.pdf

American Educational Research AssociationAmerican Psychological AssociationNational Council on Measurement in EducationJoint Committee on Standards for Educational and Psychological Testing . (2014). Standards for educational and psychological testing: AERA. https://www.aera.net/publications/books/standards-for-educational-psychological-testing-2014-edition

Bettis

R. A.

Hitt

M. A.

(1995). The new competitive landscape. Strategic Management Journal, 16(1), 7–19. https://doi.org/10.1002/smj.4250160915

Boateng

G. O.

Neilands

T. B.

Frongillo

E. A.

Melgar-Quiñonez

H. R.

Young

S. L.

(2018). Best practices for developing and validating scales for health, social, and behavioral research: A primer. Frontiers in Public Health, 6, 149. https://doi.org/10.3389/fpubh.2018.00149

Chopra

Kauts

(2023). Development of collaborative skills scale: Reliability and validity. MIER Journal of Educational Studies Trends and Practices, 13(1), 81–97. https://doi.org/10.52634/mier/2023/v13/i1/2376

Dahar

M. A.

Dahar

R. T.

Dahar

R. A.

Faize

F. A.

(2009). Impact of the prior school environment on academic achievement of students at the secondary stage in Punjab (Pakistan). European Journal of Social Sciences, 19(1), 106–113.

Dahar

M. A.

Faize

F. A.

Niwaz

Hussain

M. A.

Zaman

(2010). Relationship between the leadership styles and academic achievement at the secondary stage in Punjab (Pakistan). International Journal of Academic Research, 2(6), 459–462.

Faize

F.A.

(2015). Introducing Argumentation at Higher Education in Pakistan- A New Paradigm of Teaching Ethic based Topics. FWU Journal of Social Sciences, 9(1), 8–13.

Faize

F.A.

(2022). Assessing Science Teachers’ Understanding About the Nature of Scientific Inquiry and its Reflection in Students’ Responses Using the VASI Questionnaire. International Journal of Science Education, 44(14), 2224–2240. https://doi.org/10.1080/09500693.2022.2116959

10.

Faize

F.A.

Alribdi

N.A.

(2024). Science Teachers’ Pedagogical Orientations Versus Students’ Preferred Orientations in Pakistan. Pertanika Journal of Social Science and Humanities, 32(4), 1415–1432. https://doi.org/10.47836/pjssh.32.4.09

11.

Fjeldstad

Ø. D.

Snow

C. C.

Miles

R. E.

Lettl

(2012). The architecture of collaboration. Strategic Management Journal, 33(6), 734–750. https://doi.org/10.1002/smj.1968

12.

George

Mallery

(2019). IBM SPSS Statistics 26 step by step: A simple guide and reference (16th ed.). Routledge. https://doi.org/10.4324/9780429056765

13.

Gonzales

M. G.

Dinagsao

A. V.

(2020). Collaborative skills of pre-service teachers. Asia Pacific Journal of Social and Behavioral Sciences, 17(2020), 1–6. https://doi.org/10.57200/apjsbs.v17i2599-4891.221

14.

González-Pérez

L. I.

Ramírez-Montoya

M. S.

(2022). Components of education 4.0 in 21st century skills frameworks: Systematic review. Sustainability, 14(3), 1493. https://doi.org/10.3390/su14031493

15.

Goodheart

C. D.

(2010). A new era for collaboration. Monitor on Psychology, 41(4), 5. https://www.apa.org/monitor/2010/04/pc.

16.

Hair

J. F.

Black

W. C.

Babin

B. J.

Anderson

R. E.

(2019). Multivariate data analysis (8th ed.). Cengage Learning.

17.

Hebles

Yániz-Álvarez -de-Eulate

Alonso-Dos-Santos

(2022). Teamwork competency scale (TCS) from the individual perspective in university students. Journal of Technology and Science Education, 12(2), 510. https://doi.org/10.3926/jotse.1478

18.

Hinyard

Toomey

Eliot

Breitbach

(2019). Student perceptions of collaboration skills in an interprofessional context: Development and initial validation of the Self- assessed collaboration skills instrument. Evaluation & the Health Professions, 42(4), 450–472. https://doi.org/10.1177/0163278717752438

19.

L. T.

Bentler

P. M.

(1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. https://doi.org/10.1080/10705519909540118

20.

Husain

Faize

F. A.

(2022). The state of education in Pakistan: Assessment through Bloom’s taxonomy. Contemporary Education and Teaching Research, 3(1), 1–13. https://doi.org/10.47852/bonviewcetr2022030101

21.

Javed

M. S.

Athar

M. R.

Saboor

(2019). Development of a twenty-first century skills scale for agri varsities. Cogent Business & Management, 6(1), 1–23. https://doi.org/10.1080/23311975.2019.1692485

22.

Johnsen

M. M. W.

Sjølie

Johansen

(2024). Learning to collaborate in a project-based graduate course: A multilevel study of student outcomes. Research in Higher Education, 65(3), 439–462. https://doi.org/10.1007/s11162-023-09754-7

23.

Johnson

D. W.

Johnson

R. T.

(2009). An educational psychology success story: Social interdependence theory and cooperative learning. Educational Researcher, 38(5), 365–379. https://doi.org/10.3102/0013189X09339057

24.

Joynes

Rossignoli

Amonoo-Kuofi

E. F.

(2019). 21st century skills: Evidence of issues in definition, demand and delivery for development contexts. Gov UK. https://assets.publishing.service.gov.uk/media/5d71187ce5274a097c07b985/21st_century.pdf

25.

Kaiser

H. F.

(1958). The varimax criterion for analytic rotation in factor analysis. Psychometrika, 23(3), 187–200. https://doi.org/10.1007/BF02289233

26.

Kaiser

H. F.

(1960). The application of electronic computers to factor analysis. Educational and Psychological Measurement, 20(1), 141–151. https://doi.org/10.1177/001316446002000116

27.

Kaiser

H. F.

(1974). An index of factorial simplicity. Psychometrika, 39(1), 31–36. https://doi.org/10.1007/BF02291575

28.

Khwaja

Zafar

A. M.

Faize

F. A.

(2022). Accidental Leaders: Experiences and Perspectives of Higher Education Leaders in Pakistan. International Journal of Educational Leadership and Management, 10(2), 168–194. https://doi.org/10.17583/ijelm.8440

29.

Kline

R. B.

(2016). Principles and practice of structural equation modeling (4th ed.). The Guilford Press.

30.

Ladd

G. W.

Kochenderfer-Ladd

Visconti

K. J.

Ettekal

Sechler

C. M.

Cortes

K. I.

(2014). Grade-school children’s social collaborative skills: Links with partner preference and achievement. American Educational Research Journal, 51(1), 152–183. https://doi.org/10.3102/0002831213507327

31.

London Leadership Academy, National Health Service . (n.d.). Team effectiveness diagnostic. University of Colorado. https://www.cu.edu/sites/default/files/Team_effectiveness_questionnaire.pdf

32.

Maniam

Pruekpramool

(2019). Development of collaboration skills self-assessment test in a science subject for Thai eighth grade students. AIP Conference Proceedings, 2081(1), Article 030012. https://doi.org/10.1063/1.5094010

33.

Marsee

Kimonis

E. R.

Frick

P. J.

(2004). Peer conflict scale. University of New Orleans. Unpublished rating scale.

34.

Nunnally

J. C.

Bernstein

I. H.

(1994). Psychometric theory (3rd ed.). McGraw-Hill.

35.

Ofstedal

Dahlberg

(2009). Collaboration in student teaching: Introducing the collaboration self-assessment tool. Journal of Early Childhood Teacher Education, 30(1), 37–48. https://doi.org/10.1080/10901020802668043

36.

Partnership for 21st Century Skills Core Content Integration . (2007). Partnership for 21st century skills Ohio department of education. https://www.marietta.edu/sites/default/files/documents/21st_century_skills_standards_book_2.pdf

37.

Scott

C. L.

(2015). The futures of learning 2: What kind of learning for the 21st century? UNESCO Education Research and Foresight, Paris. UNSECO Digital Library. https://unesdoc.unesco.org/ark:/48223/pf0000242996

38.

Sholihah

Zubaidah

Mahanal

Listyorini

(2023). Biology students’ collaboration skills in the pandemic era. In: The 5th international conference on mathematics and science education (ICoMSE) 2021: Science and mathematics education research: Current challenges and opportunities, Indonesia, 3–4 August 2021. https://doi.org/10.1063/5.0112432

39.

Tseng

H.-Y.

Tseng

H. W.

Akarasriworn

(2013). Collaboration factors, teamwork satisfaction, and student attitudes toward online collaborative learning. Computers in Human Behavior, 29(3), 922–929. https://doi.org/10.1016/J.CHB.2012.12.019

40.

Voogt

Roblin

N. P.

(2010). White paper 21stCS_Final_ENG_def2. pb works. https://opite.pbworks.com/w/file/fetch/61995295/WhitePaper21stCS_Final_ENG_def2.pdf

41.

Vygotsky

L. S.

(1978) Mind in society: The development of higher psychological processes (86). Harvard University Press.

42.

Webb

N. M.

Franke

M. L.

Ing

Chan

Freund

Battey

(2008). The role of teacher instructional practices in student collaboration. Contemporary Educational Psychology, 33(3), 360–381. https://doi.org/10.1016/j.cedpsych.2008.05.003

43.

Xiong

H. J.

Toh

(2015). Assessing learners’ perceived readiness for computer-supported collaborative learning (CSCL): A study on initial development and validation. Journal of Computing in Higher Education, 27(3), 215–239. https://doi.org/10.1007/s12528-015-9102-9

44.

Zafar

M. A.

Faize

F. A.

Ahmad

R. H.

(2024). Understanding teacher identity and perceptions of action research as a professional development tool in Pakistan. Journal of Education, 204(1), 107–117. https://doi.org/10.1177/00220574221106753

45.

Zaman

Niwaz

Faize

F. A.

Dahar

M. A.

(2010). Analysis of multiple-choice items and the effect of items sequencing on difficulty level in the test of Mathematics. European Journal of Social Sciences, 17(1), 61–67.