Leveraging Bayesian Statistics in Educational Leadership and Policy Studies

Abstract

Purpose

This paper examines the application of Bayesian statistics in educational leadership and policy studies. It explores the philosophical and methodological foundations, highlights the contributions to estimation thinking in quantitative research, demonstrates the implementation of Bayesian methods through a detailed case study, and proposes a heuristic for applying Bayesian techniques in educational research.

Research Approach

Building on the methodological discussion, this study presents a case study to illustrate the practical application of Bayesian statistics. The analysis investigates the relationship between teachers’ perceptions of school climate and their job satisfaction in U.S. middle schools, utilizing data from the 2018 Teaching and Learning International Survey. A Bayesian multilevel modeling approach is employed to analyze the data, incorporating Markov chain Monte Carlo (MCMC) techniques for estimating posterior distributions. Predictive mean matching is used for data imputation to address missing data.

Findings

The case study demonstrates that teachers’ job satisfaction is positively associated with better teacher-student relations and greater participation among stakeholders, while a better disciplinary climate is associated with higher job satisfaction. The Bayesian method yields robust statistical insights, demonstrating its advantages in estimation thinking and inferences.

Implications for Research and Practice

The findings suggest that Bayesian statistics can enhance methodological rigor and offer practical insights in educational leadership and policy studies. The proposed heuristic provides a structured approach for researchers to implement Bayesian methods, thereby promoting knowledge accumulation and advancement in the field.

Keywords

Bayesian statistics multilevel modeling estimation thinking educational leadership educational policy organizational environment

Get full access to this article

View all access options for this article.

References

Aldridge

J. M.

Fraser

B. J.

(2016). Teachers’ views of their school climate and its relationship with teacher self-efficacy and job satisfaction. Learning Environments Research, 19(2), 291–307. https://doi.org/10.1007/s10984-015-9198-x

Appelbaum

Cooper

Kline

R. B.

Mayo-Wilson

Nezu

A. M.

Rao

S. M.

(2018). Journal article reporting standards for quantitative research in psychology: The APA publications and communications board task force report. American Psychologist, 73(1), 3–25. https://doi.org/10.1037/amp0000191

Armstrong

Carter

C. K.

Wong

K. F. K.

Kohn

(2009). Bayesian Covariance matrix estimation using a mixture of decomposable graphical models. Statistics and Computing, 19(3), 303–316. https://doi.org/10.1007/s11222-008-9093-8

Bahtilla

Hui

(2021). The impact of school environment on teachers’ job satisfaction in secondary schools. European Journal of Education Studies, 8(7), 16–43. https://doi.org/10.46827/ejes.v8i7.3799

Brooks

S. P.

Gelman

(1998). General methods for monitoring convergence of iterative simulations. Journal of Computational and Graphical Statistics, 7(4), 434–455. https://doi.org/10.1080/10618600.1998.10474787

Brooks

S. P.

Giudici

Philippe

(2003). Nonparametric convergence assessment for MCMC model selection. Journal of Computational and Graphical Statistics, 12, 1–22. https://doi.org/10.1198/1061860031347

Cohen

(1994). The earth is round (p<.05). American Psychologist, 49(12), 997–1003. https://doi.org/10.1037/0003-066X.49.12.997

Cumming

(2014). The new statistics: Why and how. Psychological Science, 25(1), 7–29. https://doi.org/10.1177/0956797613504966

Fan

(2001). Statistical significance and effect size in education research: Two sides of a coin. The Journal of Educational Research, 94(5), 275–282. https://doi.org/10.1080/00220670109598763

10.

Fox

J.-P.

(2010). Bayesian item response modeling: Theory and applications. Springer.

11.

Gelman

Carlin

J. B.

Stern

H. S.

Dunson

D. B.

Vehtari

Rubin

D. B.

(2014). Bayesian data analysis. Chapman and Hall/CRC. https://doi.org/10.1201/b16018

12.

Gill

(2015). Bayesian methods: A social and behavioral sciences approach. Chapman and Hall/CRC. https://doi.org/10.1201/9781420057478

13.

Goodrich

Gabry

Ali

Brilleman

(2024). rstanarm: Bayesian applied regression modeling via Stan. R package version 2.32.1. https://mc-stan.org/rstanarm

14.

Harring

J. R.

McNeish

Hancock

G. R.

(2017). Using phantom variables in structural equation modeling to assess model sensitivity to external misspecification. Psychological Methods, 22(4), 616–631. https://doi.org/10.1037/met0000103

15.

Jiang

(2021). English learner students and college access in the U.S.: Analyzing thirty years of evidence from the National Secondary School Longitudinal Studies (Publication No. 28548531) [Doctoral dissertation]. University of Georgia. ProQuest Dissertation and Theses Global.

16.

Jiang

(2025). Multicultural/multilingual preparation and professional outcomes: Exploring self-efficacy, instructional practices, and job satisfaction among STEM teachers of multilingual learners. Journal of Multilingual and Multicultural Development, 1–18. https://doi.org/10.1080/01434632.2025.2598442

17.

Kane

Burns

(2013). The argument-based approach to validation. School Psychology Review, 42(4), 448–457. https://doi.org/10.1080/02796015.2013.12087465

18.

Kaplan

(2023). Bayesian statistics for the social sciences. Guilford Press.

19.

Kaplan

Harra

(2024). A Bayesian workflow for the analysis and reporting of international large-scale surveys: A case study using the OECD teaching and learning international survey. Large-scale Assessments in Education, 12(2), 1–36. https://doi.org/10.1186/s40536-023-00189-1

20.

König

van de Schoot

(2018). Bayesian Statistics in educational research: A look at the current state of affairs. Educational Review, 70(4), 486–509. https://doi.org/10.1080/00131911.2017.1350636

21.

Levy

Mislevy

R. J.

(2017). Bayesian psychometric modeling. Chapman and Hall/CRC. https://doi.org/10.1201/9781315374604

22.

Levy

Mislevy

R. J.

(2021). A history of Bayesian inference in educational measurement. In Clauser

B. E.

Bunch

M. B.

(Eds.), The history of educational measurement (pp. 292–317). Routledge.

23.

Levy

Mislevy

R. J.

Behrens

J. T.

(2011). MCMC In educational research. In Brooks

Gelman

Jones

G. L.

Meng

X.-L.

(Eds.), Handbook of Markov chain Monte Carlo (pp. 531–545). Chapman and Hall/CRC.

24.

Little

R. J.

(1988). Missing-data adjustments in large surveys. Journal of Business & Economic Statistics, 6(3), 287–296. https://doi.org/10.2307/1391878

25.

Organization for Economic Cooperation and Development. (2019). TALIS 2018 technical report. OECD Publishing, https://www.oecd.org/education/talis/TALIS_2018_Technical_Report.pdf .

26.

Rao

J. N. K.

Shao

(1999). Modified balanced repeated replication for complex survey data. Biometrika, 86(2), 403–415. https://doi.org/10.1093/biomet/86.2.403

27.

Raudenbush

S. W.

Bryk

A. S.

(2002). Hierarchical linear models: Applications and data analysis methods. Sage.

28.

Rhemtulla

Brosseau-Liard

P. É.

Savalei

(2012). When can categorical variables be treated as continuous? A comparison of robust continuous and categorical SEM estimation methods under suboptimal conditions. Psychological Methods, 17(3), 354–373. https://doi.org/10.1037/a0029315

29.

Rubin

D. B.

(1986). Statistical matching using file concatenation with adjusted weights and multiple imputations. Journal of Business & Economic Statistics, 4(1), 87–94. https://doi.org/10.2307/1391390

30.

Sinharay

(2006). Model diagnostics for Bayesian networks. Journal of Educational and Behavioral Statistics, 31(1), 1–33. https://doi.org/10.3102/10769986031001001

31.

Sprenger

(2018). The objectivity of subjective Bayesianism. European Journal for Philosophy of Science, 8(3), 539–558. https://doi.org/10.1007/s13194-018-0200-1

32.

Stan Development Team. (2024). RStan: the R interface to Stan. R package version 2.32.6. https://mc-stan.org/

33.

Stone

B. M.

(2021). The ethical use of fit indices in structural equation modeling: Recommendations for psychologists. Frontiers in Psychology, 12, 1–4. https://doi.org/10.3389/fpsyg.2021.783226

34.

Thum

Y. M.

Bhattacharya

S. K.

(2001). Detecting a change in school performance: A Bayesian analysis for a multilevel join point problem. Journal of Educational and Behavioral Statistics, 26(4), 443–468. https://doi.org/10.3102/10769986026004443

35.

Urbina

(2014). Essentials of psychological testing (2nd ed.). Wiley.

36.

Vehtari

Gabry

Magnusson

Yao

Bürkner

Paananen

Gelman

(2024). loo: Efficient leave-one-out cross-validation and WAIC for Bayesian models. R package version 2.7.0. <https://mc-stan.org/loo/>

37.

Vehtari

Gelman

Gabry

(2017). Practical Bayesian model evaluation using leave-one-out cross-validation and WAIC. Statistics and Computing, 27(5), 1413–1432. https://doi.org/10.1007/s11222-016-9696-4

38.

Wasserstein

R. L.

Lazar

N. A.

(2016). The ASA statement on p-values: Context, process, and purpose. The American Statistician, 70(2), 129–133. https://doi.org/10.1080/00031305.2016.1154108

39.

Wasserstein

R. L.

Schirm

A. L.

Lazar

N. A.

(2019). Moving to a world beyond “p< 0.05”. The American Statistician, 73(sup1), 1–19. https://doi.org/10.1080/00031305.2019.1583913

40.

Xia

(2024). A paradigm shift to estimation thinking in quantitative research in educational leadership. Educational Administration Quarterly, 60(2), 269–271. https://doi.org/10.1177/0013161X241242599

41.

Zakariya

Y. F.

(2020). Effects of school climate and teacher self-efficacy on job satisfaction of mostly STEM teachers: A structural multigroup invariance approach. International Journal of STEM Education, 7, 1–12. https://doi.org/10.1186/s40594-020-00209-4

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.03 MB

0.00 MB