Confirmatory Factor Analysis Alternative: Free,Accessible CBID Software

Abstract

New software that performs Classical and Bayesian Instrument Development (CBID) is reported that seamlessly integrates expert (content validity) and participant data (construct validity) to produce entire reliability estimates with smaller sample requirements. The free CBID software can be accessed through a website and used by clinical investigators in new instrument development. Demonstrations are presented of the three approaches using the CBID software: (a) traditional confirmatory factor analysis (CFA), (b) Bayesian CFA using flat uninformative prior, and (c) Bayesian CFA using content expert data (informative prior). Outcomes of usability testing demonstrate the need to make the user-friendly, free CBID software available to interdisciplinary researchers. CBID has the potential to be a new and expeditious method for instrument development, adding to our current measurement toolbox. This allows for the development of new instruments for measuring determinants of health in smaller diverse populations or populations of rare diseases.

Keywords

instrument development methods Bayesian methods free software

Get full access to this article

View all access options for this article.

References

Alonso

Laenen

Molenberghs

Geys

Vangeneugden

(2010). A unified approach to multi-item reliability. Biometrics, 66, 1061-1068.

American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (2014). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.

Brown

T. A.

(2014). Confirmatory factor analysis for applied research (2nd ed.). New York, NY: Guilford Press.

Carpenter

Gajewski

Teel

Aaronson

L. S.

(2008). Bayesian data analysis: Estimating the efficacy of Tai Chi as a case study. Nursing Research, 57, 214-219.

Engelman

K. K.

Daley

C. M.

Gajewski

B. J.

Ndikum-Moffor

Faseru

Braiuca

. . . Greiner

K. A.

(2010). An assessment of American Indian women’s mammography experiences. BMC Women’s Health, 10, 34.

Gajewski

B. J.

Coffland

Boyle

Bott

M. J.

Price

L. R.

Leopold

Dunton

(2012). Assessing content validity through correlation and relevance tools: A Bayesian randomized equivalence experiment. Methodology, 8, 81-96.

Gajewski

B. J.

Price

L. R.

Bott

M. J.

(2015). Response to “Conceptions of reliability revisited, and practical recommendations.” Nursing Research, 64, 137-139.

Gajewski

B. J.

Price

L. R.

Coffland

Boyle

Bott

M. J.

(2013). Integrated analysis of content and construct validity of psychometric instruments. Quality & Quantity, 47, 57-78.

Garrard

Price

L. R.

Bott

M. J.

Gajewski

B. J.

(2015). A novel method for expediting the development of patient-reported outcome measures and an evaluation of its performance via simulation. BMC Medical Research Methodology, 15, 77.

10.

Gelman

Carlin

J. B.

Stern

H. S.

Rubin

D. B.

(2004). Texts in Statistical Science Series: Bayesian data analysis. Boca Raton, FL: CRC Press.

11.

Harris

P. A.

Taylor

Thielke

Payne

Gonzalez

Conde

J. G.

(2009). Research electronic data capture (REDCap)—A metadata-driven methodology and workflow process for providing translational research informatics support. Journal of Biomedical Informatics, 42, 377-381.

12.

Jiang

Boyle

D. K.

Bott

M. J.

Wick

J. A.

Gajewski

B. J.

(2014). Expediting clinical and translational research via Bayesian instrument development. Applied Psychological Measurement, 38, 296-310.

13.

Lewis

J. R.

(1995). IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use. International Journal of Human-Computer Interaction, 7, 57-78.

14.

Baser

(2012). Using R and WinBUGS to fit a generalized partial credit model for developing and evaluating patient-reported outcomes assessments. Statistics in Medicine, 31, 2010-2016. doi:10.1002/sim.4475

15.

Martin

A. D.

Quinn

K. M.

Park

J. H.

(2011). MCMCpack: Markov Chain Monte Carlo in R. Journal of Statistical Software, 42, 1-21.

16.

Muthén

(2010). Bayesian analysis in Mplus: A brief introduction (Technical report). Retrieved from http://www.statmodel.com/download/IntroBayesVersion%203.pdf

17.

Pawlowicz

Gajewski

Coffland

Boyle

Bott

M. J.

Dunton

(2012). Application of Bayesian methodology within an equivalence content validity study. Nursing Research, 61, 181-187.

18.

Price

L. R.

(2016). Psychometric methods: Theory into practice. New York, NY: Guilford Press.

19.

R Core Team. (2013). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing. Available from http://www.R-project.org/

20.

Sijtsma

van der Ark

L. A.

(2015). Conceptions of reliability revisited, and practical recommendations. Nursing Research, 64, 128-136.

21.

Yves

(2012). lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48, 1-36. Retrieved from http://www.jstatsoft.org/v48/i02/