An Omega-Hierarchical Extension Index for Second-Order Constructs With Hierarchical Measuring Instruments

Abstract

An index extending the widely used omega-hierarchical coefficient is discussed, which can be used for evaluating the influence of a second-order factor on the interrelationships among the components of a hierarchical measuring instrument. The index represents a useful and informative complement to the traditional omega-hierarchical measure of explained overall scale score variance by that underlying construct. A point and interval estimation procedure is outlined for the described index, which is based on model reparameterization and is developed within the latent variable modeling framework. The method is readily applicable with popular software and is illustrated with examples.

Keywords

average correlation hierarchical scale multiple-component measuring instrument omega-hierarchical coefficient second-order construct second-order factor analysis model

Get full access to this article

View all access options for this article.

References

Agresti

(2018). Statistical methods for the social sciences. Pearson.

Bentler

P. M.

(2006). EQS structural equations program manual. Multivariate Software.

Bollen

K. A.

(1989). Structural equations with latent variables. Wiley.

Browne

M. W.

(1984). Asymptotically distribution-free methods for the analysis of covariance structures. British Journal of Mathematical and Statistical Psychology, 37, 62–83.

Casella

Berger

J. O.

(2002). Statistical inference. Wadsworth.

Cheng

Pérez-Díaz

P. A.

Petrides

K. V.

(2023). Monte Carlo simulation with confusion matrix paradigm–a sample of internal consistency indices. Frontiers in Psychology, 14, Article 1298534.

Crocker

Algina

(2006). Classical and modern test theory. Prentice Hall.

Cudeck

(1989). Analysis of correlation matrices using covariance structure models. Psychological Bulletin, 105, 317–327.

Davison

A. C.

Hinkley

D. V.

(2003). Bootstrap methods and their application. Cambridge University Press.

10.

Efron

Tibshiriani

(1993). An introduction to the bootstrap. Chapman & Hall.

11.

Garcia-Garzon

Abad

F. J.

Garrido

L. E.

(2020). On omega hierarchical estimation: A comparison of exploratory bi-factor analysis algorithms. Multivariate Behavioral Research, 56, 101–119.

12.

Geiser

(2013). Data analysis with Mplus. Guildford.

13.

Gignac

G. E.

(2015). Estimating the strength of a general factor: Coefficient omega hierarchical. Industrial and Organizational Psychology, 8, 434–438.

14.

Gignac

G. E.

Reynolds

M. R.

Kovacs

(2019). Digit span subscale scores may be insufficiently reliable for clinical interpretation: Distinguishing between stratified coefficient alpha and omega hierarchical. Assessment, 26, 1554–1563.

15.

Jöreskog

K. G.

Sörbom

(1996). LISREL8 reference user manual. Scientific Software International Inc.

16.

MacCallum

R. C.

Browne

M. W.

Sugawara

H. M.

(1996). Power analysis and determination of sample size for covariance structure modeling. Psychological Methods, 1, 130–149.

17.

McDonald

R. P.

(1985). Factor analysis and related methods. Earlbaum.

18.

McDonald

R. P.

(1999). Test theory. A unified treatment. Earlbaum.

19.

Messick

(1995). Validity of psychological assessment: Validation of inferences from persons’ responses and performances as scientific inquiry into score meaning. American Psychologist, 50, 741–749.

20.

Mulaik

S. A.

(2009). Factor analysis. CRC Press.

21.

Muthén

L. K.

Muthén

B. O.

(2002). How to use a Monte Carlo study to decide on sample size and determine power. Structural Equation Modeling, 9, 599–620.

22.

Muthén

L. K.

Muthén

B. O.

(2024). Mplus user’s guide. Muthén & Muthén.

23.

Rabe-Hesketh

Skrondal

(2022). Multilevel and longitudinal modeling using Stata. Stata Press.

24.

Raykov

Goldammer

Marcoulides

G. A.

Menold

(2018). Reliability of scales with second-order structure: Evaluation of coefficient alpha’s population slippage using latent variable modeling. Educational and Psychological Measurement, 78, 1123–1135.

25.

Raykov

Pohl

(2013). Essential unidimensionality in multiple component measuring instruments: A correlation decomposition approach. Educational and Psychological Measurement, 73, 581–600.

26.

Raykov

Zinbarg

R. E.

(2011). Proportion general factor variance in a hierarchical multiple-component measuring instrument: A note on a confidence interval procedure. British Journal of Mathematical and Statistical Psychology, 64, 193–207.

27.

Revelle

Condon

D. M.

(2019). Reliability from α to ω: A tutorial. Psychological Assessment, 31, 1395–1411.

28.

Rhemtulla

Brosseau-Liard

P. É.

Savalei

(2012). When can categorical variables be treated as continuous? A comparison of robust continuous and categorical SEM estimation methods under suboptimal conditions. Psychological Methods, 17, 354–373.

29.

Watkins

M. W.

(2017). The reliability of multidimensional neuropsychological measures: From alpha to omega. The Clinical Neuropsychologist, 31, 1113–1126.

30.

Zinbarg

R. E.

Barlow

D. H.

(1996). Structure of anxiety and the anxiety disorders: A hierarchical model. Journal of Abnormal Psychology, 105, 181–193.

31.

Zinbarg

R. E.

Yovel

Revelle

McDonald

R. P.

(2006). Estimating generalizability to a latent variable common to all of a scale’s indicators: A comparison of estimators for ω _h . Applied Psychological Measurement, 30, 121–144.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.12 MB