Survey items with multiple response categories and multiple-choice test questions are ubiquitous in psychological and educational research. We illustrate the use of log-multiplicative association (LMA) models that are extensions of the well-known multinomial logistic regression model for multiple dependent outcome variables to reanalyze a set of items from a large political psychology survey. In particular, LMA models are shown to provide a useful analysis of items when the proper scoring rule for them is unclear. They also clearly reveal the performance of the items when instructions were altered to suppress “Don’t know” responses. LMA models can be fit rapidly using commonly available software.
AgrestiA. (2002). Categorical data analysis (2nd ed.).
New York, NY: John Wiley.
2.
AndersenE. B. (1995). The derivation of polytomous Rasch models. In FischerG. H.MolenaarI. W. (Eds.), Rasch models: Foundations, recent developments, and applications (pp. 271–291). New York, NY: Springer.
AndersonC. J.LiZ.VermuntJ. K. (2007). Estimation of models in a Rasch family for polytomous items and multiple latent variables. Journal of Statistical Software, 20. Retrieved fromhttp://www.jstatsoft.org/v20/i06/v20i06.pdf
5.
AndersonC. J.VermuntJ. K. (2000). Log-multiplicative association models as latent variable models for nominal and/or ordinal data. Sociological Methodology, 30, 81–121.
6.
AndersonC.J.YuH.T. (2007). Log-multiplicative association models as item response models. Psychometrika, 72, 5–23.
7.
BartholomewD. J.KnottM. (1999). Latent variable models and factor analysis (2nd ed.).
New York: Oxford University Press.
8.
BockR. D. (1972). Estimating item parameters and latent ability when responses are scored in two or more nominal categories. Psychometrika, 37, 29–51.
9.
de BoeckP.WilsonM. (2004). Explanatory item response models: A generalized linear and nonlinear approach. New York, NY: Springer.
10.
Delli CarpiniM. X.KeeterS. (1993). Measuring political knowledge: Putting first things first. American Journal of Political Science, 37, 1179–1206.
11.
Delli CarpiniM. X.KeeterS. (1996). What Americans know about politics and why it matters. New Haven, CT: Yale University Press.
12.
GelmanA.SpeedT. P. (1993). Characterizing a joint probability distribution by conditionals. Journal of the Royal Statistical Society, B, 55, 185–188.
13.
GoldenR. (1996). Mathematical methods for neural network analysis and design. Boston, MA: MIT Press.
14.
GoodmanL. A. (1979). Simple models for the analysis of association in cross-classifications having ordered categories. Journal of the American Statistical Association, 74, 537–552.
15.
GreenacreM. J. (2007). Correspondence analysis in practice (2nd ed.).
London: Chapman & Hall/CRC Press.
16.
HedekerD. (2007). Multilevel models for ordinal and nominal variables. In de LeeuwJ.MeijerE. (Eds.), Handbook of multilevel analysis. New York, NY: Springer.
17.
HeinenT. (1993). Discrete latent variable models. The Netherlands: Tilburg University Press.
18.
HeinenT. (1996). Latent class and discrete latent trait models: Similarities and differences. Thousand Oaks, CA: SAGE.
19.
IacobucciD.DuhachekA. (2003). Advancing alpha: Measuring reliability with confidence. Journal of Consumer Psychology, 13, 478–487.
20.
JoeH.LiuY. (1996). A model for multivariate binary response with covariates based on conditionally specified logistic regressions. Statistics & Probability Letters, 31, 113–120.
21.
JunkerB. W. (1993). Conditional association, essential independence and monotone unidimensional item response models. Annals of Statistics, 21, 1359–1378.
22.
JunkerB. W.SijtsmaK. (2000). Latent and manifest monotonicity in item response models. Applied Psychological Measurement, 24, 65–81.
23.
KroonenbergP. K.AndersonC. J. (2006). Additive and multiplicative models for three-way contingency tables: Darroch (1974) revisited. In GreenacreM.BlasiusJ. (Eds.), Multiple correspondence analysis and related methods (pp. 455–486). New York, NY: Chapman & Hall/CRC.
24.
KrosnickJ. A. (2002). The causes of no-opinion response to attitude measures in surveys: They rarely are what they appear to be. In GrovesR. M.DillmanD. A.EltingeJ. L.LittleR. J. A. (Eds.), Survey nonresponse. New York, NY: John Wiley.
25.
LongJ. S. (1997). Regression models for categorical and limited dependent variables. Thousand Oaks, CA: SAGE.
26.
LuceR. D. (1959). Individual choice behavior. New York, NY: John Wiley.
27.
McDonaldR. P. (1999). Test theory: A unified treatment. Mahwah, NJ: Lawrence Erlbaum Associates.
28.
MondakJ. J. (2001). Developing valid knowledge scales. American Journal of Political Science, 45, 224–238.
29.
SapiroV.RosenstoneS. J.the National Election Studies. (1999). National Election Studies, 1998 Pilot Study [dataset]. Ann Arbor: University of Michigan, Center for Political Studies [producer and distributor].
30.
SchumanH.PresserS. (1981). Questions and answers in attitude surveys: Experiments on questions using form, wording, and context. San Diego, CA: Academic Press.
31.
TettegahS.AndersonC. J. (2007). Pre-service teachers’ empathy and cognitions: Statistical analysis of text data by graphical models. Contemporary Educational Psychology, 32, 48–82.
