BIM-181: Revising the Public Domain “Basic Interest Markers” Using Item Response Theory

Abstract

The present study investigated the psychometric properties of the Basic Interest Markers (BIM), a public-domain broadband measure of basic interests. Unlike broader general interest frameworks such as Holland’s RIASEC types, basic interests represent more specific content domains and provide a granular view of vocational preferences and inclinations. We used Item Response Theory (IRT) to perform item analysis to identify the most informative items in each BIM scale and, by extension, reduce scale lengths. In addition, we used confirmatory factor analysis to test model fit for the BIM scales and previously suggested higher-order clusters. Data were drawn from a total of 2,009 participants, comprising two samples of undergraduate college students (N = 910 and N = 120) and samples of 164 university alumni and 815 adults recruited through Amazon Mechanical Turk. Our analysis demonstrated that latent trait estimates obtained from the BIM-343 were similar to those of our proposed modified BIM-181, with model fit favoring the latter. Overall, we provide support for the use of a modified version of the BIM inventory that more accurately captures the intended construct while simultaneously reducing test length by nearly 50%.

Keywords

basic interest markers interest measurement basic interests psychometric properties item response theory

Get full access to this article

View all access options for this article.

References

Aguinis

Villamor

Ramani

R. S.

(2021). MTurk research: Review and recommendations. Journal of Management, 47(4), 823–837. https://doi.org/10.1177/0149206320969787

Armstrong

P. I.

Allison

Rounds

(2008). Development and initial validation of brief public domain RIASEC marker scales. Journal of Vocational Behavior, 73(2), 287–299. https://doi.org/10.1016/j.jvb.2008.06.003

Bai

Liao

H.-Y.

(2019). The relation between interest congruence and college major satisfaction: Evidence from the basic interest measures. Journal of Career Assessment, 27(4), 628–644. https://doi.org/10.1177/1069072718793966

Betz

N. E.

(2001). Perspectives on future directions in vocational psychology. Journal of Vocational Behavior, 59(2), 275–283. https://doi.org/10.1006/jvbe.2001.1833

Buhrmester

Kwang

Gosling

S. D.

(2011). Amazon’s mechanical Turk: A new source of inexpensive, yet high-quality, data? Perspectives on Psychological Science, 6(1), 3–5. https://doi.org/10.1177/1745691610393980

Campbell

D. P.

Borgen

F. H.

(1999). Holland’s theory and the development of interest inventories. Journal of Vocational Behavior, 55(1), 86–101. https://doi.org/10.1006/jvbe.1999.1699

Chiorri

Marsh

H. W.

Ubbiali

Donati

(2016). Testing the factor structure and measurement invariance across gender of the Big Five inventory through exploratory structural equation modeling. Journal of Personality Assessment, 98(1), 88–99. https://doi.org/10.1080/00223891.2015.1035381

Chu

Hoff

Liu

Heimpel

N. F.

Greco

Oswald

F. L.

Rounds

(2023). The Comprehensive Assessment of Basic Interests—O*NET (CABIN-NET): A Hierarchical RIASEC Interest Measure with 20 Basic Interests . PsyArXiv. https://doi.org/10.31234/osf.io/3me5r

Cicchetti

D. V.

(1994). Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychological Assessment, 6(4), 284–290. https://doi.org/10.1037/1040-3590.6.4.284

10.

Cook

D. A.

Hatala

(2016). Validation of educational assessments: A primer for simulation and beyond. Advances in Simulation, 1(1), 31. https://doi.org/10.1186/s41077-016-0033-y

11.

Cook

R. M.

Wind

S. A.

(2024). Item response theory: A modern measurement approach to reliability and precision for counseling researchers. Measurement and Evaluation in Counseling and Development, 57(2), 116–135. https://doi.org/10.1080/07481756.2023.2301284

12.

Dawis

R. V.

Lofquist

L. H.

(1984). A psychological theory of work adjustment. University of Minnesota Press.

13.

De Ayala

R. J.

(2022). The theory and practice of item response theory. Guilford Publications.

14.

Dillman

D. A.

(2011). Mail and internet surveys: The tailored design method. Wiley.

15.

Donnay

D. A.

Borgen

F. H.

(1996). Validity, structure, and content of the 1994 strong interest inventory. Journal of Counseling Psychology, 43(3), 275–291. https://doi.org/10.1037/0022-0167.43.3.275

16.

Donnay

D. A.

Morris

M. L.

Schaubhut

N. A.

Thompson

R. C.

(2005). Strong Interest Inventory manual: Research, development, and strategies for interpretation. CPP Inc.

17.

Einarsdóttir

Eyjólfsdóttir

K. Ó.

Rounds

(2013). Development of indigenous basic interest scales: Re-Structuring the Icelandic interest space. Journal of Vocational Behavior, 82(2), 105–115. https://doi.org/10.1016/j.jvb.2013.01.001

18.

Embretson

S.E.

Reise

S.P.

(2000). Item response theory for psychologists. Erlbaum.

19.

Enders

C. K.

(2022). Applied missing data analysis. Guilford Publications.

20.

Ginevra

M. C.

Annovazzi

Santilli

Di Maggio

Camussi

(2018). Breadth of vocational interests: The role of career adaptability and future orientation. The Career Development Quarterly, 66(3), 233–245. https://doi.org/10.1002/cdq.12145

21.

Hansen

J. C.

(1984). The measurement of vocational interests: Issues and future directions. In Brown

S. D.

Lent

R. W.

(Eds.), Handbook of counseling psychology (pp. 99–136). Wiley & Sons.

22.

Hansen

J. C.

(2005). Assessment of interests. In Brown

S. D.

Lent

R. W.

(Eds.), Career development and counseling: Putting theory and research to work (pp. 281–304). Wiley & Sons.

23.

Hansen

J. C.

Campbell

D. P.

(1985). Manual for the SVIB-SCII (4th ed.). Stanford University Press.

24.

Harmon

L. W.

Hansen

J. C.

Borgen

F. H.

Hammer

A. C.

(1994). SII applications and technical guide. Consulting Psychologists Press.

25.

Hidi

Renninger

K. A.

(2006). The four-phase model of interest development. Educational Psychologist, 41(2), 111–127. https://doi.org/10.1207/s15326985ep4102_4

26.

Hoff

K. A.

Briley

D. A.

Wee

C. J. M.

Rounds

(2018). Normative changes in interests from adolescence to adulthood: A meta-analysis of longitudinal studies. Psychological Bulletin, 144(4), 426–451. https://doi.org/10.1037/bul0000140

27.

Holland

J. L.

(1959a). A theory of vocational choice. Journal of Counseling Psychology, 6(1), 35–45. https://doi.org/10.1037/h0040767

28.

Holland

J. L.

(1959b). Manual for the Holland vocational preference inventory. Consulting Psychologist Press.

29.

Holland

J. L.

(1985). Self-directed search. Psychological Assessment Resources.

30.

Holland

J. L.

(1997). Making vocational choices: A theory of vocational personalities and work environments (3rd ed.). Psychological Assessment Resources.

31.

Langher

Nannini

Caputo

(2018). What do university or graduate students need to make the cut? A meta-analysis on career intervention effectiveness. Journal of Educational, Cultural and Psychological Studies (ECPS Journal), 4(17), 21–43. https://doi.org/10.7358/ecps-2018-017-lang

32.

Leong

F. T.

Flores

L. Y.

(2013). Multicultural perspectives in vocational psychology. In Handbook of Vocational Psychology (pp. 53–80). Routledge.

33.

Liao

H. Y.

Armstrong

P. I.

Rounds

(2008). Development and initial validation of public domain Basic Interest Markers. Journal of Vocational Behavior, 73(1), 159–183. https://doi.org/10.1016/j.jvb.2007.12.002

34.

Little

R. J. A.

(1988). A test of missing completely at random for multivariate data with missing values. Journal of the American Statistical Association, 83(404), 1198–1202. https://doi.org/10.2307/2290157

35.

Mandelke

A. J.

Shoenfelt

E. L.

Brown

R. D.

(2016). Expected utility of interest inventories in employee selection: Perceptions of industrial organizational psychology experts. TIP: The Industrial-Organizational Psychologist, 54(2), 1–7.

36.

Marsh

H. W.

Lüdtke

Muthén

Asparouhov

Morin

A. J. S.

Trautwein

Nagengast

(2010). A new look at the big- five factor structure through exploratory structural equation modeling. Psychological Assessment, 22(3), 471–491. https://doi.org/10.1037/a0019227

37.

Morris

(2023). Introducing the strong interest Inventory® 244 assessment. The Myers-Briggs Company.

38.

Nauta

M. M.

(2010). The development, evolution, and status of Holland’s theory of vocational personalities: Reflections and future directions for counseling psychology. Journal of Counseling Psychology, 57(1), 11–22. https://doi.org/10.1037/a0018213

39.

Nye

C. D.

Rounds

Drasgow

(2012). Vocational interests and performance: A quantitative summary of over 60 years of research. Perspectives on Psychological Science, 7(4), 384–403. https://doi.org/10.1177/1745691612449021

40.

Nye

C. D.

Rounds

Drasgow

(2017). Interest congruence and performance: Revisiting recent meta-analytic findings. Journal of Vocational Behavior, 98, 138–151. https://doi.org/10.1016/j.jvb.2016.11.002

41.

Paulhus

D. L.

Vazire

(2007). The self-report method. In Robins

R. W.

Fraley

R. C.

Krueger

(Eds.), Handbook of research methods in personality psychology (pp. 224–239). Guilford Press.

42.

Ralston

C. A.

Borgen

F. H.

Rottinghaus

P. J.

Donnay

D. A.

(2004). Specificity in interest measurement: Basic interest scales and major field of study. Journal of Vocational Behavior, 65(2), 203–216. https://doi.org/10.1016/S0001-8791(03)00096-4

43.

Randahl

G. J.

(1991). A typological analysis of the relations between measured vocational interests and abilities. Journal of Vocational Behavior, 38(3), 333–350. https://doi.org/10.1016/0001-8791(91)90034-J

44.

Reise

S. P.

Waller

N. G.

(2009). Item response theory and clinical measurement. Annual Review of Clinical Psychology, 5, 27–48. https://doi.org/10.1146/annurev.clinpsy.032408.153553

45.

Renninger

K. A.

Hidi

(2016). The power of interest for motivation and learning. Routledge.

46.

Rottinghaus

P. J.

Gaffey

A. R.

Borgen

F. H.

Ralston

C. A.

(2006). Diverse pathways of psychology majors: Vocational interests, self‐efficacy, and intentions. The Career Development Quarterly, 55(1), 85–93. https://doi.org/10.1002/j.2161-0045.2006.tb00007.x

47.

Rounds

(1995). Vocational interests: Evaluating structural hypotheses. In Lubinski

D. J.

Dawis

R. V.

(Eds.), Assessing individual differences in human behavior: New concepts, methods, and findings (pp. 177–232). Davies-Black Publishing.

48.

Rounds

(2014). The nature and power of interests. Current Directions in Psychological Science, 23(2), 98–103. https://doi.org/10.1177/0963721414522812

49.

Rounds

Lewis

Rivkin

(2010). O*NET interest profiler short form psychometric characteristics: Summary. US Department of Labor.

50.

Samejima

(1969). Estimation of latent ability using a response pattern of graded coress. Psychometrika monograph supplement, 17(4), 2. https://doi.org/10.1002/j.2333-8504.1968.tb00153.x

51.

Stanton

J. M.

Sinar

E. F.

Balzer

W. K.

Smith

P. C.

(2002). Issues and strategies for reducing the length of self-report scales. Personnel Psychology, 55(1), 167–194. https://doi.org/10.1111/j.1744-6570.2002.tb00108.x

52.

Stoll

Rieger

Lüdtke

Nagengast

Trautwein

Roberts

B. W.

(2017). Vocational interests assessed at the end of high school predict life outcomes assessed 10 years later over and above IQ and Big Five personality traits. Journal of Personality and Social Psychology, 113(1), 167–184. https://doi.org/10.1037/pspp0000117

53.

Stoll

Rieger

Nagengast

Trautwein

Rounds

(2021). Stability and change in vocational interests after graduation from high school: A six-wave longitudinal study. Journal of Personality and Social Psychology, 120(4), 1091–1116. https://doi.org/10.1037/pspp0000359

54.

Streiner

D. L.

(2003). Starting at the beginning: An introduction to coefficient alpha and internal consistency. Journal of Personality Assessment, 80(1), 99–103. https://doi.org/10.1207/S15327752JPA8001_18

55.

Strong

E. K.

Jr. (1927). Vocational interest Blank. Stanford University Press.

56.

(2020). The three faces of interests: An integrative review of interest research in vocational, organizational, and educational psychology. Journal of Vocational Behavior, 116(1), 103240. https://doi.org/10.1016/j.jvb.2018.10.016

57.

Tay

Liao

H.-Y.

Zhang

Rounds

(2018). Toward a dimensional model of vocational interests. Journal of Applied Psychology, 104(5), 690–714. https://doi.org/10.1037/apl0000373

58.

Sullivan

B. A.

Hansen

J. I. C.

(2004). Mapping associations between interests and personality: Toward a conceptual understanding of individual differences in vocational behavior. Journal of Counseling Psychology, 51(3), 287–298. https://doi.org/10.1037/0022-0167.51.3.287

59.

Swanson

J. L.

Fouad

N. A.

(1999). Applying theories of person‐environment fit to the transition from school to work. The Career Development Quarterly, 47(4), 337–347. https://doi.org/10.1002/j.2161-0045.1999.tb00742.x

60.

Tavakol

Dennick

(2011). Making sense of Cronbach's alpha. International Journal of Medical Education, 2(5), 53–55. https://doi.org/10.5116/ijme.4dfb.8dfd

61.

Tay

Rounds

(2011). People-things and data-ideas: Bipolar dimensions? Journal of Counseling Psychology, 58(3), 424–440. https://doi.org/10.1037/a0023488

62.

Tranberg

Slane

Ekeberg

S. E.

(1993). The relation between interest congruence and satisfaction: A metaanalysis. Journal of Vocational Behavior, 42(3), 253–264. https://doi.org/10.1006/jvbe.1993.1018

63.

Tsabari

Tziner

Meir

E. I.

(2005). Updated meta-analysis on the relationship between congruence and satisfaction. Journal of Career Assessment, 13(2), 216–232. https://doi.org/10.1177/1069072704273165

64.

Van Iddekinge

C. H.

Roth

P. L.

Putka

D. J.

Lanivich

S. E.

(2011). Are you interested? A meta-analysis of relations between vocational interests and employee performance and turnover. Journal of Applied Psychology, 96(6), 1167–1194. https://doi.org/10.1037/a0024343