Using Big Data and Machine Learning in Personality Measurement: Opportunities and Challenges

Abstract

This conceptual paper examines the promises and critical challenges posed by contemporary personality measurement using big data. More specifically, the paper provides (i) an introduction to the type of technologies that give rise to big data, (ii) an overview of how big data is used in personality research and how it might be used in the future, (iii) a framework for approaching big data in personality science, (iv) an exploration of ideas that connect psychometric reliability and validity, as well as principles of fairness and privacy, to measures of personality that use big data, (v) a discussion emphasizing the importance of collaboration with other disciplines for personality psychologists seeking to adopt big data methods, and finally, (vi) a list of practical considerations for researchers seeking to move forward with big data personality measurement and research. It is expected that this paper will provide insights, guidance, and inspiration that helps personality researchers navigate the challenges and opportunities posed by using big data methods in personality measurement. © 2020 European Association of Personality Psychology

Keywords

big data machine learning personality measurement

Get full access to this article

View all access options for this article.

References

Adjerid

, & Kelley

(2018). Big data in psychology: A framework for research advancement. American Psychologist, 73, 899–917. https://doi.org/10.1037/amp0000190

American Educational Research Association, American Psychological Association, & National Council on Measurement in Education (2014). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.

Aroganam

, Manivannan

, & Harrison

(2019). Review on wearable technology sensors used in consumer sport applications. Sensors, 19, 1–26. https://doi.org/10.3390/s19091983

Arthur

, Doverspike

, Muñoz

G. J.

, Taylor

J. E.

, & Carr

A. E.

(2014). The use of mobile devices in high–stakes remotely delivered assessments and testing. International Journal of Selection and Assessment, 22, 113–123. https://doi.org/10.1111/ijsa.12062

Arthur

, Glaze

R. M.

, Villado

A. J.

, & Taylor

J. E.

(2010). The magnitude and extent of cheating and response distortion effects on unproctored internet–based tests of cognitive ability and personality. International Journal of Selection and Assessment, 18, 1–16. https://doi.org/10.1111/j.1468-2389.2010.00476.x

Arthur

, Keiser

N. L.

, & Doverspike

(2018). An information–processing–based conceptual framework of the effects of unproctored internet–based testing devices on scores on employment–related assessments and tests. Human Performance, 31, 1–32. https://doi.org/10.1080/08959285.2017.1403441

Axelsson

, Brink

, Lundgren

, & Lötvall

(2011). The influence of personality traits on reported adherence to medication in individuals with chronic disease: An epidemiological study in West Sweden. PLoS ONE, 6, 1–7. https://doi.org/10.1371/journal.pone.0018241

Azucar

, Marengo

, & Settanni

(2018). Predicting the Big 5 personality traits from digital footprints on social media: A meta–analysis. Personality and Individual Differences, 124, 150–159. https://doi.org/10.1016/j.paid.2017.12.018

Bachrach

, Kosinski

, Graepel

, Kohli

, & Stillwell

(2012). Personality and patterns of Facebook usage. Proceedings of the 4th Annual ACM Web Science Conference, 24–32. https://doi.org/10.1145/2380718.2380722

10.

Barocas

, & Selbst

A. D.

(2016). Big data's disparate impact. SSRN Electronic Journal, 104, 671–732. https://doi.org/10.2139/ssrn.2477899

11.

Beck

E. D.

, & Jackson

J. J.

(2019a). Within–person variability. PsyArXiv. Advance online publication.. https://doi.org/10.31234/osf.io/kavbp

12.

Beck

E. D.

, & Jackson

J. J.

(2019b). Consistency and change in idiographic personality: A longitudinal ESM network study. Journal of Personality and Social Psychology. Advance online publication, 118, 1080–1100. https://doi.org/10.1037/pspp0000249

13.

Becker

B. J.

, & Aloe

A. M.

(2008). A framework for generalization in meta–analysis: Medical and social science examples [invited presentation]. The 16th Merck–Temple conference on biostatistics, Philadelphia, PA.

14.

Beckmann

, & Wood

R. E.

(2017). Editorial: Dynamic personality science. Integrating between–person stability and within–person change. Frontiers in Psychology, 8, 1–7. https://doi.org/10.3389/fpsyg.2017.01486

15.

Bleidorn

, & Hopwood

C. J.

(2019). Using machine learning to advance personality assessment and theory. Personality and Social Psychology Review, 23, 190–203. https://doi.org/10.1177/1088868318772990

16.

Bleidorn

, Hopwood

C. J.

, & Lucas

R. E.

(2018). Life events and personality trait change. Journal of Personality, 86, 83–96. https://doi.org/10.1111/jopy.12286

17.

Bleidorn

, Hopwood

C. J.

, & Wright

A. G.

(2017). Using big data to advance personality theory. Current Opinion in Behavioral Sciences, 18, 79–82. https://doi.org/10.1016/j.cobeha.2017.08.004

18.

Borsboom

, Mellenbergh

G. J.

, & Van Heerden

(2004). The concept of validity. Psychological Review, 111, 1061–1071. https://doi.org/10.1037/0033-295X.111.4.1061

19.

Campbell

D. T.

, & Fiske

D. W.

(1959). Convergent and discriminant validation by the multitrait–multimethod matrix. Psychological Bulletin, 56, 81–105. https://doi.org/10.1037/h0046016

20.

Cascio

, Boudreau

, & Fink

(2019). Investing in people: Financial impact of human resource initiatives (3rd ed.). Alexandria, VA: Society for Human Resource Management.

21.

Cattell

R. B.

(1946). Personality structure and measurement. I. The operational determination of trait unities. British Journal of Psychology, 36, 88–103. https://doi.org/10.1111/j.2044-8295.1946.tb01110.x

22.

Chapman

B. P.

, Hampson

, & Clarkin

(2014). Personality–informed interventions for healthy aging: Conclusions from a National Institute on Aging work group. Developmental Psychology, 50, 1426–1441. https://doi.org/10.1037/a0034135

23.

Chapman

B. P.

, Lin

, Roy

, Benedict

R. H. B.

, & Lyness

J. M.

(2019). Health risk prediction models incorporating personality data: Motivation, challenges, and illustration. Personality Disorders, Theory, Research, and Treatment, 10, 46–58. https://doi.org/10.1037/per0000300

24.

Chen

E. E.

, & Wojcik

S. P.

(2016). A practical guide to big data research in psychology. Psychological Methods, 21, 458–474. https://doi.org/10.1037/met0000111

25.

Chester

D. S.

, & Lasko

E. N.

(in press). Construct validation of experimental manipulations in social psychology: Current practices and recommendations for the future. Perspectives on Psychological Science.

26.

Cheung

M. W.–L.

, & Jak

(2016). Analyzing big data in psychology: A split/analyze/meta–analyze approach. Frontiers in Psychology, 7, 1–13. https://doi.org/10.3389/fpsyg.2016.00738

27.

Ching

C. C.

, Basham

J. D.

, & Jang

(2005). The legacy of the digital divide: Gender, socioeconomic status, and early exposure as predictors of full–spectrum technology use among young adults. Urban Education, 40, 394–411. https://doi.org/10.1177/0042085905276389

28.

Chiorri

, Marsh

H. W.

, Ubbiali

, & Donati

(2016). Testing the factor structure and measurement invariance across gender of the Big Five Inventory through exploratory structural equation modeling. Journal of Personality Assessment, 98, 88–99. https://doi.org/10.1080/00223891.2015.1035381

29.

Chittaranjan

, Blom

, & Gatica–Perez

(2013). Mining large–scale smartphone data for personality studies. Personal and Ubiquitous Computing, 17, 433–450. https://doi.org/10.1007/s00779-011-0490-1

30.

Christensen

A. J.

, & Smith

T. W.

(1995). Personality and patient adherence: Correlates of the five–factor model in renal dialysis. Journal of Behavioral Medicine, 18, 305–313. https://doi.org/10.1007/BF01857875

31.

Christensen

A. P.

, Golino

, & Silvia

P. J.

(2020). A psychometric network perspective on the validity and validation of personality trait questionnaires. European Journal of Personality. Advance online publication. https://doi.org/10.1002/per.2265

32.

Corker

K. S.

, Oswald

F. L.

, & Donnellan

M. B.

(2012). Conscientiousness in the classroom: A process explanation. Journal of Personality, 80, 995–1028. https://doi.org/10.1111/j.1467-6494.2011.00750.x

33.

Costantini

, Richetin

, Preti

, Casini

, Epskamp

, & Perugini

(2019). Stability and variability of personality networks. A tutorial on recent developments in network psychometrics. Personality and Individual Differences, 136, 68–78. https://doi.org/10.1016/j.paid.2017.06.011

34.

Cronbach

L. J.

(1982). Designing evaluations of educational and social programs. San Francisco, CA: Jossey–Bass. https://doi.org/10.1177/109821408300400210

35.

Cronbach

L. J.

, Gleser

G. C.

, Nanda

, & Rajaratnam

(1972). The dependability of behavioral measurements: Theory of generalizability for scores and profiles. New York, NY: John Wiley & Sons. https://doi.org/10.1126/science.178.4067.1275

36.

Cronbach

L. J.

, & Meehl

P. E.

(1955). Construct validity in psychological tests. Psychological Bulletin, 52, 281–302. https://doi.org/10.1037/h0040957

37.

Cronbach

L. J.

, Rajaratnam

, & Gleser

G. C.

(1963). Theory of generalizability: A liberalization of reliability theory. British Journal of Statistical Psychology, 16, 137–163. https://doi.org/10.1111/j.2044-8317.1963.tb00206.x

38.

Csikszentmihalyi

, & Larson

(2014). Validity and reliability of the experience–sampling method. In Flow and the foundations of positive psychology (pp. 35–54). Dordrecht, Netherlands: Springer.

39.

De Mauro

, Greco

, & Grimaldi

(2015). What is big data? A consensual definition and a review of key research topics. AIP Conference Proceedings, 1644, 97–104. https://doi.org/10.1063/1.4907823

40.

Domingos

(2012). A few useful things to know about machine learning. Communications of the ACM, 55, 78–87. https://doi.org/10.1145/2347736.2347755

41.

Donnellan

M. B.

, & Robins

R. W.

(2010). Resilient, overcontrolled, and undercontrolled personality types: Issues and controversies. Social and Personality Psychology Compass, 4, 1070–1083. https://doi.org/10.1111/j.1751-9004.2010.00313.x

42.

Epskamp

, Rhemtulla

, & Borsboom

(2017). Generalized network psychometrics: Combining network and latent variable models. Psychometrika; Williamsburg, 82, 904–927. https://doi.org.ezproxy.rice.edu/10.1007/s11336-017-9557-x

43.

Epstein

(1983). Aggregation and beyond: Some basic issues on the prediction of behavior. Journal of Personality, 51, 360–392. https://doi.org/10.1111/j.1467-6494.1983.tb00338.x

44.

Equal Employment Opportunity Commission (1978). Uniform guidelines on employee selection procedures. Federal Register, 43, 38295–38309.

45.

Erdmier

, Hatcher

, & Lee

(2016). Wearable device implications in the healthcare industry. Journal of Medical Engineering & Technology, 40, 141–148. https://doi.org/10.3109/03091902.2016.1153738

46.

Fan

, & Li

(2006). Statistical challenges with high dimensionality: Feature selection in knowledge discovery. ArXiv:Math. Retrieved from. https://arxiv.org/abs/math/0602133

47.

Fiedler

(2018). The creative cycle and the growth of psychological science. Perspectives on Psychological Science, 13, 433–438. https://doi.org/10.1177/1745691617745651

48.

Flake

J. K.

, & Fried

E. I.

(2019). Measurement schmeasurement: Questionable measurement practices and how to avoid them. PsyArXiv. Advance online publication.. https://doi.org/10.31234/osf.io/hs7wm

49.

Fleeson

(2004). Moving personality beyond the person–situation debate: The challenge and the opportunity of within–person variability. Current Directions in Psychological Science, 13, 83–87. https://doi.org/10.1111/j.0963-7214.2004.00280.x

50.

Foster

, Schuh

, & Zhang

(2013). The 2010 survey of consumer payment choice. Research Reviews, 20, 113–118. https://doi.org/10.2139/ssrn.2564172

51.

Friedman

, Hastie

, & Tibshirani

(2008). Sparse inverse covariance estimation with the graphical lasso. Biostatistics, 9, 432–441. https://doi.org/10.1093/biostatistics/kxm045

52.

Gandomi

, & Haider

(2015). Beyond the hype: Big data concepts, methods, and analytics. International Journal of Information Management, 35, 137–144. https://doi.org/10.1016/j.ijinfomgt.2014.10.007

53.

Gerlach

, Farb

, Revelle

, & Amaral

L. A. N.

(2018). A robust data–driven approach identifies four personality types across four large data sets. Nature Human Behaviour, 2, 735–742. https://doi.org/10.1038/s41562-018-0419-z

54.

Gladstone

J. J.

, Matz

S. C.

, & Lemaire

(2019). Can psychological traits be inferred from spending? Evidence from transaction data. Psychological Science, 30, 1087–1096. https://doi.org/10.1177/0956797619849435

55.

Golbeck

, Robles

, Edmondson

, & Turner

(2011). Predicting personality from Twitter. 2011 IEEE Third International Conference on Privacy, Security, Risk and Trust and 2011 IEEE Third International Conference on Social Computing, 149–156. https://doi.org/10.1109/PASSAT/SocialCom.2011.33

56.

Golbeck

, Robles

, & Turner

(2011). Predicting personality with social media. CHI EA'11: CHI'11 Extended Abstracts on Human Factors in Computing Systems, 253–262. https://doi.org/10.1145/1979742.1979614

57.

Hamaker

E. L.

, Nesselroade

J. R.

, & Molenaar

P. C.

(2007). The integrated trait–state model. Journal of Research in Personality, 41, 295–315. https://doi.org/10.1016/j.jrp.2006.04.003

58.

Haqiqatkhah

M. M.

, & Tuerlinckx

(2019). Are we on the same page? Latent variable modeling suggests different nomothetic and idiographic factor structures for momentary affect. PsyArXiv. Advance online publication. https://doi.org/10.31234/osf.io/6wsgd

59.

Harari

G. M.

, Lane

N. D.

, Wang

, Crosier

B. S.

, Campbell

A. T.

, & Gosling

S. D.

(2016). Using smartphones to collect behavioral data in psychological science: Opportunities, practical considerations, and challenges. Perspectives on Psychological Science, 11, 838–854. https://doi.org/10.1177/1745691616650285

60.

Hawkins

D. M.

(2004). The problem of overfitting. Journal of Chemical Information and Computer Sciences, 44, 1–12. https://doi.org/10.1021/ci0342472

61.

Henrich

, Heine

S. J.

, & Norenzayan

(2010). The weirdest people in the world? Behavioral and Brain Sciences, 33, 61–83. https://doi.org/10.1017/S0140525X0999152X

62.

Huffman

(2018). The digital divide revisited: What is next? Education, 138, 239–246. Retrieved from. https://search-ebscohost-com.ezproxy.rice.edu

63.

Iacobelli

, Gill

A. J.

, Nowson

, & Oberlander

(2011). Large scale personality classification of bloggers. In D'Mello

, Graesser

, Schuller

, & Martin

J.–C.

(Eds.), Affective computing and intelligent interaction (pp. 568–577). https://doi.org/10.1007/978-3-642-24571-8_71

64.

Ihsan

, & Furnham

(2018). The new technologies in personality assessment: A review. Consulting Psychology Journal: Practice and Research, 70, 147–166. https://doi.org/10.1037/cpb0000106

65.

Ilies

, & Judge

T. A.

(2002). Understanding the dynamic relationships among personality, mood, and job satisfaction: A field experience sampling study. Organizational Behavior and Human Decision Processes, 89, 1119–1139. https://doi.org/10.1016/S0749-5978(02)00018-3

66.

Inoubli

, Aridhi

, Mezni

, Maddouri

, & Nguifo

E. M.

(2018). An experimental survey on big data frameworks. Future Generation Computer Systems, 86, 546–564. https://doi.org/10.1016/j.future.2018.04.032

67.

Ippel

, Kaptein

M. C.

, & Vermunt

J. K.

(2019). Estimating multilevel models on data streams. Psychometrika, 84, 41–64. https://doi.org/10.1007/s11336-018-09656-z

68.

Jackson

L. A.

, Zhao

, Kolenic

III , Fitzgerald

H. E.

, Harold

, & Von Eye

(2008). Race, gender, and information technology use: The new digital divide. Cyberpsychology & Behavior, 11, 437–442. https://doi.org/10.1089/cpb.2007.0157

69.

James

, Witten

, Hastie

, & Tibshirani

(2013). An introduction to statistical learning. New York, NY: Springer. https://doi.org/10.1007/978-1-4614-7138-7

70.

Jeong

I. C.

, Bychkov

, & Searson

P. C.

(2019). Wearable devices for precision medicine and health state monitoring. IEEE Transactions on Biomedical Engineering, 66, 1242–1258. https://doi.org/10.1109/TBME.2018.2871638

71.

Judge

T. A.

, Simon

L. S.

, Hurst

, & Kelley

(2014). What I experienced yesterday is who I am today: Relationship of work motivations and behaviors to within–individual variation in the five–factor model of personality. Journal of Applied Psychology, 99, 199–221. https://doi.org/10.1037/a0034485

72.

Kelley

T. L.

(1927). Interpretation of educational measurements. New York, NY: World Book Company.

73.

Kosinski

, Matz

S. C.

, Gosling

S. D.

, Popov

, & Stillwell

(2015). Facebook as a research tool for the social sciences: Opportunities, challenges, ethical considerations, and practical guidelines. American Psychologist, 70, 543–556. https://doi.org/10.1037/a0039210

74.

Kosinski

, Wang

, Lakkaraju

, & Leskovec

(2016). Mining big data to extract patterns and predict real–life outcomes. Psychological Methods, 21, 493–506. https://doi.org/10.1037/met0000105

75.

Kuhn

(2019). caret: Classification and regression training. R package version 6.0–84. https://CRAN.R-project.org/package=caret

76.

Landers

R. N.

, Brusso

R. C.

, Cavanaugh

K. J.

, & Collmus

A. B.

(2016). A primer on theory–driven web scraping: Automatic extraction of big data from the internet for use in psychological research. Psychological Methods, 21, 475–492. https://doi.org/10.1037/met0000081

77.

Laney

(2001, February 6). 3–D Data management: Controlling data volume, velocity, and variety. Application Delivery Strategies by META Group Inc. Retrieved from https://blogs.gartner.com/doug-laney/files/2012/01/ad949-3D-Data-Management-Controlling-Data-Volume-Velocity-and-Variety.pdf

78.

Lenhart

, Duggan

, Perrin

, Steppler

, Rainie

, & Parker

(2015). Teens, social media, & technology overview 2015: Smartphones facilitate shifts in communication landscape for teens (p. 48). Retrieved from https://www.pewresearch.org/wp-content/uploads/sites/9/2015/04/PI_TeensandTech_Update2015_0409151.pdf

79.

Lindsay

(2005). Employability, services for unemployed job seekers and the digital divide. Urban Studies, 42, 325–339. https://doi.org/10.1080/0042098042000316173

80.

Lodge

J. M.

, Alhadad

S. S. J.

, Lewis

M. J.

, & Gašević

(2017). Inferring learning from big data: The importance of a transdisciplinary and multidimensional approach. Technology, Knowledge and Learning, 22, 385–400. https://doi.org/10.1007/s10758-017-9330-3

81.

Lüdtke

, Roberts

B. W.

, Trautwein

, & Nagy

(2011). A random walk down university avenue: Life paths, life events, and personality trait change at the transition to university life. Journal of Personality and Social Psychology, 101, 620–637. https://doi.org/10.1037/a0023743

82.

Mackert

, Mabry–Flynn

, Champlin

, Donovan

E. E.

, & Pounders

(2016). Health literacy and health information technology adoption: The potential for a new digital divide. Journal of Medical Internet Research, 18, 211–226. https://doi.org/10.2196/jmir.6349

83.

Mansour

R. F.

(2016). Understanding how big data leads to social networking vulnerability. Computers in Human Behavior, 57, 348–351. https://doi.org/10.1016/j.chb.2015.12.055

84.

Mardonova

, & Choi

(2018). Review of wearable device technology and its applications to the mining industry. Energies, 11, 1–14. https://doi.org/10.3390/en11030547

85.

Marler

(2018). Mobile phones and inequality: Findings, trends, and future directions. New Media & Society, 20, 3498–3520. https://doi.org/10.1177/1461444818765154

86.

Marsh

H. W.

, Lüdtke

, Muthén

, Asparouhov

, Morin

A. J. S.

, Trautwein

, & Nagengast

(2010). A new look at the big five factor structure through exploratory structural equation modeling. Psychological Assessment, 22, 471–491. https://doi.org/10.1037/a0019227

87.

McCrae

R. R.

, & John

O. P.

(1992). An introduction to the five–factor model and its applications. Journal of Personality, 60, 175–215. https://doi.org/10.1111/j.1467-6494.1992.tb00970.x

88.

Meade

A. W.

, Michels

L. C.

, & Lautenschlager

G. J.

(2007). Are internet and paper–and–pencil personality tests truly comparable?: An experimental design measurement invariance study. Organizational Research Methods, 10, 322–345. https://doi.org/10.1177/1094428106289393

89.

Meers

, Dejonckheere

, Kalokerinos

E. K.

, Rummens

, & Kuppens

(2019, June 12). mobileQ: A free user–friendly application for collecting experience sampling data. https://doi.org/10.31234/osf.io/ynj7e

90.

Millsap

R. E.

(2007). Invariance in measurement and prediction revisited. Psychometrika, 72, 461–473. https://doi.org/10.1007/s11336-007-9039-7

91.

Millsap

R. E.

(2011). Statistical approaches to measurement invariance. New York, NY: Taylor & Francis.

92.

Minbashian

, Wood

R. E.

, & Beckmann

(2010). Task–contingent conscientiousness as a unit of personality at work. Journal of Applied Psychology, 95, 793–806. https://doi.org/10.1037/a0020016

93.

Molenaar

P. C.

, & Campbell

C. G.

(2009). The new person–specific paradigm in psychology. Current Directions in Psychological Science, 18, 112–117. https://doi.org/10.1111/j.1467-8721.2009.01619.x

94.

Mønsted

, Mollgaard

, & Mathiesen

(2018). Phone–based metric as a predictor for basic personality traits. Journal of Research in Personality, 74, 16–22. https://doi.org/10.1016/j.jrp.2017.12.004

95.

Murdoch

T. B.

, & Detsky

A. S.

(2013). The inevitable application of big data to health care. JAMA, 309, 1351–1352. https://doi.org/10.1001/jama.2013.393

96.

Nosek

B. A.

, & Errington

T. M.

(2020). What is replication? PLoS Biology, 18, 1–8. https://doi.org/10.1371/journal.pbio.3000691

97.

Ones

D. S.

, & Wiernik

B. M.

(2018, October 10). On “new” personality types. Retrieved from https://www.siop.org/Research-Publications/Items-of-Interest/ArtMID/19366/ArticleID/1698/On-%E2%80%9CNew%E2%80%9D-Personality-Types

98.

Perrin

, & Anderson

(2019, April 10). Share of U.S. adults using social media, including Facebook, is mostly unchanged since 2018. Retrieved May 27, 2019, from Pew Research Center website: https://www.pewresearch.org/fact-tank/2019/04/10/share-of-u-s-adults-using-social-media-including-facebook-is-mostly-unchanged-since-2018/

99.

Quercia

, Kosinski

, Stillwell

, & Crowcroft

(2011). Our Twitter profiles, our selves: Predicting personality with Twitter. 2011 IEEE Third International Conference on Privacy, Security, Risk and Trust and 2011 IEEE Third International Conference on Social Computing, 180–185. https://doi.org/10.1109/PASSAT/SocialCom.2011.26

100.

Rentfrow

P. J.

, & Gosling

S. D.

(2003). The do re mi's of everyday life: The structure and personality correlates of music preferences. Journal of Personality and Social Psychology, 84, 1236–1254. https://doi.org/10.1037/0022-3514.84.6.1236

101.

Ribeiro

M. T.

, Singh

, & Guestrin

(2016a). Model–agnostic interpretability of machine learning. In Kim

, Malioutov

D. M.

, & Varshney

K. R.

(Eds.), Proceedings of the 2016 ICML Workshop on Human Interpretability in Machine Learning (pp. 91–95). https://doi.org/10.1145/2939672.2939778

102.

Ribeiro

M. T.

, Singh

, & Guestrin

(2016b). “Why should I trust you?”: Explaining the predictions of any classifier. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 1135–1144. https://doi.org/10.1145/2939672.2939778

103.

Roberts

B. W.

, Kuncel

N. R.

, Shiner

, Caspi

, & Goldberg

L. R.

(2007). The power of personality: The comparative validity of personality traits, socioeconomic status, and cognitive ability for predicting important life outcomes. Perspectives on Psychological Science, 2, 313–345. https://doi.org/10.1111/j.1745-6916.2007.00047.x

104.

Rocher

, Hendrickx

J. M.

, & de Montjoye

Y.–A.

(2019). Estimating the success of re–identifications in incomplete datasets using generative models. Nature Communications, 10, 1–9. https://doi.org/10.1038/s41467-019-10933-3

105.

Roethlisberger

F. J.

, & Dickson

W. J.

(1939). Management and the worker. Oxford, England: Harvard University Press.

106.

Rowsell

, Morrell

, & Alvermann

D. E.

(2017). Confronting the digital divide: Debunking brave new world discourses. Reading Teacher, 71, 157–165. https://doi.org/10.1002/trtr.1603

107.

Rudin

(2019). Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead. Nature Machine Intelligence, 1, 206–215. Retrieved from. https://arxiv.org/abs/1811.10154v3

108.

Salgado

J. F.

, & Moscoso

(2003). Internet–based personality testing: Equivalence of measures and assesses’ perceptions and reactions. International Journal of Selection and Assessment, 11, 194–205. https://doi.org/10.1111/1468-2389.00243

109.

Schwartz

H. A.

, Eichstaedt

J. C.

, Kern

M. L.

, Dziurzynski

, Ramones

S. M.

, Agrawal

, Shah

, … Ungar

L. H.

(2013). Personality, gender, and age in the language of social media: The open–vocabulary approach. PLoS ONE, 8, 1–16. https://doi.org/10.1371/journal.pone.0073791

110.

Settanni

, Azucar

, & Marengo

(2018). Predicting individual characteristics from digital traces on social media: A meta–analysis. CyberPsychology, Behavior & Social Networking, 21, 217–228. https://doi.org/10.1089/cyber.2017.0384

111.

Simons

D. J.

, Shoda

, & Lindsay

D. S.

(2017). Constraints on generality (COG): A proposed addition to all empirical papers. Perspectives on Psychological Science, 12, 1123–1128. https://doi.org/10.1177/1745691617708630

112.

Society for Industrial and Organizational Psychology (2019). Principles for the validation and use of personnel selection procedures. Industrial and Organizational Psychology, 11, 1–97. https://doi.org/10.1017/iop.2018.195

113.

Soini

, Mustajoki

, Eriksson

J. G.

, & Lahti

(2018). Personality traits associated with weight maintenance among successful weight losers. American Journal of Health Behavior, 42, 78–84. https://doi.org/10.5993/AJHB.42.6.8

114.

Stillwell

D. J.

, & Kosinski

(2020, May 1). myPersonality project website. Retrieved from http://mypersonality.org/

115.

Storey

V. C.

, & Song

I.–Y.

(2017). Big data technologies and management: What conceptual modeling can do. Data & Knowledge Engineering, 108, 50–67. https://doi.org/10.1016/j.datak.2017.01.001

116.

Strickhouser

, Zell

, & Krizan

(2017). Does personality predict health and well–being? A metasynthesis. Health Psychology, 36, 797–810. https://doi.org/10.1037/hea0000475

117.

Sumner

, Byers

, Boochever

, & Park

G. J.

(2012). Predicting dark triad personality traits from Twitter usage and a linguistic analysis of tweets. 2012 11th International Conference on Machine Learning and Applications, 2, 386–393. https://doi.org/10.1109/ICMLA.2012.218

118.

Sumner

, Byers

, & Shearing

(2011). Determining personality traits & privacy concerns from Facebook activity. Black Hat Briefings, 11, 197–221.

119.

Sutin

A. R.

, Ferrucci

, Zonderman

A. B.

, & Terracciano

(2011). Personality and obesity across the adult life span. Journal of Personality and Social Psychology, 101, 579–592. https://doi.org/10.1037/a0024286

120.

Tay

, Woo

S. E.

, Hickman

, & Saef

(2020). Psychometric and validity issues in machine learning approaches to personality assessment: A focus on social media text mining. European Journal of Personality, 34, 826–844. https://doi.org/10.1002/per.2290

121.

Thorndike

E. L.

(1904). An introduction to the theory of mental and social measurements. New York, NY: Columbia University Press.

122.

Tibshirani

(1996). Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society. Series B Methodological, 58, 267–288. https://doi.org/10.1111/j.2517-6161.1996.tb02080.x

123.

Tskhay

K. O.

, & Rule

N. O.

(2014). Perceptions of personality in text–based media and OSN: A meta–analysis. Journal of Research in Personality, 49, 25–30. https://doi.org/10.1016/j.jrp.2013.12.004

124.

Umaki

T. M.

, Umaki

M. R.

, & Cobb

C. M.

(2012). The psychology of patient compliance: A focused review of the literature. Journal of Periodontology, 83, 395–400. https://doi.org/10.1902/jop.2011.110344

125.

Van Deursen

A. J.

, & Van Dijk

J. A.

(2019). The first–level digital divide shifts from inequalities in physical access to inequalities in material access. New Media & Society, 21, 354–375. https://doi.org/10.1177/1461444818797082

126.

Van Volkom

, Stapley

J. C.

, & Amaturo

(2014). Revisiting the digital divide: Generational differences in technology use in everyday life. North American Journal of Psychology, 16, 557–574.

127.

Wald

, Khoshgoftaar

, & Sumner

(2012). Machine prediction of personality from Facebook profiles. 2012 IEEE 13th International Conference on Information Reuse Integration, 109–115. https://doi.org/10.1109/IRI.2012.6302998

128.

Woo

S. E.

, Tay

, Jebb

A. T.

, Ford

M. T.

, & Kern

M. L.

(2020). Big data for enhancing measurement quality. In Woo

S. E.

, Tay

, & Proctor

R. W.

(Eds.), Big Data in Psychological Research (pp. 59–85). American Psychological Association. https://doi.org/10.1037/0000193-004

129.

Wright

A. G. C.

(2014). Current directions in personality science and the potential for advances through computing. IEEE Transactions on Affective Computing, 5, 292–296. https://doi.org/10.1109/TAFFC.2014.2332331

130.

Yan

, Nie

, Huang

, Li

, Cao

, & Wei

(2015). Is your first impression reliable? Trustworthy analysis using facial traits in portraits. In He

, Luo

, Tao

, Xu

, Yang

, & Hasan

M. A.

(Eds.), Multimedia modeling (pp. 148–158). https://doi.org/10.1007/978-3-319-14442-9_13

131.

Yarkoni

, & Westfall

(2017). Choosing prediction over explanation in psychology: Lessons from machine learning. Perspectives on Psychological Science, 12, 1100–1122. https://doi.org/10.1177/1745691617693393

132.

Yost

A. B.

, Behrend

T. S.

, Howardson

, Darrow

J. B.

, & Jensen

J. M.

(2019). Reactance to electronic surveillance: A test of antecedents and outcomes. Journal of Business and Psychology, 34, 71–86. https://doi.org/10.1007/s10869-018-9532-2

133.

Youyou

, Kosinski

, & Stillwell

(2015). Computer–based personality judgments are more accurate than those made by humans. Proceedings of the National Academy of Sciences, 112, 1036–1040. https://doi.org/10.1073/pnas.1418680112

134.

Youyou

, Stillwell

, Schwartz

H. A.

, & Kosinski

(2017). Birds of a feather do flock together: Behavior–based personality–assessment method reveals personality similarity among couples and friends. Psychological Science, 28, 276–284. https://doi.org/10.1177/0956797616678187

135.

Zimmermann

, Woods

W. C.

, Ritter

, Happel

, Masuhr

, Jaeger

, … Wright

A. G. C.

(2019). Integrating structure and dynamics in personality assessment: First steps toward the development and validation of a personality dynamics diary. Psychological Assessment, 31, 516–531. https://doi.org/10.1037/pas0000625