A Novel,Network-Based Approach to Assessing Romantic-Relationship Quality

Abstract

How should romantic-relationship quality be approached psychometrically? This is a complicated theoretical and methodological challenge that we begin to address through three studies. In Study 1a, we identified 25 distinct romantic-relationship categories among 754 items from 26 romantic-relationship-quality instruments with a weak Jaccard index (0.38), indicating that the scales’ item content was extremely heterogeneous. Study 1b then demonstrated limited structure validity evidence in 43 scale-development-validation articles of 23 of these 26 instruments. Finally, Study 2 surveyed 587 French-speaking participants in a romantic relationship on romantic-relationship quality. Applying a network-based model, we identified four dimensions, three of which are central to relationship quality. The inferences were mostly limited to French-speaking, monogamous, heterosexual women. To resolve challenges detected in the literature, we recommend a multicountry qualitative approach, more diverse sampling, better definitions of romantic-relationship quality, and a dynamic-systems approach to measuring romantic-relationship quality.

Keywords

romantic relationships measurement content overlap network analysis

Get full access to this article

View all access options for this article.

References

Ahlborg

Lilleengen

A. M.

Lönnfjord

Petersen

(2009). Quality of dyadic relationship in Swedish men and women living in long-term relationships and in couples in family counselling–Introduction of a new self-report measure, QDR36. Nordic Psychology, 61(3), 23–46. https://doi.org/10.1027/1901-2276.61.3.23

American Educational Research Association. (2014). Standards for educational and psychological testing. American Educational Research Association, American Psychological Association, National Council on Measurement in Education.

American Psychological Association. (1994). Diagnostic and statistical manual of mental disorders (4th ed.).

Arrindell

W. A.

Boelens

Lambert

(1983). On the psychometric properties of the Maudsley Marital Questionnaire (MMQ): Evaluation of self-ratings in distressed and ‘normal’ volunteer couples based on the Dutch version. Personality and Individual Differences, 4(3), 293–306. https://doi.org/10.1016/0191-8869(83)90151-4

Bandalos

D. L.

(2018). Measurement theory and applications for the social sciences. Guilford Press.

Belous

C. K.

Wampler

R. S.

(2016). Development of the Gay and Lesbian Relationship Satisfaction Scale. Journal of Marital and Family Therapy, 42(3), 451–465. https://doi.org/10.1111/jmft.12158

Blum

J. S.

Mehrabian

(1999). Personality and temperament correlates of marital satisfaction. Journal of Personality, 67(1), 93–125. https://doi.org/10.1111/1467-6494.00049

Borsboom

(2008). Latent variable theory. Measurement, 6(1 & 2), 25–53. https://doi.org/10.1080/15366360802035497

Borsboom

Cramer

A. O.

Schmittmann

V. D.

Epskamp

Waldorp

L. J.

(2011). The small world of psychopathology. PLOS ONE, 6(11), Article e27407. https://doi.org/10.1371/journal.pone.0027407

10.

Borsboom

Mellenbergh

G. J.

Van Heerden

(2004). The concept of validity. Psychological Review, 111(4), Article 1061. https://doi.org/10.1037/0033-295X.111.4.1061

11.

Boschloo

Borkulo

C. D.

van Borsboom

Schoevers

R. A.

(2016). A prospective study on how symptoms in a network predict the onset of depression. Psychotherapy and Psychosomatics, 85(3), 183–184. https://doi.org/10.1159/000442001

12.

Braiker

H. B.

Kelley

H. H.

(1979). Conflict in the development of close relationships. In Burgess

R. L.

Huston

T. L.

(Eds.), Social exchange in developing relationships (pp. 135–168). Academic Press.

13.

Busby

D. M.

Christensen

Crane

D. R.

Larson

J. H.

(1995). A revision of the Dyadic Adjustment Scale for use with distressed and nondistressed couples: Construct hierarchy and multidimensional scales. Journal of Marital and Family Therapy, 21(3), 289–308. https://doi.org/10.1111/j.1752-0606.1995.tb00163.x

14.

Cheng

Z. H.

Tan

L. X.

Yang

Lin

X. H.

Zhou

Jiang

T. H.

Zhao

Yuchi

X. L.

(2010). The Chinese marital quality inventory: Development, reliability and validity. In Lam

L. T.

Zhou

S.-J.

G.-B.

(Eds.), Psychological and health-related assessment tools developed in China (pp. 61–70). Bentham Science Publishers. https://doi.org/10.2174/978160805186111001010061

15.

Christensen

A. P.

Golino

(2021a). Estimating the stability of psychological dimensions via bootstrap exploratory graph analysis: A Monte Carlo simulation and tutorial. Psych, 3(3), 479–500. https://doi.org/10.3390/psych3030032

16.

Christensen

A. P.

Golino

(2021b). On the equivalency of factor and network loadings. Behavior Research Methods, 53(4), 1563–1580. https://doi.org/10.3758/s13428-020-01500-6

17.

Christensen

A. P.

Golino

Silvia

P. J.

(2020). A psychometric network perspective on the validity and validation of personality trait questionnaires. European Journal of Personality, 34(6), 1095–1108. https://doi.org/10.1002/per.2265

18.

Christensen

A. P.

Gross

G. M.

Golino

H. F.

Silvia

P. J.

Kwapil

T. R.

(2019). Exploratory graph analysis of the Multidimensional Schizotypy Scale. Schizophrenia Research, 206, 43–51. https://doi.org/10.1016/j.schres.2018.12.018

19.

Cramer

A. O.

Waldorp

L. J.

Van Der Maas

H. L.

Borsboom

(2010). Comorbidity: A network perspective. Behavioral and Brain Sciences, 33(2–3), 137–150. https://doi.org/10.1017/S0140525X09991567

20.

Davis

K. E.

(2001). The Relationship Rating Form (RRF): A measure of characteristics of romantic relationships and friendships. In Touliatos

Perlmutter

Holden

(Eds.), Handbook of family measurement techniques (2nd ed., pp. 195–197). Sage.

21.

Delatorre

M. Z.

Wagner

(2020). Marital quality assessment: Reviewing the concept, instruments, and methods. Marriage & Family Review, 56(3), 193–216. https://doi.org/10.1080/01494929.2020.1712300

22.

Ducat

W. H.

Zimmer-Gembeck

M. J.

(2010). Romantic partner behaviours as social context: Measuring six dimensions of relationships. Journal of Relationships Research, 1(1), 1–16. https://doi.org/10.1375/jrr.1.1.1

23.

Dujols

Klein

R. A.

IJzerman

Zsido

A. N.

Szymkow

Zickfeld

Genschow

Ratliff

Azouaghe

Igou

E. R.

Arinze

N. C.

Santos

Sayin

Albornoz

D. G.

Feldman

Satchell

Ouherrou

Kafetsios

English

A. S.

. . .Rizomyliotis

(2023). STRAEQ-2 home. OSF. https://osf.io/ghbzk

24.

Dunn

T. J.

Baguley

Brunsden

(2014). From alpha to omega: A practical solution to the pervasive problem of internal consistency estimation. British Journal of Psychology, 105(3), 399–412. https://doi.org/10.1111/bjop.12046

25.

Epskamp

Borsboom

Fried

E. I.

(2018). Estimating psychological networks and their accuracy: A tutorial paper. Behavior Research Methods, 50(1), 195–212. http://doi.org/10.3758/s13428-017-0862-1

26.

Epskamp

Cramer

Waldorp

Schmittmann

Borsboom

(2012). qgraph: Network visualizations of relationships in psychometric data. Journal of Statistical Software, 48(4), 1–18. https://doi.org/10.18637/jss.v048.i04

27.

Epskamp

Fried

E. I.

(2018). A tutorial on regularized partial correlation networks. Psychological Methods, 23(4), 617–634. https://doi.org/10.1037/met0000167

28.

Epskamp

Rhemtulla

Borsboom

(2017). Generalized network psychometrics: Combining network and latent variable models. Psychometrika, 82, 904–927. https://doi.org/10.1007/s11336-017-9557-x

29.

Evans

J. D.

(1996). Straightforward statistics for the behavioral sciences. Thomson Brooks/Cole Publishing Co.

30.

Fellows

K. J.

Chiu

H.-Y.

Hill

E. J.

Hawkins

A. J.

(2016). Work–family conflict and couple relationship quality: A meta-analytic study. Journal of Family and Economic Issues, 37(4), 509–518. https://doi.org/10.1007/s10834-015-9450-7

31.

Fincham

F. D.

Bradbury

T. N.

(1987). The assessment of marital quality: A reevaluation. Journal of Marriage and the Family, 49(4), 797–809. https://doi.org/10.2307/351973

32.

Fincham

F. D.

Linfield

K. J.

(1997). A new look at marital quality: Can spouses feel positive and negative about their marriage? Journal of Family Psychology, 11(4), 489–502. https://doi.org/10.1037/0893-3200.11.4.489-502

33.

Fincham

F. D.

Rogge

(2010). Understanding relationship quality: Theoretical challenges and new tools for assessment. Journal of Family Theory & Review, 2(4), 227–242. https://doi.org/10.1111/j.1756-2589.2010.00059.x

34.

Flake

J. K.

(2021). Strengthening the foundation of educational psychology by integrating construct validation into open science reform. Educational Psychologist, 56(2), 132–141. https://doi.org/10.1080/00461520.2021.1898962

35.

Flake

J. K.

Fried

E. I.

(2020). Measurement schmeasurement: Questionable measurement practices and how to avoid them. Advances in Methods and Practices in Psychological Science, 3, 456–465. https://doi.org/10.1177/2515245920952393

36.

Flake

J. K.

Pek

Hehman

(2017). Construct validation in social and personality research: Current practice and recommendations. Social Psychological and Personality Science, 8(4), 370–378. https://doi.org/10.1177/1948550617693063

37.

Fletcher

G. J.

Simpson

J. A.

Thomas

(2000). The measurement of perceived relationship quality components: A confirmatory factor analytic approach. Personality and Social Psychology Bulletin, 26(3), 340–354. https://doi.org/10.1177/0146167200265007

38.

Flora

D. B.

(2020). Your coefficient alpha is probably wrong, but which coefficient omega is right? A tutorial on using R to obtain better reliability estimates. Advances in Methods and Practices in Psychological Science, 3(4), 484–501. https://doi.org/10.1177/2515245920951747

39.

Forscher

P. S.

Wagenmakers

E. J.

Coles

N. A.

Silan

M. A.

Dutra

Basnight-Brown

IJzerman

(2022). The benefits, barriers, and risks of big-team science. Perspectives on Psychological Science, 18, 607–623. https://doi.org/10.1177/17456916221082970

40.

Fortunato

(2010). Community detection in graphs. Physics Reports, 486(3–5), 75–174. https://doi.org/10.1016/j.physrep.2009.11.002

41.

Fowers

B. J.

Owenz

M. B.

(2010). A eudaimonic theory of marital quality. Journal of Family Theory & Review, 2(4), 334–352. https://doi.org/10.1111/j.1756-2589.2010.00065.x

42.

Foygel

Drton

(2010). Extended Bayesian information criteria for Gaussian graphical models. arXiv. https://doi.org/10.48550/arXiv.1011.6640

43.

Fraley

R. C.

Heffernan

M. E.

Vicary

A. M.

Brumbaugh

C. C.

(2011). The experiences in close relationships—Relationship Structures Questionnaire: A method for assessing attachment orientations across relationships. Psychological Assessment, 23(3), 615–625. https://doi.org/10.1037/a0022898

44.

Fried

E. I.

(2017a). The 52 symptoms of major depression: Lack of content overlap among seven common depression scales. Journal of Affective Disorders, 208, 191–197. https://doi.org/10.1016/j.jad.2016.10.019

45.

Fried

E. I.

(2017b). What are psychological constructs? On the nature and statistical modelling of emotions, intelligence, personality traits and mental disorders. Health Psychology Review, 11(2), 130–134. https://doi.org/10.1080/17437199.2017.1306718

46.

Fried

E. I.

(2020). Lack of theory building and testing impedes progress in the factor and network literature. Psychological Inquiry, 31(4), 271–288. https://doi.org/10.1080/1047840X.2020.1853461

47.

Fried

E. I.

Flake

J. K.

(2018). Measurement matters. APS Observer, 31(3). https://www.psychologicalscience.org/observer/measurement-matters

48.

Friedman

Hastie

Tibshirani

(2008). Sparse inverse covariance estimation with the graphical lasso. Biostatistics, 9(3), 432–441. https://doi.org/10.1093/biostatistics/kxm045

49.

Fruchterman

T. M. J.

Reingold

E. M.

(1991). Graph drawing by force-directed placement. Software: Practice and Experience, 21(11), 1129–1164. https://doi.org/10.1002/spe.4380211102

50.

Funk

J. L.

Rogge

R. D.

(2007). Testing the ruler with item response theory: Increasing precision of measurement for relationship satisfaction with the Couples Satisfaction Index. Journal of Family Psychology, 21(4), 572–583. https://doi.org/10.1037/0893-3200.21.4.572

51.

Galovan

A. M.

Schramm

D. G.

(2018). Strong relationality and ethical responsiveness: A framework and conceptual model for family science. Journal of Family Theory & Review, 10(1), 199–218. https://doi.org/10.1111/jftr.12238

52.

Garthoeffner

J. L.

Henry

C. S.

Robinson

L. C.

(1993). The Modified Interpersonal Relationship Scale: Reliability and validity. Psychological Reports, 73(3), 995–1004. https://doi.org/10.1177/00332941930733pt141

53.

Glenn

N. D.

(1990). Quantitative research on marital quality in the 1980s: A critical review. Journal of Marriage and the Family, 52(4), 818–831. https://doi.org/10.2307/353304

54.

Golino

H. F.

Christensen

(2020). EGAnet: Exploratory graph analysis—A framework for dimensionality assessment and reduction using network psychometrics (Version 2.0.3) [Computer software]. R Package Documentation. https://rdrr.io/cran/EGAnet

55.

Golino

H. F.

Epskamp

(2017). Exploratory graph analysis: A new approach for estimating the number of dimensions in psychological research. PLOS ONE, 12(6), Article e0174035. https://doi.org/10.1371/journal.pone.0174035

56.

Golino

H. F.

Shi

Christensen

A. P.

Garrido

L. E.

Nieto

M. D.

Sadana

Thiyagarajan

J. A.

Martinez-Molina

(2020). Investigating the performance of exploratory graph analysis and traditional techniques to identify the number of latent factors: A simulation and tutorial. Psychological Methods, 25(3), 292–320. https://doi.org/10.1037/met0000255

57.

Hamaker

E. L.

(2012). Why researchers should think “within-person”: A paradigmatic rationale. In Mehl

M. R.

Conner

T. S.

(Eds.), Handbook of research methods for studying daily life (pp. 43–61). Guilford Press.

58.

Hamaker

E. L.

Wichers

(2017). No time like the present: Discovering the hidden dynamics in intensive longitudinal data. Current Directions in Psychological Science, 26(1), 10–15. https://doi.org/10.1177/0963721416666518

59.

Hassebrauck

Fehr

(2002). Dimensions of relationship quality. Personal Relationships, 9(3), 253–270. https://doi.org/10.1111/1475-6811.00017

60.

Hendrick

S. S.

(1988). A generic measure of relationship satisfaction. Journal of Marriage and the Family, 50(1), 93–98. https://doi.org/10.2307/352430

61.

Howell

R. D.

Breivik

Wilcox

J. B.

(2007). Reconsidering formative measurement. Psychological Methods, 12(2), 205–218. https://doi.org/10.1037/1082-989X.12.2.205

62.

Hussey

Hughes

(2020). Hidden invalidity among 15 commonly used measures in social and personality psychology. Advances in Methods and Practices in Psychological Science, 3(2), 166–184. https://doi.org/10.1177/2515245919882903

63.

IJzerman

Hadi

Coles

N. A.

Paris

Elisa

Fritz

Klein

R. A.

Ropovik

(2021). Social thermoregulation: A meta-analysis. PsyArXiv. https://psyarxiv.com/fc6yq

64.

IJzerman

Lewis

N. A.

Jr. Przybylski

A. K.

Weinstein

DeBruine

Ritchie

S. J.

Vazire

Forscher

P. S.

Morey

R. D.

Ivory

J. D.

Anvari

(2020). Use caution when applying behavioural science to policy. Nature Human Behaviour, 4(11), 1092–1094. https://doi.org/10.1038/s41562-020-00990-w

65.

Jones

(2020). networktools: Tools for identifying important odes in networks (Version 1.5.1) [Computer software]. CRAN. https://cran.r-project.org/web/packages/networktools

66.

Kane

M. T.

(1992). An argument-based approach to validity. Psychological Bulletin, 112(3), 527–535. https://doi.org/10.1037/0033-2909.112.3.527

67.

Kane

M. T.

(2013). Validating the interpretations and uses of test scores. Journal of Educational Measurement, 50(1), 1–73. https://doi.org/10.1111/jedm.12000

68.

Karney

B. R.

Bradbury

T. N.

(1995). The longitudinal course of marital quality and stability: A review of theory, methods, and research. Psychological Bulletin, 118(1), 3–34. https://doi.org/10.1037/0033-2909.118.1.3

69.

Kelley

T. L.

(1927). Interpretation of educational measurements. World Book Company.

70.

Kimmel

Van Der Veen

(1974). Factors of marital adjustment in Locke’s Marital Adjustment Test. Journal of Marriage and the Family, 36(1), 57–63. https://doi.org/10.2307/350994

71.

Kluwer

E. S.

Johnson

M. D.

(2007). Conflict frequency and relationship quality across the transition to parenthood. Journal of Marriage and Family, 69(5), 1089–1106. https://doi.org/10.1111/j.1741-3737.2007.00434.x

72.

Ren

Wang

Jin

Yang

Wang

(2021). A network perspective on marital satisfaction among older couples. Research Square. https://doi.org/10.21203/rs.3.rs-674200/v1

73.

Locke

H. J.

Wallace

K. M.

(1959). Short marital adjustment and prediction tests: Their reliability and validity. Marriage and Family Living, 21(3), 251–255. https://doi.org/10.2307/348022

74.

Markus

K. A.

Borsboom

(2013). Frontiers of test validity theory: Measurement, causation, and meaning (1st ed.). Routledge. https://doi.org/10.4324/9780203501207

75.

McWilliams

L. A.

Fried

E. I.

(2019). Reconceptualizing adult attachment relationships: A network perspective. Personal Relationships, 26(1), 21–41. https://doi.org/10.1111/pere.12263

76.

Nickull

Källström

Jern

(2022). An exploratory network analysis of sexual and relationship satisfaction comparing partnered cisgendered men and women. The Journal of Sexual Medicine, 19(5), 711–718. https://doi.org/10.1016/j.jsxm.2022.02.006

77.

Norton

(1983). Measuring marital quality: A critical look at the dependent variable. Journal of Marriage and the Family, 45(1), 141–151. https://doi.org/10.2307/351302

78.

Ouzzani

Hammady

Fedorowicz

Elmagarmid

(2016). Rayyan—A web and mobile app for systematic reviews. Systematic Reviews, 5(1), 1–10.

79.

Pierce

G. R.

Sarason

I. G.

Sarason

B. R.

(1991). General and relationship-based perceptions of social support: Are two constructs better than one? Journal of Personality and Social Psychology, 61(6), 1028–1039. https://doi.org/10.1037/0022-3514.61.6.1028

80.

Ponti

Guarnieri

Smorti

Tani

(2010). A measure for the study of friendship and romantic-relationship quality from adolescence to early-adulthood. The Open Psychology Journal, 3(1), 76–87. https://doi.org/10.2174/1874350101003010076

81.

Proulx

Helms

Buehler

(2007). Marital quality and personal well-being: A meta-analysis. Journal of Marriage and the Family, 69, 576–593. https://doi.org/10.1111/j.1741-3737.2007.00393.x

82.

R Core Team. (2015). R: A language and environment for statistical computing. R Foundation for Statistical Computing. https://www.R-project.org

83.

Reblin

Vaughn

A. A.

Birmingham

W. C.

Smith

T. W.

Uchino

B. N.

Spahr

C. M.

(2020). Complex assessment of relationship quality within dyads. Journal of Community Psychology, 48(7), 2221–2237. https://doi.org/10.1002/jcop.22392

84.

Robinaugh

D. J.

Millner

A. J.

McNally

R. J.

(2016). Identifying highly influential nodes in the complicated grief network. Journal of Abnormal Psychology, 125(6), 747–757. https://doi.org/10.1037/abn0000181

85.

Robles

T. F.

Slatcher

R. B.

Trombello

J. M.

McGinn

M. M.

(2014). Marital quality and health: A meta-analytic review. Psychological Bulletin, 140(1), 140–187. https://doi.org/10.1037/a0031859

86.

Rubin

D. B.

(1976). Inference and missing data. Biometrika, 63(3), 581–592. https://doi.org/10.1093/biomet/63.3.581

87.

Rush

A. J.

Gullion

C. M.

Basco

M. R.

Jarrett

R. B.

Trivedi

M. H.

(1996). The inventory of depressive symptomatology (IDS): Psychometric properties. Psychological Medicine, 26(3), 477–486. https://doi.org/10.1017/s0033291700035558

88.

Rust

Bennun

Crowe

Golombok

(1986). The Golombok Rust Inventory of Marital State (GRIMS). Sexual and Marital Therapy, 1(1), 55–60. https://doi.org/10.1080/02674658608407680

89.

Sabatelli

(1984). The Marital Comparison Level Index: A measure for assessing outcomes relative to expectations. Journal of Marriage and Family, 46(3), 651–662. https://doi.org/10.2307/352606

90.

Sabatelli

(1988). Measurement issues in marital research: A review and critique of contemporary survey instruments. Journal of Marriage and Family, 50(4), 891–915. https://doi.org/10.2307/352102

91.

Santor

D. A.

Gregus

Welch

(2006). Eight decades of measurement in depression. Measurement: Interdisciplinary Research and Perspectives, 4(3), 135–155. https://doi.org/10.1207/s15366359mea0403_1

92.

Schmitt

(1996). Uses and abuses of coefficient alpha. Psychological Assessment, 8(4), 350–353. https://doi.org/10.1037/1040-3590.8.4.350

93.

Schmittmann

V. D.

Cramer

A. O. J.

Waldorp

L. J.

Epskamp

Kievit

R. A.

Borsboom

(2013). Deconstructing the construct: A network perspective on psychological phenomena. New Ideas in Psychology, 31(1), 43–53. https://doi.org/10.1016/j.newideapsych.2011.02.007

94.

Schumm

W. R.

Paff-Bergen

L. A.

Hatch

R. C.

Obiorah

F. C.

Copeland

J. M.

Meens

L. D.

Bugaighis

M. A.

(1986). Concurrent and discriminant validity of the Kansas Marital Satisfaction Scale. Journal of Marriage and the Family, 48(2), 381–387. https://doi.org/10.2307/352405

95.

Shah

(1995). Clinical validity of Marital Quality Scale. Nimhans Journal, 13, 23–21.

96.

Sijtsma

(2009). On the use, the misuse, and the very limited usefulness of Cronbach’s alpha. Psychometrika, 74, 107–120. https://doi.org/10.1007/s11336-008-9101-0

97.

Silan

(2023a). Measuring social constructions? On the difference between indexing and measurement. OSF. https://osf.io/5dwvz

98.

Silan

(2023b). A multi-country investigation into the conceptualization and measurement of relationship quality. OSF. https://osf.io/n7gu2

99.

Simons

D. J.

Shoda

Lindsay

D. S.

(2017). Constraints on Generality (COG): A proposed addition to all empirical papers. Perspectives on Psychological Science, 12(6), 1123–1128. https://doi.org/10.1177/1745691617708630

100.

Snijders

T. A.

(2005). Models for longitudinal network data. In Carrington

P. J.

Scott

Wasserman

(Eds.), Models and methods in social network analysis (pp. 215–247). Cambridge University Press.

101.

Spanier

G. B.

(1976). Measuring dyadic adjustment: New scales for assessing the quality of marriage and similar dyads. Journal of Marriage and the Family, 38(1), 15–28. https://doi.org/10.2307/350547

102.

Spanier

G. B.

Cole

C. L.

(1976). Toward clarification and investigation of marital adjustment. International Journal of Sociology of the Family, 6(1), 121–146. https://doi.org/10.2307/350547

103.

Sparacio

Ropovik

Jiga-Boy

Forscher

P. S.

Paris

IJzerman

(2023). Stress regulation via self-administered mindfulness and biofeedback interventions in adults: A pre-registered meta-analysis. PsyArXiv. https://psyarxiv.com/zpw28

104.

Sparacio

Ropovik

Jiga-Boy

IJzerman

(2023). Stress regulation via being in nature and social support in adults: A meta-analysis. PsyArXiv. https://psyarxiv.com/a4zmj

105.

Stanley

S. M.

Rhoades

G. K.

Amato

P. R.

Markman

H. J.

Johnson

C. A.

(2010). The timing of cohabitation and engagement: Impact on first and second marriages. Journal of Marriage and Family, 72(4), 906–918. https://doi.org/10.1111/j.1741-3737.2010.00738.x

106.

Tavakol

Dennick

(2011). Making sense of Cronbach’s alpha. International Journal of Medical Education, 2, 53–55. https://doi.org/10.5116/ijme.4dfb.8dfd

107.

Thorndike

E. L.

(1904). Theory of mental and social measurements. The Science Press. https://doi.org/10.1037/13283-000

108.

Tsuji

Bergmann

Cristia

(2014). Community-augmented meta-analyses: Toward cumulative data assessment. Perspectives on Psychological Science, 9(6), 661–665. https://doi.org/10.1177/1745691614552498

109.

Visontay

Sunderland

Grisham

Slade

(2019). Content overlap between youth OCD scales: Heterogeneity among symptoms probed and implications. Journal of Obsessive-Compulsive and Related Disorders, 21, 6–12. https://doi.org/10.1016/j.jocrd.2018.10.005

110.

Wahyuningsih

Kusumaningrum

F. A.

Novitasari

(2020). Parental marital quality and adolescent psychological well-being: A meta-analysis. Cogent Psychology, 7(1), Article 1819005. https://doi.org/10.1080/23311908.2020.1819005

111.

Weidman

A. C.

Steckler

C. M.

Tracy

J. L.

(2017). The jingle and jangle of emotion assessment: Imprecise measurement, casual scale usage, and conceptual fuzziness in emotion research. Emotion, 17(2), 267–295. https://doi.org/10.1037/emo0000226

112.

Wetzel

Roberts

B. W.

(2020). Commentary on Hussey and Hughes (2020): Hidden invalidity among 15 commonly used measures in social and personality psychology. Advances in Methods and Practices in Psychological Science, 3(4), 505–508. https://doi.org/10.1177/2515245920957618

113.

Wilhelm

Parker

(1988). Reliability of the parental bonding instrument and intimate bond measure scales. Australian & New Zealand Journal of Psychiatry, 24(2), 199–202. https://doi.org/10.1017/S0033291700002051

114.

Zhang

Tsang

S. K.

(2013). Conceptualizing and validating marital quality in Beijing: A pilot study. Social Indicators Research, 113(1), 197–212. https://doi.org/10.1007/s11205-012-0089-6