Assessment

The NEO-PI-3 is a fourth-generation instrument that has been shown to improve the psychometrics and readability of its immediate precedent, the NEO-PI-R. We examined the psychometric properties of the Chinese versions of the NEO-PI-R and NEO-PI-3 using three datasets (Ns = 913, 299, 403) collected using both monolingual and bilingual designs. The Chinese NEO-PI-3 scales displayed a five-factor structure in which the facets had the highest loadings on their intended factors. The structure demonstrated strong invariance across both languages (English vs. Chinese) and gender groups, maintained high test-retest reliability, and attained slightly better internal consistency than the NEO-PI-R. We also examined the affective underpinnings of personality factors and well-being measures using the Chinese Circumplex Model of Affect. Consistent with past findings, Neuroticism and Extraversion were most related to affect, while Satisfaction with Life and Subjective Happiness shared the affective core of pleasant feelings and medium arousal. Based on these results, the Chinese NEO-PI-3 appears to be a sound instrument to measure personality in Chinese communities and to compare personality across cultures.

Posttraumatic stress disorder (PTSD) changed substantially when Diagnostic and Statistical Manual of Mental Disorders transitioned from fourth (DSM-IV) to fifth (DSM-5) edition. Hoge et al. found that although diagnostic prevalence remained consistent across nomenclatures, diagnostic concordance was low (55%). Study goals were to examine both the generalizability of these findings and whether either diagnosis systematically excluded patients. U.S. veterans (N = 1,171) who completed the PTSD Checklist for DSM-IV (PCL-S) and DSM-5 (PCL-5) were classified as: probable PTSD on both measures; probable PTSD on PCL-S only; probable PTSD on PCL-5 only; or no PTSD on either measure. Diagnostic prevalence was equivalent. Unlike Hoge et al.’s findings, diagnostic concordance was high (91.3%). Furthermore, observed demographic and severity differences were driven by disparities between veterans in the no PTSD versus the probable PTSD groups, not diagnostic changes. Findings suggest translatability across measures and that diagnostic changes do not systematically exclude patients.

The Dissociative Symptoms Scale (DSS) was developed to assess moderately severe types of dissociation (depersonalization, derealization, gaps in awareness and memory, and dissociative reexperiencing) that would be relevant to a range of clinical populations, including those experiencing trauma-related dissociation. The current study used data from 10 ethnically and racially diverse clinical and community samples (N = 3,879) to develop a brief version of the DSS (DSS-B). Item information curves were examined to identify items with the most precision in measuring above average levels of the latent trait within each subscale. Analyses revealed that the DSS-B preserved the factor structure and content domains of the full scale, and its scores had strong reliability and validity that were comparable to those of scores on the full measure. DSS-B scores showed high levels of measurement invariance across ethnoracial groups. Results indicate that DSS-B scores are reliable and valid in the populations studied.

The study of individual differences in emotion regulation has typically focused exclusively either on the stage of the emotion generation process at which regulation occurs or on the engagement versus disengagement orientation of the regulation efforts. We introduce a new measure that samples equally across each stage of the process model of emotion regulation and from both engagement and disengagement orientations. Through five studies (n_total = 2,543), we present the development and convergent, discriminant, and predictive validity evidence for the Process Model of Emotion Regulation Questionnaire (PMERQ). We show the final 10-scale 45-item questionnaire has acceptable internal consistency, is invariant between genders and across the age range, and has sufficient convergent and discriminant validity. The PMERQ also predicts affective and relationship functioning with strategies occurring earlier in the process model generally showing the strongest effects. We propose the PMERQ is a valuable measure to assess individual differences in the use of emotion regulation strategies.

The recent integration of traditional time series analysis and confirmatory factor analysis techniques allows researchers to evaluate the psychometric properties of measurement instruments at between- and within-persons levels while accounting for autoregressive dependencies. The current study applies a dynamic structural equation modeling (SEM) latent factor analysis (i.e., DSEM-CFA) to a sample of 333 individuals who completed the DASS-21 at their regular therapy sessions. The results of the DSEM-CFA illuminate the reliability, invariance, and structural features of each DASS-21 subscale both between and within persons. The results suggest that the DASS-21 reliably measures depression, anxiety, and stress symptoms when evaluating differences between persons, but does not reliably assess within-persons fluctuations in symptoms over time. The results also suggest that currently accepted methods of modeling sensitivity to change within an instrument are likely lacking and the DSEM-CFA provides insight into reliability within and between persons, which is extremely important for instruments used across time.

The present study evaluated the validity of Minnesota Multiphasic Personality Inventory-3 (MMPI-3) scores among police (n = 1,294), correctional officer (n = 190), dispatcher (n = 205), and firefighter (n = 237) candidates using psychosocial history data collected with the Psychological History Questionnaire (PsyQ) at a private practice in the Northwestern United States. MMPI-3 scale elevations at T score cutoffs specified in the MMPI-3 User’s Guide for the Public Safety Candidate Interpretive Reports (Corey & Ben-Porath, 2022) were examined. Consistent with previous research using the MMPI-2-RF, MMPI-3 T score means were lower and less variable in this public safety preemployment context relative to the normative sample. In addition, MMPI-3 scores were meaningfully associated with a number of aggregated scale scores derived from PsyQ data, particularly in the behavioral/externalizing domain. To address limited research on preemployment personality testing among female police candidates and the absence of research among nonpolice public safety occupations, Cohen’s q was used to compare validity coefficients across male and female police candidates and across police and correctional officer, dispatcher, and firefighter candidates. Differences were minimal, with all statistically significant effects being small in magnitude, indicating the MMPI-3 correlates identified with police candidates replicate to other public safety positions.

The disease burden of depression among older populations is high. Detecting changes in late-life depression is predicated on the seldom-examined assumption of longitudinal measurement invariance (MI). Therefore, we investigated longitudinal MI of the 8-item Center for Epidemiological Studies Depression Scale in core members repeatedly assessed in the English Longitudinal Study of Aging, a nine-wave representative study of the English population above 50 years of age (initial N = 11,391). Based on prior literature, we tested MI of a one-factor solution, a one-factor solution with correlated errors of reversely coded items, and a two-factor solution (depressed affect/somatic complaints). For all factor solutions, residual MI was confirmed across nine waves and gender. Sum score models (i.e., all factor loadings constrained to equity) had a good fit. Depression scores correlated with psychiatric diagnoses, ill health, lower life quality, and female gender. Associations slightly differed depending on the factor solutions, signifying their applicability across contexts.

Despite growing attention surrounding impostor phenomenon (also known as “imposter syndrome”), recent reviews have suggested that current measures may be inadequate in capturing the complex and multifaceted nature of this construct. The objective of the current studies was to clarify the theoretical conceptualization of impostor phenomenon based on experiences in an achievement-oriented setting. We conducted a review of the literature and developed an item pool for a novel impostor phenomenon assessment (IPA) (Study 1). Exploratory factor analyses (Study 1) and confirmatory factor analyses (Study 2) assessed this initial item pool to determine the factor structure and initial psychometric properties of the preliminary IPA (Studies 2 and 3). Our findings offer preliminary evidence for the reliability and validity of the IPA as a novel measure of impostor phenomenon.

As developmental and clinical research on identity has largely developed in disconnect, scholars recommend adopting a developmental psychopathology perspective on identity, which considers adaptive and pathological identity functioning. Such a perspective has also been introduced in the Diagnostic and Statistical Manual of Mental Disorders (5th ed.; DSM-5) Alternative Model for Personality Disorders (AMPD), which suggests that all personality disorders (PDs) are marked by moderate to extreme deficits in self-functioning (i.e., identity and self-direction). The present study aims to validate the Dutch Self-Concept and Identity Measure (SCIM), a 27-item self-report questionnaire that assesses consolidated identity, disturbed identity, and lack of identity, in 153 psychiatric inpatients with PDs (75.2% female; M_age = 31.73). We investigated the factor structure and reliability of the SCIM, and examined associations of SCIM scales with typical identity processes, AMPD domains of self-functioning, and symptoms of all PDs. Results indicated that a 23-item Dutch SCIM produced valid and reliable scores among patients with PDs. Furthermore, SCIM scales were significantly and differentially related to identity commitment processes, ruminative identity exploration, domains of self-functioning, and symptoms of all PDs. Moreover, findings indicated that PDs varied regarding the severity of identity impairment.

Category and letter verbal fluency assessment is widely used in basic and clinical research. Yet, the nature of the processes measured by such means remains a matter of debate. To delineate automatic (free-associative) versus controlled (dissociative) retrieval processes involved in verbal fluency tasks, we carried out a psychometric study combining a novel lexical-semantic retrieval paradigm and structural equation modeling. We show that category fluency primarily engages a free-associative retrieval, whereas letter fluency exerts executive suppression of habitual semantic associates. Importantly, the models demonstrated that this dissociation is parametric rather than absolute, exhibiting a degree of unity as well as diversity among the retrieval measures. These findings and further exploratory analyses validate that category and letter fluency tasks reflect partially distinct forms of memory search and retrieval control, warranting different application in basic research and clinical assessment. Finally, we conclude that the novel associative-dissociative paradigm provides straightforward and useful behavioral measures for the assessment and differentiation of automatic versus controlled retrieval ability.

The Short UPPS-P Impulsive Behavior (SUPPS-P) scale assesses impulsive traits; however, its use among racial/ethnic minorities needs further testing. The aims of this study are to (a) test the measurement invariance of the SUPPS-P scale between White and racial/ethnic minority groups and (b) determine whether impulsive personality traits differentially relate to substance use outcomes across these groups. Participants were 1,301 young adults and recruited through a large public university or Amazon’s Mechanical Turk. Multigroup confirmatory factor analysis concluded strong measurement invariance for Black, Asian American, and Hispanic/Latino groups, each compared with a White group. Most relationships between SUPPS-P traits and substance use did not differ across the groups compared, although two differences emerged with alcohol use. The SUPPS-P can validly and reliably measure impulsive traits in Black, Hispanic/Latino, and Asian American young to middle adults. Previous findings on risk patterns with the SUPPS-P likely generalize to these groups.

Although ecological momentary assessment (EMA) provides an opportunity for the examination of intervention mechanisms in real time, there are few validated tools to assess key treatment mechanisms in EMA studies. Our focus in this study is a potentially critical treatment mechanism, improvement in self-efficacy for managing negative emotions. We examined the psychometric properties of the Patient-Reported Outcomes Measurement Information System (PROMIS) self-efficacy for managing negative emotions scale measured via EMA. Participants (n = 145 college students) in a clinical trial of Dialectical Behavior Therapy skills completed four daily EMAs for 6 weeks (13,153 total responses). Results indicated (a) excellent internal consistency and good factor structure, (b) sufficient variability at both the between- and the within-persons levels, and (c) strong construct and predictive validity. This study supports the validity of an EMA measure of self-efficacy for managing negative emotions that can be used in real time, both in intervention studies and in observational research.

Parental burnout (PB) is a chronic stress-related condition resulting from long-lasting exposure to overwhelming parenting stress. Previous studies showing the seriousness of this condition stressed the urgent need to provide researchers and practitioners with effective assessment tools. Validated PB measures are the Parental Burnout Inventory (PBI) and the Parental Burnout Assessment (PBA). The good psychometric properties of these instruments have been replicated across different samples and countries, but thresholds for identifying impairing PB levels (i.e., cutoff scores) have not yet been established. The present study aims to fill this gap by adopting a multi-informant and multimethod approach to a sample of 192 burned-out and control parents. PBI and PBA cutoffs were derived from the combination of several PB indicators, based on a preregistered analysis strategy. Results identified a score of 74.6 (95% confidence interval (CI) = [69.48–79.68]) for the PBI and 86.3 (95% CI = [79.49–93.03]) for the PBA as indicators of the most severe PB levels.

Early identification and intervention of cognitive decline could be effective to prevent progression to dementia. We developed a self-delivered cognitive screening tool, Automated Memory and Executive Screening (AMES), to assess cognitive domains including memory, language, and executive function. 189 participants with diagnoses of mild cognitive impairment (MCI, n = 43), subjective cognitive decline (SCD, n = 29), objectively-defined subtle cognitive decline (obj-SCD, n = 18), and normal controls (NC, n = 99) completed the study. AMES had good convergent validity with conventional scales, and was good to discriminate patients with MCI (area under the curve [AUC] = 0.88; sensitivity = 86%; specificity = 80%) and obj-SCD (AUC = 0.78; sensitivity = 89%; specificity = 63%) from NC. These findings support that AMES is an easy to administer and effective instrument to screen for early cognitive impairment in community-based settings.

This study aimed to clarify the multidimensionality of defending by developing and validating the Adolescent Defending Behaviors Questionnaire (ADBQ) in a sample of Chinese adolescents. Results of Study 1 (N = 824, M_age = 11.25) indicated that a five-factor model, comprising (a) assertive defending, (b) aggressive defending, (c) comforting victims, (d) reporting to authority, and (e) tactical defending, yielded a good fit to the data. Study 2 (N = 1,086, M_age = 11.18) established ADBQ’s reliability (α = .78–.93) and construct validity: the five defending dimensions were differentially associated with cognitive and affective empathy, aggression, sociability, peer preference, and victimization. Together, the results suggest that the ADBQ is a psychometrically valid and reliable instrument for assessing the multidimensionality of defending.

Personality pathology is increasingly conceptualized within hierarchical, dimensional trait models. The Comprehensive Assessment of Traits Relevant to Personality Disorders (CAT-PD) is a pathological-trait measure with potential to improve on currently prevailing instruments because it has wider content coverage; however, its domain-level structure, which is of scientific and clinical interest, is not established. In this study, we investigated the structure and construct validity of the CAT-PD’s domain level to facilitate wider use of the measure. We estimated five- and six-factor models with exploratory factor analysis in a pooled sample of eight independent subsamples (N = 3,987) and found that both models fit the data well; each had interpretable factors that were invariant across gender, sample type, and Black/White racial groups; and the factors had good convergent validity with other measures of maladaptive traits, Big Five personality, and interpersonal problems. Our results support the validity of the CAT-PD for assessing multiple levels of the pathological trait hierarchy.

Differing perspectives on the operationalization of schizotypal personality pathology (STPP) have led to numerous multidimensional assessment measures. The current study applied the interpersonal construct validation approach to self-report data from 856 undergraduate students to formally examine the interpersonal content, similarities, and differences in the subscales of four measures of STPP within and across two interpersonal circumplex surfaces using a bootstrapping methodology for computing confidence intervals around circumplex structural summary method parameters. Results suggested that negative-like expressions of STPP are prototypically and distinctively interpersonal constructs associated with cold and socially avoidant interpersonal problems and hypersensitivity to others’ warmth and affection. Positive-like expressions of STPP as assessed by two out of four measures were prototypically and distinctively interpersonal constructs associated with vindictiveness. Across four measures, there was notable overlap in interpersonal correlates among related subscales, suggesting convergent validity. However, subscales containing social anxiety content were associated with more submissive (i.e., socially avoidant) interpersonal problems than subscales without social anxiety content.

An abbreviated version of the Conformity to Masculine Norms Inventory, the CMNI-30, was developed with several strengths. However, its measurement invariance across men with different sexual orientations has not been examined in a U.S. sample, so it is unclear whether these different populations understand the items similarly. In addition, no studies have compared conformity to masculinity norms across sexual orientations. This would be important to understand sexual minority men’s experience of masculinity and how it differs from heteronormative masculinity. This article explores the measurement invariance of the CMNI-30 among 882 heterosexual, gay, and bisexual+ men using confirmatory factor analysis, and compares their CMNI-30 subscale scores. Results indicated that the CMNI-30 demonstrated residual invariance between men of different sexual orientations, suggesting that men of different sexual orientations interpreted the items similarly. We also found higher levels of conformity to the masculine norms of Winning, Heterosexual self-presentation, and Power over women among heterosexual men relative to gay and bisexual+ men, and higher levels of Pursuit of status among gay men relative to the other groups. Results provide support for the use of the CMNI-30 in research with men of different sexual orientations.

We assessed the interrater reliability, convergent validity, and discriminant validity of the Self-Injurious Thoughts and Behaviors Interview-Short Form (SITBI-SF) in a sample of 1,944 active duty service members and veterans seeking services for posttraumatic stress disorder (PTSD) and related conditions. The SITBI-SF demonstrated high interrater reliability and good convergent and discriminant validity. The measurement properties of the SITBI-SF were comparable across service members and veterans. Approximately 8% of participants who denied a history of suicidal ideation on the SITBI-SF reported suicidal ideation on a separate self-report questionnaire (i.e., discordant responders). Discordant responders reported significantly higher levels of PTSD symptoms than those who denied suicidal ideation on both response formats. Findings suggest that the SITBI-SF is a reliable and valid interview-based measure of suicide-related thoughts and behaviors for use with military service members and veterans. Suicide risk assessment might be optimized if the SITBI-SF interview is combined with a self-report measure of related constructs.