Abstract
Background:
Most studies focused on only one measure of social dysfunction in older age, without proper validation and distinction across different dimensions including subjectivity, structural, and functional aspects.
Objective:
We sought to validate the Social Dysfunction Rating Scale (SDRS) and its factorial structure, also determining the association of SDRS with cognitive functions, global psychopathology, and social deprivation.
Methods:
The SDRS was administered to 484 Italian community-dwelling elderly, recruited in the GreatAGE study, a population-based study on aging conducted in Castellana Grotte, Bari, Southern Italy. We determined objective and subjective psychometric properties of SDRS against the gold standard evaluation of social dysfunction according to the Semi-structured Clinical Diagnostic Interview for DSM-IV-TR Axis I Disorders (SCID-I) criterion.
Results:
The SDRS showed a moderate accuracy with an optimal cut-off of 26 maximized with higher sensitivity (0.74,95% CI:0.63–0.84) than specificity (0.57,95% CI:0.50–0.64). A five-factor structure was carried out and five dimensions of SDRS were identified (loneliness; social isolation; feeling of contribution/uselessness; lack of leisure activities; anxiety for the health). Education and global cognitive functions were inversely correlated to SDRS, while a direct association with global psychopathology, depression, and apathy was found. The prevalence of higher SDRS scores was major in subjects with current psychiatric disorders versus other subjects.∥
INTRODUCTION
Social functioning is defined as “an individual’s ability to perform appropriately everyday social tasks and consequently to maintain an adequate social life” [1]. Social dysfunction depends on individual inability in coping with stressful situational factors and achieving adequate social gratification, and could be defined as the maladaptive way to manage personal, interpersonal, or geographic environment [2]. Individual social roles are strongly dependent on age and may be affected by the presence of psychopathology [3]. The dimension of social dysfunction is key in study of health and diseases in aging populations, especially cognitive decline [4, 5]. Effective social functioning in older population is linked to the proper social interaction with the environment (parents, siblings, and close relatives). It consists of integrated satisfaction of the person’s needs related to his own goals and how he sees himself as achieving them [3]. In terms of environmental exposure, social deprivation could even be more important in social function than material deprivation, manifesting as a lack of social support from the community and family even in places where living standards are higher. This aspect underlines the effects on individual health of the personal state of isolation and anxiety resulting from a lack of social integration (anomy) [6, 7].
In order to develop a better understanding of social functioning in late-life, research should include the development and validation of more direct, objective measures in conjunction with subjective self-report measures [8, 9]. Unfortunately, most epidemiological studies focus on only one measure of social dysfunction, precluding important comparisons. Evidence from the few studies that do include measures of objective as well as subjective aspects of social relationships suggests that the two dimensions are weakly correlated, and that they have independent effects on health-related outcomes [10]. The Social Dysfunction Rating Scale (SDRS) addresses these requirements because it objectively quantifies dysfunctional interaction with the environment [11]. Subjective and objective performance in the self, interpersonal, and performance systems are assessed. It emphasizes role-free assessment, and this is needed to evaluate functional status of adjustment in older age. Dysfunction is viewed as a discontent accompanied by attitudes of negative self-regard. Adjustment is seen as a process of coping, problem solving, and achieving one’s goals.
We know little about the links between objective measures of social integration and individuals’ subjective assessments of their social connections. The objectives of this study were to validate an Italian version of the 21-item SDRS [11, 12], specifically determining its objective and subjective psychometric properties against the gold standard evaluation of social dysfunction in psychiatric disorders according to the Semi-structured Clinical Diagnostic Interview for DSM-IV-TR Axis I Disorders (SCID-I) [13]. Furthermore, we evaluated the relationship of SDRS with cognitive function, global severity psychopathology, and social deprivation in community-dwelling Italian older subjects recruited in the GreatAGE Study, a population-based study on aging.
METHODS
Participants
The present study adhered to the “Standards for Reporting Diagnostic Accuracy Studies” (STARD) guidelines (http://www.stard-statement.org/), the “Strengthening the Reporting of Observational Studies in Epidemiology” (STROBE) guidelines (https://www.strobe-statement.org/), and in accord with the Helsinki Declaration of 1975. The sample was collected within the GreatAGE Study (Fig. 1), a population-based study on aging conducted on subjects older than 65 and residents in Castellana Grotte, a town located near Bari, Puglia in the Southeast of Italy. The final sample frame was the electoral list including at December 31, 2014, 19,675 subjects, with 4,008 people aged 65 years or older. The GreatAGE Study focused on the impact of nutrition, frailty, and age-related sensory impairments as predictors of common neurodegenerative and psychiatric diseases in older age [14]. The present study was a cross-sectional analysis of the ongoing GreatAGE Study. Detailed methodology of the study is reported elsewhere [15]. We cooperated with general practitioners who invited older subjects previously selected to participate in the study with the support of the city census office. The Institutional Review Board of the “National Institute of Gastroenterology “S. De Bellis” approved this study. Written informed consent was obtained from all the community-dwelling older adults included in this study.

Flow diagram of the study population at the different phases of the survey. The GreatAGE Study.
Data collection and measures assessment
Information was collected through semi-structured questionnaires. Demographic characteristics including age, sex, marital status, household composition, residential arrangement, and education were obtained. The information on psychiatric disorders was obtained from psychiatric examinations with a standardized anamnestic interview for dimensional and categorical diagnosis for all subjects involved in the study. This assessment was followed by the SCID-I [13], performed by trained clinicians, and aimed to categorize the presence of possible major mental disorders. Depression and other current (last month) and past (lifetime) psychiatric disorders were diagnosed according to the American Psychiatric Association criteria (DSM-IV-TR) [16]. Social functioning was defined as “an individual’s ability to perform and fulfill normal social roles”. The impairment of social functioning is considered an important characteristic and diagnostic criterion of psychiatric disorders [2]. Social dysfunction was diagnosed according to the SCID-I and psychiatric interview, in three groups: Group 0 = subjects without psychiatric disorders and without any social dysfunction, Group 1 = subjects without a current psychiatric disorder, but with social dysfunction according to the SCID-I criterion for all psychiatric disorders: “Clinically significant psychological suffering or impairment of social functioning, working or other important functional areas”, and Group 2 = subjects with a psychiatric disorder and affected by current occurrence (diagnosed in the last month) with high social dysfunction. The SCID-I diagnosis of social dysfunction was considered the gold standard. The SDRS and the SCID-I interviews were completed by two independent interviewers in the middle or at the end of the interview, i.e., when a considerable degree of self-disclosure from the respondents might be expected. The SDRS is applicable to all adults, but is designed for older age. The SDRS is composed of twenty-one items rated on a 6-point ordered-rating scale. The rater is required to make judgment of the patient’s performance in relation to the patient’s peer group and compared to the general population. The time period assessed is “today” or “the past week” [17]. Recreational and occupational roles are covered under the performance system. The self and interpersonal items include symptom assessments. Response points are global and the questions require a skilled interviewer [18, 19]. Total SDRS score can be viewed as a simple and rapid measures of general social function. Moreover, measures of 5 factors could be identified according to original factorial analysis: Factor 1 - Apathetic-Detachment, Factor 2 – Dissatisfaction, Factor 3 – Hostility, Factor 4- Health-Finance Concern, and Factor 5 - Manipulative- Dependency. This 21-item scale has also a three-subsystem structure (self system, interpersonal system, and performance system) [11, 19]. The 21 items are rated on a 6-point scale ranging from not present to very severe by a mental health professional using a semi-structured interview guide (score range: 21–126) [11, 19].
Social deprivation was studied with the Deprivation in Primary Care Questionnaire (DiPCare-Q), administered to analyze three areas of material, social, and healthcare deprivation [20]. Clinical variables included cognitive function, severity of psychopathology, and neurological examination. We firstly used the Mini-Mental State Examination (MMSE) [21] and the Clinical Dementia Rating scale (CDR), a tool designed to grade subjects from normal cognition and functions through various stages of dementia [22]. Older subjects with CDR = 0–0.5 (“normal” and “questionable dementia”) and without a diagnosis of dementia were included in the study. The Symptoms Checklist 90 Revised Global Severity Index subdomain (GSI-SCL-90R) was considered as an indicator of the degree of current psychopathology [17]. A battery of tools including the Frontal Assessment Battery (global executive function) [24], the Geriatric Depression Scale (GDS; 30-items) [25], and the Starkstein Apathy Scale (SAS) [26] was used as well.
Statistical analysis
Patients’ characteristics were reported as mean±standard deviation (SD), and frequencies and percentages, for continuous and categorical variables respectively. Differences between the three diagnostic subgroups according to SCID-I were assessed using Pearson χ2 for categorical variables and Kruskal-Wallis one-way ANOVA followed by Nemenyi post-hoc test for quantitative ones. Mann-Whitney U-test was used to assess differences in SDRS between two groups. Spearman’s rank correlation coefficient was used to assess associations between quantitative variables. The reliability and the internal consistency of the SDRS has been estimated using Cronbach’s alpha coefficient [27]. The receiver operating characteristic (ROC) curve for SDRS was used to detect the optimal cut-off score maximizing both sensitivity and specificity for the discrimination of social dysfunction across three diagnostic categories: subjects with current psychiatric disorder; subjects without a current psychiatric disorder and with social dysfunction according to the SCID-I criterion for all psychiatric disorders; subjects without psychiatric diagnosis and without social dysfunction. The area under the curve (AUC), sensitivity and specificity were calculated along with their 95% bootstrapped confidence interval (CI), considering 2,000 sampling replications. ROC analyses were performed overall and separately for each subgroup according to sex (male or female), age strata (65–71, 72–79, and 80+ years), and educational level (0–5 or 6–18 years). To determine factor dimensions useful in conceptualizing social dysfunction, an Exploratory Factorial Analysis Vari-max rotation with 5 factors was carried out on the 21-item SDRS. Multivariate logistic regression model was estimated for evaluating the influence of specific variables (educational level, sex, SAS, MMSE, GSI-SCL-90R, and CDR global score) on the performances of the SDRS using a valid cut-off. C-index and Hosmer-Lemeshow goodness of fit tests were used to assess the discrimination and the calibration of the logistic model. A p-value of 0.05 was assumed to be the threshold for statistical significance. All analyses were performed using R (v 3.3.1) and Rstudio (v 0.99.903).
RESULTS
The sample included 484 subjects (46.5% males), constituted by a subgroup of people who completed the SDRS. According to the gold standard diagnosis of social dysfunction performed with the SCID-I, the prevalence of social dysfunction in older age amounted at 30.2% overall, subdivided in 20.5% of subjects with current psychiatric disorders (Group 2) and 9.7% of subjects without current psychiatric disorders, but which meet at least the criterion of social dysfunction of the SCID-I interview (Group 1). Therefore, about 70% of subjects did not have any social dysfunction according to the gold standard. Clinical and socio-demographic variables are compared across the three diagnostic subgroups and are reported in Table 1. Compared to older subjects without psychiatric disorders, social dysfunction in both psychiatric disorders and subjects which met SCID-I criterion for social dysfunction only was more frequently present in females (70–72 % versus 46%). Mean GSI- SCL-90R and GDS-30 scores in subjects with psychiatric disorders were significantly higher than those of older subjects without psychiatric disorders and with at least the SCID-I criterion for social dysfunction. No significant differences were found between the three groups in mean age, education and in mean SAS, MMSE and CDR, FAB, and DiPCare-Q global scores. Among the three DiPCare-Q subdomains, only DiPCare-Q health differed in a statistically significant manner (p = 0.040), not DiPCare-Q social or material (p > 0.005).
Clinical and socio-demographic characteristics of the study sample subdivided in three social dysfunction profiles according to the Semi-structured Clinical Diagnostic Interview for DSM-IV-TR Axis I Disorders (SCID-I): Group 0 = subjects without psychiatric disorders and without social dysfunction; Group 1 = subjects without a current psychiatric disorder, but with social dysfunction according to the SCID-I criterion for all psychiatric disorders; Group 2 = subjects with a current psychiatric disorder. The GreatAGE Study
SD, standard deviation; SAS, Starkstein Apathy Scale; GDS-30, 30-item Geriatric Depression Scale; FAB, Frontal Assessment Battery; MMSE, Mini-Mental State Examination; CDR, Clinical Dementia Rating scale; GSI-SCL-90R, Symptoms Check-list 90 Revised Global Severity Index subdomain; DiPCare-Q, Deprivation in Primary Care Questionnaire; SDRS, Social Dysfunction Rating Scale.
Box-plots of the SDRS scores of the three diagnostic subgroups are shown in Fig. 2. Median SDRS score of subjects with current psychiatric disorders [28 (21–57)] was significantly higher than those of subjects with at least the SCID-I criterion for social dysfunction [26 (21–41)] and normal subjects [24 (21–47)]. SDRS median scores did not differ between normal subjects (Group 0) and the group which met at least the SCID-I criterion for social dysfunction (Group 1) (p = 0.142). Differences in median SDRS scores among the three diagnostic subgroups were explored by gender, age, education, cognitive, and depression status and the other clinical, behavioral, and psychosocial assessments. Spearman’s correlation between SDRS scores (and its original five factors), age, levels of education, MMSE, FAB, SAS, GDS-30, GSI- SCL-90R scores, and DiPCare-Q and its subdomains are shown in the online-only Table 1. A significant inverse relationship was found between SDRS scores and the levels of education and global cognitive function assessed with MMSE (r = – 0.155, p = 0.005) and FAB (r = – 0.157, p = 0.004), while there was a significant direct correlation of SDRS with global levels of psychopathology (r = 0.470, p < 0.0001), depressive symptoms (r = 0.312, p < 0.0001), and apathy (r = 0.196, p < 0.0001). SDRS scores were significantly associated with gender (higher in females), but not with CDR global scores categories. Spearman’s correlations between SDRS scores and DiPCare-Q subscales did not find any significant association, except for DiPCare-Q Health Deprivation subdomain and Factor 1 - Apathetic-Detachment (Supplementary Table 1).

Comparison of the Social Dysfunction Rating Scale scores among the three social dysfunction diagnostic subgroups according to the Semi-structured Clinical Diagnostic Interview for DSM-IV-TR Axis I Disorders (SCID-I): Group 0 = subjects without psychiatric disorders; Group 1 = subjects without a current psychiatric disorder, but with social dysfunction according to the SCID-I criterion for all psychiatric disorders; Group 2 = subjects with a psychiatric disorder in course (current). The GreatAGE Study.
Using factorial analysis with Vari-max rotation, five factors were identified for the 21-item SDRS. Table 3 shows the five factors with their respective loadings. These five factors explained only 38% of the overall variability. The items SDRS 18 and SDRS 19 had the higher loadings (0.75 and 0.91, respectively) for the Factor 1 (“Social Isolation”); the items SDRS 11, SDRS 12, and SDRS 13 had the higher loadings (0.73, 0.65, and 0.72, respectively) for the Factor 2 (“Loneliness”); the items SDRS 14 and SDRS 15 had the higher loadings (0.85 and 0.70, respectively) for the Factor 3 (“Feelings of Contribution/Uselessness”); the items SDRS 16 and SDRS 17 had the higher loadings (0.54 and 0.90, respectively) for the Factor 4 (“Lack of Leisure Activities”); the items SDRS 9 and SDRS 4 had the higher loadings (0.78 and 0.57, respectively) for the Factor 5 (“Anxiety for the Health”).
Performance of 21-item Social Dysfunction Rating Scale (SDRS) compared to the gold standard of a diagnosis of social dysfunction in older age performed with the Semi-structured Clinical Diagnostic Interview for DSM-IV-TR Axis I Disorders at optimal cut-off scores. Optimal cut-off scores referred to the value obtained in the receiver operating characteristic curve analysis maximizing jointly sensitivity and specificity for gender, educational levels, and age strata
PPV, positive predictive value; NPV, negative predictive value.
ROC curve for SDRS was performed on the whole sample to discriminate current psychiatric disorders versus other diagnostic categories (AUC: 0.72, 95% CI: 0.664–0.774) (Fig. 3A). The optimal cut-off score of 26 maximized both sensitivity (0.74, 95% CI: 0.63–0.84) and specificity (0.57, 95% CI: 0.50–0.64). The ROC analyses were performed separately for each subgroup (females, males, three classes of age, and two levels of education) (Fig. 3B-D) and the results are shown in Table 2. The association of sociodemographic and clinical variables (educational level, gender, SAS, MMSE, CDR, and SCID-I diagnosis) on the ratings of SDRS has been evaluated at the cut-off of 26. From the multivariate logistic regression model emerged that only the diagnosis of current psychiatric disorder as established with SCID-I was statistically significant associated to SDRS scores (odds ratio (OR) = 4.08; 95% CI: 1.98–8.40).

Receiver operating characteristic (ROC) curve analysis of the sensitivity and specificity of the 21-item Social Dysfunction Rating Scale compared to the Gold Standard Social Dysfunctional Diagnosis performed with Semi-Structured Clinical Diagnostic Interview for DSM-IV-TR Axis I Disorders across the sample separating subjects with current psychiatric disorders (pathology – Group 0) versus other subjects (without current psychiatric disorders) (no pathology – Groups 1 and 2) (A) and subdivided for gender (female and male) (B), for age strata (65–71 years, 72–79 years, and 80–95 years) (C) and for educational level (lower than 6 years and from 7 to 18 years) (D). The GreatAGE Study.
Factorial analysis of the 21 items of the Social Dysfunction Rating Scale (SDRS) with their loadings
The prevalence of social dysfunction in the overall sample of 484 subjects, according to the cut-off score of 26 for the SRDS amounted at 49.17%. According to this optimal cut-off, the SDRS found a prevalence of 73.74% of social dysfunction in the group of current psychiatric disorders, a prevalence of 55.32% of social disturbances in the group of lifelong psychiatric disorders, and a prevalence of 41.12% in the group of older subjects without current psychiatric disorders.
DISCUSSION
The present findings showed that the SDRS was a brief and accurate tool to assess social dysfunction in older age. SDRS identified a difference in social dysfunction between subjects affected by current psychiatric disorders and non-affected subjects or subjects affected by only SCID-I criterion of social dysfunction. The SDRS showed a good validity using a SCID-I diagnosis of social dysfunction as the gold standard, with the best cut-off at 26 in a scale ranging from 21 to 126. To the best of our knowledge, this was the first study testing the validation of SDRS among older subjects in a population-based setting. SDRS presented good accuracy and internal consistency, indicating that this instrument may give acceptable results in evaluating social dysfunction in older age.
In older age, our cut-off for the SDRS showed a good sensitivity (73.7%), but relatively low specificity (57.1%). Only 31% of cases of social dysfunction screened with the SDRS were true positive. In the present study, social dysfunction diagnosed with SCID-I in subjects with and without psychiatric disorders (Groups 1 and 2) was common and amounted at 30.2% in the whole sample. In this group, 9.7% of older people did not meet full criteria for psychiatric conditions (Group 1), but only for social dysfunction, so we supposed they had a moderate social dysfunction according to the clinical interview. The total amount of social dysfunction detected with the SDRS optimal cut-off (≥26) (about 50% in the whole sample) was greater than social dysfunction diagnosed with the SCID-I (about 30%). At the optimal cut-off, the SDRS found a prevalence of social dysfunction ranging from 73.74% in the group of current psychiatric disorders to 41.12% in the group of older normal subjects. Therefore, social functioning may be viewed as one of the basic measures of general well-being that could constitute a continuum from normality to pathology [9, 28]. However, only the diagnosis of current psychiatric disorders was significantly associated to the SDRS cut-off score, without association with other variables (gender, education, apathy, social deprivation, and global cognitive functions).
The five-factor structure reflected five major dimensions in the SDRS, although this simplification and grouping of the 21 items only explained about 38% of the total variability. The value of the social adjustment derived from the grouping of the items in social isolation, loneliness, feelings of contribution/uselessness, lack of leisure activities, and anxiety for the health, rather than the theorized three-subsystem structure of the 21 items (self system, interpersonal system, and performance system) proposed originally in 1969 [11]. The main loading for the SDRS was attributable to eleven items of the scale, related primarily to the external environment (resources) and the feedback that older persons receive in relationship to their behavior [29]. We hypothesized that, among the five factors, the three items most associated with the Factor 2-Loneliness (loss of satisfactory relationships with significant family members, loss of friends and social contacts, and need to have more social contacts) contributed to the assessment of the loneliness both objectively (by the evaluator) and subjectively (as expressed by the subject). The two items associated with the Factor 1-Social Isolation (lack of participation in community activities and lack of interest in community affairs) contributed to the assessment of the social isolation. Loneliness and social isolation measured the aspects of quality and size of social relations, and thus may also have slightly different associations with health outcomes [10].
A novel finding of the present study was that the strength of social deprivation and social dysfunction in health can differ in the adult life’s course [3]. In fact, we showed that psychiatric and non-affected subgroups diagnosed with SCID-I had similar rates of social and material deprivation, and they differed only in the degree of health deprivation as assessed with the DiPCare-Q (data not shown). Only the Health Deprivation subdomain of DiPCare-Q was significantly different among the three subgroups of social dysfunction, maybe because the items concerning mental health and addiction were included in this subdomain. Furthermore, according to the factorial analysis of Linn conducted in 1988 [9], only the Apathetic-Detachment Factor, encompassing lack of participation and interest in community affairs and lack of friends and satisfying relationships (family), could be correlated to the health deprivation, not to social or material deprivation evaluated with DiPCare-Q.
In the present study, the positive association between SDRS scores and GDS-30, GSI- SCL-90R, and SAS suggested that social adjustment may get worse with increasing depressive symptoms, global index of psychopathology, and apathy. In particular, the SDRS factors of apathetic-detachment, hostility, and dissatisfaction correlated to the scores of GDS-30 and GSI- SCL-90R in our population. Individuals may differ in their proneness to experience psychological distress in the form of negative emotions, i.e., depression and anxiety, a personality trait also known as neuroticism, robustly associated with the future occurrence of negative emotions such as depression and anxiety [30]. We supposed that the personality trait mostly investigated with SDRS may be neuroticism encompassing the emotional withdrawal at item 5, the anxiety described at item 9 (encompassed in Factor 5), and the adaptive rigidity in coping to stress at item 21 of the scale. Vulnerable individuals tend to be unable to deal with stress. Anxiety and vulnerability are markers of withdrawal, which accounts for augmented stress reactivity as well as for negative affect [31].
In the present study, we found an inverse correlation between SDRS and global cognitive scores (MMSE), the level of education, and the executive dysfunction (FAB). The relation of negative social interactions with late-life cognitive disorders has not been extensively investigated, but one study found more frequent negative social interaction to be related to an increased risk of developing mild cognitive impairment [32]. This association appeared to be mainly due to the correlation of negative social interactions that may induce lower social engagement and low level of activities stimulating for cognition. Satisfying interactions tend to be cognitively stimulating and thereby to benefit cognition [5].
Several other questionnaires rather than SDRS have asked persons to rate how often they engage in common social activities. Some of their inconsistency may reflect variation in the quality, rather than the quantity, of social interactions [33]. It was not the size of social networks that predicted the subsequent risk of neuropsychiatric disorders, but how satisfying and reciprocal they were. A certain level of well-being in older age would contribute to the presence of intellectual, social, and psychological resources [34] and perhaps to cognitive reserve. So, our hypothesis is that the SDRS with our proposed cut-off may be very useful in detecting social vulnerabilities in older age, such as social frailty, and considering possible interventions to maintain healthy aging. Among frailty models, physical, cognitive, and social frailty phenotypes have been operationalized. Social frailty can be defined as a continuum of being at risk of losing, or having lost, resources that are important for fulfilling one or more basic social needs during the lifespan [28]. However, social frailty has been operationalized with single questions or items from functional and depressive symptom scales or health checklists [28, 35]. The prevalence of social dysfunction in the group of older subjects without psychiatric disorders in the present study (41.12%) was in line with these studies indicating that cumulative prevalence rate of social frailty (pre-frailty plus frailty) was 35.9% and the prevalence rate of social frailty alone was more that 40% in the higher age strata [35].
The strengths of the present study were the large number of subjects and the comprehensive psychiatric, clinical, and neuropsychological assessment performed. However, we also must acknowledge some limitations. In fact, we had no objective measure of social deprivation (i.e., socio-economic status), but only a subjective measure such as the DiPCare-Q. Furthermore, we did not assess the midlife exposure to deprived social circumstances, a measure associated with the increased risk of severe mental disorder [36]. On the other hand, in the present study, the lack of association between material deprivation and mental health in psychiatric and non-affected subjects may be due also to the homogeneous socioeconomic status of a rural, small towns like Castellana Grotte, without sufficient variability to distinguish several classes of social and/or material deprivation. The SDRS could be a valid instrument to capture size (isolation) and quality (loneliness, neuroticism) of social adjustment in older age. The perception of social dysfunction was not associated with material deprivation, and this adds another stratum of complexity in the assessment of health status in older age.
