Abstract
This paper examines whether and to what extent the amount of Social Security benefits of older survey respondents in the Health and Retirement Study (HRS) are reported accurately. Inaccurate reporting leads to biased estimates of gross Social Security benefits, affecting estimates of elderly well-being, including the proportion of beneficiaries classified as poor or near poor. Our findings indicate that 73% of HRS respondents report only the net amount of Social Security benefits they receive, excluding Medicare premiums. The implication is that Social Security benefits in the HRS are underestimates of the true gross benefits. Therefore, the HRS data overestimate the proportion of the elderly respondents who are poor or nearly poor. Finally, even after correcting for gross benefits, Social Security income comprises at least 50% of the total family income for about half of elderly respondents.
Keywords
Introduction
Survey respondents are commonly asked about the income they receive in a given year from different sources (such as earnings, Social Security benefits, pensions, assets, etc.). However, the accuracy of these reports depends upon both the design of the survey questions and the respondents’ reporting error. Therefore, it is of great interest to assess the extent and the magnitude of respondents’ reporting accuracy of their Social Security benefits. This is an important issue for researchers because estimates regarding Social Security incomes in retirement are commonly based on respondents’ self-reported information, and particularly since for about half of elderly beneficiaries, Social Security income comprises at least 50% of their family income [1]. Hence, if benefits are misreported, researchers interested in retirement income security and elderly wellbeing are likely to produce inaccurate estimates. It is also important for policy makers because underreporting of Social Security benefits will affect both the proportion of elderly beneficiaries classified as poor or nearly poor, and the estimates of the share of income received from Social Security.
The total amount of Social Security benefits includes the amount paid directly to the beneficiary and the amount deducted from gross benefits and paid for Medicare premiums. Thus, when asked, survey respondents can report either the total amount of Social Security benefits or the net amount excluding Medicare premiums. Previous research [2] has shown that respondents in the Survey of Income and Program Participation (SIPP) in 2009 underreported their Social Security benefits on average by an annual amount of $1,000. In contrast, Social Security income reported in the 2010 Current Population Survey (CPS) closely corresponded to the amount in the administrative records mainly because the CPS corrected the respondents’ reported Social Security income by adding the amount of Medicare premiums.1 2
This paper assesses the accuracy of reported Social Security benefits among elderly respondents in the Health and Retirement Study (HRS), a longitudinal study with comprehensive interviews of respondents aged 51 and older and their spouses of any ages. Because of the survey design and data processing, the HRS data omit a portion of the Social Security income received by respondents 65 and over, since respondents are asked to report the amount paid to them after any deductions.3 Consequently, it is plausible that respondents report the net amount of benefits received and ignore the amount deducted for Medicare premiums. Therefore, Social Security benefits in the HRS would underestimate the total (gross) benefits. This is concerning particularly since gross Social Security benefits are included in the estimation of official poverty rates. Hence, we assess whether and to what extent elderly respondents report their gross or net benefits and compare reported amounts to those in their administrative records, and then document the impact on estimates of elderly poverty rates and of the relative importance of Social Security income.
We find that, consistent with the question asked, about 73% of elderly HRS respondents with matched administrative records reported the amount of net benefits received (excluding Medicare premiums). Of the remaining respondents, about 16% and 11%, respectively, under-reported and over-reported their net benefits. Furthermore, the mean difference between self-reported and net benefits in the payment records is not statistically significant. As expected, given the HRS question and the respondents’ reporting of their net benefits, Social Security benefits in the HRS underestimate the true gross benefits, which lead to upward biased estimates of the proportion of elderly respondents that are poor or near poor, and also of the elderly’s reliance on Social Security income.
In the next section, we describe the data and our analysis approach, followed by a discussion of the findings in the result section. Finally, we conclude by offering suggestions for improvement in the HRS data.
Data and methodology
The data for this study come from the Health and Retirement Study (HRS), a longitudinal, nationally representative sample of Americans over the age of 50 and their spouses, first interviewed in 1992 with follow-up interviews conducted every other year. The HRS is the major data source for research of aging and retirement issues in America [11]. The depth and breadth of the HRS is unparalleled by other studies. It collects comprehensive information about respondents’ socio-economic characteristics, employment, health, disability, pensions, income and wealth. Moreover, it provides detailed information on income from different sources, separately for the respondent and the spouse (if coupled), such as from Social Security, earnings, private pensions, welfare programs, capital income, and other sources. Based on survey reports, RAND creates an annual measure for each income component, and a measure of the total annual household income. The latter variable is then used to generate a measure of the poverty status for each respondent according to the Census definitions of poverty threshold by family composition.
The main variable of interest in this analysis is Social Security income as reported by respondents in the 2012 interview. Specifically, HRS respondents are asked the following question (NQ085): “About the Social Security income that you (yourself) receive, how much was the Social Security check or the amount deposited directly into your account last month? We want the amount after any deductions”. Then, married respondents are asked the same question about their spouse’s Social Security benefits. Given the wording of this question, we hypothesize that most respondents report the net benefit amount received and ignore Medicare premiums, leading to an underestimate of respondents’ gross Social Security benefits. It is also plausible that some respondents may over- or under-report their net benefit amount or may even report the gross benefit amount.
To assess the true (whether net or gross) amount of Social Security benefits that survey respondents received, we use information from the Social Security administrative records. One of the advantages of the HRS is that respondents are asked to provide consent to merge their earnings and benefits records from Social Security Administration with their survey information for research purposes. For respondents who have claimed Social Security benefits, these restricted records contain detailed information about the type of benefits they receive, when they claimed benefits, the monthly amount of benefits they actually received from Social Security, and the amount of Medicare premiums paid to the Center for Medicare and Medicaid Services (CMS). We restrict our sample to respondents aged at least 65 and one month old at the beginning of interview in 2012 consisting of 10,713 observations.4 Of this total sample of elderly, about 56% (or 6,059 observations) have a match to their Social Security benefits record in year 2012. We use information for year 2012 because as of this writing, it is the latest year with matched Social Security administrative data available for the HRS sample.
For respondents with matched Social Security benefits records, we examine their reporting accuracy regarding the receipt and the amount of Social Security benefits by comparing their self-reported benefits with information available in their own administrative records. As noted above, the total Social Security benefit is comprised of the amount that is paid directly to the beneficiary and the amount that is paid for Medicare premiums (mainly Part B). For the majority of elderly beneficiaries, the amount of Social Security benefits received excludes the amount of Medicare Part B premiums withheld.5 For the sample of respondents with a match, the true amount of their Social Security benefits is available in the Social Security records from the Payment History Update System (PHUS) file.6 The unique characteristic of the PHUS is that it contains for each month both the amount of benefits paid to the beneficiary (either by check or as direct deposit to a bank account) and the amount of Medicare premiums (deducted from the beneficiary’s total Social Security benefits) paid by the Department of Treasury to the CMS. From these records, for each respondent we derive two annual measures for year 2012: the net amount and the gross amount of Social Security benefits. The annual net benefit amount is the sum of direct payments made to the beneficiary in each of the twelve months during the calendar year 2012, whereas the annual gross benefit amount is the sum of the direct payments and the Medicare premium payments made in each of the twelve months in 2012. We compare these measures to the self-reported annual Social Security benefit amounts in the RAND-HRS public file.7 For respondents in the 2012 wave who were interviewed during year 2012 we use their annual Social Security benefits amount.8 For those interviewed during February through May of year 2013, since they report monthly benefits received in 2013, we adjust their self-reported annual benefits to 2012 dollars using the 1.7% cost of living adjustment for Social Security benefits that took effect in January 2013 (i.e., we multiply by a factor of 0.983).
Selected characteristics of respondents aged 65 and older in 2012, by status of match to their Social Security benefit records
Selected characteristics of respondents aged 65 and older in 2012, by status of match to their Social Security benefit records
Notes: Authors’ calculations using data from the 2012 wave of the Health and Retirement Study (RAND-HRS user-friendly data file version P) matched with administrative data from the Social Security benefit records – the Payment History Update System (PHUS). All selected characteristics in this table come from the RAND data file. Sample consists of respondents aged at least 65 and one month old at the beginning of the interview. Sample is disaggregated by whether respondents have a match to their Social Security benefit records. Estimates are weighted using respondents weight from the 2012 interview. Reported numbers of observations are unweighted. The percentages across categories within the same variable may not add to 100% due to rounding.
Then, we examine to what extent respondents’ report of net versus gross benefits affects the elderly poverty rate and their reliance on Social Security benefits.9 For this purpose, for respondents with a match, we replace the self-reported net Social Security benefits with the amount of gross benefits in their payment records. For respondents without a match, we add to their self-reported benefits an amount of $1,200 representing the typical Medicare premium amount paid in year 2012. Similarly, we adjust spouse’s Social Security benefits (if married and spouse is older than 65). Then, we adjust their total household income accordingly. Thus, for example, for couples without a match where both spouses are aged 65 or older and report receiving Social Security benefits, assuming that each spouse pays the standard amount of Medicare premiums, their total annual household income in 2012 would increase by $2,400 because of this adjustment. In addition, to get a more accurate estimate of poverty rate and reliance on Social Security benefits, we correct the amount of total household income to include the amount of potential withdrawals or distributions from IRAs or 401(k) type accounts.10 Dushi et al. [1] show that not accounting for such distributions will result in biased estimates of reliance on Social Security income. We follow a similar approach here and, based on respondents’ age and self-reported tax advantaged retirement account balances, calculate the stream of annual income that can be withdrawn from them. Since people at and over age 70½ are required by law to draw down their retirement account balances, we assume that they potentially have received such distributions even if they are not reported as income in the survey. To estimate the required distributions for each respondent aged 70 and over, we use the IRS Required Minimum Distribution (RMD) factor based on each respondent’s age and life expectancy. Previous research has shown that few people withdraw money from IRAs or 401(k) type accounts before the age of RMD requirement [14, 15, 16]. However, in order to maintain consistency in measuring household income from retirement accounts among older households, we derive the distribution factors for people aged 65–69 by extrapolating from the IRS RMD factor of those aged 70 and over, and then estimate their retirement accounts withdrawals.11
In this section, we discuss our sample characteristics, followed by findings with respect to reporting accuracy of Social Security benefits and its implication for estimates of elderly poverty rate and elderly reliance on Social Security income. Section 4 concludes with some recommendations.
Distribution of self-reported Social Security benefits among respondents aged 65 and older in 2012, by status of match to their benefits records
Distribution of self-reported Social Security benefits among respondents aged 65 and older in 2012, by status of match to their benefits records
Notes: Authors’ calculations using data from the 2012 wave of the Health and Retirement Study (RAND-HRS user-friendly data file version P) matched with administrative data from the Social Security benefit records – the Payment History Update System (PHUS). The variable – the annual amount of Social Security benefits – used in this table come from the RAND data file and is derived from respondents’ self-reported benefits at the time of interview. Majority of the sample was interviewed in 2012. For those who were interviewed in 2013 we adjust their self-reported benefits by multiplying it with a factor of 0.983, which reflect the COLA increase of 1.7% that took effect in January 2013. Sample consists of respondents aged at least 65 and one month old at the beginning of the interview. Sample is disaggregated by the match status to Social Security benefit records. Estimates are weighted using respondents weight from the 2012 interview. Reported numbers of observations are unweighted.
Table 1 provides demographic characteristics of the samples with and without matched records. The two samples are similar regarding gender, marital status, household income and wealth, and the proportion of respondents that report Medicaid coverage. However, the two samples differ regarding several dimensions. Compared to respondents without a match, those with a match are significantly more likely to be younger (ages 65–69), non-Hispanic whites, college graduates, and in good health; to be covered by Medicare as well as Medicare Part B; and less likely to be in poverty or near poverty.
When comparing the distribution of the survey-reported Social Security benefits separately for respondents with and without matched records we observe some small differences (Table 2). At the 25
We now focus on the sample with matched records and compare the amounts of Social Security benefits as reported by respondents and as shown in the payment (PHUS) records. Table 3a shows that only 7.9% of respondents reported benefits that are inconsistent with administrative records. Out of those, 3.7% reported receiving a positive amount of Social Security benefits but the PHUS records indicate no payment was issued by the Department of the Treasury (a Type I error; all but one of these respondents have both Medicare payment and direct payment in the PHUS record equal to zero). The remaining 4.2% of respondents reported receiving no benefits whereas the PHUS records indicate that a payment was made (a Type II error).
Receipt of Social Security benefits as reported by respondents at the 2012 interview and as reported in the PHUS records, among respondents with a match aged 65 and over
Receipt of Social Security benefits as reported by respondents at the 2012 interview and as reported in the PHUS records, among respondents with a match aged 65 and over
Notes: Authors’ calculations using data from the 2012 wave of the Health and Retirement Study (RAND-HRS user-friendly data file version P) matched with administrative data from the Social Security benefit records – the Payment History Update System (PHUS). The amount of self-reported benefits is from the RAND data file. Sample consists of respondents aged at least 65 and one month old at the beginning of the interview and with a match to their PHUS payment records in 2012. Cell percentages may not add to 100% due to rounding. Estimates are weighted using respondents weight from the 2012 interview. Reported numbers of observations are unweighted.
Distribution of Social Security benefit amounts in 2012 as reported by respondents and as reported in the PHUS records, among respondents with a match aged 65 and over
Notes: Authors’ calculations using data from the 2012 wave of the Health and Retirement Study (RAND-HRS user-friendly data file version P) matched with administrative data from the Social Security benefit records – the Payment History Update System (PHUS). The amount of self-reported benefits is from the RAND data file. Sample consists of respondents aged at least 65 and one month old at the beginning of the interview and with a match to their PHUS payment records in 2012. Cell percentages may not add to 100% due to rounding. Estimates are weighted using respondents weight from the 2012 interview. Reported numbers of observations are unweighted.
Table 3b provides the cross-tabulation of the distribution of the self-reported amount of benefits compared separately to the net and the gross amount of benefits in the PHUS. In each panel, the row and column benefit categories are created using the annual amounts of benefits. To put into perspective, within each broad category the upper and lower limits differ by $6,000 annually, or by $500 per month.
Panel A shows that, out of the total sample, 73% of respondents (the sum of the boldfaced percentages in the diagonal) reported benefits falling within the same broad categories as the net benefits in the payments records, suggesting that their self-reported benefits are close to the true net amount of Social Security payments. Of the remaining sample, 16.3% of them (the sum of all cells above the diagonal) under-reported their benefits. In other words, administrative records indicate that actual net benefits paid are higher than self-reported benefits, suggesting that these respondents clearly misreported their benefits. The other 10.7% of respondents (the sum of all cells below the diagonal) over-reported their benefits. This partly reflects the Type I error of respondents reporting non-existent Social Security benefits or reporting Supplemental Security Income instead (3.7%), whereas others may have over-reported their benefits, perhaps by including the amount of Medicare premiums.
Distributions of Social Security benefits in 2012 as reported by respondents at the interview, as reported in the PHUS records, and of their differences, among respondents with a match aged 65 and over
Notes: Authors’ calculations using data from the 2012 wave of the Health and Retirement Study (RAND-HRS user-friendly data file version P) matched with administrative data from the Social Security benefit records – the Payment History Update System (PHUS). The amount of self-reported Social Security benefits in column (1) is from the RAND data file, whereas benefits in columns (2) and (3) are from the PHUS administrative records. Sample consists of respondents aged at least 65 and one month old at the beginning of the interview and with a match to their PHUS payment records in 2012. Estimates are weighted using respondents weight from the 2012 interview. Number of observations is unweighted. The percentile categories are specific to each column.
Compared to Panel A, the cross-tabulation in Panel B of self-reported benefits and gross benefits (including Medicare premium) in the payment records reveals a shift in higher cell-proportions toward the upper right corner. Thus, a lower proportion of HRS respondents have self-reported benefits in the same broad categories as those from the PHUS records (63%, the sum of all cells in the diagonal, versus 73% in Panel A). Furthermore, the proportion of respondents that seem to have under-reported gross benefits (cells above the diagonal) substantially increased to 28.3% (versus 16.3% in Panel A). Finally, the proportion of respondents that over-reported benefits (cells below the diagonal, Panel B) decreased to 9.0% (versus 10.7% in Panel A); i.e., they reported benefits that are much greater than the gross benefits in the payment records. In sum, these findings suggest again that majority of respondents reported net benefit, consistent with the question asked in the HRS, and not gross benefits.
In Table 4 we examine the univariate distribution of the HRS reported benefits (col. 1) and of the net and gross benefits (cols 2 and 3, respectively) from the administrative payment records. Columns 4 and 5 report distributions of the difference between the survey- and PHUS-reported benefits measured at the individual level, whereas columns 6 and 7 show the distribution of the absolute difference relative to the amount of benefits in the PHUS record. Column 8 shows the distribution of Medicare premium as reported in the payment records.
Table 4 indicates that, throughout the distribution except in the 90
Distribution of the absolute and relative difference between self-reported and PHUS annual Social Security benefits, among respondents with a match aged 65 and over
Distribution of the absolute and relative difference between self-reported and PHUS annual Social Security benefits, among respondents with a match aged 65 and over
Notes: Authors’ calculations using data from the 2012 wave of the Health and Retirement Study (RAND-HRS user-friendly data file version P) matched with administrative data from the Social Security benefit records – the Payment History Update System (PHUS). The amount of self-reported benefits is from the RAND data file. Sample consists of respondents aged at least 65 and one month old at the beginning of the interview and with a match to their PHUS payment records in 2012. Numbers may not add to 100% due to rounding. Estimates are weighted using respondents weight from the 2012 interview. Reported numbers of observations are unweighted.
Sample distribution of the annual amount of Medicare premium in 2012, among respondents with a match aged 65 and over, by type of health insurance coverage
Notes: Authors’ calculations using data from the 2012 wave of the Health and Retirement Study (RAND-HRS user-friendly data file version P) matched with administrative data from the Social Security benefit records – the Payment History Update System (PHUS). The Medicare premium is from the PHUS file for year 2012. Sample consists of respondents aged at least 65 and one month old at the beginning of the interview and with a match to their PHUS payment records in 2012. Numbers may not add to 100% due to rounding. Estimated percentages are weighted using respondents weight from the 2012 interview whereas reported numbers of observations are unweighted. Due to unweighted sample sizes (in Total N row) the simple calculation of the overall proportion of people covered by Medicare, Medicare part B, and Medicaid in this table may slightly differ from weighted proportions reported in Table1.
How different are the survey-reported benefits from the benefits actually paid? For each respondent, we calculate the absolute difference between the annual self-reported benefits and the annual net and gross benefits in the payment records. Table 5a, Panel A, reveals that the distribution of the differences between the self-reported and net benefits is less dispersed (or smaller differences) than when it is compared to the gross benefit amounts (direct payment plus Medicare premium). Thus, for about 63% of respondents (col. 1), the absolute net difference of annual benefits is less than $1,101, or a difference of less than 100 dollars per month. In contrast, for only about 25% of respondents, the absolute gross difference is less than $1,101, whereas for the remaining (about 75%), the difference is greater than that (col. 3).
Another way to gauge the difference between self-reported and true Social Security benefits is to look at the distribution of the relative difference – the ratio of the absolute difference to the benefit amounts in the payment records – separately for net and gross benefits. The relative difference is within 5% of the true net benefits for about 53% of respondents (Panel B, col. 1), compared to only 20% of respondents when using gross benefits (Panel B, col. 3).12 Nevertheless, for a substantial proportion of respondents (22% and 25%, respectively in cols 1 and 3), reported benefits differ from the true net or gross benefits by more than 25%. To summarize, these findings show that the majority of respondents report quite accurately the net amount of Social Security benefits received.
Table 5b, Panel A, shows the distribution of the annual amount of Medicare premiums deducted from the benefits in 2012 according to the payment records for the overall sample and separate subgroups, by premium level categories. In 2012, the standard Part B premium for most beneficiaries was $99.90 (Panel B) totaling to an annual amount of about $1,200 [18]. Depending on the beneficiary’s income level and filing status, the monthly premium increases to $139.9 (Level 1), $199.90 (Level 2), $259.70 (Level 3) and to $319.70 (Level 4). We use these monthly premium levels to create the annual categories in Panel A. About 20% of the overall sample paid zero Medicare premium in 2012 according to the payment records, whereas about 7% paid an annual amount of less than $1,100 (Panel A, col. 1). Note that annual premiums of less than $1,100 may be due to partial year of receipt of Social Security benefits and of Medicare Part B coverage. The majority of the sample (about 58%) had annual payments between $1,101 and $1,200, i.e., they paid the standard monthly premium in 2012. Of the remaining sample, 10% paid between $1,201 and $1,680 annually in Medicare premiums or around $139.9 per month (Level 1), whereas only 5% of respondents paid annual Medicare premiums of above $1,681 or more than $140 per month. A similar pattern occurs among respondents who self-reported Medicare coverage (col. 3).
Mean and median values of the net and the gross difference between respondents- and PHUS-reported Social Security benefits, of the Medicare premiums, and the sample distribution by Medicare premium paid in 2012, among respondents with a match aged 65 and over, by selected characteristics
Mean and median values of the net and the gross difference between respondents- and PHUS-reported Social Security benefits, of the Medicare premiums, and the sample distribution by Medicare premium paid in 2012, among respondents with a match aged 65 and over, by selected characteristics
Notes: Authors’ calculations using data from the 2012 wave of the Health and Retirement Study (RAND-HRS user-friendly data file version P) matched with administrative data from Social Security benefit records – the Payment History Update System (PHUS). All selected characteristics in this table come from the RAND data file. Sample consists of respondents aged at least 65 and one month old at the beginning of the interview and with a match to their PHUS payment records in 2012. Estimates are weighted using respondents weight from the 2012 interview. Reported number of observations is unweighted.
Among those who report coverage by Medicare Part B (col. 5), a majority (69%; 6.3%
Distribution of poverty status in 2012 according to the RAND-HRS poverty measure and according to our adjusted measure of poverty, among respondents aged 65 and over, by match status
Notes: Authors’ calculations using data from the 2012 wave of the Health and Retirement Study (RAND-HRS user-friendly data file version P) matched with administrative data from the Social Security benefit records – the Payment History Update System (PHUS). Sample consists of respondents aged at least 65 and one month old at the beginning of the interview. Estimates are weighted using respondents weight from the 2012 interview. Cell proportions may not add to 100% due to rounding. Reported numbers of observations are unweighted.
Both the gross and the net differences between the survey-reported and the true benefits in payment records vary by socio-economic and demographic characteristics (Table 6). At the median, the underreporting of the net Social Security benefits varies little by demographic characteristics (col. 2). In contrast, at the mean (col. 1), the magnitude of underreporting of net benefits is greater than the overall sample mean (of
In Table 6, columns 7 to 9 provide the distribution of the sample, and of each subgroup, by levels of Medicare premiums paid in 2012. Overall, 20% of the sample paid no Medicare premiums in 2012, whereas 65% paid the standard monthly amount of about $99.90, and only 15% paid more than that. There are substantial differences by demographic characteristics in terms of the proportion that pays nothing in Medicare premiums and the portion that pays more than the standard amount. As expected, the demographic subgroups that were more likely to have paid Medicare premiums above the standard amount are college graduates, those with income four times above the poverty threshold, and those with household income and wealth in the highest quintiles.
As the findings above show, a majority of the elderly accurately reported their net Social Security benefits. Hence, the HRS does a good job in measuring the net Social Security benefits, while at the same time it does not measure the gross amount of benefits. Consequently, two measures – the Social Security (OASI) benefit and the total household income – are underestimated in the HRS, suggesting that estimates that utilize these two variables, such as poverty rate and reliance on Social Security benefits, are likely inaccurate.
First, we assess the impact of underreporting of gross Social Security benefits on the elderly poverty rate. Table 7 presents the cross-distribution of poverty under two different poverty classifications, for the whole sample of elderly respondents and separately for those with and without a match to the administrative payment records. The rows of the table classify respondents by the poverty status measure available in the RAND-HRS data file (which uses self-reported net Social Security benefits). The columns classify respondents by a poverty measure that we calculated after adjusting the total household income to reflect gross Social Security benefits and potential withdrawals from the IRA accounts, while using the same poverty threshold for each family composition as the one in the RAND-HRS file. The key poverty categories – less than 1.0 and 1.0–1.99 – identify those in poverty and those near poverty, respectively. About 9.6% of elderly respondents are classified as being in poverty according to the RAND variable (row 1, col. 5). However, when using the adjusted income measure, the proportion of elderly in poverty decreases to 7.9% (row 5, col. 1), and the proportion of those near poverty decreases from 21.1% (row 2, col. 5) to 18.6% (row 5, col. 2). Thus, overall, proportion of those in poverty or near poverty decreases by about 4 percentage points. Similar patterns are evident when looking at the sample of respondents with and without a match (similar tabulations by marital and Medicaid coverage status are available upon request from the authors).
Proportion of respondents residing in families with at least 50% and at least 90% of family income from Social Security benefits, in 2012
Proportion of respondents residing in families with at least 50% and at least 90% of family income from Social Security benefits, in 2012
Notes: Authors’ calculations using data from the 2012 wave of the Health and Retirement Study (RAND-HRS user-friendly data file version P) matched with administrative data from the Social Security benefit records – the Payment History Update System (PHUS). Sample consists of respondents aged at least 65 and one month old at the beginning of the interview. Estimates are weighted using respondents weight from the 2012 interview. Reported numbers of observations are unweighted.
Next, in Table 8 we provide estimates of the proportion of elderly respondents with at least 50% and at least 90% of their family income coming from Social Security (similar estimates by selected socio-economic characteristics are available upon request by the authors). To assess the impact of underreporting of gross Social Security benefits, we contrast the estimates using survey-reported measures (based on net Social Security benefits and total household income) with estimates based on our adjusted measure of household income (which includes gross amount of Social Security benefits and withdrawals from retirement accounts). Row 1 shows that, when using survey-reported income measures, 50.8% of elderly respondents receive at least 50% of their family income from Social Security, whereas 21.1% receive at least 90% of their income from Social Security. When we adjust household income to include potential withdrawals from retirement accounts, the respective proportions decrease to 47.4% and 17.6% (row 2).
In row 3, we report estimates where, in addition to the adjustment for withdrawals from retirement accounts (as in row 2), we also correct both the numerator (household Social Security benefits) and the denominator (total household income) to reflect the gross amount of Social Security benefits received by respondents and their spouses if married. Because this correction is similar in the numerator and denominator, we do not expect a substantial change in the proportion of respondents with at least 50% and 90% of their income from Social Security (rows 3 vs. 2). However, the estimates in row 3 are the most accurate estimates of the reliance on Social Security benefits among people aged 65 and over.
Compared to survey reported measures (row 1), after adjusting for the gross amount of Social Security benefits and income from retirement accounts, the overall proportion of elderly relying on Social Security income for 50% or more and 90% or more of their household income decreases by about 3–4 percentage points to 47.3% and 17.1% (row 3), respectively.13 Finally, for people with matched records reliance on Social Security is even lower, by 3–4 percentage points (row 4 vs. row 3). Note that the observed differences in estimates, between the two subgroups in Table 7 and the last two rows in Table 8, reflect the differences in observable characteristics between respondents with and without a match to payment records.
In sum, these findings confirm that measurement issues regarding Social Security income and household income in the HRS produce upwardly biased estimates of the elderly poverty rate and of their reliance on Social Security. It is worth noting, however, that even after our adjustments, about half of elderly respondents rely on Social Security benefits for at least 50% of their family income.
Social Security benefits are the most important source of income for a considerable proportion of the elderly population. Thus, it is important for policy makers to have accurate estimates of income security and wellbeing for elderly beneficiaries. Commonly, such estimates are based on survey reports, which are subject to measurement and/or reporting errors. In this paper, we examine the extent and the magnitude of reporting accuracy of Social Security benefits in the HRS and the implications of errors on estimates of the poverty rate among the elderly and their reliance on Social Security income.
Our findings indicate that, consistent with the question asked, 73% of HRS respondents reported the net amount of Social Security benefits they received (excluding Medicare premium). At the mean, the self-reported benefits and the net benefits in the administrative payment records are not statistically significantly different, indicating that the majority of respondents are accurate about their net benefits. In contrast, the mean difference between the self-reported and the gross benefits in the payment records is statistically significant and almost equal to the mean Medicare premium, another indication that people report net benefits and not their gross benefits. Still, about 22% of respondents misreported their annual Social Security benefits by more than 25% (or by more than $2,400) as compared to their net benefits in the payment records. Findings also reveal that, due to the downward bias of the gross Social Security benefits and exclusion of IRA distributions, proportions of elderly respondents that are poor or nearly poor and estimates of their reliance on Social Security benefits, are biased upward by about 2 to 4 percentage points. Importantly, even after our correction of Social Security income that includes Medicare premiums and withdrawals from retirement accounts, for about half of elderly respondents in our sample, Social Security benefits remain a significant income source, comprising 50% or more of their family income.
Given the differences in observable characteristics between respondents with and without a match to the payment records, it is worth noting that the magnitude of reporting accuracy of Social Security benefits among those with a match may not necessarily apply to those without a match. Since respondents in the latter group are more likely to be poor or near poor, and have lower income, they would be more likely to have their Medicare premium paid by Medicaid. Therefore, their gross benefit amount may not differ from their net benefits, so their reliance on Social Security and their poverty rate are less likely to be affected by the omission of Medicare premium.
There are alternative ways to adjust survey-reported net Social Security benefits in the HRS so that a variable of the gross amount of Social Security benefits is also available in the public file for data users. However, the simplest way that we would recommend is to correct the survey-reported net Social Security benefits for respondents (and their spouse if married) who are aged 65 and over and who do not report Medicaid coverage, by just adding the standard (or when available the self-reported) amount of Medicare premiums to the self-reported benefit amount for the respective year. Once the Social Security income variable for both the respondent and the spouse is adjusted, then the total household income and poverty measures available in the RAND-HRS public file also need to be adjusted and made available in the public file.
Footnotes
Due to lack of publicly available documentation, we have no way of knowing about the method the Census Bureau used to impute the Medicare premiums in the CPS public data.
The RAND HRS user-friendly public data file (version P used here, available at
Because respondents are asked about Social Security benefits received last month, we condition the sample to those aged at least 65 and one month old at the beginning of the interview, so that the benefit amount reported corresponds to the month after respondent reached age 65. In the remainder of the paper, we interchangeably use “65 and over” to refer to the sample aged at least 65 and one month old.
Part C and Part D premiums may also be deducted from the Social Security payment, but beneficiaries have to notify their insurance and/or prescription drug plan if they want the premiums to be deducted from their monthly Social Security payments. However, in the administrative records the field that contains the amount of Medicare premiums does not indicates whether Parts C and D premiums are also deducted from gross benefits.
For the remainder of this paper we use the terms PHUS records and payment records interchangeably.
For each respondent (and spouse, if married), the monthly Social Security benefits are annualized and made available in the RAND-HRS file. Since the annual amount of benefit is derived from the self-reported monthly benefits and the number of months the respondent report receiving such benefits in the given year, we refer to this annual amount of benefits as self-reported amount.
This sample also includes those respondents interviewed in January of 2013 since they reported the amount of benefit received in the last month (i.e., in December 2012).
Poverty rate is the ratio of total family income to poverty threshold for each Census defined family composition. Reliance on Social Security benefits is the ratio of household income from Social Security to total household income.
Beginning with the 2015 Current Population Survey, the U.S. Census Bureau measures these distributions as pension income and includes them in the official estimates of poverty and income [12,
].
To put it into context, for a person receiving, for example, a monthly benefit of $1,000 (or 12,000 annually), the 5% relative difference would mean an error of $50 per month (or $600 annually).
To test the sensitivity of these results, we applied an alternative adjustment to gross Social Security benefits to the one in row 3, where for the subset of respondents without a match to PHUS records and who reported coverage under Medicaid we assigned a zero Part B Medicare premium. Our estimates show that, at the mean, results were similar to those in row 3. Alternative estimations based only on adjustments of Social Security benefits and excluding the IRA withdrawals, revealed similar results to those in row 1. These estimates are available upon request from the authors.
Acknowledgments
The opinions and conclusions expressed herein are solely those of the authors and do not necessarily representing the opinions or policy of the Social Security Administration or any agency of the Federal Government. We thank David Weir and Susann Rohwedder for helpful comments. All errors are our own.
