The Institute of Medicine proposed recently that, while current pay for performance measures should target multiple dimensions of care, including measures of technical quality, they should transition toward longitudinal and health-outcome measures across systems of care. This article describes the development of the Diabetes Epidemiology Cohorts (DEpiC), which facilitates evaluation of intermediate “quality of care” outcomes and surveillance of adverse outcomes for veterans with diabetes served by the Veterans Health Administration (VHA) over multiple years.
Methods:
The Diabetes Epidemiology Cohorts is a longitudinal research database containing records for all diabetes patients in the VHA since 1998. It is constructed using data from a variety of national computerized data files in the VHA (including medical encounters, prescriptions, laboratory tests, and mortality files), Medicare claims data for VHA patients, and large patient surveys conducted by the VHA. Rigorous methodology is applied in linking and processing data into longitudinal patient records to assure data quality.
Results:
Validity is demonstrated in the construction of the DEpiC. Adjusted comparisons of disease prevalence with general population estimates are made. Further analyses of intermediate outcomes of care demonstrate the utility of the database. In the first example, using growth curve models, we demonstrated that hemoglobin A1c trends exhibit marked seasonality and that serial cross-sectional outcomes overestimate the improvement in population A1c levels compared to longitudinal cohort evaluation. In the second example, the use of individual level data enabled the mapping of regional performance in amputation prevention into four quadrants using calculated observed to expected major and minor amputation rates. Simultaneous evaluation of outliers in all categories of amputation may improve the oversight of foot care surveillance programs.
Conclusions:
The use of linked, patient level longitudinal data resolves confounding case mix issues inherent in the use of serial cross-sectional data. Policy makers should be aware of the limitations of cross-sectional data and should make use of longitudinal patient databases to evaluate clinical outcomes.
National Center for Chronic Disease Prevention and Health Promotion. National Diabetes Surveillance System [cited 2007 Nov 4]. Available from: http://www.cdc.gov/diabetes/statistics/index.htm.
2.
HoganPDallTNikolovP; American Diabetes Association. Economic costs of diabetes in the US in 2002. Diabetes Care. 2003; 26: 917–32.
Diabetes Control and Complications Trial Research Group. The effect of intensive treatment of diabetes on the development and progression of long-term complications in insulin-dependent diabetes mellitus. N Engl J Med. 1993; 329 (14): 977–86.
5.
UK Prospective Diabetes Study (UKPDS) Group. Intensive blood-glucose control with sulphonylureas or insulin compared with conventional treatment and risk of complications in patients with type 2 diabetes (UKPDS 33). Lancet. 1998; 352: 837–53.
6.
Heart Outcomes Prevention Evaluation Study Investigators. Effects of ramipril on cardiovascular and microvascular outcomes in people with diabetes mellitus: results of the HOPE study and MICRO-HOPE substudy. Lancet. 2000; 355 (9200): 253–9.
7.
CollinsRArmitageJParishSSleighPPetoR; Heart Protection Study Collaborative Group. MRC/BHF Heart Protection Study of cholesterol-lowering with simvastatin in 5963 people with diabetes: a randomised placebo-controlled trial. Lancet. 2003; 361 (9374): 2005–16.
Recommended Starter Set: Clinical Performance Measures for Ambulatory Care. Agency for Healthcare Rearch and Quality [cited 2007 Nov 4]. Available from: http://www.ahrq.gov/qual/aqastart.pdf.
SaaddineJBCadwellBGreggEWEngelgauMMVinicorFImperatoreGNarayanKM. Improvements in diabetes processes of care and intermediate outcomes: United States, 1988–2002. Ann Intern Med. 2006; 144 (7): 465–74.
15.
ShwartzMPekozEAAshASPosnerMARestucciaJDIezzoniLI. Do variations in disease prevalence limit the usefulness of population-based hospitalization rates for studying variations in hospital admissions?. Med Care. 2005; 43 (1): 4–11.
16.
O'ConnorPJDesaiJSolbergLIRegerLACrainALAscheSEPearsonTLClarkCKRushWACherneyLMSperl-HillenJMBishopDB. Randomized trial of quality improvement intervention to improve diabetes care in primary care settings. Diabetes Care. 2005; 28 (8): 1890–7.
FisherES. Paying for performance—risks and recommendations. N Engl J Med. 2006; 355 (18): 1845–7.
19.
KreinSLHaywardRAPogachLBootsMillerBJ. Department of Veterans Affairs' Quality Enhancement Research Initiative for Diabetes Mellitus. Med Care. 200038 (6 Suppl 1): I38–48.
20.
KupersmithJFrancisJKerrEPogachLKolodnerRPerlinJ. Advancing evidence-based care in diabetes through health information technology: lessons from the Veterans Health Administration. Health Aff (Millwood). 2007; 26 (2): w156–68.
21.
ShenYHendricksAZhangSKazisLE. VHA enrollees' health care coverage and use of care. Med Care Res Rev. 2003; 60 (2): 253–67.
22.
MillerDRSaffordMMPogachLM. Who has diabetes? Best estimates of diabetes prevalence in the Veterans Health Administration based on computerized patient data. Diabetes Care. 2004: 27Suppl 2: B10–21.
23.
HelmerDATsengCLBrimacombeMRajanMStiptzarovNPogachL. Applying diabetes-related Prevention Quality Indicators to a national cohort of veterans with diabetes. Diabetes Care. 2003; 26 (11): 3017–23.
24.
SaffordMEatonLHawleyGBrimacombeMRajanMLiHPogachL. Disparities in use of lipid lowering medications among people with diabetes. Arch Intern Med. 2003; 28;163(8): 922–8.
25.
TsengCLRajanMMillerDRHawleyGCrystalSXieMTiwariASaffordMPogachL. Use of administrative data to risk adjust amputation rates in a national cohort of medicare-enrolled veterans with diabetes. Med Care. 2005; 43 (1): 88–92.
26.
TsengCLGreenbergJDHelmerDRajanMTiwariAMillerDCrystalSHawleyGPogachL. Dual-system utilization affects regional variation in prevention quality indicators: the case of amputations among veterans with diabetes. Am J Manag Care. 2004; 10 (11 Pt 2): 886–92.
27.
TsengCLBrimacombeMXieMRajanMWangHKolassaJCrystalSChenTCPogachLSaffordM. Seasonal patterns in monthly A1c values. Am J Epidemiol. 2005; 161 (6): 565–74.
28.
FrayneSMHalanychJMillerDRLinHWangFPogachLSharkanskyEJKeaneTSkinnerKMRosenCSBerlowitzDR. Disparities in diabetes care: impact of mental illness. Arch Intern Med. 2005; 165 (22): 2631–8.
29.
PogachLXieMShentueYTsengCLManeyMRajanMTiwariAKolassaJHelmerDCrystalSSaffordM. Diabetes healthcare quality report cards: how accurate are the grades?. Am J Manag Care. 2005; 11: 797–804.
30.
ThompsonWWangHXieMKolassaJRajanMTsengCLZhangQVardiVPogachLSaffordMM. Assessing quality of diabetes care by measuring longitudinal changes in hemoglobin A1c in the Veterans Health Administration. Health Serv Res. 2005; 40: 1818–35.
31.
GreenbergJDTiwariARajanMMillerDNatarajanSPogachL. Determinants of sustained uncontrolled blood pressure in a national cohort of persons with diabetes. Am J Hypertens. 2006; 19 (2): 161–9.
32.
KernEFManeyMMillerDRTsengCLTiwariARajanMAronDPogachL. Failure of ICD-9-CM codes to identify patients with comorbid chronic kidney disease in diabetes. Health Serv Res. 2006: 41 (2): 564–80.
33.
TsengCSambamoorthiUTiwariARajanMFrayneSFindleyPPogachL. Are there gender differences in diabetes care among veterans?. J Gen Intern Med. 2006; 21Suppl 3: S47–53.
34.
HalanychJHWangFMillerDRPogachLMLinHBerlowitzDRFrayneSM. Racial/ethnic differences in diabetes care for older veterans: accounting for dual health system use changes conclusions. Med Care. 2006; 44 (5): 439–45.
35.
SambamoorthiUTsengCLRajanMAnjaliTFindleyPAPogachL. Initial nontraumatic lower extremity amputations among veterans with diabetes. Med Care. 2006; 44 (8): 779–87.
36.
TsengCLSambamoorthiUTiwariARajanMFindleyPPogachL. Diabetes care among veteran women with disability. Womens Health Issues. 2006; 16 (6): 361–71.
37.
ManeyMTsengCLSaffordMMillerDPogachL. Impact of self-reported patient characteristics upon assessment of glycemic control in the Veterans Health Administration. Diabetes Care. 2007; 30 (2): 245–51.
38.
TiwariATsengCLKernEFManeyMMillerDRPogachL. Facility variation in utilization of angiotensin-converting enzyme inhibitors and angiotensin II receptor blockers in patients with diabetes mellitus and chronic kidney disease. Am J Manag Care. 2007; 13 (2): 73–9.
39.
PogachLMTiwariAManeyMRajanMMillerDRAronDC. Should mitigating comorbidities be considered in assessing healthcare plan performance in achieving optimal glycemic control. Am J Manag Care. 2007; 13 (3): 133–40.
40.
ZhangQSaffordMMillerDCrystalSRajanMTsengCLPogachL. Short term statin exposure is associated with reduced all-cause mortality in persons with diabetes. Med Care. 2007; 45 (4): 308–14.
41.
KahlerKHRajanMRhoadsGGSaffordMMDemissieKLuSEPogachLM. Impact of oral antihyperglycemic therapy on all-cause mortality among patients with diabetes in the Veterans Health Administration. Diabetes Care. 2007; 30 (7): 1689–93.
42.
TsengCLHelmerDRajanMTiwariAMillerDCrystalSSaffordMGreenbergJPogachL. Evaluation of regional variation in total, major, and minor amputation rates in a national health-care system. Int J Qual Health Care. 2007 Dec; 19 (6): 368–76.
43.
SohnMWArnoldNMaynardCHynesDM. Accuracy and completeness of mortality data in the Department of Veterans Affairs. Popul Health Metr. 2006 Apr 10; 4: 2.
44.
SohnMWZhangHArnoldNStroupeKTaylorBCWiltTJHynesDM. Transition to the new race/ethnicity data collection standards in the Department of Veterans Affairs. Popul Health Metr. 2006 Jul 6; 4: 7.
45.
KerrEASmithDMHoganMHKreinSLPogachLHoferTPHaywardRA. Comparing clinical automated, medical record, and hybrid data sources for diabetes quality measures. Jt Comm J Qual Improv. 2002; 28: 555–65.
46.
RosenstockJDaileyGMassi-BenedettiMFritscheALinZSalzmanA. Reduced hypoglycemia risk with insulin glargine: a meta-analysis comparing insulin glargine with human NPH insulin in type 2 diabetes. Diabetes Care. 2005; 28 (4): 950–5.
47.
SawinCTWalderDJBrossDSPogachLM. Diabetes process and outcome measures in the Department of Veterans Affairs. Diabetes Care. 2004; 27Suppl 2: B90–4.
ReiberGEBoykoEJSmithDG. Lower extremity foot ulcers and amputations in diabetes. In: National Diabetes Data Group, editors. Diabetes in America. Washington, DC: U.S. Govt. Printing Office; 1995. p. 409–28.
NicolucciAGreenfieldSMattkeS. Selecting indicators for the quality of diabetes care at the health systems level in OECD countries. Int J Qual Health Care. 2006; 18Suppl 1: 26–30.
53.
Center for Organization and Delivery Studies, Agency for Healthcare Research and Quality, Rockville, Maryland. Epidemiology and Statistics Br, Div of Diabetes Translation, National Center for Chronic Disease Prevention and Health Promotion, CDC. Hospital discharge rates for nontraumatic lower extremity amputation by diabetes status—United States, 1997 [cited 2007 Nov 4]. Available from: http://www.cdc.gov/mmwr/preview/mmwrhtml/mm5043a3.htm.
54.
PogachLCharnsMPWrobelJSRobbinsJMBonackerKMHaasLReiberGE. Impact of policies and performance measurement upon the development of organizational coordinating strategies for chronic care delivery. Am J Manag Care. 2004; 10: 171–80.
55.
JeffcoateWJvan HoutumWH. Amputation as a marker of the quality of foot care in diabetes. Diabetologia. 2004; 47 (12): 2051–8.
56.
WrobelJSCharnsMPBonackerKMReiberGEPogachL. Diabetes-related foot care at 10 Veterans Affairs medical centers: must do's associated with successful microsystems. Jt Comm J Qual Patient Saf. 2006; 32 (4): 206–13.
57.
WrobelJSCharnsMPDiehrPRobbinsJMReiberGEBonackerKMHaasLBPogachL. The relationship between provider coordination and diabetes-related foot outcomes. Diabetes Care. 2003; 26 (11): 3042–7.
58.
Centers for Disease Control and Prevention (CDC). Prevalence of diabetes and impaired fasting glucose in adults—United States, 1999–2000. MMWR Morb Mortal Wkly Rep. 2003 Sep 5; 52 (35): 833–7.
