A robust set of quality measures is essential to provide consumers with a vehicleto evaluate nurses' contributions to the care of hospitalized patients, providers, and systems with a set of nursing processes and outcomes to guide quality improvement, and insurers with indicators to reward hospitals for high quality nursing services. The processes employed by the Nursing Care Performance Measures Steering Committee convened by the National Quality Forum (NQF) in 2004 resulted in the endorsement of 15 indicators of health care quality influenced by nurses and contributed to the identification of significant gaps in measurement and priority areas for future research. This critical review of the state of the science related to health care processes and outcomes that reflect nurses' contributions to the quality of care for hospitalized patients is intended to push the boundaries in the measurement of nursing performance. Specific recommendations for future research and measure development are presented.
AHRQ Quality Indicators—Guide to Patient Safety Indicators, Revision 1. 2003. AHRQ Pub.03-R203. AHRQ Pub.03-R203. Rockville, MD: Agency for Health care Research and Quality. http://www.premierinc.com/all/safety/resources/guidelines/downloads/ahrq-guide-pat-safe-indicators-rev01-05-28-04.pdf (accessed January 23, 2005).
2.
Aiken, L.H., S.P. Clarke, R.B. Cheung, D.M. Sloane, and J.H. Silber.2003. Educational levels of hospital nurses and surgical patient mortality. JAMA290 (12): 1617-1623.
3.
Aiken, L.H., S.P. Clarke, D.M. Sloane, J. Sochalski, and J.H. Silber.2002. Hospital nurse staffing and patient mortality, nurse burnout, and job dissatisfaction. JAMA288 (16): 1987-1993.
4.
Aiken, L.H., H.L. Smith, and E.T. Lake.1994. Lower Medicare mortality among a set of hospitals known for good nursing care. Medical Care32: 771-787.
5.
American Nurses Association.1999. Nursing-Sensitive Quality Indicators for Acute Care Settings and ANA's Safety and Quality Initiative. Washington, DC: ANA. http://www.nursingworld.org/readroom/fssafe99.htm .
6.
Anderson, M.A., and L.B. Helms.1995. Communication between continuing care organizations. Research in Nursing &Health18 (1): 49-57.
7.
Blegen, M.A., T.E. Vaughn, and C.J. Goode.2001. Nurse experience and education: Effect on quality of care. The Journal of Nursing Administration31 (1): 33-39.
8.
Birkmeyer, J.D., E.A. Kerr, and J.B. Dimick.2005. Improving the quality of quality measurement . In Pathways to quality health care: Performance measurement , Washington, DC: National Academies Press.
9.
Bogardus, S.T., Jr., M.M. Desai, C.S. Williams, L. Leo-Summers, D. Acampora, and S.K. Inouye.2003. The effects of a targeted multicomponent delirium intervention on post-discharge outcomes for hospitalized older adults . American Journal of Medicine114: 383-390.
10.
Bourbonniere, M., N.E. Strumpf, L.K. Evans, and G. Maislin.2003. Organizational characteristics and restraint use for hospitalized nursing home residents. Journal of the American Geriatrics Society51 (8): 1079-1084.
11.
Bucknall, T.2003. Review: Several interventions prevent ventilator associated pneumonia (VAP) in critically ill patients. Evidence-Based Nursing6 (4): 112.
12.
California HealthCare Foundation.2004. What patients think of California hospitals. Oakland: CHCF. California Nursing Outcomes Coalition.2004. Data submitted to National Quality Forum .
13.
Capezuti, E., N.E. Strumpf, L.K. Evans, J.A. Grisso, and G. Maislin.1998. The relationship between physical restraint removal and falls and injuries among nursing home residents. The Journals of Gerontology. Series A, Biological Sciences and MedicalSciences53 (1): M47-M52.
14.
Castle, N.G.2002. Nursing homes with persistent deficiency citations for physical restraint use. Medical Care40: 851-852.
15.
Centers for Disease Control and Prevention. National Center for Chronic Disease Control and Prevention.2004. Reducing tobacco use. http://www.cdc.gov/nccdphp/bb_tobacco/index.htm (accessed January 26, 2005).
16.
Centers for Disease Control and Prevention. National Nosocomial Infections Surveillance (NNIS) System Report.Data Summary from January 1992-June 2001, issued August 2001. www.cdc.gov/ncidod/hip/NNIS/2001nnis_report_accessible.pdf (accessed February 1, 2005).
17.
Chang, V.T., S.S. Hwang, and M. Feuerman.2000. Validation of the Edmonton Symptom Assessment Scale (ESAS). Cancer88: 2164-2171.
18.
Cho, S.H., S. Ketefian, V.H. Barkauskas, and D.G. Smith.2003. The effects of nurse staffing on adverse events, morbidity, mortality, and medical costs. Nursing Research52 (2): 71-79.
19.
Coleman, E.A., J.D. Smith, T.B. Eilertsen, J.C. Frank, J.N. Thiare, and A.M. Kramer.2002. Development and testing of a measure designed to assess the quality of care transitions. International Journal of Care Integration, 2. http://www.ijic.org (accessed February 21, 2005).
20.
Collard, H.R., S. Saint, and M.A. Matthay.2003. Prevention of ventilator-associated pneumonia: An evidence-based systematic review. Annals of Internal Medicine138 (6): 494-501, I-67.
21.
The Commonwealth Fund.2005. Quality Matters: January Update from The Commonwealth Fund. News Briefs. http://www.cmwf.org/publications (accessed February 1, 2005).
22.
Coopersmith, C.M., T.L. Rebmann, J.E. Zack, M.R. Ward, R.M. Corcoran, and M.E. Shallom.2002. Effect of an education program on decreasing catheter-related bloodstream infections in the surgical intensive care unit . Critical Care Medicine30 (1): 59-64.
23.
Cunliffe, P.J., and T.N. Fawcett.2002. Wound cleansing: The evidence for the techniques and solutions used. Professional Nurse18 (2): 95-99.
24.
Donat, D.C.2002. Impact of improved staffing on seclusion/restraint reliance in a public psychiatric hospital. Psychiatric Rehabilitation Journal25:413-416.
25.
Doraiswamy, P.M., J. Leon, J.L. Cummings, D. Marin, and P.J. Newmann.2002. Prevalence and impact of medical comorbidity in Alzheimer's disease. Journals of Gerontology. Series A: Biological Sciences & MedicalSciences57A (2): M173-M177.
26.
Doran, D.I., S. Sidani, M. Keatings, and D. Doidge.2002. An empirical test of the nursing role effectiveness model. Journal of Advanced Nursing38 (1): 29-39.
27.
Estabrooks, C.A., W.K. Midodzi, G.G. Cummings, K.L. Ricker, and P. Giovannetti.2005. The impact of hospital nursing characteristics on 30-day mortality. Nursing Research54 (2): 74-83.
28.
Edwards, M.M.1990. The reliability and validity of self-report activities of daily living scales. Canadian Journal of Occupational Therapy57 (5): 273-278.
29.
Eggimann, P., H. Sax, and D. Pittet.2004. Catheter-related infections. Microbes andInfection6 (11): 1033-1042.
30.
Fein, A.M.1994. Pneumonia in the elderly: Special diagnostic and therapeutic considerations. Medical Clinics of NorthAmerica78 (5): 1015-1033.
31.
Fick, D., and M. Foreman.2000. Consequences of not recognizing delirium superimposed on dementia in hospitalized elderly individuals. Journal ofGerontological Nursing26 (1): 30-40.
32.
Fiore, M.C., W.C. Bailey, S.J. Cohen, S.F. Dorfman, M.G. Goldstein, and E.R. Gritz.2000. Treating tobacco use and dependence. (Clinical practice guideline). Rockville, MD: U.S. Department of Health and Human Services. Public Health Service. June. http://www.surgeongeneral.gov/tobacco/treating_tobacco_use.pdf (accessed January 23, 2005).
33.
Foreman, M.D.1993. Acute confusion in the elderly. Annual Review of Nursing Research11: 3-30. Francis, J.1992. Delusions, delirium, and cognitive impairment: The challenge of clinical heterogeneity . Journal of the American Geriatrics Society40: 848-849.
34.
Gillick, M.R., N.A. Serrell, and L.S. Gillick.1982. Adverse consequences of hospitalization in the elderly. Social Science and Medicine16: 1033-1038.
35.
Given, B., C.W. Given, R. McCorkle, S. Kozachik, B. Cimprich, and M.H. Rahbar.2002. Pain and fatigue management: Results of a nursing randomized clinical trial. Oncology Nursing Forum29 (6): 949-956.
36.
Given, C., B. Given, M. Rahbar, S. Jeon, R. McCorkle, and B. Cimprich.2004. Does a symptom management intervention affect depression among cancer patients: Results from a clinical trial. Psychooncology13 (11): 818-830.
37.
Goode, C.J., S. Pinkerton, M.P. McCausland, P. Southard, R. Graham, and C. Krsek.2001. Documenting chief nursing officers' preference for BSN-prepared nurses. Journal of Nursing Administration31: 55-59.
38.
Happ, M.B., S.H. Kagan, N.E. Strumpf, L.K. Evans, and E. Sullivan-Marx .2001. Elderly patients' memories of physical restraint use in the intensive care unit. American Journal of Critical Care10 (5): 367-369.
39.
Heidrich, S.M., and C.D. Ryff.1993. Physical and mental health in later life: The self-system as mediator. Psychology and Aging8: 327-338.
40.
Hirsch, C.H., L. Sommers, A. Olsen, L. Mullen, and C.H. Winograd.1990. The natural history of functional morbidity in hospitalized older patients. Journal of the American Geriatrics Society38 (12): 1296-1303.
41.
Hu, K.K., B.A. Lipsky, D.L. Veenstra, and S. Saint.2004. Using maximal sterile barriers to prevent central venous catheter-related infection: A systematic evidence-based review . American Journal of Infection Control32 (3): 142-146.
42.
Inouye, S.K.1994. The dilemma of delirium: Clinical and research controversies regarding diagnosis and evaluation of delirium in hospitalized elderly medical patients. American Journal of Medicine97 (3): 278-288.
43.
————. 1999. Predisposing and precipitating factors for delirium in hospitalized older patients. Dementia and Geriatric Cognitive Disorders10 (5): 393-400.
44.
Inouye, S.K., S.T. Bogardus, D.I. Baker, L. Leo-Summers, and L.M. Cooney, Jr. 2000. The Hospital Elder Life Program: A model of care to prevent cognitive and functional decline in older hospitalized adults . Journal of the American Geriatrics Society48 (12): 1697-1706.
45.
Inouye, S.K., J.T. Rushing, M.D. Foreman, R.M. Palmer, and P. Pompei.1998. Does delirium contribute to poor hospital outcomes? A three-site epidemiologic study. Journal of General Internal Medicine13: 234-242.
46.
Inouye, S.K., M.J. Schlesinger, and T.J. Lydon.1999. Delirium: A symptom of how hospital care is failing older persons and a window to improve quality of hospital care. The American Journal of Medicine106: 565-573.
47.
Inouye, S.K., D.R. Wagner, D. Acampora, R.I. Horwitz, L.M. Cooney, Jr., and M.E. Tinetti .1993. A controlled trial of a nursing-centered intervention in hospitalized elderly medical patients: The Yale Geriatric Care Program. Journal of the American Geriatrics Society41 (12): 1353-1360.
48.
Institute of Medicine. Committee on Quality of Health Care in America.2001. Crossing the quality chasm: A new health system for the 21st century. Washington, DC : National Academy Press.
49.
Institute of Medicine.2002. National priorities for action: Transforming health care quality. Washington, DC: National Academy Press.
50.
Institute of Medicine. Committee on the Work Environment for Nurses and Patient Safety.2003. Keeping patients safe: Transforming the work environment of nurses. Washington, DC: National Academies Press.
51.
Institute of Medicine.2005. Performance Measurement: Accelerating Improvement. Washington, DC: National Academies Press.
52.
Irvine, D., S. Sidani, and L.M. Hall.1998. Linking outcomes to nurses' roles in health care. NursingEconomics16: 58-87.
53.
Janssens, J.-P., and K.-H. Krause.2004. Pneumonia in the very old. Lancet Infectious Diseases4: 112-124.
54.
JCAHO. Joint Commission Public Policy Initiative.2002. Health care at the crossroads, strategies for addressing the evolving nursing crisis. OakBrook Terrace, IL. http://www.aacn.nche.edu/media/pdf/JCAHO8-02.pdf (accessed January 23, 2005).
55.
Jin, Y., K.C. Carriere, G. Predy, D.H. Johnson, and T.J. Marrie.2003. The association between influenza immunization coverage rates and hospitalization for community-acquired pneumonia in Alberta . Canadian Journal of Public Health94 (5): 341-345.
56.
Johnson, J.H.1988. Differences in the performance of baccalaureate, associate degree, and diploma nurses: A meta-analysis. Research in Nursing and Health11 (3): 183-197.
57.
Johnson, E.A., T.S. Harwell, P.M. Donahue, M.A. Weisner, M.J. McInerney, and G.S. Holzman.2003. Promoting pneumoccal immunication among Medicare beneficiaries using multiple strategies. Journal of Rural Health19 (4): 506-510.
58.
Kahn, K., W. Rogers, L. Rubenstein, M. Sherwood, E. Reinisch, and E. Keeler, 1990. Measuring quality of care with explicit process criteria before and after implementation of the DRG-based prospective payment system . JAMA264 (15): 1969-1973.
59.
Katz, S.1983. Assessing self-maintenance: Activities of daily living, mobility, and instrumental activities of daily living. Journal of the American Geriatrics Society37 (12): 721-726.
60.
Kennedy, A.M., A.M. Elward, and V.J. Fraser.2004. Survey of knowledge, beliefs, and practices of neonatal intensive care unit health care workers regarding nosocomial infections, central venous catheter care, and hand hygiene. Infection Control and Hospital Epidemiology25 (9): 747-752.
61.
Kovner, C., and P.J. Gergen.1998. Nurse staffing levels and adverse events following surgery in U.S. hospitals. Image: Journal of Nursing Scholarship30 (4): 315-321.
62.
Kovner, C., C. Jones, C. Zhan, P.J. Gergen, and J. Basu.2002. Nurse staffing and postsurgical adverse events: An analysis of administrative data from a sample of U.S. hospitals, 1990-1996. Health Services Research37 (3): 611-629.
63.
Leape, L., D. Bates, D. Cullen, J. Cooper, H. Demonaco, and T. Gallivan.1995. Systems analysis of adverse drug effects . JAMA274 (1): 35-43.
64.
Lichtig, L.K., R.A. Knauf, and D.K. Milholland .1999. Some impacts of nursing on acute care hospital outcomes. Journal of NursingAdministration29 (2): 25-33.
65.
McCorkle, R., L. Hughes, L. Robinson, B. Levine, and I. Nuamah.1998. Nursing interventions for newly diagnosed older cancer patients facing terminal illness. Journal of Palliative Care14 (3): 39-45.
66.
McCorkle, R., N.E. Strumpf, I.F. Nuamah, D.C. Adler, M.E. Cooley, C. Jepson. E. J. Lusk, and M. Torosion.2000. A specialized home care intervention improves survival among older postsurgical cancer patients. Journal of the American Geriatrics Society48 (12): 1707-1713.
67.
Milisen, K., M.D. Foreman, I.L. Abraham, S. De Geest, J. Godderis, E.B. Vandermeulen, H. Fischler, H. Delooz, B. Spiessens, and P.L. Broos.2001. A nurse-led interdisciplinary intervention program for delirium in elderly hip-fracture patients. Journal of the American Geriatrics Society49 (5): 523-532.
68.
Mion, L.C., J. Fogel, S. Sandhu, R.M. Palmer, A.F. and Minnick, T. Cranston.2001. Outcomes following physical restraint reduction programs in two acute care hospitals. Joint Commission Journal on Quality Improvement27 (11): 606-618.
69.
Mitchell, P., and S.M. Shortell.1997. Adverse outcomes and variations in organization of care delivery. Medical Care35. Suppl. no. 11: NS19-NS32.
70.
National Quality Forum.2004a. National voluntary consensus standards for nursing home care: A consensus report. Washington, DC: NQF. http://www.qualityforum.org/txNursingHomesReportFINALPUBLIC.pdf (accessed January 27, 2005).
71.
National Quality Forum.2004b. National voluntary consensus standards for nursing-sensitive care: An initial performance measure set. A consensus report. Washington, DC: NQF.
72.
National Quality Forum.2006. Nurses educational preparation and patient outcomes in acute care: A case for quality. Washington, DC: NQF .
73.
Nationwide Inpatient Sample (NIS).Health care Cost and Utilization in Project (HCUP). 2003. Rockville, MD: Agency for Health care Research and Quality. July. http://www.ahrq.gov/data/hcup/hcupnis.htm (accessed January 23, 2005).
74.
Naylor, M., D. Brooten, R. Campbell, B. Jacobsen, M. Mezey, M. Pauly, and J. Schwartz.1999. Comprehensive discharge planning and home follow-up of hospitalized elders: A randomized controlled trial. JAMA: 281 (7): 613-620.
75.
Naylor, M.D., D.A. Brooten, R.L. Campbell, G. Maislin, K.M. McCauley, and J.S. Schwartz.2004. Transitional care of older adults hospitalized with heart failure: A randomized, controlled trial. Journal of the American Geriatrics Society52: 675-684.
76.
Naylor, M.D., D. Brooten, R. Jones, R. Lavizzo-Mourey, M. Mezey, and M. Pauly.1994. Comprehensive discharge planning for the hospitalized elderly: A randomized clinical trial. Annals of Internal Medicine120: 999-1006.
77.
Needleman, J., P.I. Buerhaus, S. Mattke, M. Stewart, and K. Zelevinsky.2001. Nurse staffing and patient outcomes in hospitals. final report to US DHHS/HRSA, February 28, 2001. HRSA Report No.:230-99-0021. Boston: Harvard School of Public Health. April. ftp://ftp.hrsa.gov/bhpr/nursing/staffstudy/staffingoutcomes.pdf (accessed January 23, 2005).
78.
Needleman, J., P. Buerhaus, S. Mattke, M. Stewart, and K. Zelevinsky.2002. Nurse staffing levels and the quality of care in hospitals. New England Journal of Medicine346 (22): 1715-1722.
79.
Neufeld, R.R., L.S. Libow, W.J. Foley, J.M. Dunbar, C. Cohen, and B. Breuer.1999. Restraint reduction reduces serious injuries among nursing home residents. Journal of the American Geriatrics Society47 (10): 1202-1207.
80.
O'Keefe, S., and J. Lavan.1997. The prognostic significance of delirium in older hospitalized patients. Journal of the American Geriatrics Society45 (2): 174-178.
81.
Pronovost, P., B. Weast, and M. Schwarz.2003. Medication reconciliation: A practical tool to reduce the risk of medication errors. Journal of Critical Care18 (4): 201-205.
82.
Rice, V.H.1999. Nursing intervention and smoking cessation: A meta-analysis . Heart & Lung28: 438-454.
83.
Rice, V.H., and L.F. Stead.2005. Nursing interventions for smoking cessation . Cochrane Database of Systematic Reviews1.
84.
Rich, M.W., V. Beckham, C. Wittenberg, C.L. Leven, K.E. Freedland, and R.M. Carney.1995. A multidisciplinary intervention to prevent the readmission of elderly patients with congestive heart failure . New England Journal of Medicine333 (18): 1190-1195.
85.
Richards, M.J., J.R. Edwards, D.H. Culver, and R.P. Gaynes.2000. Nosocomial infections in combined medical-surgical intensive care units in the United States. Infection Control and HospitalEpidemiology21 (8): 510-515.
86.
Rizzo, J.A., S.T. Bogardus, Jr., L. Leo-Summers , C.S. Williams, D. Acampora, and S.K. Inouye.2001. Multicomponent targeted interventions to prevent delirium in hospitalized older patients: What is the economic value?Medical Care39 (7): 740-752.
87.
Rothschild, J.M., D.W. Bates, and L.L. Leape.2000. Preventable medical injuries in older patients. Archives ofInternal Medicine160 (18): 2717-2728.
88.
Sasichay-Akkadechanunt T., C.C. Scalzi, and A.F. Jawad.2003. The relationship between nurse staffing and patient outcomes. The Journal of Nursing Administration33 (9): 478-485.
89.
Seal, L.A., and D. Paul-Cheadle .2004. A systems approach to preoperative surgical patient skin preparation. American Journal of Infection Control32 (2): 57-62.
90.
Siderov, J.E., M. Christianson, S. Girolami, and C. Wydra.1997. A successful primary care nurse led tobacco cessation program in a managed care setting. American Journal of Managed Care3: 207-214.
91.
Silber, J.H., P.H. Rosenbaum, and R.N. Ross.1995. Comparing the contributions of groups of predictors: Which outcomes vary with hospital rather than patient characteristics?Journal of the American Statistical Association90: 7-18.
92.
Silber, J.H., S.V. Williams, H. Krakauer, and J.S. Schwartz.1992. Hospital and patient characteristics associated with death after surgery. A study of adverse occurrence and failure to rescue. Medical Care,30 (7): 615-629.
93.
Spratley, E., A. Johnson, J. Sochalski, M. Fritz, and W. Spencer.2000. The registered nurse population: Findings from the National Sample Survey of Registered Nurses. DHHS: Health Resources and Services Administration . http://bhpr.hrsa.gov/healthworkforce/reports/rnsurvey/rnss1.htm (accessed February 22, 2005).
94.
Sullivan-Marx, E.M., N.E. Strumpf, L.K. Evans, M. Baumgarten, and G. Maislin.1999. Predictors of continued physical restraint use in nursing home residents following restraint education efforts. Journal of the American Geriatrics Society47: 342-348.
95.
Swoboda, S.M., K. Earsing, K. Strauss, S. Lane, and P.A. Lipsett.2004. Electronic monitoring and voice prompts improve hand hygiene and decrease nosocomial infections in an intermediate unit. Critical Care Medicine32 (2): 358-363.
96.
Taunton, R.L., S.V. Kleinbeck, R. Stafford, C.Q. Woods, and M.J. Bott.1994. Patient outcomes: Are they linked to registered nurse absenteeism, separation, or work load? Journal of NursingAdministration24 (4 Suppl.): 48-55.
97.
Thomas, J.W., K.E. Guire, and G.G. Horvat.1997. Is inpatient length of stay related to quality of care?Hospital & Health Services Administration42 (4): 489-507.
98.
Unruh, L.2003. Licensed nurse staffing and adverse events in hospitals . Medical Care41 (1): 142-152.
99.
van der Meer, R.M., E.J. Wagena, R. Ostelo, J.E. Jacobs, and C.P. van Schayck .2004. Smoking cessation for chronic obstructive pulmonary disease. Cochrane Database of Systematic Reviews4.
100.
Wanich, C.K., E.M. Sullivan-Marx, G.L. Gottlieb, and J.C. Johnson.1992. Functional status of a nursing intervention in hospitalized elderly. Image, The Journal of Nursing Scholarship24 (2): 201-207.
Wenger, N.S., and R. Young.2004. Quality indicators of continuity and coordination of care for vulnerable older persons. RAND report no. WR-176. August. Santa Monica, CA: RAND Health.
103.
Whitman, G.R., Y. Kim, L.J. Davidson, G.A. Wolf, and S. Wang.2002. The impact of staffing on patient outcomes across specialty units. Journal of Nursing Administration32: 633-639.
104.
Yuan, Z., G.S. Cooper, D. Einstadter, R.D. Cebul, and A.A. Rimm.2000. The Association between hospital type and mortality and length of stay: A study of 16.9 million hospitalized Medicare beneficiaries. Medical Care38 (2): 231-45.
