The purpose of this study was to review instruments that assess the level of preparedness of state and local public health departments to respond to health threats such as bioterrorism.
Methods.
The authors examined 27 published population-based instruments for planning or evaluating preparedness that were mostly unavailable in the peer-reviewed literature. Using the Essential Public Health Services framework, the instruments were evaluated for (1) clarity of measurement parameters, (2) balance between structural and process measures, (3) evidence of effectiveness, and (4) specification of an accountable entity.
Results.
There was a great deal of overlap but little consistency in what constitutes “preparedness” or how it should be measured. Most instruments relied excessively on subjective or structural measures, lacked scientific evidence for measures assessed, and failed to clearly define what entity was accountable for accomplishing the task or function.
Conclusion.
Strategies for improvement include measure standardization, better interagency communication, and investment in public health practice research to develop the underlying evidence base required for developing quality measures and assessments.
References
1.
Department of Health and Human Services (US). HHS announces $1.1 billion in funding to states for bioterrorism preparedness [cited 2003 Sep 15]. Available from: URL: http://www.hhs.gov/news/press/2002pres/20020131b.html
2.
Department of Health and Human Services (US). HHS announces bioterrorism aid for states, Including special opportunity for advance funding [cited 2003 Sep 15]. Available from: URL: http://www.hhs.gov/news/press/2003pres/20030320.html
3.
National Association of City and County Health Officials. Impact of smallpox vaccination program on local public health services [cited 2005 Apr 26]. Research Brief: February 2003, No. 9. Available from: URL: http://archive.naccho.org/Documents/Research_Brief_9.pdf
4.
KindigDStoddartG. What is population health?Am J Public Health2003;93:380–3.
5.
StotoMAAbelCDievlerA, editors. Healthy communities: New partnerships for the future of the public's health. Washington: National Academy Press; 1996.
6.
Institute of Medicine. The future of the public's health. Washington: National Academy Press; 2002.
7.
DurchJSBaileyLAStotoMS, editors. Committee on Using Performance Monitoring to Improve Community Health. Improving health in the community: A role for performance monitoring. Washington: National Academy Press; 1997.
8.
PerrinEBDurchJSSkillmanSM, editors. Health performance measurement in the public sector: Principles and policies for implementing an information network. Washington: National Academy Press; 1997.
9.
DeroseSFSchusterMAFieldingJEAschSM. Public health quality measurement: Concepts and challenges. Annu Rev Public Health2002;23:1–21.
10.
National Association of City and County Health Officials. The impact of federal funding on local bioterrorism preparedness [cited 2005 Apr 26]. Research Brief: April 2004 Issue 5, No. 9. Available from: URL: http://archive.naccho.org/Documents/Research_Brief_April_04.pdf
11.
JencksSFCuerdonTBurwenDRFlemingBHouckPMKussmaulAE. Quality of medical care delivered to Medicare beneficiaries: A profile at state and national levels. JAMA2000;284: 1670–6.
12.
Joint Commission on Accreditation of Healthcare Organizations. Oryx fact sheet. Oakbrook Terrace (IL): JCAHO; 2001.
13.
National Committee for Quality Assurance. The state of managed care quality. Washington: NCQA; 1999.
14.
HalpernJ. The measurement of quality of care in the Veterans Health Administration. Med Care1996;34(3 Suppl):MS55–68.
15.
KaniaCRichardsRSanderson-AustinJWagnerJWetzlerH. Using clinical and functional data for quality improvement in outcomes measurement consortia. Jt Comm J Qual Improv1996;22:492–504.
16.
DarbyM. Health care quality: From data to accountability. Washington: National Health Policy Forum, George Washington University; 1996.
17.
American Public Health Association, Committee on Administrative Practice. Appraisal form for city health work. 4th ed.New York: APHA; 1934.
18.
PerrinEBDurchJSSkillmanSM, editors. Health performance measurement in the public health sector: Principles and policies for implementing and information network. Washington: National Academies Press, 1999.
19.
HandlerAIsselMTurnockB. A conceptual framework to measure the performance of the public health system. Am J Public Health2001;91:1235–9.
20.
BakerELMeltonRJStangePVFieldsMLKoplanJPGuerraFASatcherD. Health reform and the health of the public. Forging community health partnerships. JAMA1994;272:1276–82.
21.
McGlynnEAAschSM. Developing a clinical performance measure. Am J Prev Med1998;14(3Suppl):14–21.
22.
State of Washington, Department of Health. Public health improvement plan [cited 2005 Apr 27]. Olympia (WA): State of Washington; 1994. Available from: URL: http://www.doh.wa.gov/Publicat/94_PHIP/94phip.htm
23.
California Department of Health Services. State of California bioterrorism surveillance and epidemiologic response plan. Sacramento: State of California; 2002.
24.
California Department of Health Services. California hospital bioterrorism response planning guide. Sacramento: State of California; 2002.
25.
State of Michigan, Departments of Agriculture, Community Health and Environmental Quality. Michigan local public health accreditation program self-assessment report. Lansing: State of Michigan; 2001.
26.
Federal Emergency Management Association. Guide for all-hazard emergency operations planning (state and local guide). Washington: FEMA; 1996.
27.
Department of Health and Human Services (US). Emergency support function #8, health and medical services annex (ESF 8). Washington: DHHS; 1999.
28.
Department of Health and Human Services (US). Healthy people 2010. Washington: DHHS; 2000.
29.
Department of Health and Human Services (US). Assessing core capacity for infectious disease surveillance. Washington: DHHS; 2000.
30.
Department of Health and Human Services (US), Centers for Disease Control and Prevention (US). The public health response to biological and chemical terrorism: Interim planning guide for state public health officials. Washington/Atlanta: DHHS/CDC; 2001.
31.
Health Resources and Services Administration (US). Bioterrorism hospital preparedness program cooperative agreement guidance. Washington: HRSA; 2002.
32.
Centers for Disease Control and Prevention (US). Public health preparedness and response capacity inventory (local version 1). Atlanta: CDC; 2002.
33.
Centers for Disease Control and Prevention (US). Public health preparedness and response capacity inventory (state version 1). Atlanta: CDC; 2002.
Centers for Disease Control and Prevention (US). Continuation guidance for cooperative agreement on public health preparedness and response for bioterrorism—budget year five [cited 2005 Apr 27]. Atlanta: CDC; 2004. Available from: URL: http://www.bt.cdc.gov/planning/continuationguidance/index.asp
36.
Joint Commission on Accreditation of Healthcare Organizations. Checklist for bioterrorism preparedness: Environment of care standards. Oakbrook Terrace (IL): JCAHO; 2001.
37.
Association for Professionals in Infection Control and Epidemiology. Bioterrorism readiness plan: A template for healthcare facilities. Washington: APIC; 1999.
38.
National Association of County and City Health Officials. Local health department infrastructure survey. Washington: NACCHO; 1999.
39.
Health Officers Association of California. Public health assessment of California local health departments. Sacramento: HOAC; 2001.
40.
Association of State and Territorial Health Officials. Bioterrorism accountability indicators project. Washington: ASTHO; 2002.
41.
National Association of County and City Health Officials. Assessment protocol for excellence in public health. Washington: NACCHO; 1996.
42.
Council of State and Territorial Epidemiologists. Epidemiologic capacity assessment guide. Atlanta: CSTE; 1998.
43.
Centers for Disease Control and Prevention. Fiscal year 1999 state domestic preparedness support program: Assessment and strategy development tool kit. Atlanta: CDC; 1999.
44.
National Association of County and City Health Officials. National public health performance standards program: Local public health system assessment instrument. Washington: NACCHO; 2001.
45.
National Association of County and City Health Officials. National public health performance standards program: State public health system assessment instrument. Washington: NACCHO; 2001.
46.
National Association of County and City Health Officials. National public health performance standards program: Local public health governance performance assessment instrument. Washington: NACCHO; 2002.
47.
Pan American Health Organization. Public health in the Americas: Conceptual renewal, performance assessment, and basis for action. Washington: PAHO; 2002.
48.
National Association of County and City Health Officials. Local health department infrastructure survey. Washington: NACCHO; 1999.
49.
Health Officers Association of California. Public health assessment of California local health departments. Sacramento: HOAC; 2001.
50.
Health Resources and Services Administration (US). Bioterrorism hospital preparedness program cooperative agreement guidance. Washington: HRSA; 2002.
51.
DonabedianA. The quality of medical care. Science1978;200:856–64.
52.
StotoMASchonlauMMarianoLT. Syndromic surveillance: Is it worth the effort?Chance2004;17:19–24.
53.
IrvinCBNouhanPPRiceK. Syndromic analysis of computerized emergency department patients' chief complaints: An opportunity for bioterrorism and influenza surveillance. Ann Emerg Med2003;41:447–52.
54.
BuehlerJW. Review of the 2003 National Syndromic Surveillance Conference: Lessons learned and questions to be answered. MMWR Morb Mortal Wkly Rep2004;53Suppl:18–22.
55.
Interventions to improve vaccination coverage in children, adolescents, and adults. Task Force on Community Preventive Services. Am J Prev Med2000;18(1 Suppl):92–6.
56.
DeroseSFAschSMFieldingJESchusterMA. Developing quality indicators for local health departments: Experience in Los Angeles County. Am J Prev Med2003;25:347–57.
57.
BlackN. Evidence based policy: Proceed with care. BMJ2001; 323:275–9.
58.
McDanielRR. Chaos and complexity in a bioterrorism future. Bioterrorism, preparedness, attack and response. Advances in health care management. Vol. 4, Elsevier Ltd., 2004:119–39
59.
BrissPAZazaSPappaioanouMFieldingJAgueroL Wright-DeTrumanBI. Developing an evidence-based Guide to Community Preventive Services—methods. The Task Force on Community Preventive Services. Am J Prev Med2000;18(1 Suppl):35–43.
60.
Institute of Medicine (US). Healthy communities: New partnerships for the future of the public's health. Washington: National Academy Press; 1996.
61.
LichielloP. Turning point: A guidebook for performance measurement in public health. Seattle: University of Washington Press; 1999.
62.
Department of Health and Human Services (US). 17 critical benchmarks for bioterrorism preparedness planning, June 6, 2002 [cited 2003 Sep]. Available from URL: http://www.hhs.gov/news/press/2002pres/20020606a.html
63.
LurieNValdezRBWassermanJStotoMMyersSMolanderR. Technical report: Public health preparedness in California: Lessons from seven health jurisdictions. Santa Monica: RAND Corporation; 2004.
