Use of the Prioritization Matrix to Enhance Triage Algorithms in Clinical Decision Support Software

Abstract

Clinical decision support (CDS) software requires regular maintenance and development. CDS software can be very complex and can have several different performance parameters that need to be considered in development and maintenance cycles. Stakeholders in management and software development need a shared and mutually agreed on framework to prioritize the development and maintenance of CDS software. The prioritization matrix, a quality improvement tool, was used to prioritize triage algorithms at Ask Mayo Clinic, a national triage call center. Key elements used in the priority matrix were the frequency of algorithm use, potential safety impact of the algorithm, algorithm length, overall agreement between software recommendation and triage nurse, and asymmetry of nurse overrides of the software recommendation. This methodology also bridges the language gap between software developers and management and gives management the ability to customize how software maintenance and development cycles are prioritized.

Keywords

clinical decision support systems algorithms telephone triage prioritization matrix

Get full access to this article

View all access options for this article.

References

Grol R. , Giesen P. , van Uden C. After-hours care in the United Kingdom, Denmark, and the Netherlands: new models. Health Aff (Millwood). 2006;25:1733-1737.

NHS Direct. NHS Direct annual report & accounts 2007/08. http://www.nhsdirect.nhs.uk/Assets/Documents/AR2008.pdf. Accessed June 9, 2009.

O’Cathain A. , Sampson FC , Munro JF , Thomas KJ , Nicholl JP Nurses’ views of using computerized decision support software in NHS Direct. J Adv Nurs. 2004;45:280-286.

St George I. , Cullen M. , Gardiner L. , Karabatsos G. Universal telenursing triage in Australia and New Zealand: a new primary health service. Aust Fam Physician . 2008;37:476-479.

O’Hanley P. Telephone triage: the quiet revolution in Canada. Telemed J E Health. 2004;10:109-111.

North F. , Varkey P. A retrospective study of adult telephone triage calls in a US call centre . J Telemed Telecare. 2009; 15:165-170.

Bunik M. , Glazner JE , Chandramouli V. , Emsermann CB , Hegarty T. , Kempe A. Pediatric telephone call centers: how do they affect health care use and costs ? Pediatrics. 2007; 119:e305-e313.

Osheroff JA , Pifer E. , Teich JM , Sittig DF , Jenders RA Improving Outcomes With Clinical Decision Support : An Implementer’s Guide. 1sted. Chicago, IL: Healthcare Information and Management Systems Society; 2005.

Kempe A. , Bunik M. , Ellis J. , et al. How safe is triage by an after-hours telephone call center? Pediatrics. 2006;118:457-463.

10.

Lattimer V. , George S. , Thompson F. , et al. Safety and effectiveness of nurse telephone consultation in out of hours primary care: randomised controlled trial. The South Wiltshire Out of Hours Project (SWOOP) Group. BMJ. 1998;317:1054-1059.

11.

O’Cathain A. , Webber E. , Nicholl J. , Munro J. , Knowles E. NHS Direct: consistency of triage outcomes . Emerg Med J. 2003;20:289-292.

12.

Breyfogle F. Implementing Six Sigma. 2nd ed. Hoboken, NJ: John Wiley; 2003.

13.

Brassard M. The Six Sigma Memory Jogger II. 1st ed. Salem, NH: Goal QPC; 2002.

14.

Tailored Solutions by Expert-24. http://www.expert-24.com/ . Accessed January 17, 2010.

15.

McGinn T. , Wyer PC , Newman TB , Keitz S. , Leipzig R. , For GG

Tips for learners of evidence-based medicine: 3. Measures of observer variability (kappa statistic)

CMAJ . 2004;171:1369-1373.

16.

Vsetecka D. , Berg KM , Olsen RC , et al. Triage nurse disagreement with algorithm generated triage conclusions: useful variation to guide algorithm quality improvement. Poster presented at: American Medical Informatics Association Spring Congress; May 23, 2007; Orlando, FL.

17.

Urac. Health call center standards and summary. http://www.urac.org/programs/prog_accred_hcc_ss.aspx?navid=accreditation&pagename=prog_accred_HCC. Accessed January 17, 2010.

18.

Poole SR , Glade G. Cost-efficient telephone care during pediatric office hours. Pediatr Ann. 2001;30:256-267.