Validity and Reliability of a Pediatric Hematology Oncology Patient Acuity Tool

Abstract

Appropriate use of nursing resources in the pediatric hematology and oncology inpatient settings demands a patient acuity system that is easy to use and accurate, and that objectively measures nursing care needs of a specialized patient population. Structured survey of 13 comprehensive cancer centers and a review of the literature show no valid and reliable acuity tools for this pediatric population. The purpose of this project was to study the validity and reliability of a newly developed pediatric hematology and oncology acuity system designed to quantify patient care needs. A new acuity tool for this pediatric population was developed based on the patient classification tool used at Johns Hopkins Hospital Oncology Center (JHHOC). The levels of care from the JHHOC tool were adopted, with therapeutic indicators modified to reflect nursing diagnoses relevant to the pediatric inpatient. Nursing care hours required for each level of care were also identified. Validity was studied using a content validity index (CVI). Experts from the pediatric unit where the tool would be used were asked whether each therapeutic indicator was assigned to the correct level of care (1 thru 5) based on patient care hours. CVIs for items ranged from .5 to 1.0; the overall CVI for the tool was .93. Interrater reliability was studied using two raters from the unit. Data were collected for 150 patient observations on a 12-bed pediatric hematology and oncology inpatient and short-stay outpatient unit. The resulting Pearson correlation coefficient was r = .97 (P <.001). The resulting tool is nursing diagnoses based, interfaces with standard care plans, is easy to use, requires no calculation, and provides reliable quantification of nursing work load based on pediatric hematology and oncology patients care needs. Data from this acuity tool determine variable nursing hours per patient per day and assist with patient assignments, staffing and scheduling decisions, budgetary processes, establishing productivity, and will ultimately facilitate establishing charges for nursing services to patients. Currently, a quality assurance interrater reliability design audit system is used to maintain and monitor ongoing integrity and accuracy of the classification system. CVI and interrater reliability studies will occur at regular intervals to ensure the validity and reliability of the tool.

Get full access to this article

View all access options for this article.

References

Schroder P. , Washington W. , Deering C. , et al: Testing validity and reliability in a psychiatric patient classification system. Nurs Manage 17:49-54, 1986

Cullen DJ , Civetta JM , Briggs BA , et al: Therapeutic intervention scoring system: A method for quantitative comparison of patient care. Crit Care Med 2:57-60, 1974

Keene AR , Cullen DJ : Therapeutic intervention scoring system: Update 1983. Crit Care Med 11:1-3, 1983

Kraus WA , Zimmerman JE , Wagner DP , et al: APACHE—Acute physiology and chronic health evaluation: A physiologically based classification system. Crit Care Med 9:591-597, 1981

Kraus WA , Draper EA , Wagner DP , et al: APACHE II: A severity of disease classification. Crit Care Med 13:818-829, 1985

Horn SD , Sharkey PO , Bertram DA : Measuring severity of illness: Homogeneous case mix groups. Med Care 21:14-25, 1983

Eklof M. , Qu W. : Validating a psychiatric patient classification system. J Nurs Adm 16:10-17, 1986

Jackson B. , Resnick J. : Comparing classification systems. Nurs Manage 13:13-19, 1982

WhitneyJ. , Killien M. : Establishing predictive validity of a patient classification system. Nurs Manage 18:80-86, 1987 10. Arenth M. : The development and validation of an oncology patient classification system . Oncol Nurs Forum, 12:17-22, 1985

10.

Kinley J. , Cronenwett LR : Multiple shift patient classification: Is it necessary? J Nurs Adm 17:22-25, 1987