Abstract
Introduction
Asthma is a leading cause of childhood hospitalization, disability, and healthcare-related cost. Pediatric asthma care in the United States is fractured with patients too often seeking nonurgent care in the emergency department (ED). 1 Asthma disproportionately affects Black and Hispanic children, and these populations have been shown to be more likely to use the ED as a routine source of sick care. 2 In addition, prior work suggests that many families traveling to the ED for nonurgent complaints are looking for reassurance. 3 Contributing to the problem of ED overuse, telephone triage systems used in practice for an estimated 39 million calls per year may conservatively over-refer children to the ED. 4
The use of video to enhance triage may help address these concerns. The nurse or physician providing triage may be able to determine a child's level of distress more accurately through the use of video compared with verbal questions. In addition, families may be more effectively reassured if a clinician has seen their child. Widespread mobile phone use may provide a foundation for video-enhanced triage for those who may rely on the ED for asthma care. Although disparities in access to the Internet and information technology persist, 5 90% of Americans are now mobile phone subscribers. 6 “Feature” phones and “smart” phones with nonvoice functions such as still or video cameras predominate the market, with the majority of American adults owning smartphones. 7 A 2015 Pew survey showed that 60% of Americans used their phones to take pictures or videos, indicating Americans' willingness to use these functions. 6
Video enhancement of triage may be of particular importance for minority populations who are at higher risk of poor asthma outcomes and high ED use. Prior studies found that African American men and women were willing to participate in e-health/m-health research 8,9 and that African American women had high use of mobile health applications, 9 suggesting that using mobile technology to improve healthcare is of interest to this population. However, despite likely benefits, no study in the United States has formally assessed the feasibility and utility of this technology to improve triage for an underserved pediatric population with a common chronic condition.
Given the opportunity to use mobile technology to improve telephone triage, we sought to study this technology with families who had sought care for their child for asthma in the ED. Our objective was to examine the feasibility, acceptability, and to explore the clinical utility of videos obtained from mobile devices for phone triage of asthma patients. We hypothesized that capturing videos would be feasible, acceptable, and could improve the quality of triage assessment.
Materials and Methods
Study Design
We conducted a prospective cohort study in a population seeking asthma care in an urban children's hospital ED to assess the feasibility, acceptability, and to explore the clinical utility of videos obtained from mobile devices for telephone triage. Participants were enrolled between September 2012 and March 2013.
Study Population and Setting
Subjects for this study were recruited from The Children's Hospital of Philadelphia ED, a tertiary care center in urban West Philadelphia that provides care for children at ∼90,000 visits annually, 8,000 of which are for asthma.
Study staff worked with clinical providers to identify patients in the waiting room or ED rooms between the ages of 2 and 10 years who were being treated for acute asthma. To be included, families were required to be English speaking, have a mobile phone with video capability with them at the time of the visit, and receive a noncritical triage on arrival in the ED.
Data Collection
After providing written informed consent, family members completed a questionnaire that included demographic characteristics, mobile phone information (brand, phone capabilities, data plan), and Likert-scaled questions about the acceptability and feasibility of using videos from mobile phones in telephone triage. Families were then directed by a trained member of the research team to obtain a video of their child's respiratory status and to transmit that video to the research team as an email attachment or text message. The research team also obtained a video of the child's respiratory status for quality comparison by using what was considered a top quality device (iPhone 4s; Apple Computer, Cupertino, CA) at the time of the study.
The research team member then conducted an in-person evaluation of the child's respiratory status, documenting items that can be visually assessed from the Pediatric Respiratory Assessment Measure. 10 The components of the in-person assessment included: work of breathing, breathlessness, mental status/alertness, accessory muscle use, nasal flaring, respiratory rate, and overall severity. Respiratory status was rated as asymptomatic, mild, moderate, or severe based on these components. The in-person assessment was completed immediately after the videos were obtained. If a patient was scheduled to have a treatment while the research team was in the room, the in-person assessment and video were delayed so that they still captured the same time point. Each family received a $15 gift card for participation and to offset any data transmission costs.
To simulate the process of pediatric phone triage enhanced by video, pediatric triage nurses and pediatricians viewed the videos and assessed respiratory status using the same components previously described (e.g., work of breathing, respiratory rate). The clinicians were asked to make an assessment of how the video would affect their triage of the patient by reporting whether they felt reassured, neutral, or more concerned about the child's asthma exacerbation status after viewing the video. Each clinician viewed ∼40 videos and was compensated for their time. Each video was reviewed by four clinicians.
Outcomes
Acceptability and feasibility
We assessed acceptability to parents of using video from mobile phones in phone triage using Likert-scaled questions with face validity. Questions focused on attitudes and behaviors related to phone triage (e.g., “I find advice over the phone from my child's doctor's office helpful,” “I follow the advice of my child's doctor's office over the phone”), as well as on attitudes toward using video from mobile phones in the triage process (e.g., “Sending a video of my child to the nurse would be helpful to my child's care”). For each item, the response options were scaled from 1 to 9 (1–3 = disagree, 4–6 = neutral, 7–9 = agree). Feasibility was assessed by the proportion of videos successfully transmitted to the research team. Quality of the videos was scored by the Mean Opinion Score (MOS), 11 which was used in the technology field for image quality from 1 (bad) to 5 (excellent). The distribution of both family and team video MOS scores was described.
Clinical utility of video recordings
After reviewing videos of patients, clinicians determined whether each video reassured them regarding the child's asthma severity, had a neutral effect, or raised concerns.
Covariates
Covariates included the type of phone available to the family, age of the parent, age of the patient, educational level of the parent, and respiratory status rating based on the in-person assessment (asymptomatic, mild, moderate, or severe).
Statistical Analyses
We described participants' demographic, clinical, and telephone characteristics. To assess acceptability, we examined the distribution of responses and, for clarity of presentation, calculated the proportion of parents agreeing (answering 7–9 on Likert-scaled responses) to each item. Feasibility was examined by the proportion of parents able to successfully transmit a video to the research team. Next, we assessed associations between (1) demographic characteristics/phone specifications and (2) feasibility of video triage (successful transmission of a video) using t-tests and Mann–Whitney U tests for continuous variables and Fisher's exact tests for categorical variables (due to cell counts <5). 12 Finally, we calculated the proportion of videos that were of sufficient quality to be interpreted.
To evaluate the potential clinical utility of the video recordings, we calculated the proportion of cases in which all evaluating clinicians reported being reassured about the child's asthma exacerbation status after reviewing the video. We calculated proportions overall and by respiratory status assessed via in-person respiratory exam (asymptomatic, mild, moderate, severe) according to the Pediatric Respiratory Assessment Measure. All statistical analyses were done using Stata version 13 (College Station, TX) (p < 0.05 considered significant in all analyses). This study was approved by the Institutional Review Board of The Children's Hospital of Philadelphia.
Results
Study Population
Demographic information on the study population is presented in Table 1. The majority (85%) of participants were African American, which is consistent with the neighboring community. Parents had 40% Apple and 33% Samsung phones. The majority of the phones had been obtained within the past 2 years, and most had unlimited data (72%) and/or text plans (95%).
Characteristics of Study Population Children Presenting to the Emergency Department with Asthma Exacerbation and Their Parents (N = 60 Children and 60 Parents)
Respiratory status rating is based on in-person assessment.
Acceptability
A majority of families found video transmission to be acceptable. Specifically, 39 out of 60 parents (65%) reported that having the nurse see their child via the video would improve their trust in the phone triage system (Table 2). In addition, 48 parents (80%) reported that they thought that having the nurse see a video of their child would be helpful to their child's care. Few parents reported that they either would not have enough time (4, 7%) or would be too worried (5, 8%) to provide a video as part of the triage assessment. Further analysis revealed that successfully transmitting the video was not associated with higher acceptability scores (data not shown).
Acceptability of Mobile Phone Video Transmission to Parents/Guardians of Children with Asthma
Response options included: disagree (1–3), neutral (4–6), agree (7–9).
Feasibility
Most families successfully transmitted a video to the research team (45/60, 75%). Forty-four videos (73%) were rated as sufficient quality to be evaluated. Parents with Apple phones were significantly more likely to successfully transmit a video [100% compared with 65% for Samsung phones and 47% for other phone types; relative differences of 35% (95% confidence interval: 9%, 61%) and 53% (16%, 90%), p < 0.001] (Table 3). Additionally, higher parent educational level was positively associated with successful transmission to the research team (p = 0.04). MOS scores ranged from 0 to 5 for the family videos, with a median of 3 indicating some differences from in-person assessment or minor problems with focus/lighting, but no difficulty in assessing overall appearance. For the team videos, MOS scores ranged from 2 to 5, with a median of 4 indicating only minor differences from in-person assessment. The brand of phone was not associated with the quality rating for the transmitted video in this study.
Child, Parent, and Phone Characteristics Associated with Successful Transmission of Video From Parent Mobile Phone to the Clinical Team
p-Values calculated using t-tests and Mann–Whitney U tests for continuous variables and Fisher's exact tests for categorical variables (due to sparse cell counts). Missing values were dropped before calculating all p-values.
Respiratory status rating is based on in-person assessment.
Clinical Utility of the Video Recordings
After viewing the videos, most clinicians felt reassured about the child's asthma exacerbation (Table 4). Specifically, all raters were reassured for 40 of the 58 videos of children (68%) with a nonmissing respiratory status. Clinicians were less likely to be reassured by videos of children with a moderate respiratory assessment status compared with those with a mild or asymptomatic assessment (44% compared with 78% and 100%, respectively).
Clinician Responses After Viewing Mobile Phone Video Recordings Made by the Research Team, Overall and by Respiratory Status
Each video was reviewed by four clinician raters. After reviewing videos of patients, clinicians determined whether each video reassured them regarding the child's asthma severity, had a neutral effect, or raised concerns.
Respiratory status was determined by an in-person evaluation using items from the pediatric respiratory assessment measure. Respiratory status was missing for 2/60 families.
p-Value calculated using Fisher's exact test due to cell counts <5.
For only one video, a reviewer was concerned after viewing the video, and, in that case, only one reviewer out of four was concerned. That child's respiratory status was rated as mild.
Discussion
In this study, we evaluated the acceptability, feasibility, and potential clinical utility of families providing videos from mobile devices to assist telephone triage of children with acute asthma. Overall, our results indicate that most families of low socioeconomic status in an urban setting are able and willing to transmit videos to their healthcare providers to support telephone triage and that these videos might help improve triage quality.
This study, focused on a largely African American, urban population, is consistent with prior research that found the use of mobile or Internet-based health applications to be feasible by underserved or low-income populations. 13 –16 Our study also identified specific capabilities that may be utilized to improve communication with these families. For example, a high proportion of families in our study had unlimited text messaging plans, suggesting that costs to families associated with sharing clinical information (like videos) via text would be minimal. In addition, responses to the acceptability questions indicate that most families welcome the opportunity to transmit videos and would better trust phone advice from a health professional who could see the child. These findings are clinically relevant since prior studies have found that rates of parent noncompliance with phone triage advice for ED/urgent care are between 17% and 40%. 4,17 –20
Our findings also highlight the potential for videos to improve the quality of the phone triage process by ensuring that children receive an appropriate triage classification. Triage currently relies exclusively on parent report and discussion with a triage nurse. We found that clinicians were frequently reassured about the status of the child's asthma exacerbation after viewing the video and that, as expected, clinicians were more likely to be reassured for children with less severe respiratory status ratings, suggesting that these videos might ultimately enhance the ability of clinicians to direct children to the right level of care. Given that many families overuse the ED, 21 augmentation of the phone triage process with video might help families avoid unnecessary use of the ED.
Although this study explores an innovative enhancement to the phone triage process for an underserved population that has not been examined in prior studies, there are several limitations. The study was designed as a pilot with a modest sample size conducted in one ED with an English-speaking, low socioeconomic status, urban population. As such, results may not be generalizable. Further, some parent videos were of poor quality. We expect that this problem will be mitigated as the video quality of mobile phones continues to improve. We also encountered transmission issues (difficulties with cellular signals in the hospital and with connecting to the WiFi network) that prevented some families in transmission of video files to the research team. Future work that builds on the present study and tests this approach with families in the community should assess how often the transfer of videos is limited by problems with Internet connectivity in that setting. As data collection occurred in 2012–2013, phone quality and familiarity of users with video technology has increased in the subsequent years. Given these changes, it is possible that the feasibility of video transmission would be higher, and quality of video transmission better, were the study repeated today.
Conclusions
We found that obtaining videos from the mobile phones of parents for use in the phone triage process was feasible and acceptable to parents and provided information that was potentially useful to improving the telephone triage process. Our results support formal testing of the use of video to enhance telephone triage for children with asthma in pediatric call centers.
Footnotes
Acknowledgments
The authors acknowledge Valerie McGoldrick, Anastasia Bailey, Andrew Lippa, and the Pediatric Call Center nurses of The Children's Hospital of Philadelphia, as well as the network physicians and the families. Funding for this study was provided by the Robert Wood Johnson Foundation Clinical Scholars Program, the Robert Wood Johnson Health Society Program at The University of Pennsylvania, and the Robert Wood Johnson Foundation Clinical Scholars Program at the University of Pennsylvania Eisenberg Fund.
Disclosure Statement
No competing financial interests exist.
