Abstract
BACKGROUND:
Quality control system is one of the hospital information systems. The adoption of quality control system increases the work efficiency; however, to some extent, it also increases the workload for physicians.
OBJECTIVE:
The purpose of this study is to investigate the impacts of the quality control system on quality of care (e.g., process and outcome performance).
METHODS:
Our study collected physicians’ behavior information from a large urban hospital in China. We constructed the fixed-effect model to examine the relationship between the quality control system adoption and quality of care.
RESULTS:
Using the quality control system has a significant (
CONCLUSIONS:
The controlling system can improve medical quality even though it limits physician behavior to some extent. The controlling system improves both the process performance and outcome performance, and it brings more benefits to outcome performance rather than process performance which means the reflection of the new technology may have more evident on outcome variables.
Introduction
Work overload is typical for the top three hospitals in China [1]. To mitigate this situation, many cities invest money in the hospital information system (HIS) to improve work efficiency, such as EMR and operational system. However, in a practical application, there are still various problems mainly concentrating on the interaction between human and computer [2, 3, 4, 5].
To some extent, the investment of information systems enhanced efficiency and quality of work in hospitals [6, 7]. On the contrary, human-computer interaction also put extra pressure on agents in hospitals; for example, physicians will spend time on typing patient records especially when they have lower computer literacy. Additionally, when physicians fail to fulfill the contents of patients in HIS accurately and timely, undesirable outcomes will be accumulated in the system over time, like limitating physicians’ behavior and creating bad records. Thus, while hospital executives have to consider the effects of IT on employees, they also need to consider the differences among various systems and impacts of these tools on patients’ health status, which will potentially be very different on improving productivity, efficiency, and quality.
As a primary system in the hospital, electronic medical record (EMR) plays critical roles in improving quality of care in hospital [8, 9, 10]. However, in addition to these mainstream systems in hospitals, augmented systems are also crucial to the various organizational environment [10]. Therefore, referring to the impacts of information systems in hospitals, controversy still exists due to the complex interaction between human and diverse systems [11]. Acting as a strategy to attain a competitive advantage, quality improvement increases the reputation and profitability of a health organization during the time [12]. Hospitals have found that it is necessary to measure, monitor, and improve the quality of healthcare services to survive and achieve patient satisfaction [13, 14]. The quality control system provided a procedure which reduces errors by eliminating illegible orders, improving communication, tracking orders, checking for inappropriate prescriptions, and reminding professionals of actions to be undertaken [15, 16]. Based on the above, we pose the following question: How can quality control systems in hospitals influence the physicians’ behavior and improve the quality of care?
Previous studies have found that quality control system brings benefits to medical quality which enhances the patients’ satisfaction of medical services [30]. The benefits include reduced mortality rates [17, 18, 19], improved vaccination rates [20], increased use of recommended procedures [21], and patient safety [22, 23]. The quality control systems also have positive impacts on the ward round which has been seen to affect the quality of patient outcomes [24]. Utilizing the system to improve the ward round structure can also improve physicians’ service quality in return [25]. The system can decrease the nonstandard medical advice which results in patients’ noncompliance. This strengthens the relationship between physicians and patients and enhances patients’ compliance and outcomes [26]. To date, we still confront some research gaps. First, research related to the quality control system are still insufficient while most of them focus on the EMR, HIS and other clinical IT [9], limited studies investigated the effect of controlling systems. Second, the differences between monitoring and controlling system also raise the concerns and discussions, in particular referring to the developing country like China. Whether the quality control system relieves the stress of overworked clinicians, brings them convenient or increases the difficulty of their work are still unknown. Third, whether the system can change physicians’ behavior or not is also a novel research point.
Considering the imbalance between effective use of information system and increased workflow resulted from the information system, we leverage this gap to evaluate the impacts of the hospital information system, in particular, the effects of a quality control system on quality of care. To test this relationship, we constructed an empirical model by theorizing the relationship between the information system and behavior change. Then, we used a fixed effect model and included a control for relevant observables (e.g., workloads, environment factors) to estimate these impacts. We disentangled the variation of effects from different types of variables, in particular, the process and outcome variables. By collecting data from a large hospital in China, we found that the quality control system benefits both the process and outcome performance. However, the impacts on process variables are less significant than outcome variables. This study contributes to the literature of information system impacts in healthcare, and also promotes better understanding of economic and policy literature. In practice, our work gives support to the hospital reform related to the information system.
We organized the rest of the paper as follows. First, we review the literature of HIS and quality control systems’ impacts. Next, we introduce the research settings including a description of the empirical methods, the proposed model and the dataset. Lastly, we introduce the analytical results and then a discussion including limitations and a conclusion.
Methods
Process variables are variables related to medical quality, which may dynamically change before hospital discharge. Outcome variables are closely related to medical quality, which indicates the eventual consequence of disease therapy, such as improvement in function, recovery or survival. Hospital information systems provide various functions through which could improve both the effectiveness and efficiency of physicians’ decision-making [27]. To investigate the impacts of the quality control system in hospital and its various impacts on the outcome and process performance, we collected data from hospitals which have adopted the quality control system. In this section, we describe the data that we collected and discuss the operationalization of the variables that we use in our model.
Data: The setting
Data collection
We collected data from a large hospital in China that had applied quality control system for couples of years. It is the first time they implement such system to control medical quality. Our data collection consisted of two steps. First, the authors have several discussions with physicians and managers in this hospital. Based on these interviews, we could list several examples and the real practical problems during the process of hospital management to illustrate the impact of quality control on the behavior of agents. Second, we collected the data from three datasets including the medical record (i.e., first page of patients’ medical record, outcomes on patients’ perspective), evaluation report (i.e., comprehensive evaluation result for medical care of primary section), and department report (i.e., monthly statement of the basic section), ranging from 2015/11 to 2016/06.
Dependent variables
We extracted time-series data on patient admission length and defined it as a process variable, cured rate, recovery rate, mortality rate as outcome variables. We extracted this part of data from patient discharge reports based on the individual level. We aggregated these into department level by calculating the average number. The patient discharge reports include patients’ basic admission statement and time period, which supports the hypotheses of process and outcome variables as the measurements of medical quality.
Independent variables
We calculated the evaluation scores at the department level. As the results of system generated information, evaluation scores are the average score which measures the physician adherence behavior to the system from time and content perspectives. We extracted the scores from the quality control system which marks them automatically when users make errors. Furthermore, the system will report the final scores every month per department.
Control variables
We extracted the patient number, switching-out number and bed utilization rates from monthly medical report. The monthly medical report is a traditional way to measure the medical quality which reflects the medical performance from an organizational perspective. Thus, we can obtain statistic data from the control variables in this study. Additionally, we also consider the economic factors and other extrinsic factors to avoid sample bias. Table 1 presents the definition of variables.
Definitions of constructs
Definitions of constructs
We performed natural logarithm transformations on all variables to endorse the assumption of normality. Moreover, we used ordinary least square regression (OLS) to test our hypotheses, variables have introduced in the data section. However, the rate ranges from 0 to 1 which do not belong to the normal distribution and is inconsistent with the basic assumption of OLS, so we used a fractional logit regression model to examine the impacts on dependent variables related to rate. Furthermore, to examine how the quality control system affects the quality of care, we use panel data and a fixed effect regression model as follows:
Here,
In the above specification, the department level fixed effect controls the time-invariant differences across departments. The inclusion of this fixed effect compares each department in a given month to any other department at other periods. Additionally, other factors are influencing the time-serious variation of impacts; in other words, the fixed effect cannot be the only measurement. To account for such effects, several control variables
Results
Main results
We have two dependent variables including procedural measurements and outcome measurements. Table 2 presents summary statistics of variables. Table 3 shows the results for the fixed effect model.
Summary statistics
Summary statistics
Results of the model
The results of the procedural measurements model suggest that quality control system has a significantly negative effect on the procedural variables (
Outcome performance
The results of the outcome measurements model suggest that quality control system has a significantly positive effect on the procedural measurements (
Comparison
According to the results from Table 3, the coefficient of the dependent variable from the process is lower than the outcome, and they are all significant.
Post hoc analysis
After we test the main impacts of the information system, we identify the variation of scores on departments. According to Fig. 1, the average scores present upward trend in the period of system implementation. Limited by the data we collected, the trend before the time point, 2015/11, is stable but not visible. But it is obvious that increasing trend gets to the highest point at 2015/11 and then comes to considerable downward until 2015/12. Comparing with increase occurred before 2015/11, the substantial increase occurred from 2015/12 to 2016/1 with a gradually steady trend. According to this fluctuation, the marked downward and then upward show the reflection related to the first implementation of a new information system which may occur because of the sudden limitation and the inconsistent with traditional medical process. Furthermore, a stable trend reveals the forming of new habits of the medical process which requires further exploration.
Trends of evaluation scores of departments.
In this section, we assess the robustness of the main results concerning alternative variables of dependent variables. Since our model formulation is at the department level and the patient status can be different in different departments and situations, we replaced dependent variables to make sure that our analysis is robust. We use these two-replaced outcome dependent variables, recovery rate and mortality rate from our data, in that these are also two dependent variables which can reflect the patient status when they leave the hospital. Table 4 presents the robustness results in which are all significant and consistent with results before. In other words, according to the robustness test, the impacts on outcome variables are still more significant than process variables during the medical process.
Results of robustness checks
Results of robustness checks
According to the results of models, our study has the following findings. First, the controlling system can improve medical quality even though it limits physician behavior. Previous research showed the potential of the monitoring system in the hospital rather than controlling system because of the resistant emotion towards new technology and some habits [23]. Contrarily, our study gives strong support to the benefits of controlling system which provides new insight for both theoretical and practical perspectives. Moreover, it is an inventive way for physicians to improve the adherence of the system. Second, the controlling system improves both process quality and outcome quality. Previous research explored the effect on quality of care [29], as well as the effects of surveillance, prevention, and controlling system [30]. Our study puts forward a new insight to measure medical quality from process and outcome perspective. Third, comparing with outcome quality, the impacts of controlling system on process quality has a less significant effect which means that the reflection of the new technology may be more evident on outcome variables. When we discuss process quality, it is sometimes a two-sided sword which is sensitive to the change. The outcome variables may have more direct effects from variations about the work process. We discuss the theoretical and practical implications of the study in the following section.
Main implications
First, we extend the research about the impacts of different types of subsystems in hospitals, in particular, the role of the quality control system. Extant research on the controlling system and its effects on quality of care state that monitoring the activities of clinicians in hospitals is more valuable than controls [23]. Our findings reveal the positive impacts of the quality controlling system which tests the roles in turn and posits new research about different types of information system in hospitals. Additionally, our findings examined the various impacts on medical performance, such as process variables and outcome variables. By variable classification, our findings answer the questions about the mechanism of effectiveness and efficiency related to the clinical information system and extend the exploration of the process to outcome. Specific classifications will help us better understand the impact and controversy results from previous research.
Second, our findings make it clear that the implementation of the controlling system will benefit organizational performance even though it limited and changed the behavior of physicians. Thus, considering the low costs of this subsystem, hospitals can consider to adopt it as a way to mitigate the drawbacks from other influences.
Conclusions
In conclusion, our study provides new insights into the roles of quality control functions on two main types of quality care, namely process and outcome performance. Our findings related to these two variables indicate that controlling system promotes quality of care by regulating user behavior. Even though such a system limits physician behavior, and increases the workflow to some extent, the results still show the positive side which argues that the controlling system is not useless comparing with a monitoring system in the hospital. We believe that this research can be extended to explore a variety of technology and policy interventions related to medical process such as enacting personalized system design for specific departments to satisfy their requirements.
Furthermore, since this study used data from a department level which is still from the organizational perspective, further research could be done from the individual level to explore the variation of behavior change, such as agents’ adherence with the various controlling system specifications, and also interactions among different types of system in the hospital. In particular, this research can serve as a basis for further studies on how behavior intervention in quality management can be combined with technological mechanisms to produce optimal quality outcomes. We hope that our results will spawn further research in this critical area.
Footnotes
Acknowledgments
This work received support from the National Natural Science Foundation of China (Grant nos 71531007, 71471048, and 71471049).
Conflict of interest
None to report.
