Abstract
This study interprets the development and validation of the organizational capacity assessment tool, which is designed to evaluate the gaps in capabilities of hospitals across India. This assessment tool was tested on 300 managers working in hospitals across 16 states of India, with a majority coming from small-sized hospitals. The 40-item measure assessed six factors of organizational capabilities, namely, organizational foundation, organizational resources, organizational capacities, core task implementation, benefits and impacts, and external relations. Gaps in the capacities were identified. Internal consistency was evaluated using the Cronbach’s alpha. Confirmatory factor analysis supported the inclusion of the items in the questionnaire. In addition, structural equation modeling was conducted to evaluate the goodness of fit of the model demonstrating the relationships between the study variables. It was found that individual factors such as core task implementation and organizational foundation significantly influenced benefits and impacts as well as external relations. Similarly, organizational resources positively impacted evaluation capacity outcomes. In contrast, organizational capacity had no significant influence on either benefits and impacts or external relations. This study only validates the capacity assessment tool; however, it needs to be measured with varied types of work personnel within the healthcare sector as there is a huge diversity in the work force of this area. Based on this empirical study, many future research implications were suggested.
Keywords
Introduction
The Indian healthcare sector forms among the top-ranking industries in India with respect to revenue generation and employment strength (IBEF, 2020). Growth drivers include increased infrastructure in the near future, enhanced use of services due to increase in average life expectancy of Indians, heightened scope for medical tourism, presence of healthcare centers, rising earnings, and rise in automatic processes through robots (India Health, 2019). Typically, the meaning of healthcare sectors includes hospitals, healthcare centers, pharmaceuticals, diagnostics, medical tourism, telemedicine, health insurance, equipment as well as supplies. Even though the market size is exponentially increasing with a compound annual growth rate (CAGR) of 22%, India is ranked lowly in terms of quality and approachability, standing at the 145th position within 195 nations (IBEF, 2020). Thus, working toward improving quality and accessibility should be our primary concern. This clearly implies that India has a great potential for improvement as public and private investments in healthcare infrastructure is increasing at a staggering rate to the tune of CAGR of 16%–17%. On the other hand, India can be considered to be in an advantageous position as there is a large pool of well-trained medical professionals available and government policy that are supportive of growth. The first step toward improving ranking lies in the evaluation of healthcare areas. Since the scope of healthcare areas is broad, therefore, considering hospitals as healthcare organizations will be convenient for our study. Sulaiman et al. (2018) have described hospitals as organizations which are “capital-intensive,” human resource-rich, technologically furnished business units that handle business by rendering services in terms of medical, nursing, nutritional, pharmaceutical, and diagnostic, along with general administrative work and financial accounting for its smooth functioning. Therefore, considering hospitals as organizations, this study adopted an approach for assessment of organizational capacity in hospitals from 14 states across India using an assessment tool. Moreover, it was observed that there are hardly any studies describing capacity assessment in hospitals. Organizational capacity assessment has mostly been employed by organizations when in need of funding. Thus, our study is a necessity for managers who are in the pursuit of improving their organizational efficiency.
The primary aim of our study was developed so as to provide an answer to the following research question: “How can the organizational capacity assessment tool be applied in identifying gaps in capabilities of different types of hospitals?” Based on the research question, the following objectives are proposed:
To identify the gaps which are present in the capabilities of the hospitals using the organizational capacity assessment tool. To validate the components of the organizational capacity assessment tool used for identifying gaps in organizational capabilities of hospitals.
Organizational Capacity Assessment Tools
The organizational assessment (OA), also known as organizational capacity assessment (OCA), can be defined as a structured tool for a facilitated self-evaluation of an organization's capacity followed by action planning for capacity improvements and initiative developments (Simister & Garbutt, 2017). In addition, this may include both monitoring and evaluation. The organization capacity assessment tool described by Booth et al. (1998) showed that the participation cycle identifies the problem and then reflects on the real needs, followed by decision-making and finally action is taken. Ibrahim and Gambo (2019a) described it as an instrument that evaluates the internal and external factors rather than using any fixed-format or tried-and-tested practices. These facilitate the organization to diagnose the underachieved areas for the scope of performance improvisations in the organizations (Breuer et al., 2015). Since there is no fixed formula for organizational success, each organization needs to find its own loopholes and do corrective measures for amendment. Booth et al. (1998) used OCA tool as a diagnostic measure for evaluating the maturity of firms, for estimating the existing capabilities as well as teaching the employees regarding their effective functioning and creation of commitment goals. Shapiro (2007) and LeMay (2010) listed some of the advantages that OCA can reveal about the organization such as providing crucial information controls the functioning of programs, ensures proper reporting of procedures and confirming the use of standardized processes. This self-assessment approach increases the ownership of the action plan. The OCA format helps the organization reflect on its processes and functions and score itself against benchmarks. Based on the discussions and the scoring, the organization shapes and sets priorities for actions that it can take to strengthen its capacity.
According to Booth et al. (1998) and Simister and Garbutt (2017), the OA undergoes four basic stages. As reported by Booth et al. (1998), it grows with the organization, commencing from nascent to emerging to expanding to mature. However, Simister and Garbutt (2017) elaborated that stage 1 starts with the division of capacity into distinct zones according to their functions such as management, leadership, resources etc. This is followed by the development of a transparent ‘rating system’ (stage 2). Stage 3 involves the receipt of assent from various stakeholders of the organization and then final stage 4 encompasses the critical analysis of the rating system and enforces the action plan to enhance the status of capacity in the organizations.
Components of OA Tools Used by Various Researchers.
Components of OA Tools Used by Various Researchers.
From the Table 1, few commonalities as well as differences were observed amongst the above defined commonly used OCA tools. Financial and human resources were the basis for commonality among all these tools, whereas each OCAT from organisations varied in terms of variables such as governance, training needs, partnerships and sustainability. Hazy (2008) conducted a survey on cultural dimensions and found that the four dimensions namely, strategy and roadmap, member engagement, decision quality and timeliness and norm execution influence the member behaviour in culture formation in an organization. Hence it is suggested to include these items in capturing culture in the organizational capacity assessment. Korst et al., (2011) conducted a study on the hospital readiness to participate in health information exchange as part of the organisational capacity assessment and found that human resource factor (e.g., hospital leadership) predominantly contributed to the quality improvement culture of the hospitals.
Booth et al. (1998) described some of the disadvantages of these self-assessment tools. It is expected that the participants need to be more matured and experienced enough for proper implementation. Moreover, it can become time-consuming and lagging in the required quality of information, thereby causing improper conclusions. Lafond and Brown (2003) reported that capacity assessment involves only one-time measurement. However, these assessment tools have been found to be useful by many organizations as capacity has been considered to be one of the main factors influencing performance (Brown et al., 2001). Even though there are many OCA scales available, there are hardly any studies on validation of scales testing the organizational capacity, especially in case of hospitals. To the best of our understanding, the concept of using organization capacity assessment as tool for improving organizational performance has not yet been explored in the area of healthcare industry but seems to have a huge potential in the future.
Sampling Design
The current study employs convenient sampling technique, a nonprobability sampling technique where subjects are selected because of their convenient accessibility and proximity to the researcher. Ideally, the entire population comprising of all the managers working in various hospitals forms our general population for this study. However, it is physically impossible to collect data from each of these managers on the research topic. Therefore, the target population was represented by the managers working in hospitals across India, which is estimated to be 1,200. The minimum sample size estimated using Cochran’s formula for unknown population with the 95% confidence level and a 5% margin of error was calculated to be 291. Thus, a total sample size of 300 managers from various hospitals across India was selected, well above the estimated count.
Study Participants and Their Organizations
Demographics of the Hospital Managers.
Demographics of the Hospital Managers.
Distribution of Hospitals Across India That Were Taken into Consideration in Our Study.
For the purpose of evaluating the capacity of the hospital, the measure for this study was selected from the various OA tools as mentioned in the website of a UK-based company. 1 This tool has been numbered 8, called the capacity assessment guide, which is a well-structured questionnaire. It included 40 items and divided into six sections pertaining to capabilities: organizational foundation, organizational resources, organizational capacities, core task implementation, benefits and impacts, and external relations. Organizational foundation and core task implementation formed the individual factors, whereas benefits and impacts and external relations constituted the evaluation capacity outcomes. The organizational resources were further divided into physical and information resources, financial resources and human resources. Leadership, organization, and management and learning constituted the measures for organizational capacities. Organizational foundations represent an organisation’s vision, mission and strategy that are clearly defined, consistent and shared among staff. They represent the strategy that links core programmes with organisational capacities and environmental realities, to promote sustainable change. Organisational resources are the financial, human resource, physical and information resources of an organisation while organisational capacities encompass leadership, learning, administration and management. Core task implementation indicates the performance and accountability of staff in an organisation. Monitoring and evaluation provides feedback used for performance improvement and organisational learning. Benefits and impacts are indicated through the programmes that build sustainable local capacities and resources rather than dependencies making the beneficiary perceive and value benefits. Organisation creates and maintains stable relationships with external environment. Organisation builds alliances with and learns from other NGOs and competitive firms. This particular tool was selected due to its holistic nature of covering all important and critical aspects of organisational capacity. Moreover, it was also found to be depending upon the staff size, budget, organisational culture, leadership, capacity requirements, logistics and other complexities within these organisations (Hewlett Foundation, n.d.). The questions for evaluating each variable were measured on a five-point Likert scale with values ranging from one to five, where 1 = strongly disagree, 2 = disagree, 3 = neutral, 4 = agree, and 5 = strongly agree.
Data Analysis
The data collected were subjected to statistical analyses using statistical software IBM SPSS version 24, and meaningful inferences were drawn from the results. Various tests were conducted depending upon the study requirements. Descriptive statistics in the form of frequency with percentage and mean with standard deviation was used to summarize demographic data and other variables of the study. Pearson’s correlation was conducted to identify the gaps present in the capabilities of the hospitals using the organizational capacity tool, followed by which the assessment was tested for its reliability and validity. The reliability was tested using Cronbach’s alpha (α) as reported by Cronbach (1951). Confirmatory factor analysis (CFA) was done to measure how well the measured variables represent the number of constructs by assessing factor loadings, variance, and covariance (Bowen & Guo, 2012). After this, structural equation modeling (SEM) was used to evaluate any existing relationship using analysis of moment structures software. It is also known as analysis of covariance or causal modeling software. This helps in evaluating the goodness of fit of the theoretical model with the help of good and bad indices of fit such as chi-square, comparative fit index (CFI), Tucker–Lewis index (TLI), and root-mean-square error of approximation (RMSEA), respectively. RMSEA refers to the “discrepancy between the estimated and observed covariance matrices per degree of freedom in terms of the population, not the sample” (Hair et al., 2010), whereas the CFI compares the estimated model with the null model and is sensitive to the sample size of the study (Kline, 2011). TLI, on the other hand, “compares the estimated model fit to a null model and takes into account the model parsimony by assessing the degrees of freedom from the estimated model to the degrees of freedom of the null model” (Garver & Mentzer, 1999). It does not depend on the sample size. The recommended threshold values for χ2 / df were less than 3, RMSEA should be between 0.5 and 0.8, whereas the recommended values for CFI and TLI are more than 0.90 (Hu & Bentler, 1999). CFA of first order and second order were made to assess the higher order of the constructs. CFA analysis and SEM were considered as a two-step process (Jöreskog, 1993). This is the graphical equivalent of the mathematical depiction of the relationship of the explanatory variables on dependent variables.
Results
Correlation Studies
Table 4 demonstrates the mean, standard deviation, and correlation between all study variables, namely, organizational foundation, organizational resources, organizational capacities, core task implementation, benefits and impacts, and external relations. The highest capabilities were observed in organizational resources, particularly financial resources (4.17 ± 0.80) and lowest in core task implementation (3.07 ± 0.92). Statistically significant correlations at varying degrees were observed between the variables. The highest level of correlation was observed between benefits and impacts with external relations (r = 0.998). High level of association was also observed between core task implementation and benefits and impacts (r = 0.96); physical and informational resources and financial resources (r = 0.69), organizational capacity such as leadership with human resources (r = 0.85), benefits and impacts with organizational foundation (r = 0.96), and external relations also with organizational foundation (r = 0.96). Organizational foundation was found to be negatively correlated with organization and management (r = −0.30) as well as core task implementation (r = −0.23). Organization and management were also negatively influenced by organizational capacities such as learning (r = −0.17), evaluation capacity outcomes such as benefits and impacts (r = −0.28) and external relations (r = −0.287). The correlations were significant at P < 0.01 for all values mentioned above. From these results, it can be implied that a lot of gaps were identified in terms of capabilities of the hospitals used in the study. The managers perceive implementation as the major issue in capacity building. There was a clash between the vision and mission of the organization with communication within the peers. The divide and coordination between the structures of the organization prohibited problem-solving. Resources of all forms were associated with the supervisors and even higher authorities. Moreover, the top heads were linked to implementations of tasks. Within both the evaluation capacity outcomes, benefits and impacts are connected to the spread of external relations. Therefore, it is clear that these areas need improvement.
Reliability of the Assessment Tool
Correlation Between the Study Variables.
Correlation Between the Study Variables.
**Correlation is significant at P < 0.01. *Correlation is significant at P < 0.05.
Reliability Analysis.
Indices of Fit.
Indices of Fit.

Our results show that the OCA tool used here can be accepted as a critical instrument for the evaluation of organizational capacities. The research aim was fulfilled as all the proposed objectives were successfully met. The application of this new not-so-used assessment tool was found to be adept for testing capacity in hospitals. The gaps in capabilities were identified, and their associations with each other were pointed to overcome any forthcoming issues. Our study also validated the questionnaire and found it to be extremely reliable in nature. Core task implementation through development interventions lead to the long term benefit of the organization. Organisation learning and performance improvement will be developed through feedback on monitoring and evaluation of the core tasks. Organisation strategy and development is validated by the Core task implementation programmes. Furthermore, organisations can build alliances across segments to unravel development problems. To the best of our knowledge, this is the first study evaluating and validating any capacity assessment tool especially with respect to hospitals. Thus, this study can be considered as a pioneering work that establishes the authenticity of the scale. Moreover, it also suggests that improving organizational capacities require an integrated introspection of many factors apart from resources. Theoretically, a model demonstrating the supposed relationships between the variables could be successfully developed.
Limitations and Recommendations for Future Research
This study was restricted due to certain limitations common to empirical research. The number of hospitals spread across India is quite large; therefore, the sample size can be an issue. Moreover, not all the states were covered and only one representative from each hospital was considered which can be a source of bias. In addition, the sample population belonged to group with majority at the middle-level managerial positions. The perspective might change in the uppermost brass. Our questionnaire did not take into account governance and sustainability into picture. Our study shows a huge scope for future studies. This study only validates the capacity assessment tool; however, it needs to be measured with varied types of work personnel within the healthcare sector as there is a huge diversity in the work force of this area. Organisations with diverse workforce pose many challenges and the study using Organisational Capacity Assessment tools in such a scenario may yield noteworthy results. Even though there are some limitations in our study, we highly recommend the use of the tool in different areas to have a comparative opinion on the choice of tool selection. There can be differences in identifying gaps in capacity building between industries as each area works in a different manner. This tool can channelize the right number of resources and capabilities hopefully in the right direction. This can also form the basis for qualitative analysis so that the actual problem gets identified and fixed. In addition, changes in capacities due to functional or operational alterations within hospitals such as size, types of hospitals, and the services rendered by the hospitals can be considered in further studies.
