Abstract
BACKGROUND:
In recent years, the interest of performing research about and providing e-services for individuals with disabilities has grown significantly. However, there is a knowledge gap in the existing literature on how to stimulate the pre-requisites needed for a sustainable implementation of e-services.
AIM AND METHOD:
The study aims to contribute to this knowledge gap by performing semi-structured email interviews with twelve project coordinators from the EU programmes of FP6-IST and FP7-ICT.
RESULTS:
The findings showed that knowledge-based and financially based resources, the complexity of the project context, ethical issues and the structural responsibility of the implementation process were key issues in creating a sustainable implementation. Furthermore, users often were not able to perceive added value from the e-services as they seldom were developed beyond prototypes within the research project.
CONCLUSION:
The implementation of e-services and/or ICT based applications for individuals with disabilities face similar challenges to the challenges that have been identified when implementing IT-based innovations. Further studies should focus on how users can be involved in the choice and development of e-services they understand as effective, and how to ensure that the implementation strategy will contribute to long-term social inclusion, that is, sustainability.
Introduction
Implementation research
Research publications that focus on implementation in general, first began appearing in the 1970s, mainly originating from the United States during a period of growing concern about the effectiveness of public policy and its economic impact [1]. These studies are characterized for being explorative with an intention to explain implementation gaps from the perspective of central government policy makers and using a top-down perspective [2, 3]. Implementation studies of policies and programmes performed during the 1980s focus on the role of staff, who put the policies into action, and the importance of the decisions made when implementing policies for individuals and in organizations. These studies are mainly performed from a bottom-up perspective [4, 5, 6, 7, 8]. In the latter half of the 1980s, a new stream of implementation research emerged with a major focus on research methodology and on the sustainability of the results. These studies tend to be comparative case studies and aim to improve the understanding of the implementation processes of strategies, policies or programmes. The interest in implementation studies diminished, however, at the end of the 1990s and in the beginning of 2000s [3, 4, 9, 10].
A literature review on implementation research conducted during 2009–2014 within the areas of e-health, education, military defense and transport found some common success factors and barriers for sustainable implementation [11]. The common success factors include a common understanding of the implementation process among stakeholders, professional project and resource management during the implementation process, a strong guiding coalition and change champions and potential value for the end-users. The common barriers include lack of funding and governance, lack of stakeholder management, failed technologies and lack of added value for end-users. The success factors and barriers, and what actions to take to achieve a sustainable implementation are further described in Table 1.
Success factors and barriers for sustainable implementation according to [11]
Success factors and barriers for sustainable implementation according to [11]
E-services and/or ICT based applications for individuals with disabilities are supposed to contribute to diminish barriers and stimulate social inclusion because of their capacity to support interaction, connectivity 24/7 and diminish limit geographical boundaries. Most studies relating to this area, can be found in the e-health domain [12, 13] and in the educational setting. Studies can also be found on e-services that support individuals’ participation in the community and in the labor market [14, 15]. In general, the published studies with the focus on social integration of individuals with some disability seem to lack theoretical frameworks framing [16, 17] and the e-services or ICT based applications suggested or prototyped are usually developed without any participation of the end-users [18, 19]. Further, there are seemed to be a lack of studies that describe how the implementation process should be carried out and which factors that are of special relevance for a successful and sustainable implementation of e-services or ICT based applications for individuals with disabilities.
ICT-based applications and e-services as a means of inclusion has been a topic of growing interest in the academic discipline of informatics in recent years regarding both design [20], requirements engineering [21], accessibility [22, 23], and use [24]. Most of the reports in the area of informatics show that the implementation of e-services or of ICT based applications leads to failures, resistance to use the service or to non-optimal use of resources [25, 26, 27, 28, 29, 30, 31]. In general, however, there is a lack of studies that provide knowledge on successful implementation of e-services that support social inclusion of individuals with disabilities [32, 33]. The European Research Council (ERC) has stated to evaluate and measure the impact of implemented products and services designed and developed in projects supported by EU-grants [34]. To the best of our knowledge, despite the efforts performed in many projects, there are no generic models or methods (i.e. that includes guidelines, frameworks, norms or processes) that support implementation of services that aim to foster social inclusion of individuals with disabilities.
The purpose of this paper is therefore to explore factors that contribute to, or constrain, a sustainable implementation of e-services or ICT based applications for individuals with disabilities. The findings will improve the understanding of factors that need to be considered during implementation in order to achieve sustainability. We define sustainability as the benefits that e-service could bring to individuals with disabilities by increasing their possibility to become actively integrated into the society, not just temporary, but over a long-time period.
Methods
The data used in this study was collected in several steps. As a first step, we searched through the CORDIS1
EU database containing EU-granted research projects.
A total of 70 projects that matched the focus of our search were found within the FP7-ICT and the FP6-IST research program between 2004 and 2015. The rational for the choice of the time interval was that we searched for reported projects that, theoretically, should have the time needed to implement the achieved results. P7 stands for the Seventh Framework Program for Research and Technological Development and is designed to respond to Europe’s employment needs, competitiveness and quality of life. FP7-ICT addresses the information and communication technologies theme in the framework program [35]. FP6 is an abbreviation for the Sixth Framework Program for Research and Technological Development. The Information Society Technologies (IST) thematic priority aims to increase innovation and competitiveness in European businesses and industry and to help all European citizens so that they can fully benefit from the development of the knowledge-based society [36].
Twenty-four projects from FP7 and 13 projects from FP6 were excluded after reading the project descriptions and after comparing the aims and expected results described in the project applications. Criteria used for the exclusion of the 37 projects were: a) they referred to the implementation of medical technologies or devices which needs vast clinical trials, and b) they were focused on frameworks or policy development but not on the impact of the results for social inclusion of individuals with disabilities. Based on the 33 included projects, a project coordinator or contact person were identified for each project.
As a second step, online interviews were conducted with the chosen respondents. The rational for choosing interviews online rather than face-to-face was that online interviews give respondents flexibility in time and place to answer the questions. Online interviewing also brings opportunities of reviewing and carefully phrasing answers before sending them, in opposition to face-to-face interviews, where responses need to be immediate [37, 38]. Moreover, email interviews are automatically transcribed, as responses are given in a written format.
A research assistant contacted the project coordinators, or the contact person referred in the application of the included studies (
To diminish bias, we sent reminder three weeks after the deadline to non-respondents. After one more week, we tried to contact the respondents that did not answer our emails by phone. None of them were reached by phone. A possible explanation can be that phone numbers were not in use after the end of the projects. Two additional projects were excluded from the study as the email addresses of the projects coordinators or contacts persons had expired after the final report of the outcomes of the project. The total amount of emails sent was (
We received a total of twelve answers (ca 36% response rate). Six of the respondents were representatives from projects supported by the FP7-ICT research program and six were from the FP6-IST research program.2
From FP7-ICT research program: BackHome, AsTeRICS, BrainAble, ARGUS, REPLAY, Help4Mood (
The responses were analyzed by inductive content analysis to find significant concepts and patterns in the data [39, 40]. Codes representing significant concepts about sustainable implementation were extracted from the email interviews, and then grouped into categories. Only concepts with a high frequency (were more than 75% of the respondents included the concept in their responses) were included in this study. The following concepts were most frequently mentioned by the respondents: (i) resources (financial and human), (ii) the context, (iii) structural responsibility for the implementation process, and (iv) the status of the suggested product or service.
Even if the number of respondents (
The analysis of the collected data showed that there were some key issues, represented by the categories in the analysis, that influenced the possibility to achieve sustainable implementation of innovations aiming to support social inclusion of individuals with disabilities (Table 2).
Key issues (represented by categories) that sustain or constrain sustainable implementation of innovations supporting social inclusion
Key issues (represented by categories) that sustain or constrain sustainable implementation of innovations supporting social inclusion
There was a consensus among the respondents that knowledge and financial resources determined the ambition level of the implementation process and strategy. Difficulties to access previous knowledge and experiences about hindrances and facilitators that influence the implementation, the non-accessibility to final reports, or the non-accessibility to sampled information (some projects web-pages are even taken offline after the delivery of the final report), were one of the ma- jor issues. The respondents therefore stressed the importance of developing collaborative relationships with stakeholders such as, decision makers, representatives from organizations or associations and authorities.
Some of the respondents indicated that the absence of strategic financial resources made a generic implementation of the products or services produced during the program difficult. Further, due to that the project had a deadline, and because the products or services were mainly presented as prototypes it was difficult to develop a long-term implementation strategy.
The complexity of the context and the number of laws, rules, guidelines and ethical issues were perceived as a barrier for a generic implementation of the suggested innovations. One respondent expressed:
“The prototype was successful, but the ethical requirements limited the range of the study. Even when the complete product has been created it will be some difficulties to reach the market”.
The respondents were also aware of that sustainability could be compromised if the implementation process or strategy became dependent on a few key individuals or organizations. In some cases, the research groups got help from external actors (companies) to implement the final products. This ended in that the implementation documentation was not available to the public and thus it was not possible to generalize a process or strategy or to learn from success stories and failures was possible.
An interesting outcome from the interviews was that most of the respondents experienced that only having a prototype or testing the products on a limited number of users, constrained further implementation of the innovations developed in the project. Some respondents expressed that the projects faced difficulties in the final stages regarding the delivery of the product to the market. They said:
“We had developed a complete product ready to be commercialized. We offered the product through the project’ website but the main obstacle has been that no company in the Consortium was operating in this market. The actors in the consortium contributed to the development but not to the commercialization of the product. This market is not easy, all the purchases are made by the social services organizations, normally public owned, so it is difficult to sell a completely new product in a sector that has very limited budget”.
Another respondent stated: “A pre-product exists, and we are exploring ways to go to market via piloting activities. The main obstacle has been to find seed funding to make the product market-ready”.
It is, however, interesting to note that one respondent expressed that the product developed was still alive after the end of the project. However, they could not implement the product in a larger scale because of the absence of a sustainable market for this type of products or services.
From the results, it can be concluded that the implementation of e-services and or ICT based applications for individuals with disabilities face similar challenges to the challenges that have been identified when implementing IT-based innovations [11]. Predictably, the findings demonstrate the importance of financial resources, of the context, the structural responsibilities and the status of the delivered product or services, and they are consistent with previous studies [11].
However, the implementation of e-services for individuals with disabilities demands the existence of evidence regarding the efficiency and effectiveness of the services for the core group [32]. Users will not use technology because it is needed, users will use technology if they feel satisfied with it, and if it does not bother their health conditions [41]. Therefore, it is not sufficient to ignore the end-users and involve the professional staff only [39]. In addition to this, it seems that it is necessary to create a unified identity in which all actors participate, share knowledge and match the demands from producers, consumers and users of the services [42]. Four major factors for a successful implementation of services and products that support social inclusion of individuals with disabilities were found in this study. The factors are interrelated and work together in such a way that not one single factor is either primary or by itself sufficient. Rather, each factor makes a contribution to achieve a sustainable implementation of the innovations suggested [43]. For example, an implementation strategy that secures financial resources, but fails to adopt itself to the demands of a complex environment, due to several laws and ethical rules, and that does not clearly identify division of responsibilities in innovation implementation will hardly survive in the long run [2]. Sustainability may also be difficult to achieve when the product or service is developed as prototypes or demo objects, even when they have been tested by a reduced number of representatives of the different stakeholders belonging to the context. Thus, sustainable implementation demands a range of interrelated factors [43]. Focusing on just a few factors while ignoring others may significantly hamper the sustainability of the process.
An interesting point that emerged from the findings was the importance of avoiding dependence on key persons and organizations for the transfer of knowledge and experiences to further studies. This is, nevertheless, an aspect which has received little attention in previous evaluation studies and indicates that implementation strategies with a high degree of dependence on key persons need to develop strategies for increasing the organizational interchange of knowledge and expertise.
This does not mean that further implementation projects and programmes will not include private actors. On the contrary, an extensive collaboration and openness to establish collaboration between different stakeholders can lead to increase the probability from key actors that innovations are sent to the market faster and that they follow effective and successful implementation strategies that can be adapted and further developed for some specific sectors and areas. For this it will be of key relevance to find alternatives that protect the intellectual property of the companies that develop models or implementation strategies and at the same time policies that stimulate companies to share documentation and experiences.
Limitations and suggestions for further research
Despite the limitations of the study: limited number of responses, the non-possibility to access to final reports, the absence of public documentation of implementation failure and success, the results provide information on issues that are of importance for the implementation of innovations in a sector that has growing importance in society.
Further studies should focus on: a) How to ensure that potential users, and especially individuals with disabilities are involved in the development of the product or services suggested and if the services and products improve social inclusion in the society b) how to ensure that the implementation strategy or model can contribute to increased sustainability of services and products.
Footnotes
Acknowledgments
Thanks to Owe Jansson, the research assistant who collected data both through the information search in Cordis and by sending the emails to the respondents.
Conflict of interest
None to report.