Abstract
This paper proposes a method for assessing a university-based entrepreneurship ecosystem, grounded in the identification of major stakeholders, entrepreneurship-related activities directly related to those stakeholders, and with an eye to more comprehensive experiential entrepreneurship education that goes beyond traditional classroom education. The method incorporates specific approaches with each major activity area as well as outcomes, which are then aggregated into overall ecosystem strategy and performance. The paper concludes with an approach to action planning and resource allocation staging for university officials and supporting government bodies.
Keywords
Introduction
Universities play a foundational role in a local and regional entrepreneurship ecosystem development and are recognised as an important source of new technology and new ventures for local entrepreneurship ecosystems around the world.
Entrepreneurship ecosystem research is generally viewed from a broader lens that spans venture development policies and programmes at the municipal, regional and country levels. At the ecosystem definitional level, Neck, Greene and Brush (2014) and Cohen (2006) specify ecosystems components as including an ‘informal network’, a ‘formal network’, government, policy, professional and support services, a venture capital industry, and a broader local and regional talent pool. Researchers such as Spigel (2017) have posited that entrepreneurial ecosystems have numerous cultural, social and material attributes that provide benefits and resources to entrepreneurs, or, are negative factors impeding new venture creation (such as a culture of risk aversion). Other studies have focused on specific country policies, including the venture investment funds, tax policies and other related initiatives, examining these in countries that include Israel, Ireland, Canada, South Korea, China and elsewhere (Armanios et al., 2017; Doh & Kim, 2014; McCann & Ortega-Argilés, 2016; Senor & Singer, 2011), including several studies that have challenged the impact of such investments in regional economic growth (McCann & Ortega-Argilés, 2016). And there is a substantial body of literature that has focused on the university context itself (DiGregoria & Shane, 2003), including the evolution and effectiveness of entrepreneurship education in the classroom (Aernoudt, 2004; Bae et al., 2014; Fayolle et al., 2006; Kassean et al., 2015; Katz, 2003; Kuratko, 2005; Solomon, 2007), the emergence of university-based incubators (Kim & Jung, 2009; Lasrado et al., 2016; Stal et al., 2016), and technology transfer practices and policies (Allen & O’Shea, 2014; Boh et al., 2016). These three components of classroom education, incubators and technology transfer are important elements in a university-based or specific entrepreneurship ecosystem, as are others that include faculty capabilities and experience, entrepreneurship centres and programme resourcing and venture mentoring.
Within this context of research, however, there does not yet exist a research-based assessment method by which universities can assess their respective ecosystems and plan future ecosystem initiatives in the years ahead. Providing such a method to assess and by which to develop a strategy within a university and its key external stakeholders is the focus and purpose of this paper.
University Entrepreneurship Ecosystem Stakeholders
Designing a granular entrepreneurship ecosystem assessment methodology requires a specific design approach. Given the substantial body of extant entrepreneurship ecosystem research, there are numerous potential variables for studying ecosystem status and growth. To narrow down the list of potential research variables that are most important for university entrepreneurship ecosystem assessment, we decided to:
identify major stakeholders in any robust entrepreneurship ecosystem, consider foremost those research dimensions most important and meaningful to these stakeholders and then create a research instrument that contains these selected stakeholder-relevant research variables.
We then organised a pilot study with the United States, Korean and Indian Universities to study their respective entrepreneurship ecosystem developments. With this approach, the assessment methodology was designed from the user’s perspective. Applying user-centred design to the structuring of a research instrument offers the promise of creating an instrument that is not only grounded in the literature but also relevant and useful to practitioners than an instrument based exclusively on past academic literature.
Accordingly, we identified the primary stakeholders in the university-based entrepreneurship ecosystem as (a) the entrepreneurs (who may be undergraduate students, graduate students, research staff, faculty and alumni returning to the university for help starting their companies), (b) teaching faculty, (c) professional staff responsible for venture incubators, (d) venture investors, (e) university leadership and (f) the government policy decision-makers. There are also (g) alumni who might fund entrepreneurship ecosystem activities, as well as (h) corporations that have an appetitive for the technologies developed by the entrepreneurs. As we delve further into a university-based entrepreneurship ecosystem, the definition of actors/stakeholders becomes fine-tuned to this specific context:
Within educational institutions themselves level, we can specify primary stakeholders as the following:
External to the university (meaning no formal or paid association as an employee or student of the university) but nonetheless primary actors/stakeholders in the entrepreneurial process are the following:
With these stakeholders identified, the authors held conversations with individuals representing each stakeholder group identified above, with the goal of several interviews each in the Boston (United States), Seoul (South Korea) and Vijayawada (Andhra Pradesh, India), the three regions specified in the research grant supporting this paper. These conversations revealed specific dimensions of entrepreneurship learning and activity most relevant to each type of stakeholder. We then operationalised these prioritised dimensions into a series of data-driven (not opinion-based or Likert-scaled) questions within each ecosystem dimension. This mapping of stakeholders to major ecosystem activity set is shown in Figure 1.

Ecosystem Assessment Dimensions
Experiential entrepreneurship education is different and shown to be more effective than traditional classroom-only entrepreneurship education. (Corbett, 2005; Mandel & Noyes, 2016). Experiential entrepreneurship education immerses students in the start-up world through a variety of mechanisms, including listening to and conversations with current entrepreneurs, working in paid internships for venture companies, and starting new companies themselves within an on-campus incubator, or helping to manage the incubator itself. Both the classroom and the experiential education model must be captured in a comprehensive university-based entrepreneurship ecosystem method.
As shown earlier, Figure 1 presents the model used as the basis for this ecosystem research methodology. It has five major dimensions: three internal to the university, and two external.
We now proceed to specific assessment dimensions within the framework. Figure 2 allocates these specific dimensions to the major components of our ecosystem assessment model.

Endogenous Ecosystem Assessment Dimensions: Areas University Leadership Can Control
Classroom Education
Entrepreneurship education in the classroom has become standard across most major global regions. There is evidence that such education increases student’s entrepreneurial inclinations (Bae et al., 2014). At the same time, not all entrepreneurship education is effective, and some researchers have found that certain commonly used pedagogies have harmed entrepreneurial intent (Kassean et al., 2015; Piperopoulos & Dimov, 2015). There is a substantial amount of research on the design of entrepreneurship curricula for undergraduates, as well as a smaller, more focused set of writings on courses for on technological entrepreneurship for graduate students (Béchard & Grégoire, 2005; Katz, 2003; Kuratko, 2005; McMullan & Long, 1987; Nichols & Armstrong, 2003; Solomon, 2007). Generally, universities offer Entrepreneurship Majors and Minors (for students not in Business or Management colleges or departments) with standard entrepreneurship courses and electives. The core courses tend to be in market opportunity assessment, entrepreneurial marketing, business planning, small business operations, and venture finance. Electives are found in family firms, social entrepreneurship, and specific technology areas of focus. More recently, ‘design thinking’ has also entered the entrepreneurship curriculum (Linton & Klinton, 2019; Von Kortzfleisch et al., 2013). At the graduate level, there are commonly masters programmes, an entrepreneurship track within the MBA, or shorter form entrepreneurship certificates.
For ecosystem assessment, five major components of classroom education are the following:
Work Internships
This is an essential part of experiential entrepreneurship education (Dhliwayo, 2008; Fayolle et al., 2006; Solomon, 2007). Here, we can differentiate the typical, more standard type of internship (several months during a summer session, paid or often, not paid) with the more serious form of experiential education generally known as ‘co-op’. Germany has a long history of work apprenticeships in engineering and manufacturing disciplines for young learners (Deissinger, 2015). In a more contemporary context, many schools in the United States feature cooperative education programmes as important elements of their curricula (Linn et al., 2004). For this assessment methodology, we are most interested not just the step-up function of going from short internships to longer duration, paid ‘Co-ops’, but also, those that are specifically focused on work in a start-up or growing venture companies. This too has been recognised as an important part of entrepreneurship education at the collegiate level (Mandel & Noyes, 2016; Scott et al., 2016). The benefit of extended work internships, or Co-ops for students in venture companies, is that it provides direct industry experience, and this experience proves important for start-up success. Based on this discussion, the assessment component for internship programmes needs to examine the nature and intensity of such internships. The methodology tracks the existence of a formal programme, the number of student placements, whether internships are developed specifically within early-stage venture companies, and the specific structure (duration, paid or non-paid), and the support staff required to implement an effective programme.
Venture Incubation
This dimension focuses on on-campus incubators, industry mentors and technology licensing offices (TLOs).
Exogenous Ecosystem Factors: Areas University Leadership Cannot Control
There are also many dimensions pertaining to university-originated venturing that a university leadership team cannot directly control, such as the investor community, legal frameworks regarding early-stage firm formation, and government policy at both the local and federal level. A university administrator, while not being able to directly control these elements, must nonetheless understand their state of development and impact on venturing within his or her university, and then engage in public and private forums to help shape policy if the administrator is so inclined.
Operationalising the Entrepreneurship Ecosystem as a Field Research Instrument
We designed an assessment tool to reflect our research and applied experience developing university-based experiential entrepreneurial ecosystems. It takes the form of a survey, which has 14 parts, each reflecting a component of the research model described above. We start with the Entrepreneurship Centre dimension because our partners in completing this survey have typically been such centres seeking self-improvement and benchmarking for best practices. This dimension and those following it are as follows:
To these endogenous factors, we also developed survey questions that examined exogenous factors, including the intensity of the local venture investment and service provider community supporting new ventures, private or public-funded incubators or accelerators in the same region as the university, networking events and directly supportive government policies and governmental or affiliated foundation-driven programmes in the form of educational initiatives for state-sponsored universities, venture subsidies, grants or co-investments.
Important exogenous factors are part of the country culture itself, which in the case of entrepreneurship includes both obvious and less obvious factors. For example, in India, most universities are non-residential. Students are often bussed to and from campus each day, limiting extracurricular engagement in various students or on-campus incubators to essentially day-light hours. This forces university administrators to try to convert extracurricular initiatives into curricular or for-credit activities, in which case, several years are needed for approval from the state or national-run institutions. Another cultural factor is the relationships between males and females (Noguera et al., 2013), where gender separation might easily lead to gender bias where young women might feel cultural pressure to not take leadership roles in starting new companies. Another similar factor is parental support for entrepreneurship. In certain cultures (such as the United States) there is considerable support; while in others (South Korea, India), less so (Parasuraman et al., 1996). This affects the availability of early-stage venture finance, much of which is ‘friends and family’ sources in different parts of the world.
These exogenous factors, while important for any university president, are not under her/his control, and were therefore not our major focus. However, we did gather data for these questions as an extended component of the research instrument.
The instrument was first developed and tested with academic partners in the state of Andhra Pradesh, with five participating engineering-focused universities. This fieldwork commenced in 2017. The assessment instrument went through several iterations over a year. Then, with funding from the Korean government funding, was further improved and applied to additional universities in the United States and South Korea. We also took pains to gather new data from the early Indian participants for new questions developed during the 2nd phase of the survey development.
The specific data elements for each university surveyed are close to one thousand specific items. In practice, gathering these data required pre-work by entrepreneurship staff at participating universities, at least a full day visit by our research team to the participating university, several days of follow-up gap filling for specific items, and several days of assessment on our part that resulted in a presentations to university leadership on assessment results and recommended improvements.
The vast majority of items within each dimension are based on actual activity levels, resources and venture outcomes. Moreover, universities are at present updating their surveys to review progress and update planning. Also, each dimension has outcomes data, such as the number of students enrolled, their discipline affiliations and the number of ventures created and the amount of venture finance raised by those ventures. In the surveys administered and analysed to date, one can see the relationship between strategies, processes and resources for ecosystem development and student participation and venture creation outcomes.
Two members of the research team always collaborated on scoring survey items. These scores were reviewed with respondents in follow-up meetings to help ensure correct interpretation of data or to request additional data. To develop scores for each component in the assessment framework, our research team created a scoring (from 1 to 5, 5 being best) for each question within each of the 14 dimensions above. The individual item scores are then averaged for the entire dimension, and this average dimension score (for example, an average 2.5 for items in the on-campus incubator dimension) used to develop a strategy and assess yearly improvement. Over time, the scoring will become increasingly normative as the number of university participants increases.
Sample Survey Results: A University in Andhra Pradesh, India
An example of the application of the method is shown and described in the next few pages. The university used as the example is itself not named, but for context, it is a large institution with more than 15,000 students and with a strong emphasis on engineering with multiple campuses not just with Andhra Pradesh but in other parts of India. It sits within the state Andhra Pradesh whose successive governments have realised that both employment and local societal innovation/problem solving should in part come from newly formed ventures from its local universities. As in other countries, private educational institutions tend to have more degrees of freedom to innovate in areas such as entrepreneurship education. In Andhra Pradesh, these are called ‘autonomous’ institutions. The university profiled here attained its autonomous status about 15 years ago and then, university status about a decade ago, allowing it to open multiple campuses across the country.
For this university, and the other four included in the pilot study, government policy and support for entrepreneurship played an important role. Most of the funding for the incubators and related training programmes came from national and state funding sources.
We now turn to the specific example of the application of the methodology to assess the current activity level and guide future recommendations. This university was selected for this description because it is the most advanced in terms of entrepreneurship ecosystems of the five institutions secured for the pilot study. In the case of this university, the chancellor was the direct and primary stakeholder.
Noting that there are 13 distinct dimensions in the assessment, Box 1 shows the actual questions for the undergraduate entrepreneurship education dimension, classroom-based, in terms of entrepreneurship majors, minors, specific courses, major content areas in the courses and student enrolments.
Box 2 shows the on-campus incubator questions. It includes factors such as existence, budget, major learning processes and key events hosted in the incubator, including early-stage grants and services provided to the ventures themselves. Box 2 also has its outcome measures, including ventures launched over specific periods, venture financing and firm survivorship.
Box 1.
Box 2. Survey Questions for an On-Campus Incubation System (Dimension 7 of the Framework)
Table 1 shows the overall results based on our two-person assessment of this particular university (two of our four authors always teamed up to perform the scorings). The scoring themselves was relative to levels of capabilities in each of the dimensions currently found in leading entrepreneurship programmes in the United States. The major findings in Table 1 are as follows:
The university has a well-established entrepreneurship centre that runs a variety of programmes, but lacked dedicated resources and focus. On the classroom education front, this university has no formal entrepreneurship learning programme at either the undergraduate or graduate level. It has several popular electives, however, with substantial student enrolment. Note, however, that from an experiential perspective, this university had a strong work internship programme, with nearly all students working in summer internships with local companies. This university’s strength is its on-campus incubator relative to the other Indian and South Korean pilot study members. The incubator produces many new ventures each year. At the time of this writing, it has 20 active ventures. Even then, the incubator has its deficiencies, including insufficient levels of early-stage grants or gap funding to support prototype development and market tests. The incubator also lacked a structured process for venture development that each venture could use for solution design, business modelling and financial projections and other aspects of business planning. In sum, the incubator is a collaborative workspace, with some mentoring at the R&D level, but not much else. Rounding out the assessment in the university’s process for technology licensing, alumni engagement and mentoring are weak and together with entrepreneurship curricula, make for clear areas for improvement.
Entrepreneurship Ecosystem Assessment for an Indian University
From these and other dimensions of the survey data, we were then able to develop a report for the Entrepreneurship Centre Director and the university’s senior leadership team that showed assessment scores and recommended action steps for each entrepreneurship ecosystem dimension, and then prioritise these based on our own judgment in terms of implementation stage or timing. This ecosystem improvement strategy, building on the findings from the survey, is shown in Table 2. This figure is the consolidated output of the assessment methodology.
Entrepreneurship Ecosystem Improvement Strategy for an Indian University
Stage 1: 1st Year
Stage 2: 2nd Year
Stage 3: Year 3 and beyond
For this Indian university, the focus of these recommendations was (a) improve the incubator with specific business model, channel design and business planning capabilities, (b) design a formal entrepreneurship curriculum as a platform that could be shared with both undergraduate and graduate students and (c) rework and improve the mentoring programme. At present, the mentors were engineering-focused; the teams themselves also needed business mentors. The last column in Table 2 is labelled ‘Phase’. This provides our collective recommendation on which areas should be improved first and those next.
Each university in the pilot has its own story to tell in terms of what occurs post-assessment in the form of tangible improvements. With 13 dimensions, each one the focus of potential improvement, university administrators must prioritise the work, not based just on the study results, but also, the political and funding realities facing their respective institutions. In the Indian university described here, the indicated improvements were difficult to implement in the year following our study. Its Entrepreneurship Centre was poorly resourced and inadequately funded. It did not have full-time dedicated staff and there was no systematic business planning process. At a higher level, entrepreneurship itself had many owners at the university but no central owner, making coordinated, focused efforts difficult. The Chancellor used this study plus other inputs to apply for a large national grant focused on university-incubator implementation, and that year, his university was recently selected as a recipient. Interestingly, the structure of the grant reimburses the university for its incubator operating expenses only based on outcomes, for example, the number of ventures launched and sustained. The potential funding is substantial but must be ‘earned’. The Chancellor began working with external partners to implement a more structured, proven business planning and mentoring process, with the associated learning programmes for students, venture coaches and external mentors. He is also transforming the Entrepreneurship centre from having no single dedicated person to three full-time staff persons. And perhaps most important, he has taken it upon himself to be the ‘owner’ and champion of entrepreneurship across the university’s various campuses.
Discussion and Future Direction
We conducted this assessment in a pilot form in the United States and South Korea, as well as India. Our future research is to expand the sample and to initiate comparisons by dimension across countries/cultures. For example, it is already clear that in India, entrepreneurship education is focused on product or systems development courses and extracurricular activities focused on solving societal and social problems in the local community. With a clear emphasis on product development, the Indian institutions lacked substantive programmes for actual venture development based on these technologies. This assessment methodology should also serve as the basis for ongoing self-assessment and programme improvement by the participating institutions.
There are many areas of future research. The impact of cultural differences is already clear for university entrepreneurship in our participating institutions. Factors such as gender, residential versus non-residential and parental encouragement deserve more careful study. Also, faculty hiring policies as they relate to entrepreneurship education are striking different and deserve further attention. The Indian participants wish to hire only PhD qualified faculty, so that even in a large faculty, one is hard-pressed to find the types of professors of practices so common to leading entrepreneurship programmes in the United States. A third area of study is the closeness and importance of university–industry partnerships for work internships as part of experiential education. In just our current sample, the United States and Indian universities each had strong internship programmes (including in small, medium-sized businesses), while the Korean universities lacked such programmes. One could posit that this might affect not only industry learning but a bright student’s willingness to start or work in a small company as opposed to always seek employment in a chaebol. Essential skill gaps as related to successful entrepreneurship outcomes is another area for research. The major knowledge gap among STEM students in all three venues—the United States, Korea and India—was financial acumen and translating that acumen into business models and plans for venture finance. In the assessment survey, we capture the course topics and can, therefore, look for the inclusion of these topics and eventual outcomes. The assessment methodology as a whole lends itself strongly for a study of best practices in all thirteen dimensions of the instrument.
The assessment methodology reported in these pages was a pilot study. There is quite a bit more information than one need to build a complete implementation plan for a university-based entrepreneurship ecosystem. These data include and public sources funding for ecosystem activities, the size and the willingness of academic units and faculty to participate in hands-on venture development activities, and the capacity and facility by technology from academic research laboratories can be used as the foundation for new ventures. Many of these data are gathered in the survey instrument and can be integrated into a strategy by knowing hands. More importantly, all the data in the survey dimensions are the basis for interesting conversations with major stakeholders on ecosystem design and improvement, the purpose of the method presented here.
Methodologically, up until this point in time, all dimensions have been treated as equal, for example, undergraduate entrepreneurship education factors as equal to graduate education factors, or on-campus incubation programmes equal to classroom entrepreneurship education generally, or mentor programmes the same as work internships, alumni engagement and so forth. As the database grows, one can consider weighting certain dimensions as more important than others, such as the intensity of an on-campus venture incubation system relative to simply tracking venture progress and entrepreneur success over time. At present, we chose not to make this type of value judgment. All are important; nor do we have the data yet to suggest which are more important than others.
As noted at the beginning of these pages, we did not dive deeply into those ecosystem factors external to a university, even though such factors can have a profound impact on a university’s entrepreneurship efforts. We reason that in the main, these ecosystem factors are outside a university’s control. A university might have a weak curricular and incubation process yet be surrounded by a powerful regional ecosystem that helps make its alumni successful entrepreneurs. However, our initial studies have shown that to achieve systematic success in the form of creating high impact, growing ventures from within the university, leadership must work diligently to build its entrepreneurship ecosystem and that this ecosystem must feature entrepreneurship education programmes, process-driven venture incubation and networking services to local investors.
Footnotes
Declaration of Conflicting Interests
The authors declared no potential conflicts of interest with respect to the research, authorship and/or publication of this article.
Funding
This paper is based on work funded by the Korean Institute for Startup Enterprise Development (KISED) and Seoul National University of Science and Technology to formalise an assessment methodology and apply it to a pilot sample of universities in the United States, Korea and India (Andhra Pradesh). The assessment survey is available for non-commercial use to interested readers employed by an educational institution or government ministry.
