A Study on the R&D Performance of Government-funded Research Institutions According to the Change in the Performance Evaluation System in South Korea

Abstract

Since 2014, the evaluation system for government-funded research institutions (G-FRIs) has undergone significant reforms aiming to improve the quality and utilisation of performance outcomes. The performance evaluation system for national R&D projects has also been enhanced to encourage the active dissemination of research outputs.

The present study aims to analyse the relationship between the changes in the performance evaluation system and the main research and development outcomes of these institutions, while considering the period before and after these systemic improvements. This study analyses whether the improvement of the evaluation system and performance indicators over the past decade (2011–2020) has had a significant impact on scientific and technological achievements, economic performance, and diffusion of achievements.

The research results revealed that there was a decrease in overall scientific and technological outcomes, particularly in the number of patents granted, following the improvements made to the performance evaluation system. However, it was also observed that certain aspects of performance dissemination showed significant positive effects as a result of the evaluation system improvement. Specifically, the analysis indicated that there were significant impacts on technology transfer rates relative to Article publication and patents, suggesting that the evaluation system improvement had positive effects in some aspects of performance dissemination indicators.

Keywords

Government-funded research institutions evaluation system research and development performance national R&D project evaluation performance indicators

Get full access to this article

View all access options for this article.

References

Brown

M. G.

, & Svenson

R. A.

(1998). Measuring R&D productivity. Research-Technology Management, 41(6), 30–35.

Crespi

, & Geuna

(2004). The productivity of science: A cross-country analysis. Science and Public Policy, 31(6), 421–435.

Freeman

, & Soete

(1997). The economics of industrial innovation (3rd ed.). MIT Press.

Griliches

(1980). Returns to research and development expenditures in the private sector. In Kendrick

J. W.

& Vaccara

(Eds.), New developments in productivity measurement and analysis (pp. 419–454). University of Chicago Press for NBER.

Jeon

, Geetha

, Kang

, & Narayanamoorthy

(2022). Development of the evaluation model for national innovation capability. Technology Analysis & Strategic Management, 34(3), 335–348.

Krishna

V. V.

(2014). Changing governance of science, technology and innovation: The emerging knowledge economy and the policy challenge. Science, Technology and Society, 19(2), 133–160.

Lee

J.-H.

, & Nam

C.-W.

(2020). An analysis of influence factors for acceptance of evaluation in government-funded research institutes in the science and technology field. Korean Urban Management Association, 33(2), 59–79.

Lundvall

B.-Å.

(1992). National systems of innovation: Towards a theory of innovation and interactive learning. Pinter Publishers.

Marinova

, Annandale

, & Phillimore

(2008). Innovation for sustainability: The role of government research and technology transfer. In Surborg

(Ed.), Innovation, sustainability and development (pp. 45–67). Edward Elgar Publishing.

10.

Min

C.-G.

, & Park

S.-W.

(2013). Factors affecting government-funded research institutes’ research performance analysis. Technological Innovation Research, 21(3), 121–140.

11.

Ministry of Science, ICT, and Future Planning. (2013–2014, 2020). Standard performance indicators for national research and development projects (3rd–5th eds.). (most.go.kr).

12.

National Research Council of Science & Technology. (2009–2020). Guidebook for institutional evaluation of affiliated research institutions. nst.re.kr

13.

National Science and Technology Commission. (2011). Second basic plan for national research and development performance evaluation (2011–2015). (most.go.kr).

14.

Rossi

P. H.

, Lipsey

M. W.

, & Freeman

H. E.

(1979). Evaluation: A systematic approach. Sage Publications.

15.

Schumpeter

J. A.

(1942). Capitalism, socialism and democracy. Harper & Brothers.

16.

H.-S.

, Park

H.-G.

, & Park

H.-J.

(2021). The impact of government-funded research and development project evaluation feedback activities on performance improvement. Journal of the Korean Association for Policy Analysis and Evaluation, 31(2), 59–83.