Cluster policy is increasingly becoming part of many governments’ economic policy strategies. At the same time, evidence-based policy-making is gaining importance, bringing about a call for policy evaluation. Since the quality of the evaluation results depends highly on the method used, data, assumptions and techniques must be adequate for the specific evaluation question. This holds for cluster policy evaluation in particular, given the complexity and indirect nature of cluster policy interventions. This article provides an overview of evaluation methods suited to the ex-post analysis of cluster policy, covering both micro- and macroeconomic approaches.
Ahuja G. ( 2000) Collaboration networks, structural holes, and innovation: a longitudinal study. Administrative Science Quarterly45(3): 425-55.
2.
Angeles Diez M., Esteban MS ( 2000) The evaluation of regional innovation and cluster policies: looking for new approaches. Paper presented at the 4th EES Conference, Lausanne.
3.
Angrist JD, Krueger AB ( 2001) Instrumental variables and the search for identification: from supply and demand to natural experiments. Journal of Economic Perspectives15(4): 69-85.
4.
Aranguren MJ, Larrea M., and Navarro I. ( 2006) The policy process: clusters versus spatial networks in the Basque Country. In Pitelis C, Sugden R, and Wilson JR (eds) Clusters and Globalization. Cheltenham and Northampton: Edward Elgar, 258-80.
5.
Arthurs, D., Cassidy E., Davis CH, and Wolfe D. ( 2009) Indicators to support innovation cluster policy . International Journal of Technology Management45:3-4: 263-279.
6.
Ashenfelter O. ( 1978) Estimating the effect of training programs on earnings . Review of Economics and Statistics60(1): 47-57.
7.
Augurzky B., Kluve J. ( 2004) Assessing the performance of matching algorithms when selection into treatment is strong. RWI Discussion Paper No. 21, Essen: Rheinisch-westfälisches Institut für Wirtschaftsforschung.
8.
Autio E., Kanninen S., and Gustafsson R. ( 2008) First- and second-order additionality and learning outcomes in collaborative R&D programs. Research Policy37(1): 59-76.
9.
Bachtler J., Yuill D., and Davies S. ( 2005) Regional Policy and Innovation. EoRPA Paper 05/5, prepared for the twenty-sixth meeting of the EoRPA Consortium , Ross Priory.
10.
Becker SO, Ichino A. ( 2002) Estimation of average treatment effects based on propensity scores. Stata Journal2(4): 358-77.
11.
Benneworth P., Charles D. ( 2001) Bridging cluster theory and practice: learning from the cluster policy cycle, in Oecd (ed.) Innovative Clusters: Drivers of National Innovation Systems 389-403 . Paris: OECD.
12.
Benneworth P., Danson M., Raines P., and Whittam G. ( 2003) Confusing cluster? Making sense of the cluster approach in theory and practice. European Planning Studies11(5): 511-20.
13.
Blundell R., and Monica CD ( 2000). Evaluation Methods for Non-Experimental Data. Fiscal Studies, 21(4): 427-468.
14.
Boekholt P. ( 2003) Evaluation of regional innovation policies in Europe . In Shapira P, Kuhlmann S (eds) Learning from Science and Technology Policy Evaluation: Experiences from the United States and Europe. Cheltenham and Northampton: Edward Elgar, 244-59.
15.
Boekholt P., Thuriaux B. ( 1999) Public policies to facilitate clusters: background, rationale and policy practices in international perspective. In Oecd (ed.) Boosting Innovation: The Cluster Approach, 381-412 . Paris: OECD .
16.
Breiger RL ( 2004) The analysis of social networks. In Hardy MA, Bryman A (eds) Handbook of Data Analysis. London: SAGE, 505-26.
17.
Breschi S., Cusmano L. ( 2004) Unveiling the Texture of a European Research Area: Emergence of Oligarchic Networks under EU Framework Programmes. International Journal of Technology Management27(8): 747-772.
18.
Buchinger E., Wagner P. ( 2003) Evaluierung des Technologietransfer-Programms ‘TechnoKontakte Seminare’, Endbericht im Rahmen des Projektes 7.62.00083 im Auftrag des Österreichischen Bundesministeriums für Wirtschaft und Arbeit, Seibersdorf.
19.
Buendia F. ( 2005) Towards a system dynamic-based theory of industrial clusters . In Karlsson C, Johansson B, and Stough RR (eds) Industrial Clusters and Inter-Firm Networks. Cheltenham and Northampton: Edward Elgar , 83-106.
20.
Camagni RP ( 1995) The concept of innovative milieu and its relevance for public policies in European lagging regions. Papers in Regional Science74(4): 317-40.
21.
Campbell DT ( 1966) Pattern matching as an essential in distal knowing . In Hammond KR (ed.) The Psychology of Egon Brunswik. New York: Holt, Rinehart & Winston, 81-106.
22.
Cheshire PC ( 2003) Territorial competition: lessons for (innovation) policy . In Bröcker J, Dohse D, and Soltwedel R (eds) Innovation Clusters and Interregional Competition . Berlin: Springer, 331-46.
23.
Cochrane AL ( 1972) Effectiveness and Efficiency: Random Reflection on Health Services. London: Nuffield Provincial Hospitals Trust.
24.
Corbett T., Lennon MC ( 2003) Implementation studies: from policy to action. In Lennon MC, Corbett T (eds) Policy into Action: Implementation and Welfare Reform. Washington, DC: Urban Institute Press, 1-14.
25.
Corley EA ( 2007) A use-and-transformation model for evaluating public R&D: illustrations from polycystic ovarian syndrome (PCOS) research. Evaluation and Program Planning30(1): 21-35.
26.
Dar A., Gill IS ( 1998) Evaluating retraining programs in OECD countries: lessons learned. World Bank Research Observer13(1): 79-101.
27.
DTI (2004) A Practical Guide to Cluster Development: A Report to the Department of Trade and Industry and the English RDAs. London: DTI.
28.
European Commission (2002) Regional Clusters in Europe. Observatory of European SMEs 2002/3. Brussels: EC.
29.
European Commission (2004) Five-Year Assessment of the European Union Research Framework Programmes 1999-2003. Luxembourg: EC.
30.
European Commission (2006) Guidance on the Methodology for Carrying out Cost-Benefit Analysis. DG Regional Policy Working Document, 4. Brussels: EC.
31.
Florida R. ( 2002) The Rise of the Creative Class. New York: Basic Books.
32.
Flyvbjerg B. ( 2004) Five misunderstandings about case-study research . In Seale C, Gobo G, Gubrium JF and Silverman D (eds) Qualitative Research Practice . London: SAGE, 420-34.
33.
Formica P. ( 2003) Corporate governance of cluster development agencies: the case for market orientation. In Bröcker J, Dohse D, and Soltwedel R (eds) Innovation Clusters and Interregional Competition. Berlin: Springer, 241-71.
34.
Foss-Hansen H. ( 2005) Choosing evaluation models: a discussion on evaluation design. Evaluation11(4): 447-62.
35.
Fromhold-Eisebith M., Eisebith G. ( 2008) Looking behind facades: evaluating effects of (automotive) cluster promotion. Regional Studies42(14): 1343-56.
36.
Gabriel C. ( 2001) Constructing regionalized input-output tables: a new simple-to-use method. In Pfähler W (ed.) Regional Input-Output Analysis: Conceptual Issues, Airport Case Studies and Extensions, 75-87. Baden-Baden : Nomos.
37.
Gabriele R., Zamarian M., and Zaninotto E. ( 2006) Assessing the economic impact of public industrial policies: an empirical investigation on subsidies. Paper presented at EARIE annual conference, Amsterdam.
38.
Gebel M. ( 2006) Monitoring und Benchmarking bei arbeitsmarktpolitischen Maßnahmen. ZEW-Dokumentation 2006-01, Mannheim: ZEW.
39.
George AL, Bennett A. ( 2005) Case Studies and Theory Development in the Social Sciences . Cambridge, MA: MIT Press .
40.
Georghiou L., Roessner D. ( 2000) Evaluating technology programs: tools and methods . Research Policy29: 657-78.
41.
Ghauri PN ( 2004) Designing and conducting case studies in international business research. In Marschan-Piekkari R , Welch C (eds) Handbook of Qualitative Research Methods for International Business. Cheltenham and Northampton: Edward Elgar, 109-24.
42.
Gloor PA, Kidane YH, Grippa F., Marmier P., and von Arb C. ( 2008) Location matters? Measuring the efficiency of business social networking. International Journal of Foresight and Innovation Policy4(3-4): 230-45.
43.
González X., Pazó C. ( 2008) Do public subsidies stimulate private R&D spending ? Research Policy37(3): 371-89.
44.
Gordon IR, McCann P. ( 2000) Industrial clusters: complexes, agglomeration and/or social networks. Urban Studies37(3): 513-31.
45.
Grossman JB ( 1994) Evaluating social policies: principles and U.S. experience . World Bank Research Observer9(2): 159-80.
46.
GTZ (2007) Cluster Management: A Practical Guide. Eschborn: Deutsche Gesellschaft für Technische Zusammenarbeit (GTZ) GmbH.
47.
Guinet J. ( 2003) Drivers of economic growth: the role of innovative clusters . In Bröcker J, Dohse D, and Soltwedel R (eds) Innovation Clusters and Interregional Competition . Berlin: Springer, 150-60.
48.
Guy K. ( 2003) Assessing RTD program portfolios in the European Union . In Shapira P, Kuhlmann S (eds) Learning from Science and Technology Policy Evaluation: Experiences from the United States and Europe . Cheltenham and Northampton: Edward Elgar, 174-203.
49.
Hansen HF ( 2005) Choosing evaluation models: a discussion on evaluation design. Evaluation11(4): 447-62.
50.
Hartmann C. ( 2002) Styria. In Raines P (ed.) Cluster Development and Policy. Aldershot: Ashgate, 123-40.
51.
Hawe P., Webster C., and Shiell A. ( 2004) A glossary of terms for navigating the field of social network analysis. Journal of Epidemiology and Community Health58(12): 971-5.
52.
Heckman JJ ( 1979) Sample selection bias as a specification error . Econometrica47(1): 153-61.
53.
Heckman JJ ( 2004) Micro data, heterogeneity and the evaluation of public policy. American Economist48(2): 3-25.
54.
Heckman JJ, Smith JA ( 1999) The pre-programme earnings dip and the determinants of participation in a social programme: implications for simple programme evaluation strategies. Economic Journal109(457): 313-48.
55.
Heckman JJ, Ichimura H., and Todd PE ( 1997) Matching as an econometric evaluation estimator: evidence from evaluating a job training programme. Review of Economic Studies64(221): 605-54.
56.
Holland PW ( 1986) Statistics and causal inference. Journal of the American Statistical Association81(396): 945-60.
57.
Ichino A., Mealli F., and Nannicini T. ( 2008) From temporary help jobs to permanent employment: what can we learn from matching estimators and their sensitivity? Journal of Applied Econometrics23(3): 305-27.
58.
Imbens GW ( 2004) Nonparametric estimation of average treatment effects under exogeneity: a review. Review of Economics and Statistics86(1): 4-29.
59.
Jappe-Heinze A., Baier E., and Kroll H. ( 2008) Clusterpolitik: Kriterien für die Evaluation von regionalen Clusterinitiativen. Fraunhofer ISI Arbeitspapiere Unternehmen und Region 3/2008, Karlsruhe: Fraunhofer Institute for Systems and Innovation Research ISI.
60.
Jick TD ( 1979) Mixing qualitative and quantitative methods: triangulation in action. Administrative Science Quarterly24(4): 602-11.
61.
Jones MK ( 2004) The dynamic benchmarking of labour markets. Regional Studies38(5): 495-506.
62.
Keilbach M. ( 2005) Quantitative, Non-Experimental Approaches to the Microeconomic Evaluation of Public Policy Measures: A Survey. Discussion Papers on Entrepreneurship, Growth and Public Policy 2005-30, Jena: Max Planck Institute of Economics, Entrepreneurship, Growth and Public Policy Group.
63.
Koschatzky K., Lo V. ( 2007). Methodological Framework for Cluster Analyses . Fraunhofer ISI Arbeitspapiere Unternehmen und Region R1/2007, Karlsruhe: Fraunhofer Institute for Systems and Innovation Research ISI.
64.
Krugman PR ( 1991) Geography and Trade. Leuven : Leuven University Press.
65.
Lagendijk A. ( 1999) Innovative forms of regional structural policy in Europe: the role of dominant concepts and knowledge flows. In Fischer MM, Suarez-Villa L, and Steiner M (eds) Innovation, Networks and Localities. Berlin: Springer, 272-99.
66.
Larreina M. ( 2007) Detecting a cluster in a region without complete statistical data, using Input-Output analysis: The case of the Rioja wine cluster. CRIEFF Discussion Papers 706.
67.
LaLonde R. ( 1986) Evaluating the econometric evaluations of training programs with experimental data. American Economic Review76: 604-620.
68.
Learmonth D., Munro A., and Swales JK ( 2003) Multi-sectoral cluster modelling: the evaluation of Scottish Enterprise cluster policy. European Planning Studies11(5): 567-84.
Litzenberger T., Sternberg R. ( 2005) Regional clusters and entrepreneurial activities: empirical evidence from German regions. In Karlsson C, Johansson B, and Stough RR (eds) Industrial Clusters and Inter-Firm Networks. Cheltenham and Northampton: Edward Elgar, 260-302.
71.
Lublinski AE ( 2001) Identifying geographical business clusters: a critical review and classification of methods using I/O data. In Pfähler W (ed.) Regional Input-Output Analysis. Conceptual Issues, Airport Case Studies and Extensions, 37-49. Baden-Baden: Nomos.
72.
Lublinski AE ( 2002) Geographical Business Clusters: Concepts for Cluster Identification with an Application to an Alleged Aeronautics cluster in Northern Germany. Dissertation, University of Hamburg.
73.
Lublinski AE ( 2003) Does geographic proximity matter? Evidence from clustered and non-clustered aeronautic firms in Germany. Regional Studies37(5): 453-67.
74.
Malmberg A., Maskell P. ( 2002) The elusive concept of localization economies: towards a knowledge-based theory of spatial clustering. Environment and Planning A34(3): 429-49.
75.
Mansfield E., Rapoport J., Romeo A., Villani E., Wagner S., and Husic F. ( 1977) The Production and Application of New Industrial Technology . New York: Norton.
76.
Marsden PV ( 2005) Recent developments in network measurement. In Carrington PJ, Scott J, and Wasserman S (eds) Models and Methods in Social Network Analysis. New York : Cambridge University Press, 8-30.
77.
Marshall A. ( 1920) Principles of Economics. London : Macmillan.
78.
Martin R., Sunley P. ( 2003) Deconstructing clusters: chaotic concept or policy panacea ? Journal of Economic Geography3(1): 5-35.
79.
Mohr LB ( 1999) The qualitative method of impact analysis. American Journal of Evaluation20: 69-84.
80.
Nagarajan N., Vanheukelen M. ( 1997) Evaluating EU Expenditure Programmes: A Guide. Ex Post and Intermediate Evaluation. Brussels : European Commission, DG Budget.
81.
Newman MEJ ( 2003) The structure and function of complex networks . SIAM Review45(2): 167-256.
82.
Newman MEJ ( 2004) Coauthorship networks and patterns of scientific collaboration . Proceedings of the National Academy of Sciences101 (suppl. 1): 5200-5.
83.
Oecd (1999) Boosting Innovation: The Cluster Approach. Paris: OECD .
84.
Oecd (2007) Competitive Regional Clusters: National Policy Approaches. Paris: OECD Reviews of Regional Innovation.
85.
Pelsoci TM ( 2005) Photonics Technologies: Applications in Petroleum Refining, Building Controls, Emergency Medicine, and Industrial Materials Analysis. NIST GCR 05-879, Gaithersburg, MD: National Institute of Standards and Technology.
86.
Pfähler W., Lublinski AE ( 2003) Luftfahrt-Cluster Hamburg Norddeutschland: Bestandsaufnahme, Perspektiven und Vision für die Zulieferindustrie. Frankfurt/Main : Lang.
87.
Popper KR ( 2002) The Logic of Scientific Discovery. London: Routledge.
88.
Porter ME ( 1990) The Competitive Advantage of Nations. The Free Press, New York.
89.
Raines P. ( 2002) Cluster policy - does it exist? In Raines P (ed.) Cluster Development and Policy . Aldershot: Ashgate, 21-33.
90.
Raines P. ( 2002b) The challenge of evaluating cluster behaviour in economic development policy. Paper presented at the International RSA Conference ‘Evaluation and EU regional policy: New questions and challenges’, Aix-en-Provence.
91.
Rip A. ( 2003) Societal challenges for R&D evaluation. In Shapira P, Kuhlmann S (eds) Learning from Science and Technology Policy Evaluation: Experiences from the United States and Europe. Cheltenham and Northampton: Edward Elgar, 32-53.
92.
Rosenbaum PR, Rubin DB ( 1983) The central role of the propensity score in observational studies for causal effects. Biometrika70(1): 41-55.
93.
Rosenfeld SA ( 2002) Creating smart systems: A guide to cluster strategies in less favoured regions. Paper prepared for the EU Regional Innovation Strategies Conference.
94.
Rossi PH, Lipsey MW, and Freeman HE ( 2004) Evaluation: A Systematic Approach (7th edn). Thousand Oaks, CA: SAGE .
95.
Ruegg R. ( 2006) Bridging from Project Case Study to Portfolio Analysis in a Public R&D Program: A Framework for Evaluation and Introduction to a Composite Performance Rating System. NIST GCR 2006-891, Gaithersburg, MD: National Institute of Standards and Technology.
96.
Ruegg R., Feller I. ( 2003) A Toolkit for Evaluating Public R&D Investment: Models, Methods, and Findings from ATP’s First Decade. NIST GCR 2003-857 , Gaithersburg, MD: National Institute of Standards and Technology.
97.
Schaffer WA ( 1999) Regional Impact Models. Regional Research Institute, West Virginia University, Morgantown, WV .
98.
Schilder A. ( 2000) Government Failures and Institutions in Public Policy Evaluation: The Case of Dutch Technology Policy. Assen : Van Gorcum.
99.
Schmidt CM ( 1999) Knowing What Works. The Case for Rigorous Program Evaluation. IZA Discussion Paper 77, Bonn.
100.
Schmitz H., Nadvi K. ( 1999) Clustering and industrialization: introduction . World Development27(9): 1503-14.
101.
Schütz H., Speckesser S., and Schmid G. ( 1998) Benchmarking Labour Market Performance and Labour Market Policies: Theoretical Foundations and Applications. Berlin : Wissenschaftszentrum Berlin für Sozialforschung Discussion Paper 198-205.
102.
Scriven M. ( 1976) Maximizing the power of causal investigations: the modus operandi method. In Glass GV (ed.) Evaluation Studies: Review Annual . London : SAGE, 1, 101-18.
103.
Shipp S., Chang C., and Wisniewski L. ( 2005) Evaluation Best Practices and Results: The Advanced Technology Program. NISTIR 2005-7174, Gaithersburg, MD : National Institute of Standards and Technology .
104.
Snijders TAB ( 2005) Models for longitudinal network data. In Carrington PJ, Scott J, and Wasserman S (eds) Models and Methods in Social Network Analysis. New York : Cambridge University Press, 215-47.
105.
Spackman M. ( 2007) Social discount rates for the European Union: an overview . In Florio M (ed.) Cost-Benefit Analysis and Incentives in Evaluation: The Structural Funds of the European Union. Cheltenham and Northampton : Edward Elgar, 253-79.
106.
Spencer L., Ritchie J., Lewis J., and Dillon L. ( 2003) Quality in Qualitative Evaluation: A Framework for Assessing Research Evidence. London: Government Chief Social Researcher’s Office.
107.
Sternberg R. ( 2003) New firms, regional development and the cluster approach: what can technology policies achieve? In Bröcker J, Dohse D, and Soltwedel R (eds) Innovation Clusters and Interregional Competition. Berlin: Springer, 347-71.
108.
Stufflebeam DL ( 1999) Foundational Models for 21st Century Program Evaluation. Evaluation Center Occasional Paper 16, Western Michigan University, Kalamazoo.
109.
Tornatzky LG ( 2003) Benchmarking university-industry relationships: a usercentered evaluation approach. In Shapira P, Kuhlmann S (eds) Learning from Science and Technology Policy Evaluation: Experiences from the United States and Europe . Cheltenham and Northampton: Edward Elgar, 223-43.
110.
US Department of Education (1999) Satisfaction with TRIO Programs: Final Report. Washington, DC: US Dept of Education.
111.
van den Hove N., Roelandt TJA, and Grosfeld T. ( 1998) Cluster Specialisation Patterns and Innovation Styles . The Hague: Ministry of Economic Affairs.
112.
van der Linde C. ( 2005) Cluster und regionale Wettbewerbsfähigkeit. Wie Cluster entstehen, wirken und aufgewertet werden. In Cernavin O, Führ M, Kaltenbach M, and Thießen F (eds) Cluster und Wettbewerbsfähigkeit von Regionen. Erfolgsfaktoren regionaler Wirtschaftsentwicklung. Berlin : Duncker & Humblot, 15-33.
113.
Wassermann S., Faust K. ( 1999) Social Network Analysis: Methods and Applications . Cambridge: Cambridge University Press.
114.
White H., Sinha S., and Flanagan A. ( 2006) A review of the state of impact evaluation. Paper presented at the 5th meeting of the DAC Network on Development Evaluation.
115.
Yin RK ( 2003) Case Study Research: Design and Methods (3rd edn). Thousand Oaks, CA: SAGE.
