2. Carlo Gianelle, Fabrizio Guzzo
Evaluation of Smart Specialisation: Some introductory notes to the brainstorming session
Carlo Gianelle, Fabrizio Guzzo
Brussels, 24 January 2019

3. Some reflections to start with
What we mean by “evaluation” 01
Characteristics of Smart Specialisation policy and implications for evaluation 02 03
Choice of evaluation methods
The (important) relationship between monitoring and evaluation 04

4. What do we mean by "evaluation"?01
We use this term to refer to the application of quantitative or qualitative techniques with the aim to reach a better understanding of the mechanisms behind a certain observed course of action related to a policy intervention or relevant for the aim of the policy
DIRECT influence of the policy intervention on the relevant socio-economic outcomes
Factors and circumstances NOT directly related to the policy intervention which may influence the policy process and the policy outcomes

5. Characteristics of Smart Specialisation policy and implications for evaluation02
Smart Specialisation: a complicated and complex policy framework
Meta-policy – policy process reshaping other policy areas
Multi-level governance setting and multiple objectives
Selective public intervention – priority areas
Smart Specialisation evaluation: what?
POLICY – Impact of all strategies implemented in a defined area (e.g. EU level)
STRATEGY – Impact of a single strategy (e.g effects on the regional innovation ecosystem)
INSTRUMENTS (Specific objectives)

6. Choice of evaluation methods03
There is no superior method of producing evidence
The choice of methods needs to follow from the type of questions that are being asked
Use of different perspectives and methods

7. The (important) relationship between monitoring and evaluation04
The rationale is ultimately the same!  Better understand the reality of the policy intervention, compare it with expectations, and explain the possible gap
MONITORING: describe what is going on
EVALUATION: explain why we observe a certain situation
…we start evaluation by analysing the result and output variables in the S3 monitoring system

8. Any questions? You can find us at Carlo.GIANELLE@ec.europa.eu