1. The interim evaluation of Horizon 2020 – the way forward
Liviu Stirbat DG Research & Innovation, European Commission

2. BFOR - EU Budget Focused on Results
1. In WHICH areas do we spend? European public goods with higher EU added value of funds
BFOR
Relevant for:
Annual budget
Discharge
Mid-term review
Post-2020 funding
4. HOW do we
communicate?
2. HOW do we spend? More leverage of EU funds More simplification efforts
3. How are budget implementation and performance ASSESSED? Rigorous application and further development of our control framework

3. BFOR – influence on Horizon 2020
Performance considerations taken into account in the design and implementation of Horizon 2020:
Flexible: able to focus and refocus on new priorities (e.g. Ebola, Migration)
Simplifications: reduce the administrative burden on beneficiaries/grantees and related costs of participation
Indicators: key elements to better measure the implementation and outcomes

4. Horizon 2020 – the policy cycle
Support new initiatives
Brief overview – ensure they understand where evaluation fits in BR and that it is BACKWARD looking exercise
Stress links between evaluation and IA

5. Horizon 2020 – Stronger links
Ex-ante impact assessment of Horizon 2020
Ex-post evaluation of FP7
Review of EIT
Mid-term evaluations of JTIs and the Art. 185s
Results/impact
Interim Evaluation of Horizon 2020
MFF proposal
Ex-ante impact assessment of the next EU FP
Ex-post Evaluation of Horizon 2020

6. Horizon 2020 – Interim Evaluation
Political context - Legal Requirements (art 32 of the Regulation setting up Horizon 2020 and art. 30 of the Rules for participation)
Better Regulation guidelines – raising the bar:
Effectiveness - do the effects correspond to the objectives?
Efficiency - were the impacts (benefits) achieved at a reasonable cost?
Relevance - do the objectives correspond to the needs?
Coherence - interventions do not contradict others with similar objectives
EU-added value - additional value from EU activities, compared to what could be achieved at other levels

7. HORIZON 2020 INTERIM EVALUATION PACKAGE
1) Staff Working Document
Evaluation results based on legal base requirements and five mandatory evaluation criteria of the Better Regulation Guidelines.
2) HLG report with recommendations
3) Commission Communication
Overall conclusions on the evaluation results.
State of implementation of the FP7 ex-post HLEG recommendations.
Commission's response to the HLG recommendations on interim evaluation.
It will also cover political messages on art. 185 and art. 187 initiatives.

8. TIMELINE Dec 2016: start of the HLG on Horizon 2020 Interim Evaluation
Oct/Dec 2016: on-line stakeholder consultation on Horizon 2020 Interim Evaluation
May 2017: publication of SWD on Horizon 2020 Interim Evaluation
June 2017: publication of Report of High Level Group; stakeholder conference on Horizon 2020 Interim Evaluation
Oct 2017: publication of Commission Communication on Horizon 2020 Interim Evaluation, including art. 185 and art. 187 initiatives

9. Methodologies EG - context
Evidence-gathering started for:
interim & ex-post evaluation of Horizon 2020
ex-ante assessment of successor
Previously, focus on:
management, implementation and efficiency
New focus on:
outputs, outcome/results and impacts
New methodologies and measuring techniques needed to help with our wealth of data
altmetrics, mining, Big Data, visualisation, etc.

10. Methodologies EG – Objectives
Develop and apply methodologies to identify:
• Relevance of the specific objectives of Horizon 2020 and their contribution to the Europe 2020 Strategy goals;
• Impact and contribution to tackle societal challenges (as defined in Horizon 2020) through FP4-H2020 by portfolio analysis;
• Success stories with the highest impacts.

11. Supporting and seeking for impact
ec.europa.eu/research/evaluations/