1. Expert Evaluation Network
ESF
Expert Evaluation Network
VT/2010/014
As in this programming period on-going evaluations are not conducted on fixed dates, but on the basis of specific needs of each MS and/or ESF Operational Programme, the topics, scopes and methods of the evaluations vary significantly between the MS. It is therefore a challenge for the Commission services to gather, analyse and synthesise the findings of the evaluations conducted at national level. The Directorate General for Employment, Social Affairs and Inclusion has therefore decided to set up an Expert Evaluation Network entrusted with the detailed analysis and the synthesis of ESF evaluations carried out by MS and a synthesis at EU level.

2. Objective Main questions
Compile a comprehensive inventory of the ESF evaluations from MS
Learn about the ESF effectiveness and efficiency through MS evaluations
Main questions
What types of evaluations have been produced?
What methodologies and methods have been used?
What have been the preferred policy fields and themes for evaluations?
What are the quantitative and qualitative findings of the evaluations?
OBJECTIVE
The main objective of this contract is the setting up of an Expert Evaluation Network to compile a comprehensive inventory of ESF evaluations conducted by the Member States and .
The experts will first scan the available evaluations, and create a kind of inventory. This will be check with EMPL country desks through 03 whether the inventory is complete/correct, and only afterwards, experts will contact the relevant authorities in the MS for a last check. We see establishing a good relationships between the experts and the evaluation capacities as a crucial element of this assignment and building block for the future work.
The Commission envisages this network as a longer term initiative. This contract is seen as a first phase of this initiative.
The priority for this first phase of the network's work is to collect and summarise the main findings of all ESF related evaluations available in the MS and relevant information about ongoing or planned evaluations.
The detailed analysis of methodologies used, innovative approaches to evaluation, and good practices on evaluation, although certainly relevant, could be dealt with at a later stage.

3. Scope Deliverables evaluations related to ESF Operational Programmes
managed by the MS evaluation capacities (national or regional level)
27 Member States
programming period
Deliverables
27 Country Reports on evaluations carried out in the Member States
EU Synthesis Report
SCOPE
The scope of this contract covers the evaluations undertaken by the MSs during the programming period The scope includes all evaluations related to ESF OPs in all 27 MSs. The focus will be on evaluations undertaken or managed by the MSs' evaluation capacities in charge of the ESF OPs at national or regional level. However, evaluations carried out by independent bodies (unions, confederations of enterprises, banks, research institutions, etc…) may be useful as well, in particular in those Countries where "official" evaluations are missing.
DELIVERABLES
As for the country reports, the inventory phase is the main priority, which should be then followed by the analysis and synthesis of findings from indentified evaluations – presented by the ESF policy fields as they are outlined in the ESF Regulation.

4. Preliminary results
Draft inventories of evaluations planned, ongoing or finalised per MS
Conducted mainly at national level (except: BE, IT, AT, PL)
More process than impact evaluations (and within impact evaluations more TBE than counterfactual)
Main focus is on effectiveness

5. Draft Inventories Still partial results
Aim at covering all planned, ongoing and finalised evaluations
National experts to check with Managing Authorities
Regularly updated till June/July 2011

6. Draft Inventories

7. Following Steps Complete inventories Pilot Country reports
Final Report EU level (thematic analysis)

8. Contacts Coordinator:
Paolo PASIMENI – EC, DG EMPL, Evaluation and Impact Assessment Unit.
Back-up:
Agnieszka STERNIK – EC, DG EMPL, Evaluation and Impact Assessment Unit.