Expert Evaluation Network ESF Expert Evaluation Network VT/2010/014 As in this programming period on-going evaluations are not conducted on fixed dates, but on the basis of specific needs of each MS and/or ESF Operational Programme, the topics, scopes and methods of the evaluations vary significantly between the MS. It is therefore a challenge for the Commission services to gather, analyse and synthesise the findings of the evaluations conducted at national level. The Directorate General for Employment, Social Affairs and Inclusion has therefore decided to set up an Expert Evaluation Network entrusted with the detailed analysis and the synthesis of ESF evaluations carried out by MS and a synthesis at EU level.

Objective Main questions Compile a comprehensive inventory of the ESF evaluations from MS Learn about the ESF effectiveness and efficiency through MS evaluations Main questions What types of evaluations have been produced? What methodologies and methods have been used? What have been the preferred policy fields and themes for evaluations? What are the quantitative and qualitative findings of the evaluations? OBJECTIVE The main objective of this contract is the setting up of an Expert Evaluation Network to compile a comprehensive inventory of ESF evaluations conducted by the Member States and . The experts will first scan the available evaluations, and create a kind of inventory. This will be check with EMPL country desks through 03 whether the inventory is complete/correct, and only afterwards, experts will contact the relevant authorities in the MS for a last check. We see establishing a good relationships between the experts and the evaluation capacities as a crucial element of this assignment and building block for the future work. The Commission envisages this network as a longer term initiative. This contract is seen as a first phase of this initiative. The priority for this first phase of the network's work is to collect and summarise the main findings of all ESF related evaluations available in the MS and relevant information about ongoing or planned evaluations. The detailed analysis of methodologies used, innovative approaches to evaluation, and good practices on evaluation, although certainly relevant, could be dealt with at a later stage.

Scope Deliverables evaluations related to ESF Operational Programmes managed by the MS evaluation capacities (national or regional level) 27 Member States programming period 2007-2013 Deliverables 27 Country Reports on evaluations carried out in the Member States EU Synthesis Report SCOPE The scope of this contract covers the evaluations undertaken by the MSs during the programming period 2007-2013. The scope includes all evaluations related to ESF OPs in all 27 MSs. The focus will be on evaluations undertaken or managed by the MSs' evaluation capacities in charge of the ESF OPs at national or regional level. However, evaluations carried out by independent bodies (unions, confederations of enterprises, banks, research institutions, etc…) may be useful as well, in particular in those Countries where "official" evaluations are missing. DELIVERABLES As for the country reports, the inventory phase is the main priority, which should be then followed by the analysis and synthesis of findings from indentified evaluations – presented by the ESF policy fields as they are outlined in the ESF Regulation.

Preliminary results Draft inventories of evaluations planned, ongoing or finalised per MS Conducted mainly at national level (except: BE, IT, AT, PL) More process than impact evaluations (and within impact evaluations more TBE than counterfactual) Main focus is on effectiveness

Draft Inventories Still partial results Aim at covering all planned, ongoing and finalised evaluations National experts to check with Managing Authorities Regularly updated till June/July 2011

Draft Inventories

Following Steps Complete inventories Pilot Country reports Final Report EU level (thematic analysis)

Contacts Coordinator: Paolo PASIMENI – EC, DG EMPL, Evaluation and Impact Assessment Unit. Paolo.PASIMENI@ec.europa.eu Back-up: Agnieszka STERNIK – EC, DG EMPL, Evaluation and Impact Assessment Unit. Agnieszka.STERNIK@ec.europa.eu