1. ESF Evaluation Partnership meeting 8 June 2010
II. DG EMPL evaluations

2. Ex post evaluation of the EQUAL Community Initiative (2000-2006)
II. DG EMPL evaluations
Ex post evaluation of the EQUAL Community Initiative ( )
Efie Meletiou, EMPL.03

3. Ex post evaluation of the EQUAL Community Initiative (2000-2006)
Finalised: April 2010
Delivered interim and final reports which include
9 case studies on each of EQUAL themes
inventories that can be a useful point of ref.
Innovations
Mainstreaming cases
Impacts
objective
to learn about ESF means & priorities and its management
audience
newcomers to ESF Directorates (A-B-C)
other DG EMPL staff who wish to learn about the ESF

4. Ex post evaluation of the EQUAL Community Initiative (2000-2006)
Provided answers on
Utilisation of funding
Effectiveness (generation of relevant and useful innovation)
Effectiveness & impacts (mainstreaming into policy and other)
Long-term impact potential
European Added Value
Use of results
Discussions on next ESF programming period
Developing social innovation dimension in EU policies and programmes (PROGRESS, BEPA, DG ENTR- new Research and Innovation Strategy)
objective
to learn about ESF means & priorities and its management
audience
newcomers to ESF Directorates (A-B-C)
other DG EMPL staff who wish to learn about the ESF 4

5. II. DG EMPL evaluations
Evaluation of ESF support to the integration of the ethnic minorities and migrants in the labour market
Agnieszka Sternik, EMPL.03

6. Evaluation of the ESF support to migrants and ethnic minorities
Timetable
Aug 2009 – Aug 2010
State of play
Interim report
Roma Thematic report – under revision
National case studies: AT, ES, FI, FR, GR, HU, IT, NL, PL, RO, SE, UK – missing DE, LT, SK
Validation survey with MAs – mid June
Focus groups: ES, LT, NL, RO - 2nd half of June
Draft Final report – July
Dissemination
Presentation of the results to the ESF partnership – Nov 2010 WG on Antidiscrimination

7. II. DG EMPL evaluations
ESF implementation in the period Template for EC reporting and 2008 outline report
Jeannette Monier, EMPL.03

8. ESF implementation in the period Template for EC reporting and 2008 outline report Terms of Reference
provide the Commission with a tested template based on:
a typology of Policy Areas
a typology of Interventions and
Common Indicators
that can generate a standardised set of tables on ESF use and implementation (based on data extracted from SFC 2007)
Template will be used by the Commission to report at EU level on ESF

9. → Feedback from steering committee and technical meetings
ESF implementation in the period Template for EC reporting and 2008 outline report Methods used by the contractor
Review of a sample of programmes, interviews with selected DG EMPL staff, and proposal of policy areas, intervention typology, and identification of a series of preliminary common indicators (CI)
Analysis of all the 117 OPs, analysis and translation of all the selected indicators (about 5,000 out of more around 7400)
→ Feedback from steering committee and technical meetings

10. ESF implementation in the period Template for EC reporting and 2008 outline report Policy areas
6 policy areas:
1. adaptability,
2. access to employment,
3. social inclusion,
4. human capital,
5. partnerships, pacts and initiatives through networking,
6. institutional capacity (the last two being means to achieve goals in the first 4 areas)
Derived from ESF regulation, linked to specific EES guidelines and related objectives of social OMC

11. Overall disbursement per policy area, 2008
ESF implementation in the period Template for EC reporting and 2008 outline report Example of chart for reporting
Overall disbursement per policy area, 2008

12. ESF implementation in the period Template for EC reporting and 2008 outline report Types of interventions
1. Dissemination of information and TIC
10. Support for self-employment and start-up
2. Lifelong learning in firms
11. Participation of migrants in employment
3. Human potential in research and innovation
12. Anticipation of economic changes
4. Women access to employment
13. Labour market institutions
5. Other social infrastructure
14. Reforming education and training systems
6. Social inclusion of disadvantaged people
15. Participation in education & training throughout lifecycle
7. Adaptability of employees and enterprises
16. Education infrastructure
8. Activation and prevention on labour market
17. Partnerships
9. Active ageing
18. Institutional capacity

13. Policy area « Access to the labour market »
ESF implementation in the period Template for EC reporting and 2008 outline report Examples of possible common indicators
Policy area « Access to the labour market »
Number of unemployed people in employability and training activities (output)
share of unemployed in employability and training activity who gained a qualification (result)
Number of unemployed people who exit unemployment (result)
Young unemployed who exit unemployment
unemployed who exited unemployment and still hold a job after at least 3 months

14. ESF implementation in the period Template for EC reporting and 2008 outline report Consultation of MAs
Estimates displayed in Excel folder (policy areas, types of intervention, grouping in a common indicator)
Several ways to express comments
Comments on ‘problematic indicators’
Any suggestion on other alternative meaningful common indicators

15. II. DG EMPL evaluations
Evaluation of the capacity of the ESF delivery systems to attract and support OP target groups
Ines Hartwig, EMPL.03

16. II. DG EMPL evaluations ESF Evaluation expert’s network
Paolo Pasimeni, EMPL.03

17. ESF expert’s evaluation network
Why?
Under the current Regulations ongoing evaluations are conducted on the basis of specific needs of each MS and/or ESF OP and the topics, scopes and methods of the evaluations vary significantly between the Member States
It is therefore a challenge for the Commission services to gather, analyse and synthesise the findings of the evaluations conducted at national level.
Objective and scope
To set up an Expert Evaluation Network to collect, analyse, synthesise and aggregate evaluations carried out by the Member States.
Work will be based on evaluations undertaken or managed by the Member States' evaluation capacities in charge of the ESF OPs at national or regional level.
Will cover all evaluations related to ESF Operational Programmes (OPs) in all 27 MS.
One contract with one contractor who establishes a network of national experts. One national expert in each Member State.

18. ESF expert’s evaluation network
Tasks
A) At Member State level:
Producing 27 Country Reports on evaluations carried out in the Member States and a synthesis of these evaluations at EU level
B) At EU level:
Delivering a horizontal analysis of the main topics addressed in the Country Reports, aggregating evidence where possible, but also identifying important trends taking place in the Member States. It should also compare Member States' approaches to ESF evaluations.
Duration
The duration of the contract will be 12 months.
Probable start: September 2010

19. II. DG EMPL evaluations Evaluation of the ESF support to
Lifelong Learning
Matthieu Hebert, EMPL.03

20. Evaluation of the ESF support to Lifelong Learning - Background
Initial stage: preparation of the ToR
Indicative calendar: Sep. 10 – Sep. 11
New framework: New skills for new jobs, ET 2020, Europe 2020:
‘Youth on the move’
‘An agenda for new skills and jobs’
Particular relevance for 3 categories of citizens strongly hit by the crisis:
Young people of working age
Low-skilled workers
Older workers
objective
to learn about ESF means & priorities and its management
audience
newcomers to ESF Directorates (A-B-C)
other DG EMPL staff who wish to learn about the ESF 20

21. Evaluation of the ESF support to Lifelong Learning – Purpose and scope
Push further the analysis of the impacts and CAV (00-06) as well as outputs and results (07-13)
Assess coherence of ESF measures (content and delivery) with the new political framework
Scope: extremely focussed: ESF supported LLL activities linked to:
The integration of young people of working age into the labour market
Skills upgrading of low-skilled workers
Skills updating of older workers
Contribution to the discussion on next ESF programming period
objective
to learn about ESF means & priorities and its management
audience
newcomers to ESF Directorates (A-B-C)
other DG EMPL staff who wish to learn about the ESF 21

22. II. DG EMPL evaluations Evaluation of the reaction of the ESF
to the economic and financial crisis
Agnieszka Sternik, EMPL.03

23. Evaluation of the reaction of the ESF to the economic and financial crisis
Context
EU Recovery Plan – Nov 2008 in reaction to the crisis
ESF – key part of the ‘recovery toolbox’
Purpose
to review how the ESF reacted to the crisis
to analyse the ESF contribution to mitigation of the crisis
to assess the rationale of the ESF reaction to the crisis in the view of labour market policies and analysis
Scope
programming period with the focus on the period starting as from the 2nd half of 2008

24. Evaluation of the reaction of the ESF to the economic and financial crisis
Preliminary tasks
To take stock of the ESF policy measures introduced by MS in response to the crisis
To examine the extend to which the ESF contributed to mitigation of the crisis
To explore how the ESF can support the post-crisis recovery
To assess the effectiveness of the ESF as an emergency instrument
To draw up conclusions and recommendations for the ESF regulation post 2014
Methods
Desk research & MS based case studies
Timetable
Indicative calendar: Nov 2010 – Nov 2011