Data collection and validation support for the management of the ESF 2014-2020 Barbara Moench Impact Assessment and Evaluation DG Employment, Social Affairs and Inclusion Brussels, 13 June 2013

http://ec. europa. eu/social/main. jsp http://ec.europa.eu/social/main.jsp?catId=625&langId=en&callId=378&furtherCalls=yes 2

Content of the presentation Background Objectives Tasks / Deliverables Budget and duration Expertise sought and Award Criteria Timeline

Background (1) One of the guiding principles underlying the legislative proposals for Cohesion Policy is a strengthened performance orientation in programme design, implementation and monitoring and evaluation. Serious deficiency in the quality and reliability of the data transmitted to the Commission via SFC2014 could lead to a suspension of interim payments to Member States. 4

Background (2) The EC will continue to collate the aggregated data on common indicators received in structured form from the Member States and make them available as standardised reports. EC will have to update the SFC2007 application to SFC2014 and ensure that the system is operational and in line with the legal requirements for the 2014-2020 programming period. 5

Background (3) MAs will continue to be responsible for the collection, recording and storage and transmission to the EC of monitoring data, but will also be required to store data at the level of individual participants (micro-data). In order to verify the quality of the data, the EC will perform consistency checks on the data received. 6

Background (4) Possible anticipated sources of problems for data collection:  Authorities, bodies or beneficiaries understanding of indicator definitions recording, storing and reporting of appropriate data;  Recording of annual data (not cumulative);  Data quality;  Data protection requirements for processing and access of micro-data;  Reconciliation of different cut-off-dates;  Treatment of missing values;  Effective data validation system;  Reporting and retroactive correction of annual data;  Sampling technique ensuring representativeness:  ??? 7

Objective To assist MS in order to fulfil monitoring requirements on Data processing (in particular data collection, recording, storage) Transmission of structured data to the EC using SFC2014. To improve the quality of data on ESF interventions in terms of Reliability Consistency Meaningful aggregation 8

Tasks/Deliverables Development of a guidance document Set-up and running of a data support centre Methodological support Support regarding data collection, recording, validation, storage and transmission to the EC Support in upgrading of the common web application (SFC2014) Drafting and updating of FAQ guide 9

Tasks/Deliverables Development of a guidance document Analysis of data collection problems Suggestion of possible methodological and practical solutions This will result in overview of existing problems and gaps in the monitoring systems. 10

Tasks/Deliverables Set-up and running of a data support centre (1) Methodological support to MAs Clarify methodological questions Reply on any question for which guidance is already available Compilation of questions and responses for FAQ guide 11

Tasks/Deliverables Set-up and running of a data support centre (2) b. Support on data collection, recording, validation, storage and transmission to EC Monitor progress of monitoring information systems Assistance in identifying systemic weaknesses in data collection, recording and storage Technical and methodological advice to establish, improve or adapt monitoring information systems (data collection, recording and storage) to comply with monitoring requirements Methodological advice and technical support in set-up and running of data validation systems Upon request: Assistance in trial run of data processing 12

Tasks/Deliverables Set-up and running of a data support centre (3) c. Support in upgrading of the common web application (SFC2014) Methodological advice to the EC on interoperability of monitoring information systems and SFC2014 Upon request, technical assistance on data-immanent or methodological difficulties with SFC web application 13

Tasks/Deliverables FAQ guide Part one Solutions and principles of guidance document Part two Questions received and the responses provided In English, French and German EC will publish for download from ESF website 14

Tasks/Deliverables - General No audit tasks No support to remedy hard- and software problems and basic manipulations in the SFC2014 system For all support activities quality control routine, allowing MAs to evaluate quality and utility of services provided 15

Budget and Duration Maximum amount of the contract is 500 000 € Duration of the contract will be 12 months, renewable once. 16

Expertise sought / Selection criteria Proven experience in the field of the call, including in depth knowledge of data management, statistics and the European Social Fund In depth knowledge of management, aggregation, manipulation and quality of data and of descriptive and inferential statistics Proven track record in managing similar activities Organisational capacity, and excellent analytical and drafting capacity 17

Award Criteria (1) AC.1 Understanding of the services The degree of understanding of nature of assignment, context and results to be achieved AC. 2 Proposed methodology and tools Appropriateness, feasibility and robustness of methodology and tools proposed Quality and value added of the communication architecture to implement contract for efficient and effective delivery Quality of reporting and presentations 18

Award Criteria (2) AC. 3 Approach for management Organisational clarity, coherence and soundness of work plan; structure of team allocation of human resources, milestones, deadlines and critical path analysis and ability to complete work within time available Tailored quality assurance, quality control routine 19

Timeline Published in Official Journal no. 2013/S 100-170263 on 25/05/2013 Deadline for receipt of bids: 18/07/2013 Opening of bids: 01/08/2013 Start of Contract: End 2013 After 6 months of contract year: FAQ guide (update 6 months after) 20

Thank you for your attention 21