European Commission IDEAS - New Delhi 14 April 2005 European Commission DG Budget – Evaluation Unit

European Commission DG Budget – Evaluation Unit Commission Communication on evaluation standards and good practise  Entry into force July 2003 Organisational context Main evaluation responsability on individual Main evaluation responsability on individual Directorates General (evaluation functions) Directorates General (evaluation functions) Centralised support and coordination Centralised support and coordination

European Commission DG Budget – Evaluation Unit Regulatory context Previous good practise guidelines Previous good practise guidelines Commission Communications: Commission Communications: - on evaluation (2000) - on Activity Based Management (2001) Financial regulation with rules on evaluation Financial regulation with rules on evaluation Internal Control Standards (evaluation is one of Internal Control Standards (evaluation is one of 24) 24)

European Commission DG Budget – Evaluation Unit Purpose and scope Purpose: Assist services in organising and managing their Assist services in organising and managing their evaluation activities evaluation activities Ensure quality of evaluation Ensure quality of evaluation Achieve usefulness and use of evaluation Achieve usefulness and use of evaluation Recognition of the importance of evaluation across Recognition of the importance of evaluation across management levels and decision-making management levels and decision-making

European Commission DG Budget – Evaluation Unit Scope: "Evaluation principles", resources, processes "Evaluation principles", resources, processes Evaluation function in all Commission departments Evaluation function in all Commission departments and the preparation, management and use of and the preparation, management and use of results of evaluation activities results of evaluation activities Type of evaluation: Type of evaluation: - evaluations of policies, programmes, activities,... (except individual projects)... (except individual projects) - ex ante, interim and ex post - internal and external

European Commission DG Budget – Evaluation Unit Structure 39 standards (binding) and 20 good practice 39 standards (binding) and 20 good practice (recommended). (recommended). Main sections: Evaluation function: profile, role, tasks, Evaluation function: profile, role, tasks, resources resources Evaluation activities: planning, feedback, Evaluation activities: planning, feedback, external communication external communication Evaluation process: evaluation project, steering Evaluation process: evaluation project, steering groups, conduct of evaluations groups, conduct of evaluations Quality of evaluation reports Quality of evaluation reports

European Commission DG Budget – Evaluation Unit Contents (1) – The evaluation function Profile, role, tasks and resources of the evaluation Profile, role, tasks and resources of the evaluation function function - Evaluation function with clear role and visible in the DG structure the DG structure - Support in the formulation of policies, programmes and management processes programmes and management processes - Adequate human & financial resources

European Commission DG Budget – Evaluation Unit Contents (2) – Evaluation activities Management of Evaluation Activities Management of Evaluation Activities - Annual and multi-annual planning - Feedback to decision-making process - Action on conclusions and recommendations - Dissemination of evaluation results

European Commission DG Budget – Evaluation Unit Contents (3) – The evaluation process - Design of an evaluation project - terms of reference reference - Steering Group - Managing evaluations: responsibilities, independence

European Commission DG Budget – Evaluation Unit Contents (4) – Quality of Report Quality of the reports. Quality of the reports. - Substance of the report - Conclusions and recommendations: non-interference and unbiased and unbiased - Recommendations: clear, useful, applicable

European Commission DG Budget – Evaluation Unit Regulation vs. persuasion Binding minimum standards & auditable Binding minimum standards & auditable Combined with good practices Combined with good practices Guidance on how to apply the standards Guidance on how to apply the standards Training & exchange of good practices Training & exchange of good practices

European Commission DG Budget – Evaluation Unit Acceptance and utilisation In the establishment phase Drafted with the involvement of an interservice Drafted with the involvement of an interservice working group working group Formal Interservice consultation (integration of Formal Interservice consultation (integration of comments) comments)

European Commission DG Budget – Evaluation Unit Acceptance and utilisation In the application phase Self assessment by services Self assessment by services - Compliance with Internal Control Standards (89% claim compliance) - Annual reporting cycle Questionnaire by DG Budget -open-ended with 2 Questionnaire by DG Budget -open-ended with 2 questions: questions: - Useful? - Changes needed? European Court of Auditors: auditing questionnaire European Court of Auditors: auditing questionnaire covering many standards covering many standards