1. Hungarian Evaluation Study Tour Dublin 8/9 May 2003 External Evaluation: A Consultant’s Perspective 1

2. Who We Are  consultancy, specialising in economic, public policy analysis  very wide experience in EU structural funds evaluation  assisting KPMG Budapest regarding ex ante evaluations (ECOP and EIOP) 2

3. Experience in Evaluation of Operational Programmes 3

4. Internal and External Evaluations Features InternalExternal Experience Can build internal capacityLarge cumulative experience, also related studies Expertise Can build specialist evaluation expertise Can have specialist sectoral expertise e.g. transport, environment IndependenceCan be difficult to balance with internal role Need for caution on conflicts of interest but can have credibility with EU Ability to influenceBeing internal helpsDepends on context CapacityReady availability, but ongoing commitment A flexible resource CostDepends on size, ongoing, full cost crucial High in short-term, but not ongoing 4

5. Areas to Watch  Terms of Reference  Clarity  Focus  Indicate Scale  Relationships  Be open post selection  Avoid surprises  Committees  Raise particular issues  Commission  Views external evaluators as its “people on the ground”  Must be kept in the loop 5