1. (C) Emmanuel JAECK Warsaw 2009 Key factors of a quantitative indicator system EJ-2007 1 Emmanuel JAECK Prefecture of the Midi-Pyrénées region / France Warsaw 2009 EJ\Warsaw-2009.ppt Sixth European Conference on Evaluation of Cohesion Policy New Methods for Cohesion Policy Evaluation: Promoting Accountability and Learning

2. (C) Emmanuel JAECK Warsaw 2009 Key factors of a quantitative indicator system EJ-2007 2 Emmanuel JAECK Head of the Evaluation Unit Prefecture of the Midi-Pyrénées region (Managing Authority) FRANCE

3. (C) Emmanuel JAECK Warsaw 2009 Key factors of a quantitative indicator system EJ-2007 3 Midi-Pyrénées? Source : http://www.midipyreneeseurope.be/05_territoire/carte_00.html

4. (C) Emmanuel JAECK Warsaw 2009 Key factors of a quantitative indicator system EJ-2007 4 A consciously instrumental approach => Looking for causal links

5. (C) Emmanuel JAECK Warsaw 2009 Key factors of a quantitative indicator system EJ-2007 5 1 – Multi-Level System

6. (C) Emmanuel JAECK Warsaw 2009 Key factors of a quantitative indicator system EJ-2007 6 Single Programming Document 2000-2006 Midi-Pyrénées 7 Priorities –23 measures 75 actions On 31 December 2006On 31 December 2006 15 760 operations entered15 760 operations entered 11 800 operations planned11 800 operations planned

7. (C) Emmanuel JAECK Warsaw 2009 Key factors of a quantitative indicator system EJ-2007 7 But in reality we have: 128 individual actions like Example of a heterogeneous action (territorial approach) Axe 2 ………..…….= Promouvoir les territoires de projets Measure 2.7….....= Accompagner le développement concerté et durable Action 2.7.2…….. = Soutien aux projets intégrés => Support to –Actions culturelles –Patrimoine rural –Insertion pas léconomie –Fiche industrielle et urbaine

8. (C) Emmanuel JAECK Warsaw 2009 Key factors of a quantitative indicator system EJ-2007 8 For 11,800 planned operations 202 output and result indicators 18 indicators for performance reserve 6 impact indicators And on 30 th October 2009 3.8 % of indicators not correctly registered (incomplete or incoherent)

9. (C) Emmanuel JAECK Warsaw 2009 Key factors of a quantitative indicator system EJ-2007 9 Key factors of: 1. 2.Collection System 3.Management of indicator data

10. (C) Emmanuel JAECK Warsaw 2009 Key factors of a quantitative indicator system EJ-2007 10 2 – Collection system A network of officers trained An information system A collection tool A procedure + A practical guide

11. (C) Emmanuel JAECK Warsaw 2009 Key factors of a quantitative indicator system EJ-2007 11 3 – Management of Indicator Data Contact with the promoter Control by examining department Quality control

12. (C) Emmanuel JAECK Warsaw 2009 Key factors of a quantitative indicator system EJ-2007 12 Sensitive points: System Design Implementation Use of Indicators

13. (C) Emmanuel JAECK Warsaw 2009 Key factors of a quantitative indicator system EJ-2007 13 Sensitive points : System Design The system cannot reflect everything. Striking the balance between monitoring and evaluation is a must. Un système qui répond à tous les enjeux de pilotage et aussi de gestion. The objectives of the actions are sometimes vague and choosing the indicators often follows later Higher level indicators to be precisely defined very early

14. (C) Emmanuel JAECK Warsaw 2009 Key factors of a quantitative indicator system EJ-2007 14 Sensitive points : Implementation Bear in mind that the system cannot quickly answer to questions on effects Train and support the persons responsible for the management of indicator data throughout the period Keep track of changes of reference documents (PO et Domo)

15. (C) Emmanuel JAECK Warsaw 2009 Key factors of a quantitative indicator system EJ-2007 15 Sensitive points : Use of Indicators Indicators should not become final objectives Integrate the natural dynamics of each action in target setting Take into account the internal factors influencing the progress of indicator values Communiquer avec rigueur et prudence à laide dindicateurs notamment si les précautions méthodologique ne sont pas entendables

16. (C) Emmanuel JAECK Warsaw 2009 Key factors of a quantitative indicator system EJ-2007 16 Pragmatic System under Control Legitimate Real Obligation Control from Supervising Authority Potential Sanctions

17. (C) Emmanuel JAECK Warsaw 2009 Key factors of a quantitative indicator system EJ-2007 17 Thank you for your attention