1. Pay for performance and impact evaluation design Practical lessons from OECD review Y-Ling Chi, OECD

3. Methods available Quantitative methods -Experimental methods Golden standard -Non-experimental methodology - Quasi experimental methods Qualitative methods

4. Non-experimental/Quasi experimental Quasi-experimental: Interrupted times series, regression discontinuity and score matching Non experimental: before/after intervention or treatment/control afterwards

5. Experimental methods = Randomized Control Trials (RCTs) Easy to understand Internal Validity External Validity BUT Timeline (very long) Strong civil society (hard to comply) Hard to implement (need to have experts) Expensive

6. INTERVENTION GROUP INTERVENTION GROUP Treatment control Treatment control t -0 t +1 intervention Evaluation: difference between control and treatment // difference in t-0 and t+1

7. How to understand Impact Evaluation? Design a proper impact model Translate impact model into quantifiable indicators Think about the design model Timing has to articulate within the implementation process Plan resources ahead (staff, implementation, analysis etc.) Once you finish, need good qualitative evaluation

8. Review from OECD countries  OECD countries don’t do well in terms of evaluation US Premier Hospital scheme example shows that evaluation is not central once the prorgam has been implemented. QOF shows that despite the yearly cost -1 billion pounds-, investment for evaluation is marginal but not even well performed.