1. C. CALZADA 13/11/08 Experience in France Impact Evaluation of financial aids to firms

2. Page 2 Evaluation Network Meeting C. CALZADA13/11/08 Purposes Network of the 24 regional offices of the France's National Institute of Statistics and Economic Studies (INSEE) Impact analysis – Quantify the impact on business performance in terms of a program to assist firms in a given territory Public financial aids and subsidies Efficiency vs. Effectiveness Ex-ante evaluation vs. Ex-post evaluation

3. Page 3 Evaluation Network Meeting C. CALZADA13/11/08 Review Public partners in region – 11 studies between 2004 and 2008 – 14 programs evaluated Development objectives of the partners : – improve the programs – call into question the appropriateness of financial aids and subsidies Experimental data vs. nonexperimental Matching methods Econometric estimation – Structural effects and selection bias

4. Page 4 Evaluation Network Meeting C. CALZADA13/11/08 Analytical tools StructuralEffects Comparison of distributions means GLM SelectionBias Matching methods Rubin Selectivity methods Heckman

5. Page 5 Evaluation Network Meeting C. CALZADA13/11/08 Case study ARDAN : Regional association for the development of new activities, National/Regional, Cne-Cnam Nonexperimental data : – Treatment group : 440 firms treated between 1999 and 2002 by ARDAN – Control group : 2 500 firms randomly – Matching with data from administrative sources in statistics : Sirene, Dads, Ficus

6. Page 6 Evaluation Network Meeting C. CALZADA13/11/08 Data sources Variables of interest : – Growth rate of value added and between T-1 and T+3 Explanatory variables : – T-1 : dated from the year before the obtention of aid (endogeneity problem) – sector activitiy, financial data, year of obtaining financial aid, location, firm size, year of creation of the firm

7. Page 7 Evaluation Network Meeting C. CALZADA13/11/08 Structural effects Generalized Linear Model (GLM) Productivity, investment rate, exportation rate, age of firm (4), sector activity (4), year of the financial aid (4), firm size (6), Ardan aid Differences of means Difference of means corrected Employment*+ 7,2+ 12,4 Value added*+ 13,7+ 16,7 Between T-1 and T+3

8. Page 8 Evaluation Network Meeting C. CALZADA13/11/08 Selection bias Evaluation model of RUBIN Causal effectEmploymentValue added Treatment group+ 11+ 15,5 Control group+ 15,5+ 23,5 Between T-1 and T+3

9. Page 9 Evaluation Network Meeting C. CALZADA13/11/08 Results

10. Page 10 Evaluation Network Meeting C. CALZADA13/11/08 Lessons learned Implementation tools : – Sharing tools in the regional network – Rapid and inexpensive – Econometric skills – Efforts in explaining the econometric results Tomorrow : – Strategy Insititute in region – Ex-ante evaluation (Crest, French ministerial statistical offices)

11. Page 11 Evaluation Network Meeting C. CALZADA13/11/08 Many thanks for your attention