1. joaquim.bernardo@observatorio.p t J OAQUIM B ERNARDO Coordenador Adjunto do Observatório do QREN Deputy Coordinator of the NSRF Observatory

2. PORTUGUESE NSRF 2007-2013 - OVERVIEW PORTUGUESE NSRF 2007-2013 - OVERVIEW 2 THE INVESTMENT 21.5 M of EU Funds, 29.2 M of public expenditure and 44 M with private investment (current prices) MAIN STRATEGIC PRIORITIES Develop the skills of Portuguese - men and women; Promote sustained growth; Guarantee social cohesion; Ensure the qualification of the territory and the cities; Improve the efficiency of governance. OPERATIONAL PROGRAMMES 3 Thematic OP (Human Capital; Competitiveness Factors; Territorial Enhancement) 9 Regional OP (5 OP of the Mainland and 4 OP of the Autonomous Regions) 2 Technical Assistance OP (ESF and ERDF) 8 European Territorial Cooperation NSRF and OP Global Evaluation Plan 2007-2013

3. OVERALL APPROACH TO EVALUATION OVERALL APPROACH TO EVALUATION 3 The Portuguese NSRF and OP Global Evaluation Plan (GEP) 2007-2013 is based on an approach to evaluation that assumes the major importance of bridging None of these issues is independent from one another, so the main goal of the GEP is to INTEGRATE AND ARTICULATE THE EVALUATION NEEDS OF ALL NSRF AND OP STAKEHOLDERS, IN A SINGLE PLAN, SO ITS POSSIBLE TO HAVE A GENERAL PERSPECTIVE OF THE MAIN AREAS OF INTEREST OF THE NSRF ORGANIZATIONAL LANDSCAPE AND AVOID REPEATED EXERCISES. Evaluation Monitoring Strategy Operationalization Global Thematic/Sectorial NSRF and OP Global Evaluation Plan 2007-2013

4. OVERALL APPROACH TO EVALUATION OVERALL APPROACH TO EVALUATION 4 NSRF and OP Global Evaluation Plan 2007-2013 Evaluation Network NSRF Ministerial Coordination Committee OP Ministerial Coordination Committees Managing Authorities of the OP NSRF Observatory National Coordination Authorities of the ERDF, Coehesion Fund (IFDR ) and ESF (IGFSE) Monitoring Committees Other Stakeholders Ministries Coordination

5. OVERALL APPROACH TO EVALUATION OVERALL APPROACH TO EVALUATION 5 UtilityPartnershipFlexibility Accountability Independence The Global Evaluation Plan 2007-2013 join together a very significant number of evaluation exercises, all of them with the same values approach: These exercises are organized in two types of evaluation: Strategic Evaluation Operational Evaluation But strategic evaluations should produce operational consequences and vice-versa NSRF and OP Global Evaluation Plan 2007-2013

6. EVALUATION SCOPE EVALUATION SCOPE 6 The Global Evaluation Plan 2007-2013 has a very large scope, including the following topics: Main issues covered: Qualification of the portuguese population, Sustained growth, Social cohesion, Qualification of the cities and the territory and Governance efficiency – connected with the main priorities Funds actually spent: Structural Funds, Cohesion Fund, National Public Expenditure, Private Investment Time period: 2007-2013, with at least annual revision (dynamic/flexible planning) Geographical coverage: National, with a regional and/or transnational focus when necessary Target groups: Governmental institutions, Public Administration, Enterprises and their associations, Municipalities and their associations, Civil Society organizations, citizens in general NSRF and OP Global Evaluation Plan 2007-2013

7. MAIN EVALUATIONS PLANNED AND TIMING MAIN EVALUATIONS PLANNED AND TIMING 7 NSRF and OP Global Evaluation Plan 2007-2013

8. MAIN EVALUATIONS PLANNED AND TIMING MAIN EVALUATIONS PLANNED AND TIMING 8 NSRF and OP Global Evaluation Plan 2007-2013

9. MAIN EVALUATIONS PLANNED AND TIMING MAIN EVALUATIONS PLANNED AND TIMING 9 NSRF and OP Global Evaluation Plan 2007-2013 Major stages and objectives/aims of the on-going evaluations planned in the GEP: Operational evaluation stage (mainly 2009) - improve the strategic and operational management of the OP (information diffusion, selection criteria, monitoring, regulations, etc.) and/or of specific thematic areas of the NSRF. Focalized strategic evaluations stage (2009-2010) – global view of the NSRF implementation and macro-economic impacts, namely in order to contribute to the portuguese report containing information on the contribution of the OP to the cohesion policy. Mid term evaluations stage (2010 and mainly 2011) – global view of the performance of the OP and NSRF (intermediate results and impacts), in order to examine and, if necessary, review them (article 33.º of the regulation (CE) n.º 1083/2006). Global strategic evaluation stage (2012...) – general evaluations of the performance of the NSRF, manly to support the preparation of the next cycle of structural policies in Portugal.

10. MONITORING AND EVALUATION MONITORING AND EVALUATION 10 NSRF and OP Global Evaluation Plan 2007-2013 OperationalStrategic Selection Process Financial Execution Outputs Context/Environment Impact Analysis Operation Applyment Outcomes (results) Effects Global Evaluation Plan NSRF (2007-2013) Programmation P ROJECT LIFE CYCLE

11. USE OF EVALUATION RESULTS USE OF EVALUATION RESULTS 11 Based on a learning and improvement approach, the evaluation results will be used mainly to: 1.Analyse the impacts of the structural funds and the cohesion fund; 2.Determine whether any adjustments are necessary to improve programme effectiveness in: Programme strategy; Results and resources framework; Regulamentary framework; Activities… 3.Increase awareness and accountability on achievements; 4.Contribute to ex-post evaluations with valid information. NSRF and OP Global Evaluation Plan 2007-2013

12. IMPLEMENTATION AND METAEVALUATION IMPLEMENTATION AND METAEVALUATION 12 Main concerns: Launch and follow-up the evaluation exercises (one monitoring team for each exercise, including a representative of the NSRF Observatory) ; Contribute to the development of the evaluation market and methodologies Plan a metaevaluation. We believe that the evaluation itself should be formatively and summatively evaluated against its own goals, objectives, principals and standards of utility, feasibility, property and accuracy, so that its conduct is appropriately guided and stakeholders can closely examine its strengths and weaknesses. NSRF and OP Global Evaluation Plan 2007-2013

13. joaquim.bernardo@observatorio.pt Thank you for your kind attention (For more information of the Portuguese NSRF www.qren.pt)