1. Performance Evaluation of National R&D Program in Korea Performance Evaluation of National R&D Program in Korea AEA Annual Conference Nov. 13, 2009

2. 1. Purpose of R&D Performance Evaluation A nalyzing a whole process such as 「 Planning- Implementation-Result-Utilization 」 in line with strategic goals and indicators of national R&D program To improve the outcome and induce efforts of researchers ` To enhance the efficiency and effectiveness of national R&D investment 2

3. Investigation, analysis and evaluation - Input Accounts People - Output patent paper Resources & Output Performance evaluation - Input - Activity - Function - Output Purpose Performance management & evaluation - programs - Outputs - Outcomes - Impact Purpose & Performance management Purpose Focus Emphasis 1999 2005 2008 … -Special Law for S&T Innovation (1997) - S&T Framework Law - Law on Performance Evaluation and Performance Management of National R&D Program(2006) - Law on Performance Evaluation and Performance Management of National R&D Program(2006) - National Finance Law (2008) 3 2. Historical Perspective in KOREA

4. ※ NSTC : National Science & Technology Council / MOSF : Ministry of Strategy & Finance MEST:Ministry of Education, Science and Technology/ MKE :Ministry of Knowledge Economy NRF : National Research Foundation 3. Structure of S&T Administration System President NRF MKEOthers MOSF MEST KISTEP KIAT, KEITAgencies Main Bodies of R&D (Research Institutions under Research Council, Private Companies, Universities, etc.) NSTC 4

5. 4. R&D Management Process Planning R&D Program Program R&D Program Mgt Program Evaluation Budget Allocation Application of results <NSTC>NationalR&DMgt. Research Analysis Monitoring Budget Outcome planning NSTC Planning & Coordinating MOSF Budget Allocation Program Evaluation MEST, MKE, etc Planning R&D Program R&D Program Management KISTEP Supporting Whole Process, including NSTC ’ s Roles 5

6. 5. National R&D Program Evaluation System Feasi- bility Analysis Specific -Eval. (In- depth Eval.) Follow up Eval. Self- Eval. Meta- Eval. Self- Eval. Meta- Eval. Self- Eval. Meta- Eval. End year Evaluation- depth Start + 1year +3year SectionFeasibility AnalysisSelf -Eval./Meta -Eval.Specific(In-depth) Eval.Follow-up Eval. Organizatio n MOSFMOSF(NSTC) ActorKISTEP(Self-Eval.) each Ministry (Meta-Eval.) KISTEP KISTEP(Self-eval.) Each Ministry (Meta-eval.) KISTEP Target Newly proposed Program On going Program (triennial) Programs for which the self- evaluation result indicates the necessity of additional in-depth evaluation Terminated Program PurposeFeasibility(technology, policy & economic) Performance evaluation & performance management Relevance of structure, Effectiveness, etc. Impact assessment UsesMaking decisionCoordinate budget allocationRecommendation to program ministries Consult to another program planning ReportEach Ministry/MOSFNSTC/OGPCNSTC Ex-ante Ex-post Monitoring 6

7.  Session Agenda 1. Reformation of National R&D Program Evaluation System Mr. Woo Chul Chai 1. Reformation of National R&D Program Evaluation System Mr. Woo Chul Chai 2. In-depth Evaluation of R&D Program in Korea Dr. Seung Jun Yoo 2. In-depth Evaluation of R&D Program in Korea Dr. Seung Jun Yoo 3. Evaluation of National Science and Technology Innovation Capacity Mr. Seung Ryong Lee 3. Evaluation of National Science and Technology Innovation Capacity Mr. Seung Ryong Lee 4. The Effect of Institutional Evaluation System of GRIs on the Receptivity of Evaluation Result and the Performance of GRIs Dr. Soon Cheon Byeon 4. The Effect of Institutional Evaluation System of GRIs on the Receptivity of Evaluation Result and the Performance of GRIs Dr. Soon Cheon Byeon Discussion 7

8. Contact us : kbjok@kistep.re.kr