1. INNOVATION 2004 Prague, Nov. 30/Dec.1-3, 2004 The EUREKA Initiative: Assessment and Evaluation Procedures Svatopluk Halada EUREKA Secretariat, Brussels svatopluk.halada@es.eureka.be

2. Agenda  Hanover Declaration (1985)  Assessment and Evaluation Procedures  Competitiveness matrix  Criteria and Indicators  Project Assessment Methodology  Criteria and Indicators  Innovation and Competitiveness through R&D projects  How to measure competitiveness  Technological Innovation  Market Impact  Summarizing points of attention

3. Hanover Declaration - 1985 EUREKA Initiative’s primary objective is “to raise, through closer co-operation among enterprises and research institutes in the field of advanced technologies, the productivity and competitiveness of Europe’s industries and national economies on the world market”

4. EUREKA Mission  A European Programme and Network for market- oriented R&D and innovation activities  Integral component of the European Research Area  Strengthening European competitiveness  Promoting innovation in market-oriented collaborative projects

5. ASSESSMENT AND EVALUATION PROCEDURES OBJECTIVES  Assess added value: Trans-national R&D  Contribution to European competitivity  Identify success stories  Monitor project implementation  Input to strategic reviews  Raise visibility of the EUREKA INITIATIVE  Continual ENHANCEMENT OF EUREKA LABEL

6. EUREKA PROJECT ASSESSMENT AND EVALUATION PROCEDURES PHASES  Ex-ANTE (Project selection / assessment)  MONITORING (Project progress during implementation)  Ex-POST (Project results)  EXPLOITATION (Economic, technological, social impacts)

7. Assessment and Evaluation Ex-ante  Project selection procedure (EUREKA´s criteria )  Competitiveness Matrix (C-matrix)  Project Assessment Methodology (PAM)  Monitoring  Early progress check Ex-post  Final report of newly finnished projects  Report on Withdrawn Projects Exploitation  Market Impact Report  Continuous & Systematic Evaluation (CSE)

8. The criteria for a EUREKA project The project must:  Include partners from at least two EUREKA Members  The R&D content must concern development or application of innovative technologies within the EUREKA scope  Result in a marketable product, process or service  Be aimed at the civilian sector

9. Competitiveness matrix: 5 criteria Technological Innovation Output (max. 4 points) –product, process, service, etc. Consortium (max. 3 points) –quality, capability, capacity Costs (max. 2 points) Market Impact Market potential/perspective (max. 5 points) Market(ing) power of consortium (max. 4 points)

10. Competitiveness matrix TWO CRITERIA: TECHNOLOGICAL INNOVATION IMPACT ON THE MARKET

11. Project Assessment Methodology : 19 criteria Combination of:WeightPoints  Partner and consortium capabilities5max. 100 –financial –managerial  Project management aspects1,25max. 100 –organisation –task distribution –planning, milestones, etc.  Technology and innovation2,5max. 100  Market impact and competitiveness2max. 100

12. Project Assessment Methodology  PAM is obligatory since January 1st 2004 for 2 years pilot (implemenation) period  The first result is opening new ways of strengthening procedures especially for project assessment and monitoring  The second result is opening a new perspective in making European procedures for innovation projects like EUREKA projects more homogeneous in the future. This kind of “harmonisation” will really pave the way for a European innovation policy (not to assess several times the same project) Towards cohesion and innovation policy

13. Project Assessment Methodology Role and responsibility of forthcoming Czech EUREKA Chairmanship  Active involving in the present Working Group on  Project Assessment Methodology (PAM)  Continuous & Systematic Evaluation (CSE)  Preparation of the Evaluation report on results and output of PAM in implementation period 2004-2005

14. Innovation: views and cross-links  Product or service  Application  New  Improved  Existing  Technological  Non-technological  Varies per market, region and culture

15. Indicators for innovation assessment  Description of deliverables  Consortium composition R&D intensive companies (large/small) Involvement of universities/institutes  Partners’ commitment  Costs related to project activities

16. Market impact: views and cross-links  Usage value  Application spread / market size generic (many sectors) specific sector niche application own use (in case of process improvement)  Geographic spread / market size own country Europe worldwide  Transferability and spin-offs

17. Indicators for market impact assessment  Description of deliverables  Existing or new market application/sector, geographically market access business plan/model  Consortium composition users involved from how many countries industry or academia driven  Sales network of participants multinational companies vs. SMEs  Time to market

18. Summarizing points of attention The Hanover Declaration should be considered as the leading principle. A good understanding of the project outcome is essential. Inter-linkages/relations between assessment criteria should be taken into account. The quality of the consortium composition is a measure for the innovative/technological content of the project as well as for the market impact of the final project results. Time-to-market is an important element of the EUREKA Initiative; project duration in combination with total costs, project deliverables and marketing capacity of the consortium should be taken into account. Making good assessments is a matter of experience. It cannot be learned overnight. ‘Real world’ case discussions seem to be a good training tool.