1. Current Research Information Systems in Europe (and wider) for Evaluation and Management Prof Keith G Jeffery President Emeritus euroCRIS CERIF Opportunities and Trends

2. Structure Introduction to euroCRIS and CERIF CERIF Features CERIF for metrics Conclusion

3. Rationale Late 1960s: UNESCO/ICSU, Conference of Rectors of European Universities recognised needs – Recording and interoperating research information Used for – Research management and administration CVs, bibliographies… Finding collaborators (and competitors) Assisting proposal writing Research management decision support – Evaluation Scientometrics: output, outcome, impact Research is distributed nationally and internationally therefore need interoperation Research institutions Research Funders Innovators Media / Public

4. Before 2002 1984-87 IDEAS Project 1987-99 EXIRPTS Project 1987-1990 EC Expert Group CERIF91 1991 First euroCRIS conference Bergen 1993-2000 euroCRIS conferences supported by EC 1995-2001 Platform Group – Jostein Hauge, Marga van Meel 1997-1999 EC Expert Group CERIF2000 2002- euroCRIS as a registered not-for-profit organisation 2002 EU requested euroCRIS to maintain, develop and promote CERIF (as an EU recommendation to member states)

5. Membership Starting in 2002 with around 20 delegates… ~300 members in 42 countries; all continents except Antarctica

6. Strategic Partners formalising with LATTES In 2002 – none! Now….

7. Seminar Nothing in 2002 Very successful series starting 2003 Much participation by European Commission And of course strategic partners Has a real impact

8. Communications Website: nothing in 2002 – now (from 2011 annual report) Newsflash Annual Report (since 2010) Conferences – first one under euroCRIS August 2002; 2012 largest and best ever

9. CERIF 2002 basic EER data model – Formal Syntax – User semantics Extensions – Facilities – Indicators Language variants Semantic layer XML version LOD version Federated IDs CERIF EU Recommendation to Member States

10. CRIS-IR In 2002 CRIS and IR were different worlds. Progressive integration. Catalogue of IRs in euroCRIS DRIS Recognition of value of CERIF as metadata for IR OpenAIRE adopted CERIF COAR strategic relationship 2011 Rome Declaration

11. LOD Popular way to browse / query data W3C RDF Metadata standards in RDF – CKAN, eGMS, DC Some work on triplestores Generating from CERIF – Integrity – Consistency – View over CERIF Relates to ENGAGE Relates to VIVO Relates to PSI / e-Gov / data.gov initiatives

12. Projects UK Projects – CRISPool, IRIOS, R4R, MICE, Snowball, CERIFy, BRUCE, CIA, RMAS, RMAS-EE, IRIOS-2, UKRISS, C4D, REDIC, DESCRIBE, UniQuip UK Funder Projects – REF, GtR, ROS, EVAL EC Projects – ENGAGE – EuroRIs-Net – OpenAIREPlus – Many national projects Provide – Exposure and PR – Funding – Technology – Know-how 2002 – no projects 2008 – considered strategic 2010 first successes UK, EC

13. Suppliers Atira (now Elsevier) Avedas Symplectic Other nationally-based companies (e.g. CZ, SK) VIVO (US) Elsevier SCIVAL Thomson Reuters RIV Commercial market has arisen since 2003 Partly because of research evaluation Partly because of the desire to communicate the research of an institution Partly because of a desire to interoperate – Benchmarking – Administration (B2B)

14. Penetration of CERIF National standard in 10 European countries (UK, NO, BE, IT, DE, IS, DK, SE, CZ, SK); – Example systems: CRIStiN (NO); FRIS (BE) In use in (almost) all EU and EEA countries; Used as standard for ERC system Used as standard in MERIL (ESF) RI system Adopted by OpenAIRE community – Publication repositories, research evaluation for EC Framework Programmes

15. The Need Need for management of research information demonstrated by take-up Need for interoperation of research information – Benchmarking, evaluation, cooperation – Business-to-business between research institutions, funders, innovators etc – Coherent picture for government, public

16. Structure Introduction to euroCRIS and CERIF CERIF Features CERIF for metrics Conclusion

17. The Users Research and Development Information – For the political decision-makers – For the funding organisations – For the entrepreneurs – For the researchers – For the research managers – For the innovators – For the media – For the general public

18. Project Person / CV Institution Event Equipment Books Journal/article Patent Research Group Publisher Information of Interest

19. CERIF Model (EU Recommendation to Member States)

20. RESULT_PUBLICATION PROJECT ORGUNIT PERSON Result_Publication Can Express: Person A (DT1 - DT2) (is author of) Publication X Orgunit O(DT1 - DT2) (is owner of IPR in) Publication X Person A (DT1 - DT2) (is employee of ) Orgunit O Person A (DT1 - DT2) (is project leader of)Project P Person A (DT1-DT2) (is member of) Orgunit M Person A (DT1-DT2) (is member of) Orgunit N Orgunit M (DT1-DT2) (is part of) Orgunit O Orgunit N (DT1-DT2) (is part of) Orgunit O CERIF Expressiveness

21. Result_Publication Instance Diagram Person A Publication X OrgUnit O OrgUnit M OrgUnit N Project P member employee Part of owns IPR author Project leader

22. CERIF-CRIS related to other systems CERIF-CRIS as the centre of the organisation – Provides interlinking and interoperation WITHIN one organisation – Repositories (bibliographic, datasets) – Organisational administrative systems (Finance, HR…) – Web pages presentation (generate from CERIF- CRIS) CVs, bibliographies, project overviews…. – Directories and support of workflow

23. CERIF-CRIS in context Publication repository Dataset Software repository Finance system Human Resources system Project Management system CERIF-CRIS Web pages Directory Services

24. CRIS + Repositories at 1 institution CRIS Research Context [projects, persons, organisational units funding, products, patents, publications facilities, equipment, events] OA Repository (hypermedia) Documents e-Research repository Datasets and Software OAI- PMH Various protocols End-User CERIF

25. ….and multiple institutions CRIS OA repository e-Research repository CRIS OA repository e-Research repository CRIS OA repository e-Research repository End-User Institution AInstitution BInstitution C

26. The CERIF Solution (including OpenAIRE)

27. Integration of Repositories To view content in repositories through contextualised, structured metadata – E.g. Relate publication to: Persons Organisations Projects Funding Facilities Equipment Event Patent Product Repository metadata DC (Dublin Core) insufficient (as recognised by OpenAIREPlus when adopted CERIF)

28. Key Features Developed by international community – consensus Flexible and extensible Separation of base and link entities – Flexible / extensible – Rich semantics (role) – Temporal : it is the relationships that have duration Multi characterset Multilingual Formal Syntax – Efficient, accurate computer processing Declared Semantics – Including crosswalks for interoperation CERIF

29. Structure Introduction to euroCRIS and CERIF CERIF Features CERIF for metrics Conclusion

30. CERIF-CRIS Being Useful Researcher CVs Bibliographies Web pages (semantic web) Improved scholarly publications Improved research proposals Finding collaborators Finding reviewers Current awareness of relevant research activity Finding appropriate funding opportunities Innovation (knowledge and technology transfer) A CERIF-CRIS improves quality and reduces effort in daily work

31. But also…. Evaluation and Benchmarking – By funding organisations justifying their spend – By research organisations demonstrating their competence euroCRIS has an indicators Task Group – Bringing together the international teams (NL, DE, UK, NO) including CASRAI, Elsevier and Thomson- Reuters – To develop better metrics Output, outcome, impact

32. MICE Project: CERIF Architecture

33. CERIF Indicators Segment

34. Physical data Structure Indicators

35. Structure Introduction to euroCRIS and CERIF CERIF Features CERIF for metrics Conclusion

36. CERIF (Common European Research Information Format) – mature standard, only one of its kind in the world – used widely in many countries and several EC projects – commercial products support it, demonstrated benefits – EU Recommendation to member states – maintained / developed / promoted by euroCRIS euroCRIS (European Current Research Information Systems) – association of research information management professionals represents Europe and beyond – covers all aspects of research information management, incl. research evaluation – significant strategic partnerships – has experience in projects – ready for a wide action and cooperation CERIF