1. 8 th euroCRIS Strategic Seminar, September 13 th – 14 th, 2010, Brussels | Mikael K. Elbæk, Technical University of Denmark Evaluation in OpenAIRE

2. OpenAIRE - factsheet Open Access Infrastructure for Research in Europe Programme: FP7 – Research Infrastructures Starting date: December 1, 2009 Duration: 36 months Budget: 4.1 Million 38 partners covering all European member- states – To be reached at www.openaire.euwww.openaire.eu 2

3. FP7 OA Pilot The European Commission launched the open access pilot in August 2008 in seven thematic research areas and it will run until the end of FP7: – Energy – Environment (including Climate Change) – Health – Information and Communication Technologies (Cognitive Systems, Interaction, Robotics) – Research Infrastructures (e-infrastructures) – Science in society – Socio-economic sciences and the humanities Special clause 39 : “In addition to Article II.30.4, beneficiaries shall deposit an electronic copy of the published version or the final manuscript accepted for publication of a scientific publication relating to foreground published before or after the final report in an institutional or subject-based repository at the moment of publication.“ 3

4. ERC OA guidelines The ERC Scientific Council's Statement on Open Access of December 2006 stressed the fundamental importance of peer-review in ensuring the certification and dissemination of high-quality scientific research, as well as the importance of wide access and efficient dissemination of research results. In December 2007, the ERC Scientific Council followed this up with Guidelines for Open Access. These Guidelines state that: – The ERC requires that all peer-reviewed publications from ERC- funded research projects be deposited on publication into an appropriate research repository where available, such as PubMed Central, ArXiv or an institutional repository, and subsequently made Open Access within 6 months of publication. – The ERC considers essential that primary data - which in the life sciences for example could comprise data such as nucleotide/protein sequences, macromolecular atomic coordinates and anonymized epidemiological data - are deposited to the relevant databases as soon as possible, preferably immediately after publication and in any case not later than 6 months after the date of publication. 4

5. European Helpdesk Promote FP7-pilot and ERC OA guidelines National Open Access Desks (27 countries) Provide OA “toolkits” for – Researchers – Institutions – Repository managers Setup 24/7 portal for deposit, search of OA publications Liaison with – Other European OA initiatives – Publishers – CRIS systems 5

6. Reaching out to EC members Region 1 North (DTU) Denmark (Technical University of Denmark) Denmark (Technical University of Denmark) Finland (University of Helsinki) Finland (University of Helsinki) Sweden (National Library of Sweden) Sweden (National Library of Sweden) Region 2 South (UMINHO) Cyprus (Universtity of Cyprus) Cyprus (Universtity of Cyprus) Greece (National Documentation Center) Greece (National Documentation Center) Italy (CASPAR) Italy (CASPAR) Malta (Malta Council for Science & Technology) Malta (Malta Council for Science & Technology) Portugal (University of Minho) Portugal (University of Minho) Spain (FECYT) Spain (FECYT) Region 3 East (eIFL) Bulgaria (Bulgarian Academy of Sciences) Bulgaria (Bulgarian Academy of Sciences) Czech Republic (Technical University of Ostrava) Estonia (University of Tartu) Estonia (University of Tartu) Hungary (HUNOR) Latvia (University of Latvia) Latvia (University of Latvia) Lithuania (Kaunas Technical University) Lithuania (Kaunas Technical University) Poland (ICM – University of Warsaw) Poland (ICM – University of Warsaw) Romania (Kosson) Slovakia (university Library of Bratislava) Slovakia (university Library of Bratislava) Slovenia (University of Ljubljana ) Slovenia (University of Ljubljana ) Region 4 West (UGENT) France (Couperin) France (Couperin) Germany (University of Kostanz) Germany (University of Kostanz) Ireland (Trinity College) Ireland (Trinity College) Netherlands (Utrecht University) Netherlands (Utrecht University) UK (SHERPA) UK (SHERPA) Austria (University of Wien) Belgium (Universtiy of Gent) Belgium (Universtiy of Gent) Norway (University of Tromsoe) Norway (University of Tromsoe) National Open Access Desks evaluating and disseminating policies & best practices 6

7. OpenAIRE infrastrucure basics Builds on European OA Repository infrastructure Researchers deposit once – Harvest from OpenAIRE compliant repositories – OpenAIRE provides “Orphan” repository Extend DRIVER guidelines for repository managers Based on DRIVER developed D-NET software toolkit Access to scientific publications – Search, browse – Visualization tools Provide monitoring tools for – Document/depositing statistics – Usage statistics from repository infrastructure Interoperation with other infrastructures 7

8. OpenAIRE in a nutshell OpenAIRE overall overview: functionalities and domains served 8

9. CERIF Data Model 9

10. OpenAIRE Data Model 10

11. OpenAIRE Controlled Vocs 11 NationalitiesAuthors Countries Organization s LicenseKindsArticles Languages DataSource Typologies DataSources FP7Subjects Projects _FP7subjects Projects nationality license_kind language country_of_origintypology

12. OpenAIRE Guidelines DC DRIVER guidelines +: projectID – dc:relation accessRights – dc:rights embargoEndDate – dc:date 12

13. Measuring success of OA in FP7 Document statistics for OA deposition – % rate of OA deposition Usage statistics on FP7 OA publications – Impact of OA deposited publications One WP dedicated in development of usage statistics service 13

14. Funders requirements (EC) Open Access evaluation: the following stats will be broken down by research area, programme, ERC, contract type (NoE, IP, etc.) country, institution, – total number of articles published in FP7 after August 2008 – total number of open access articles – average number of articles per project – total/average number of articles of SC39 projects – number of articles still in embargo period (those in 6 months embargo, those in 12 months, those with no embargo, i.e., gold) Project evaluation based on OA publication, broken down by research area, programme, funding (e.g., big vs. small projects), maturity of project (how long has it been going for), etc. – number of projects that have not published any articles – number of projects in the pilot that have not published any articles Overall compliance with the mandate (how many are, how many are not) – this in relative numbers 14

15. Usage statistics 15 Davichi / David Oliva, http://creativecommons.org/licenses/by/2.0/

16. Strategy for recording usage Based PRIUS model slightly adapted to OpenAIRE Basically the normalization will be done centrally – When – What – Who – Which 16

17. Usage statistics service for FP7 publications 17

18. Usage statistics service components Harvester/aggregator from OpenAIRE compliant repositories Service for processing usage data and produce meaningful statistics Provide web and graphical tools for – Managers – Funders – Researchers Service can easily be adopted to non FP7 publications (e.g. in DRIVER, …) 18

19. OpenAIRE compliant repositories Definition of OpenAIRE compliant repositories – OpenAIRE guidelines for usage statistics Align with current initiatives Support major usage data formats – Interoperability is important Support multiple transfer protocols OpenAIRE orphan repository (Invenio/CERN) to comply with guidelines 19

20. OpenAIRE partners expertise UNIBI, UGOE, SURF – National initiatives – OA-stat – PEER project – Knowledge Exchange Univ. of Minho – DSpace statistics plugin University of Athens – Processing of web server & application logs – Usage statistics application in TELPlus – Personalized applications in DRIVER & TELPlus 20

21. Services to repository managers & funders 21

22. Web graphical tool Statistics provided by publication 22

23. Web graphical tool Statistics provided by publication 23

24. Other article level stats Citations Web usage Expert ratings Social bookmarking Community rating Media/blog coverage Commenting activity More sophisticated types of usage metrics Tracking ‘conversations’ outside of the publisher Reputation metrics for users Tagging and more… Mark Patterson – PLoS.org - www.ape2010.eu/ppt_wednesday/15 _Patterson.pdf www.ape2010.eu/ppt_wednesday/15 _Patterson.pdf 24

25. Thank you 25 http://creativecommons.org/licenses/by/2.0/ by ky_olsenky_olsen

26. Open Issues Unique/persistent identifiers of publications – Publications on different repositories – Capture different versions/formats of same publication Exclusion of robots Repository platform specific implementations – Uniform approach? When? – What happens in thematic repositories? Volume of usage stats – OpenAIRE sets? 26

27. OpenAIRE workplan & timeline May-July, 2010 – OpenAIRE internal specifications for usage data and transfer specs November, 2010 – Usage data exchange guidelines for OpenAIRE compliant repositories – Harvester, aggregator service July, 2011 – Usage statistics service – Web usage statistics graphical tools 27