1. IST- 2001-320015 OAForum: A European View on the Open Archives Initiative Museum Information on the Basis of an Open Standard Uwe Müller Humboldt University Berlin, Germany Electronic Publishing Group University Library / Computing Centre u.mueller@rz.hu-berlin.de

2. IST- 2001-320015 Uwe Müller, 21.11.2002, Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative Agenda 1.Open Archives 2.The Open Archives Initiative 3.OAForum: The European View 4.Open Access to Museum Information

3. IST- 2001-320015 Uwe Müller, 21.11.2002, Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative Open Archives Different types of archives scholarly publication server (pre-prints, e-prints) libraries (OPAC, e-journals) museum databases (object metadata) archives (historical documents) and cultural heritage education Origin self archiving unclosing existing databases establishing new databases open archives approach gains popularity cross archive access low cost dissemination of previously hidden resources building of new service provision

4. IST- 2001-320015 Uwe Müller, 21.11.2002, Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative Open Archives: Problems Problem: lacking interoperability different metadata standards Different terminology different languages different access strategies different interfaces / transfer protocols different copyright regulations Difficulty to establish new services cross archive access approach: Z39.50 protocol search distributed databases homogenously mainly used for bibliographic data

5. IST- 2001-320015 Uwe Müller, 21.11.2002, Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative Open Archives: Problems (2) Metadata different formats (DC, MAB, MARC, …) different interpretation possibilities (Creator: Author vs. Artist vs. Photographer) Transfer protocols libraries: Z39.50 NCSTRL: DIENST protocol harvest systems: HTTP based Search methods database based vs. file system based DB: real time, ODBC, SQL, PHP, Perl etc. FS: no real time, index file, SOIF

6. IST- 2001-320015 Uwe Müller, 21.11.2002, Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative Agenda 1.Open Archives 2.The Open Archives Initiative 3.OAForum: The European View 4.Open Access to Museum Information

7. IST- 2001-320015 Uwe Müller, 21.11.2002, Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative The Open Archives Initiative (OAI) Main ideas world-wide consolidation of scholarly archives free access on the archives (at least: metadata) consistent interfaces for archives and service provider effortless implementation based on existing standards (e.g. HTTP, XML, DC) Basic functioning HarvesterRepository Requests (based on HTTP) Metadata (encoded in XML) Metadata (Documents) Metadata Service ProviderData Provider Service

8. IST- 2001-320015 Uwe Müller, 21.11.2002, Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative OAI: Organisational Structure Steering Committee general policy of OAI 12 members (USA, United Kingdom, Germany) Executive Committee operational decision Carl Lagoze (Cornell University) Herbert van de Sompel (Los Alamos National Laboratory) Technical Committee formulation of the OAI protocol specification contact with OAI community Executive Committee + 14 members (USA, United Kingdom, Denmark, Switzerland)

9. IST- 2001-320015 Uwe Müller, 21.11.2002, Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative OAI: General Assumptions 2 groups of participants Data Providers (Open Archives, Repositories) free access of metadata not necessarily: free access to full texts / resources easy to implement, low barriers useable for small institutions Service Providers use OAI interfaces of the Data Providers harvest and store metadata may select certain subsets from Data Providers (set hierarchy, date stamp) may enrich metadata offer (value-added) service on the basis of the metadata

10. IST- 2001-320015 Uwe Müller, 21.11.2002, Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative OAI: Technical Model Service Provider e-print Data Provider e-prints e-print Data Provider Images e-print Data Provider OPAC e-print Data Provider Museum e-print Data Provider Archive Requests: Identify ListMetadataformats ListSets ListIdentifiers ListRecords GetRecord Responses: General information Metadata formats Set structure Record identifier Metadata Data Provider Harvester Repository

11. IST- 2001-320015 Uwe Müller, 21.11.2002, Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative OAI: Protocol Basics and Details Basics of OAI-PMH protocol based on HTTP request arguments as GET or POST parameters six request types e.g. http://archive.org?verb=ListRecords&from=2002-11-01 responses are encoded in XML syntax supports any metadata format (at least: Dublin Core) Details of OAI-PMH logical set hierarchy (definition: data providers) date stamps (last change of metadata set) error messages flow control

12. IST- 2001-320015 Uwe Müller, 21.11.2002, Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative OAI: Protocol Basics and Details (2) Metadata sets (Records) 1.header unique identifier (key for further archive requests), e.g. oai:HUBerlin.de:30000231 datestamp, e.g. 2002-11-01 logical sets in which the record is contained 2.metadata metadata prefix metadata set (at least: Dublin Core)

13. IST- 2001-320015 Uwe Müller, 21.11.2002, Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative Example: http://edoc.hu-berlin.de/OAI-2.0? verb=ListIdentifiers&from=2002-01-03&until=2002-01-08& metadataPrefix=oai_dc&set=doctypes:dissertations 2002-10-22T17:49:49+01:00 http://edoc.hu-berlin.de/OAI-2.0 oai:HUBerlin.de:3000819 2002-01-08 doctypes doctypes:dissertations dnb dnb:dnb33 oai:HUBerlin.de:3000831 2002-01-07 doctypes doctypes:dissertations dnb dnb:dnb27

14. IST- 2001-320015 Uwe Müller, 21.11.2002, Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative OAI: Data Provider Architecture SQL- Database OAI Data Provider Web server (e.g. Apache, IIS) OAI request (HTTP request) Programming extension (e.g. PHP, Perl) SQL request DB response OAI response (XML instance)

15. IST- 2001-320015 Uwe Müller, 21.11.2002, Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative OAI: Service Provider Architektur Data Provider Scheduler Flow control XML Parser Normaliser Database Service module UserHarvesterUser OAI Service Provider Dublication checker Update mechanism

16. IST- 2001-320015 Uwe Müller, 21.11.2002, Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative OAI: Examples / Participants Data Provider / Repositories see http://www.openarchives.org/Register/BrowseSites.plhttp://www.openarchives.org/Register/BrowseSites.pl Service Provider Repository Explorer: http://oai.dlib.vt.edu/cgi-bin/Explorer/oai2.0/testoai/ http://oai.dlib.vt.edu/cgi-bin/Explorer/oai2.0/testoai/ Cross Archive Searching Service: http://arc.cs.odu.edu/http://arc.cs.odu.edu/ MyOAI: http://www.myoai.org/http://www.myoai.org/ DINI: http://edoc.hu-berlin.de/oaisearch/http://edoc.hu-berlin.de/oaisearch/ Physnet: http://physnet.uni-oldenburg.de/oai/query.phphttp://physnet.uni-oldenburg.de/oai/query.php …

17. IST- 2001-320015 Uwe Müller, 21.11.2002, Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative Agenda 1.Open Archives 2.The Open Archives Initiative 3.OAForum: The European View 4.Open Access to Museum Information

18. IST- 2001-320015 Uwe Müller, 21.11.2002, Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative OAForum: Background Project Open Archives Forum European Union Information Society Technologies (IST) Programme accompanying measure project start: October 1st, 2001 (duration: 2 years) project partners: UKOLN, University of Bath, United Kingdom I.E.I.-CNR, Pisa, Italy Humboldt University Berlin, Germany http://www.oaforum.org/ Motivation increasing discussion about open archives approach setting up a framework for the approach in general promotion of the approach European view...

19. IST- 2001-320015 Uwe Müller, 21.11.2002, Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative OAForum: Project Partners UKOLN, Bath various projects contexts of metadata and interoperability, cross searching Renardus project, Schemas, DESIRE I.E.I-CNR, Pisa CYCLADES project, DELOS development of services on top of OAI specification Humboldt University, Berlin Dissertation Online, NDLTD DINI workshops on OAI

20. IST- 2001-320015 Uwe Müller, 21.11.2002, Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative OAForum: Objectives raise and sharpen awareness on the open archives approach promote low barrier interoperability opening cultural resources detecting potentials for new services encourage collaborative development of solutions discussion of problems exchange of experiences and information support European liaison with OAI … build community of interest

21. IST- 2001-320015 Uwe Müller, 21.11.2002, Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative OAForum: Objectives (2) Establish an information repository activities related to the open archives approach experiences, developed services (e.g. document delivery, searching, browsing, summarisation, linking) share the database with other organisations (e.g. OAI) Validation of European experience concerning implementing and using the OAI-PMH and other similar approaches requirements from implementers and users Organisational review and analysis possible business models Intellectual Property Rights Dissemination of the open archives approach workshops

22. IST- 2001-320015 Uwe Müller, 21.11.2002, Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative OAForum: Ask and Answer Questions Not: yet another OAI implementation project … supporting activities European initiatives with open-archives based approach clustering activities existing and new communities IST projects national initiatives dissemination activities share experiences on Open Archives investigation of usage: different paradigms global availability share developments

23. IST- 2001-320015 Uwe Müller, 21.11.2002, Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative OAForum: Benefits tool to reach communities bring together what is happening in Europe raise awareness on and discuss main issues common terminology on digital repositories metadata / full text harvesting models needs of users and communities advanced services make European projects ready for action develop possible solutions establish business models

24. IST- 2001-320015 Uwe Müller, 21.11.2002, Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative Communities institutions of cultural heritage museums European digitising projects scholarly institutions public libraries special user groups publishers commercial sector education Service Provider e-print archives subject gateways with aggregating functions value-added services Data Provider existing metadata repositories new metadata collections OAForum: Participants Carriers and Users of Open Archives

25. IST- 2001-320015 Uwe Müller, 21.11.2002, Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative OAForum: Topics 1.Workshops, Distribution distribute information and experiences on technologies, etc. produce interest for topics connected with open archives articles, talks, etc. 2.Organisational Evaluation analyse business models tackle issues of copyrights (IPR …) 3.Technical Evaluation apply the technical framework of OAI develop an information portal with information on projects, repositories, service provider metadata schemas software and implementations discuss problems of interoperability

26. IST- 2001-320015 Uwe Müller, 21.11.2002, Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative OAForum: Workshops, Distribution Contact: I.E.I.-CNR, Pisa – Donatella Castelli May 2002, Pisa, Italy experiences from the European e-prints community establish the forum December 2002, Lisbon, Portugal archives and libraries open access to hidden archives March 2003, Berlin, Germany metadata schemas museums and institutions of cultural heritage September 2003, Bath, United Kingdom cooperation with LIBER and SPARC initiative final workshop – bigger conference

27. IST- 2001-320015 Uwe Müller, 21.11.2002, Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative OAForum: Organisational Evaluation Contact: UKOLN, Bath – Leona Carpenter Business models co-operations between data providers to establish service networks metadata exchange between archives and services provision of value-added services (e.g. enrichment of metadata, automatic classification, OpenURL) Copyright issues IPR and copyright (influence on producers and distributors) property rights on metadata (collective use of metadata, metadata exchange, agreements with publishers etc.) long-term availability of digital resources Discussion group Dennis Nicholson (University Glasgow)

28. IST- 2001-320015 Uwe Müller, 21.11.2002, Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative OAForum: Technical Evaluation Contact: Humboldt University, Berlin – Susanne Dobratz Interoperability integration of new (open archive) approaches with existing technologies Is unqualified Dublin Core sufficient? Issues on database management concurrency and update problems scalability de-dublication Software and tools collect and share experiences and existing solutions estimation of necessary expenditure establish data provider / service … skills, manpower, time

29. IST- 2001-320015 Uwe Müller, 21.11.2002, Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative Agenda 1.Open Archives 2.The Open Archives Initiative 3.OAForum: The European View 4.Open Access to Museum Information

30. IST- 2001-320015 Uwe Müller, 21.11.2002, Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative Museum and Open Archives rich information resources often not accessible for search engines information is hold in databases other non-HTML forms other problem for overlapping search: no precise, useful, reliable information possibility: collecting & indexing metadata records solution: combination of best traditional library and museum techniques new internet techniques OAI …

31. IST- 2001-320015 Uwe Müller, 21.11.2002, Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative Museums: Existing Approaches CIMI (Consortium for the Interchange of Museum Information) pre-release tester for OAI protocol generic OAI repository implementation downloadable source code (v1.0, v2.0 to come) (http://cimi.webfarm.com/wg/oai/OAI_signup.html)http://cimi.webfarm.com/wg/oai/OAI_signup.html planned: large-scale test (real world applications) XML schema for SPECTRUM (alpha test) (http://www.cimi.org/wg/xml_spectrum/index.html)http://www.cimi.org/wg/xml_spectrum/index.html Canada Place Portal Canadian federal Department of Canadian Heritage (PCH) Canadian Heritage Information Network (CHIN) National Library of Canada OAI for harvesting and aggregating object records http://www.pch.gc.ca/progs/em-cr/2002/2002_5/02_e.cfm

32. IST- 2001-320015 Uwe Müller, 21.11.2002, Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative Museums: Existing Approaches (2) AMOL (Australian Museums Online) OAI-enabling regional servers supply records to National Database of Museum Objects target: regional server network entirely based on OAI protocol http://amol.org.au/oai/service/ http://www.amol.org.au/collection/collection_index.asp Adlib (company for museum software) implemented OAI-PMH in Internet Server module (works with any CGI web server) target: joined web presence of museums Netherlands: > 10 museum OAI compatible Mellon Foundation set of experiments in seven USA institutions, e.g. RLG http://www.arl.org/newsltr/217/waters.html

33. IST- 2001-320015 Uwe Müller, 21.11.2002, Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative Museums: Open Questions Should we unclose museum resources? benefits, costs, risks, … analysis of user necessities Access strategies / protocols Is OAI useable for exchange of museum information? hierarchical descriptions, scalability, required extensions, presentation and partitioning community extensions for OAI / DC alternatives to DC, e.g. SPECTRUM technical and organisational pre-conditions aggregation, integration, access and presentation (bibliographic, textual, multiple media, and object metadata) data quality need of a central registry (scope and services) utility of Dublin Core for meeting requirements

34. IST- 2001-320015 Uwe Müller, 21.11.2002, Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative Museums: Open Questions (2) Co-operation national / international best practice guidelines Business models sustainability Copyright problems access control and rights IPR (Intellectual Property Rights)

35. IST- 2001-320015 Uwe Müller, 21.11.2002, Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative Museums: Ask and Answer Questions OAForum Questionnaire Technical Validation Glossary Resource / Project Information OAForum workshop on Museums and Open Archives just get in contact with OAForum …

36. IST- 2001-320015 Uwe Müller, 21.11.2002, Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative http://www.oaforum.org/resources/tecvalq2.php

37. IST- 2001-320015 Uwe Müller, 21.11.2002, Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative http://www.oaforum.org/resources/glossary.php

38. IST- 2001-320015 Uwe Müller, 21.11.2002, Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative Information Gateway Please help us! with information on your projects with questions you have concerning open archives with experiences and existing solutions with ideas and suggestions … Endorse the workshop in March 2003 in Berlin 27th-29th March 2003 especially for museum community suggestions for topics textual contributions participation http://www.oaforum.org/workshops/berl_invitation.php Contact: Susanne Dobratz, HU Berlin

39. IST- 2001-320015 Uwe Müller, 21.11.2002, Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative http://www.oaforum.org/oaf_db/register/

40. IST- 2001-320015 Uwe Müller, 21.11.2002, Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative www.oaforum.org/oaf_db/list_db/list_services.php

41. IST- 2001-320015 Uwe Müller, 21.11.2002, Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative Thank you … Questions? http://www.oaforum.org/ contact@oaforum.org Leona Carpenter (Bath) Donatella Castelli (Pisa) Susanne Dobratz (Berlin) Uwe Müller Humboldt University Berlin, Germany u.mueller@rz.hu-berlin.de

42. IST- 2001-320015 Uwe Müller, 21.11.2002, Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative Additional Information Open Archives Initiative http://www.openarchives.org/ http://www.openarchives.org/OAI/openarchivesprotocol.htmlhttp://www.openarchives.org/OAI/openarchivesprotocol.html (OAI-PMH) http://www.openarchives.org/service/listproviders.htmlhttp://www.openarchives.org/service/listproviders.html (Service Providers) http://www.openarchives.org/Register/BrowseSites.plhttp://www.openarchives.org/Register/BrowseSites.pl (Data Providers) http://www.openarchives.org/tools/index.htmlhttp://www.openarchives.org/tools/index.html (Tools,...) Open Archives Forum http://www.oaforum.org/ http://www.oaforum.org/workshops/berl_invitation.php http://www.oaforum.org/workshops/berl_invitation.php (workshop, Berlin, March 2003) Signal-Hill OAI Site http://www.signal-hill.org/nav/archives2.html Eprints.org http://software.eprints.org/#sites CIMI http://www.archimuse.com/mw2001/papers/perkins/perkins.html http://www.archimuse.com/mw2001/papers/perkins/perkins.html (article by John Perkins) http://www.mcn.edu/mcn2001/workshop6.htmlhttp://www.mcn.edu/mcn2001/workshop6.html (CIMI OAI workshop) http://www.cimi.org/wg/xml_spectrum/index.html http://www.cimi.org/wg/xml_spectrum/index.html (SPECTRUM XML schema)