IST OAForum: A European View on the Open Archives Initiative Museum Information on the Basis of an Open Standard Uwe Müller Humboldt University Berlin, Germany Electronic Publishing Group University Library / Computing Centre

IST Uwe Müller, , Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative Agenda 1.Open Archives 2.The Open Archives Initiative 3.OAForum: The European View 4.Open Access to Museum Information

IST Uwe Müller, , Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative Open Archives Different types of archives scholarly publication server (pre-prints, e-prints) libraries (OPAC, e-journals) museum databases (object metadata) archives (historical documents) and cultural heritage education Origin self archiving unclosing existing databases establishing new databases open archives approach gains popularity cross archive access low cost dissemination of previously hidden resources building of new service provision

IST Uwe Müller, , Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative Open Archives: Problems Problem: lacking interoperability different metadata standards Different terminology different languages different access strategies different interfaces / transfer protocols different copyright regulations Difficulty to establish new services cross archive access approach: Z39.50 protocol search distributed databases homogenously mainly used for bibliographic data

IST Uwe Müller, , Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative Open Archives: Problems (2) Metadata different formats (DC, MAB, MARC, …) different interpretation possibilities (Creator: Author vs. Artist vs. Photographer) Transfer protocols libraries: Z39.50 NCSTRL: DIENST protocol harvest systems: HTTP based Search methods database based vs. file system based DB: real time, ODBC, SQL, PHP, Perl etc. FS: no real time, index file, SOIF

IST Uwe Müller, , Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative Agenda 1.Open Archives 2.The Open Archives Initiative 3.OAForum: The European View 4.Open Access to Museum Information

IST Uwe Müller, , Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative The Open Archives Initiative (OAI) Main ideas world-wide consolidation of scholarly archives free access on the archives (at least: metadata) consistent interfaces for archives and service provider effortless implementation based on existing standards (e.g. HTTP, XML, DC) Basic functioning HarvesterRepository Requests (based on HTTP) Metadata (encoded in XML) Metadata (Documents) Metadata Service ProviderData Provider Service

IST Uwe Müller, , Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative OAI: Organisational Structure Steering Committee general policy of OAI 12 members (USA, United Kingdom, Germany) Executive Committee operational decision Carl Lagoze (Cornell University) Herbert van de Sompel (Los Alamos National Laboratory) Technical Committee formulation of the OAI protocol specification contact with OAI community Executive Committee + 14 members (USA, United Kingdom, Denmark, Switzerland)

IST Uwe Müller, , Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative OAI: General Assumptions 2 groups of participants Data Providers (Open Archives, Repositories) free access of metadata not necessarily: free access to full texts / resources easy to implement, low barriers useable for small institutions Service Providers use OAI interfaces of the Data Providers harvest and store metadata may select certain subsets from Data Providers (set hierarchy, date stamp) may enrich metadata offer (value-added) service on the basis of the metadata

IST Uwe Müller, , Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative OAI: Technical Model Service Provider e-print Data Provider e-prints e-print Data Provider Images e-print Data Provider OPAC e-print Data Provider Museum e-print Data Provider Archive Requests: Identify ListMetadataformats ListSets ListIdentifiers ListRecords GetRecord Responses: General information Metadata formats Set structure Record identifier Metadata Data Provider Harvester Repository

IST Uwe Müller, , Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative OAI: Protocol Basics and Details Basics of OAI-PMH protocol based on HTTP request arguments as GET or POST parameters six request types e.g. responses are encoded in XML syntax supports any metadata format (at least: Dublin Core) Details of OAI-PMH logical set hierarchy (definition: data providers) date stamps (last change of metadata set) error messages flow control

IST Uwe Müller, , Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative OAI: Protocol Basics and Details (2) Metadata sets (Records) 1.header unique identifier (key for further archive requests), e.g. oai:HUBerlin.de: datestamp, e.g logical sets in which the record is contained 2.metadata metadata prefix metadata set (at least: Dublin Core)

IST Uwe Müller, , Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative Example: verb=ListIdentifiers&from= &until= & metadataPrefix=oai_dc&set=doctypes:dissertations T17:49:49+01:00 oai:HUBerlin.de: doctypes doctypes:dissertations dnb dnb:dnb33 oai:HUBerlin.de: doctypes doctypes:dissertations dnb dnb:dnb27

IST Uwe Müller, , Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative OAI: Data Provider Architecture SQL- Database OAI Data Provider Web server (e.g. Apache, IIS) OAI request (HTTP request) Programming extension (e.g. PHP, Perl) SQL request DB response OAI response (XML instance)

IST Uwe Müller, , Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative OAI: Service Provider Architektur Data Provider Scheduler Flow control XML Parser Normaliser Database Service module UserHarvesterUser OAI Service Provider Dublication checker Update mechanism

IST Uwe Müller, , Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative OAI: Examples / Participants Data Provider / Repositories see Service Provider Repository Explorer: Cross Archive Searching Service: MyOAI: DINI: Physnet: …

IST Uwe Müller, , Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative Agenda 1.Open Archives 2.The Open Archives Initiative 3.OAForum: The European View 4.Open Access to Museum Information

IST Uwe Müller, , Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative OAForum: Background Project Open Archives Forum European Union Information Society Technologies (IST) Programme accompanying measure project start: October 1st, 2001 (duration: 2 years) project partners: UKOLN, University of Bath, United Kingdom I.E.I.-CNR, Pisa, Italy Humboldt University Berlin, Germany Motivation increasing discussion about open archives approach setting up a framework for the approach in general promotion of the approach European view...

IST Uwe Müller, , Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative OAForum: Project Partners UKOLN, Bath various projects contexts of metadata and interoperability, cross searching Renardus project, Schemas, DESIRE I.E.I-CNR, Pisa CYCLADES project, DELOS development of services on top of OAI specification Humboldt University, Berlin Dissertation Online, NDLTD DINI workshops on OAI

IST Uwe Müller, , Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative OAForum: Objectives raise and sharpen awareness on the open archives approach promote low barrier interoperability opening cultural resources detecting potentials for new services encourage collaborative development of solutions discussion of problems exchange of experiences and information support European liaison with OAI … build community of interest

IST Uwe Müller, , Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative OAForum: Objectives (2) Establish an information repository activities related to the open archives approach experiences, developed services (e.g. document delivery, searching, browsing, summarisation, linking) share the database with other organisations (e.g. OAI) Validation of European experience concerning implementing and using the OAI-PMH and other similar approaches requirements from implementers and users Organisational review and analysis possible business models Intellectual Property Rights Dissemination of the open archives approach workshops

IST Uwe Müller, , Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative OAForum: Ask and Answer Questions Not: yet another OAI implementation project … supporting activities European initiatives with open-archives based approach clustering activities existing and new communities IST projects national initiatives dissemination activities share experiences on Open Archives investigation of usage: different paradigms global availability share developments

IST Uwe Müller, , Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative OAForum: Benefits tool to reach communities bring together what is happening in Europe raise awareness on and discuss main issues common terminology on digital repositories metadata / full text harvesting models needs of users and communities advanced services make European projects ready for action develop possible solutions establish business models

IST Uwe Müller, , Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative Communities institutions of cultural heritage museums European digitising projects scholarly institutions public libraries special user groups publishers commercial sector education Service Provider e-print archives subject gateways with aggregating functions value-added services Data Provider existing metadata repositories new metadata collections OAForum: Participants Carriers and Users of Open Archives

IST Uwe Müller, , Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative OAForum: Topics 1.Workshops, Distribution distribute information and experiences on technologies, etc. produce interest for topics connected with open archives articles, talks, etc. 2.Organisational Evaluation analyse business models tackle issues of copyrights (IPR …) 3.Technical Evaluation apply the technical framework of OAI develop an information portal with information on projects, repositories, service provider metadata schemas software and implementations discuss problems of interoperability

IST Uwe Müller, , Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative OAForum: Workshops, Distribution Contact: I.E.I.-CNR, Pisa – Donatella Castelli May 2002, Pisa, Italy experiences from the European e-prints community establish the forum December 2002, Lisbon, Portugal archives and libraries open access to hidden archives March 2003, Berlin, Germany metadata schemas museums and institutions of cultural heritage September 2003, Bath, United Kingdom cooperation with LIBER and SPARC initiative final workshop – bigger conference

IST Uwe Müller, , Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative OAForum: Organisational Evaluation Contact: UKOLN, Bath – Leona Carpenter Business models co-operations between data providers to establish service networks metadata exchange between archives and services provision of value-added services (e.g. enrichment of metadata, automatic classification, OpenURL) Copyright issues IPR and copyright (influence on producers and distributors) property rights on metadata (collective use of metadata, metadata exchange, agreements with publishers etc.) long-term availability of digital resources Discussion group Dennis Nicholson (University Glasgow)

IST Uwe Müller, , Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative OAForum: Technical Evaluation Contact: Humboldt University, Berlin – Susanne Dobratz Interoperability integration of new (open archive) approaches with existing technologies Is unqualified Dublin Core sufficient? Issues on database management concurrency and update problems scalability de-dublication Software and tools collect and share experiences and existing solutions estimation of necessary expenditure establish data provider / service … skills, manpower, time

IST Uwe Müller, , Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative Agenda 1.Open Archives 2.The Open Archives Initiative 3.OAForum: The European View 4.Open Access to Museum Information

IST Uwe Müller, , Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative Museum and Open Archives rich information resources often not accessible for search engines information is hold in databases other non-HTML forms other problem for overlapping search: no precise, useful, reliable information possibility: collecting & indexing metadata records solution: combination of best traditional library and museum techniques new internet techniques OAI …

IST Uwe Müller, , Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative Museums: Existing Approaches CIMI (Consortium for the Interchange of Museum Information) pre-release tester for OAI protocol generic OAI repository implementation downloadable source code (v1.0, v2.0 to come) ( planned: large-scale test (real world applications) XML schema for SPECTRUM (alpha test) ( Canada Place Portal Canadian federal Department of Canadian Heritage (PCH) Canadian Heritage Information Network (CHIN) National Library of Canada OAI for harvesting and aggregating object records

IST Uwe Müller, , Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative Museums: Existing Approaches (2) AMOL (Australian Museums Online) OAI-enabling regional servers supply records to National Database of Museum Objects target: regional server network entirely based on OAI protocol Adlib (company for museum software) implemented OAI-PMH in Internet Server module (works with any CGI web server) target: joined web presence of museums Netherlands: > 10 museum OAI compatible Mellon Foundation set of experiments in seven USA institutions, e.g. RLG

IST Uwe Müller, , Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative Museums: Open Questions Should we unclose museum resources? benefits, costs, risks, … analysis of user necessities Access strategies / protocols Is OAI useable for exchange of museum information? hierarchical descriptions, scalability, required extensions, presentation and partitioning community extensions for OAI / DC alternatives to DC, e.g. SPECTRUM technical and organisational pre-conditions aggregation, integration, access and presentation (bibliographic, textual, multiple media, and object metadata) data quality need of a central registry (scope and services) utility of Dublin Core for meeting requirements

IST Uwe Müller, , Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative Museums: Open Questions (2) Co-operation national / international best practice guidelines Business models sustainability Copyright problems access control and rights IPR (Intellectual Property Rights)

IST Uwe Müller, , Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative Museums: Ask and Answer Questions OAForum Questionnaire Technical Validation Glossary Resource / Project Information OAForum workshop on Museums and Open Archives just get in contact with OAForum …

IST Uwe Müller, , Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative

IST Uwe Müller, , Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative

IST Uwe Müller, , Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative Information Gateway Please help us! with information on your projects with questions you have concerning open archives with experiences and existing solutions with ideas and suggestions … Endorse the workshop in March 2003 in Berlin 27th-29th March 2003 especially for museum community suggestions for topics textual contributions participation Contact: Susanne Dobratz, HU Berlin

IST Uwe Müller, , Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative

IST Uwe Müller, , Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative

IST Uwe Müller, , Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative Thank you … Questions? Leona Carpenter (Bath) Donatella Castelli (Pisa) Susanne Dobratz (Berlin) Uwe Müller Humboldt University Berlin, Germany

IST Uwe Müller, , Les rencontres d'Aliénor: OAForum - A European view on the Open Archives Initiative Additional Information Open Archives Initiative (OAI-PMH) (Service Providers) (Data Providers) (Tools,...) Open Archives Forum (workshop, Berlin, March 2003) Signal-Hill OAI Site Eprints.org CIMI (article by John Perkins) (CIMI OAI workshop) (SPECTRUM XML schema)