LIS 654 BUILDING DIGITAL LIBRARIES FALL 2011 NOVEMBER 03, 2011 The OAI-PMH Harvester Plugin for The Omeka Content Management System JAMES R. GRIFFIN III.

Slides:



Advertisements
Similar presentations
OAI from 50,000 Feet OAI develops and promotes interoperability solutions that aim to facilitate the efficient dissemination of content. Begun in 1999.
Advertisements

Heinrich Stamerjohanns Institute for Science Networking Distributed Open Archives Dr. Heinrich Stamerjohanns Institute for Science Networking at the University.
White Paper on Establishing an Infrastructure for Open Language Archiving Steven Bird and Gary Simons.
OAI and Publishers metadata Using the static repositories approach to disclose small journals.
Rapid Visual OAI Tool S. Kothamasa, K. Maly, M. Zubair (Old Dominion University) X. Liu (Los Alamos National Laboratory) RCDL 2003, St. Petersburg.
Y.T. a brief history of the OAI 0 Kaynak: Herbert van de Sompel.
OAI in DigiTool DigiTool Version 3.0.
This product includes material developed by the Globus Project ( Introduction to Grid Services and GT3.
Harvesting Metadata Using OAI-PMH Roy Tennant California Digital Library.
OAI-PMH Dawn Petherick, University Web Services Team Manager, Information Services, University of Birmingham MIDESS Dissemination.
1 The IIPC Web Curator Tool: Steve Knight The National Library of New Zealand Philip Beresford and Arun Persad The British Library An Open Source Solution.
StatCat Building a Statistical Data Finder ssrs.yale.edu/statcat Steven Citron-Pousty Ann Green Julie Linden Yale University.
Rethinking the library catalogue: making search work for the library user Sally Chambers The European Library
Dspace – Digital Repository Dawn Petherick, University Web Services Team Manager Information Services, University of Birmingham MIDESS Dissemination.
UCLA Digital Library UC Digital Library Forum August 5, 2002 UCLA Digital Library Presenter: Curtis Fornadley Senior Programmer/Analyst.
OAI Standards for Sheet Music Meeting March 28-29, 2002 Basic OAI Principals How They Apply to Sheet Music Presenter: Curtis Fornadley, Senior Programmer/Analyst.
Web Services Michael Smith Alex Feldman. What is a Web Service? A Web service is a message-oriented software system designed to support inter-operable.
Digital Library Architecture and Technology
Introduction to the OAI Metadata Harvesting Protocol Hussein Suleman, Digital Library Research Laboratory Virginia Tech.
DATA COMMUNICATION DONE BY: ALVIN SAMPATH CARLVIN SAMPATH.
How to participate in the Union Catalogue Project Hussein Suleman Sivulile – Open Access South Africa Advanced Information Management.
C Copyright © 2009, Oracle. All rights reserved. Appendix C: Service-Oriented Architectures.
Metadata Harvesting The Hague, 13 & 14 January 2009 Julie Verleyen Scientific Coordinator, Europeana Office EuropeanaLocal Knowledge Sharing Workshop.
Rapid Visual OAI Tool S. Kothamasa, K. Maly, M. Zubair (Old Dominion University) X. Liu (Los Alamos National Laboratory) RCDL 2003, St. Petersburg.
1 Chapter 2 & Chapter 4 §Browsers. 2 Terms §Software §Program §Application.
Metadata Harvesting Interoperable digital collections.
REST.  REST is an acronym standing for Representational State Transfer  A software architecture style for building scalable web services  Typically,
Metadata Harvesting Interoperable digital collections.
IUScholarWorks is a set of services to make the work of IU scholars freely available. Allows IU departments, institutes, centers and research units to.
Indo-US Workshop, June23-25, 2003 Building Digital Libraries for Communities using Kepler Framework M. Zubair Old Dominion University.
6 th Annual Focus Users’ Conference Manage Integrations Presented by: Mike Morris.
OAI-PMH The Open Archives Initiative Protocol for Metadata Harvesting Presenter: Knud Möller Friday,
IESR Interfaces: Current Services and Future Plans Ann Apps MIMAS, The University of Manchester, UK.
1 OAI-PMH harvester for agricultural knowledge gathering (Development, testing and implementation) Francesco Castellani and Stefka Kaloyanova 4 February.
Kingdom of Saudi Arabia Ministry of Higher Education Al-Imam Muhammad Ibn Saud Islamic University College of Computer and Information Sciences Chapter.
OAI-PMH: Open Archives Initiative Protocol for Metadata Harvesting T.B. Rajashekar National Centre for Science Information (NCSI) Indian Institute of Science,
WDC-MARE – World Data Center for Marine Environmental Sciences Data portal based on Open Archives Initiative Protocols and Apache Lucene Uwe Schindler,
1 CS 502: Computing Methods for Digital Libraries Lecture 19 Interoperability Z39.50.
Roy Tennant California Digital Library escholarship.cdlib.org/rtennant/presentations/2003cil/ Achieving Together What None Can Do Alone: Interoperability.
Discovery Metadata for Special Collections Concepts, Considerations, Choices William E. Moen School of Library and Information Sciences Texas Center for.
Metadata harvesting in regional digital libraries in PIONIER Network Cezary Mazurek, Maciej Stroiński, Marcin Werla, Jan Węglarz.
Kurt Maly Department of Computer Science Old Dominion University Norfolk, Virginia 23529, USA Digital Libraries, OAI and Free Software.
Open Archives Initiative Protocol for Metadata Harvesting (OAI-PMH) Phil Barker, March © Heriot-Watt University. You may reproduce all or any part.
Caltech CODA CODA: Collection of Digital Archives Caltech Scholarly Communication.
1 GRID Based Federated Digital Library K. Maly, M. Zubair, V. Chilukamarri, and P. Kothari Department of Computer Science Old Dominion University February,
OAI Overview DLESE OAI Workshop April 29-30, 2002 John Weatherley
Bitter Harvest Metadata Harvesting Issues, Problems, and Possible Solutions Roy Tennant California Digital Library.
The Open Archives Initiative Marshall Breeding Director for Innovative Technologies and Research Vanderbilt University
Open Archives Initiative Protocol for Metadata Harvesting.
Module: Software Engineering of Web Applications Chapter 2: Technologies 1.
Sharing Digital Scores: Will the Open Archives Initiative Protocol for Metadata Harvesting Provide the Key? Constance Mayer, Harvard University Peter Munstedt,
2/22/2016J Ammerman1 Open Archives Initiative What is it? What’s it good for?
NSDL & the Open Archives Initiative A Brief Introduction to OAI Timothy W. Cole Mathematics Librarian & Professor of Library Administration.
Copyright 2007, Information Builders. Slide 1 iWay Web Services and WebFOCUS Consumption Michael Florkowski Information Builders.
1 CS 430: Information Discovery Lecture 26 Architecture of Information Retrieval Systems 1.
LIS654 lecture 4 more on omeka Thomas Krichel
The NSDL, OAI and Your Metadata Core Infrastructure Metadata Repository (“union catalog”) Naomi Dushay Cornell University.
Mod_oai: Metadata Harvesting for Everyone Michael L. Nelson, Herbert Van de Sompel, Xiaoming Liu, Aravind Elango
The world’s libraries. Connected. CONTENTdm ® Digital Collection Management Solutions Learn what to consider when outsourcing your library’s digitization.
NDLTD Standards, Metadata and the OAI-PMH Hussein Suleman University of Cape Town October 2003.
Web Services Overview Thomas Hickey. 2 What are Web Services? Machine-to-machine communication Run over standard Web protocols –XML syntax, HTTP packaging.
Harvesting and Exporting Metadata 714: Metadata Margaret E.I. Kipp -
The Hosted Model Charl Roberts Good morning again,
Georges Arnaout Chaitanya Krishna
OAI and Metadata Harvesting
Open Archive Initiative
Cloud-Enabling Technology
IVOA Interoperability Meeting - Boston
The Internet and Electronic mail
The Bentley Digital Media Library
Presentation transcript:

LIS 654 BUILDING DIGITAL LIBRARIES FALL 2011 NOVEMBER 03, 2011 The OAI-PMH Harvester Plugin for The Omeka Content Management System JAMES R. GRIFFIN III

Defining the OAI-PMH "The Open Archives Initiative Protocol for Metadata Harvesting (OAI-PMH) is a low-barrier mechanism for repository interoperability. Data Providers are repositories that expose structured metadata via OAI-PMH. Service Providers then make OAI-PMH service requests to harvest that metadata. OAI-PMH is a set of six verbs or services that are invoked within HTTP.“ 1 Thus, the OAI-PMH is a means by which to enable digital repositories to openly and freely exchange and share metadata detailing their collections with the world. 1 Open archives initiative protocol for metadata harvesting. (2011). Retrieved from

Installing the OAI-PMH Harvester Plugin for Omeka 1. Download the plug-in from the following source: (Note: This is a ZIP archive [like other plug-ins for Omeka]) 2. Upload the ZIP archive to the server wotan (Note: This can be done using any scp client such as WinSCP) 3. Decompress the archive into the appropriate directory for your installation of Omeka (Note: This is typically the path /home/[USER NAME]/omeka/plugins/) 4. Using the web interface, install the harvester plug-in

The Purpose Behind the OAI-PMH Metadata shared using the OAI-PMH is structured in a uniform manner, ensuring that metadata for all collections shared on the World Wide Web can be harvested regardless of the specific application For example, one institution can archive content using the Drupal application as a repository, while another institution can archive content using Omeka Using the OAI-PMH protocol, both repositories can be configured to exchange information detailing the contents of their archived collections.

Repository Interoperability Unfortunately, not every digital repository has been developed using the same framework (or even the same programming language[s]) Thus, if OAI-PMH were to attempt to institute language-specific standards for exchanging metadata, inevitably some repository application would be developed in an unsupported language The solution to this is the software object

OAI-PMH Metadata Objects For the purposes of this presentation, a software object is a means by which to structure data in a language- independent manner As the OAI-PMH Initiative seeks to establish their contribution as the definitive standard for the exchange of repository metadata, this will increase the likelihood that future repository applications (some of which will be written in currently non-existent [i.e. future] languages) will still employ this protocol

OAI-PMH Metadata Objects The metadata objects are transferred over the HyperText Transfer Protocol (HTTP) This means that no platform-specific binaries must be employed in order to harvest OAI-PMH-compliant metadata (e.g. Anyone can access information detailing the contents of these archived collections using a web browser – you do not need to purchase or install any additional software)

OAI-PMH Metadata Objects The metadata objects are bound to/serialized using the eXtensible Markup Language (XML) This is mentioned for the sake of those who are enrolled in LIS650, those who have previously taken LIS650, or those who are familiar with web design For those unfamiliar with XML or web design itself, this simply means that this metadata can be extended and manipulated easily by web designers as well as developers

An Instance of an OAI-PMH Metadata Object In order to generate OAI-PMH-compliant metadata objects for one’s collection, one must first install and configure another plugin: The OAI-PMH Repository ( Retrieving metadata from the repository: The parameter “verb” specifies to wotan precisely what is being requested  (e.g. A list of my collections – “ListRecord”) The parameter “metadataPrefix” specifies to wotan precisely which metadata framework to use in the formatting of the response  (e.g. “oai_dc” is the OAI’s format which is based upon the Dublin Core framework)

An Instance of an OAI-PMH Metadata Object This was retrieved by requesting the following resource: T19:46:59Z oai:wotan.liu.edu/omeka/jgriffin/: T00:48:49Z 6 /src/bin/psql/psql.c Regents of the University of California […]

Harvesting Metadata from Remote Repositories in Omeka The plugin has its utility in its ability to directly import data detailing items archived in a remote repository into one’s own repository Conceptually, the mechanisms underlying this process are similar to those used in the practice of “copy cataloging”

Harvesting Metadata from Remote Repositories in Omeka As previously specified, the server must be running an OAI-PMH repository for the archived collections In order to demonstrate this, I can harvest from my own OAI-PMH repository: …as well as from L’Université Rennes 2 de la Bibliothèque Numérique*: *This source was specified by Sheila Brennan of the Roy Rosenzweig Center for History and New Media. Please see

Harvesting Metadata from Remote Repositories in Omeka Metadata sets can be re-harvested or deleted While a set of records are being harvested, one is offered the ability to “kill” the process Should there be problems regarding the memory required by the harvester, one can modify the settings of the plugin  The “Memory Limit” field should only be modified if a harvest fails due to an error.  The path for the PHP binary should always be ‘/usr/bin/php5’ on wotan

The OAI-PMH Harvester Plug-In for the Omeka Digital Archive Questions? Comments?