Interoperability through Library APIs Library Technology Services Open House 7/30/15.

Slides:



Advertisements
Similar presentations
Putting together a METS profile. Questions to ask when setting down the METS path Should you design your own profile? Should you use someone elses off.
Advertisements

Interoperability Aspects in Europeana Antoine Isaac Workshop on Research Metadata in Context 7./8. September 2010, Nijmegen.
SEMANTIC WEB INITIATIVES – MAKING LINKED OPEN DATA REAL EMMANUELLE DELMAS-GLASS November 21, 2014.
DSpace Devika P. Madalli DRTC, ISI Bangalore.
Virtual Collections VIRTUAL COLLECTIONS Focus on Metadata Cataloging Discussion Group, Friday, November 18.
William Y. Arms Corporation for National Research Initiatives March 22, 1999 Object models, overlay journals, and virtual collections.
DIGITAL MANUSCRIPT INTEROPERABILITY SharedCanvas and IIIF in Practice Benjamin Albritton Digital Manuscript Product
Romain Wenz- BnF-DIBN – SWIB 2010 November The data.bnf.fr project describing resources of the French National Library.
Metadata: Its Functions in Knowledge Representation for Digital Collections 1 Summary.
UKOLUG - July Metadata for the Web RDF and the Dublin Core Andy Powell UKOLN, University of Bath UKOLN.
RDA and Linked Data Steve Henry University of Maryland March 2, 2013.
Tom Cramer Chief Technology Strategist Stanford University Libraries Digital Library Federation (DLF) Forum Denver, Colorado * 4 November 2012.
XML: The Strategic Opportunity Roy Tennant Challenges*  Only librarians like to search, everyone else likes to find  Our users want more information.
OCLC Online Computer Library Center CONTENTdm ® Digital Collection Management Software Ron Gardner, OCLC Digital Services Consultant ICOLC Meeting April.
Metadata: An Overview Katie Dunn Technology & Metadata Librarian
Interoperable Digitised Content “Discover, search, extract, link, associate, and view digitised content” Les Carr.
‘The Universal Catalogue’ a cultural sector viewpoint David Dawson Senior Policy Adviser (Digital Futures) Museums, Libraries and archives Council.
The Metadata Object Description Schema (MODS) NISO Metadata Workshop May 20, 2004 Rebecca Guenther Network Development and MARC Standards Office Library.
The DNER - a national digital library Andy Powell ZIG Meeting, York October 2001 UKOLN, University of Bath UKOLN is funded by Resource:
Overview of IU Digital Collections Search Hui Zhang Jon Dunn Indiana University Digital Library Program IU Digital Library Brown Bag October 19, 2011.
Lifecycle Metadata for Digital Objects (INF 389K) September 18, 2006 The Big Metadata Picture, Web Access, and the W3C Context.
Metadata Lessons Learned Katy Ginger Digital Learning Sciences University Corporation for Atmospheric Research (UCAR)
19/10/20151 Semantic WEB Scientific Data Integration Vladimir Serebryakov Computing Centre of the Russian Academy of Science Proposal: SkTech.RC/IT/Madnick.
Common challenges, common issues Lorcan Dempsey School for scanning The Hague, 16 October 2002.
DNER Architecture Andy Powell 6 March 2001 UKOLN, University of Bath UKOLN is funded by Resource: The Council for.
Accessing a national digital library: an architecture for the UK DNER Andy Powell ELAG 2001, Prague 7 June 2001 UKOLN, University of Bath
VIVO and Scholarly Repositories: Synergistic Opportunities.
The Digital Library for Earth System Science: Contributing resources and collections GCCS Internship Orientation Holly Devaul 19 June 2003.
Slavic Digital Text Workshop 2006 The Open Archives Initiative Protocol for Metadata Harvesting: an Opportunity for Sharing Content in a Distributed Environment.
OAI Overview DLESE OAI Workshop April 29-30, 2002 John Weatherley
Core Integration Web Services Dean Krafft, Cornell University
Linked Data: Emblematic applications on Legacy Data in Libraries.
The physical parts of a computer are called hardware.
Introduction to the Semantic Web and Linked Data Module 1 - Unit 2 The Semantic Web and Linked Data Concepts 1-1 Library of Congress BIBFRAME Pilot Training.
Introduction to the Semantic Web and Linked Data
The New DRS Introduction. What is DRS? Digital repository for preservation and access – Maintains integrity of deposited content – Preserves content for.
The Mint Mapping tool The MoRe aggregator Vassilis Tzouvaras, Dimitris Gavrilis National Technical University of Athens Digital Curation Unit - IMIS, Athena.
Collecting History: Profiles in Science Alexa T. McCray National Library of Medicine Bethesda, MD Stanford University August 21, 1999.
Metadata “Data about data” Describes various aspects of a digital file or group of files Identifies the parts of a digital object and documents their content,
National Library of the Czech Republic Integration of digital materials into EDL Adolf Knoll National Library of the Czech Republic Helsinki CENL Workshop.
THE BIBFRAME EDITOR AND THE LC PILOT Module 3 – Unit 1 The Semantic Web and Linked Data : a Recap of the Key Concepts Library of Congress BIBFRAME Pilot.
Digitization – Basics and Beyond workshop Interoperability of cultural and academic resources New services for digitized collections Muriel Foulonneau.
Metadata and Meta tag. What is metadata? What does metadata do? Metadata schemes What is meta tag? Meta tag example Table of Content.
Interoperability How to Build a Digital Library Ian H. Witten and David Bainbridge.
KAnOE: Research Centre for Knowledge Analytics and Ontological Engineering Managing Semantic Data NACLIN-2014, 10 Dec 2014 Dr. Kavi Mahesh Dean of Research,
Discovering libraries’ gold through collection-level descriptions ELAG 2014, Bath Valentine Charles Data specialist.
IIIF Ghent Report Randy Stern Chip Goines Harvard University IT Library Technology Services Bill Stoneman Houghton Library January 11, 2016.
Paloma Marín Arraiza 17 th International Conference on Grey Literature 1 st and 2 nd December 2015, Amsterdam (Netherlands) SCIENTIFIC AUDIOVISUAL MATERIALS.
HathiTrust: Possibilities Metadata Working Group Cornell University Library March 21, 2014.
Differences and distinctions: metadata types and their uses Stephen Winch Information Architecture Officer, SLIC.
IIIF and Mirador Randy Stern Harvard University IT Library Technology Services January 29, 2016.
A Project of the University Libraries Ball State University Libraries A destination for research, learning, and friends.
1 CS 430: Information Discovery Lecture 26 Architecture of Information Retrieval Systems 1.
Linked Open Data RDF Graphical Databases A Conversation with Karen Miller School of Library & Information Science, University of South Carolina.
A RCHIVAL COLLECTIONS IN A D IGITAL W ORLD Cheryl Walters Nov. 6, 2008.
Digitally Enabled Scholarship with Medieval Manuscripts Michael Appleby Yale Digital Collections Center (YDC2) March 1, 2013.
Linked Library (+AM) Data Presented LITA Next-Generation Catalog IG Corey A Harper Publish, Enrich, Relate and Un-Silo.
Pcdm, iiif, & interoperability esmé dplafest
Ten Thousand Rooms Life of the Buddha
Information modeling and infrastructures for metadata
Digital library and OR 21 October 2002 Members’ Council
Repository Software - Standards
WHAT DOES THE FUTURE HOLD? Ann Ellis Dec. 18, 2000
Accessing a national digital library: an architecture for the UK DNER
OAI and Metadata Harvesting
Cataloging the Internet
Metadata to fit your needs... How much is too much?
IDEALS at the University Of Illinois: A Case Study of Integration Between an IR and Library Discovery Systems Sarah L. Shreeves University of Illinois.
Why IIIF? Shane Huddleston Jeff Mixter Dave Collins Product Manager
Metadata supported full-text search in a web archive
Presentation transcript:

Interoperability through Library APIs Library Technology Services Open House 7/30/15

Metadata Digital Content Inventory Data Sets API APIs Interesting Web Apps The Opportunity 18M titles, authors, subjects, locations, etc 45M Images, books, audio, video holdings availability scientific data geospatial Faculty papers etc. Semantic Web

Metadata

Digital Content

How to re-use this stuff? APIs

Library API landscape Library Cloud - Unified Metadata API Combines silos of descriptive metadata into a single Web Service API Descriptive info like title, creator, subject – what you see in HOLLIS PRESTO – bibliographic item data API HOLLIS search Bibliographic data from HOLLIS PUBMED, DOI, VIA data Item availability (checked out?) Digital content delivery API International Image Interoperability Framework (IIIF) DRS delivery services (paged objects, audio, documents) In the future: Semantic Web APIs (grant funded development) Linked Open Data RDF Triples (no more “records”), SPARQL API

Guiding principles Support innovation, interoperability, and reuse through: Standard HTTP web service API protocols - REST, SPARQL, JSON, XML Community supported metadata schemas – e.g. MODS, MARC, Dublin Core, RDF Community supported digital content APIs - IIIF Open access

Available today: Library Cloud ● A queryable metadata hub (solr indexed) of Harvard library holdings ● 13M HOLLIS records, 4M visual image records, 2M archival and special collections items ● A pipeline for updating and enriching records ● Deployed in Amazon Web Services ● Open source software

Library Cloud 5/5/15 books images archives More... Ingest DPLA, OCLC Innovation apps LD4L BIBFRAME NormalizeEnhance Distribute API OAI-PMH Metadata sources AWS Queue pipeline APIConsumers

Library Cloud API name=Schulz Faceting ets=name,resourceType Search on a facet eType=“still image” Api documentation - yStaffDoc/LibraryCloud+Item+API yStaffDoc/LibraryCloud+Item+API

IIIF International Image Interoperability Framework Opens Harvard library digital content for reuse over the Web and allows Harvard to reuse external content A content delivery Web API (the digital book or digital image) Not a discovery API (title, author, subject) Sample Use Cases Teaching: Displaying a “Virtual manuscript” where Harvard holds some pages and Yale holds other pages Research: Comparison of a Harvard and British Library copy of the same work Library or Museum: Creating on-line collections that include material from multiple institutions

IIIF Harvard University Bibliothèque Nationale de France British Library Oxford University Stanford University Johns Hopkins University University of Fribourg Saint Louis University Drew University TextGrid Los Alamos National Laboratory Yale University Cambridge University ARTstor Cornell University Princeton University Walters Art Museum National Library of Norway The National Archives (UK) DPLA Europeana … and more – see Community driven ( Defined APIs for digital object linking and reuse Plug & Play software (such as Mirador)

Mirador

IIIF APIs at the Library Image API Presentation API Uses the Shared Canvas data model and W3C Open Annotation Mirador uses both APIs

PRESTO Availability for Moby Dick HOLLIS+ Search for Moby Dick Dick”

Metadata (Titles, Authors, Subjects, etc) Digital Images Inventory Holdings, availability, etc Data Sets Social science, astronomy, GIS Library Cloud API IIIF APIPRESTO API Open APIs Interesting Web App OPEN APIS - Third parties can reuse, embed, and repurpose library data… HOLLIS VIA OASIS … Harvard DRS Harvard Canvas? HarvardX? Aleph HOLLIS+ … Dataverse HGL DASH DatasourcesDatasources 5/5/15

Metadata (Titles, Authors, Subjects, etc) Digital Images Related Authorities Names, Places Data Sets Social science, astronomy, GIS IIIF Presentation API IIIF Image APILinked Open Data Open APIs … and Harvard can reuse data from other institutions Stanford Yale Oxford (etc) British Library etc. Stanford Yale Oxford (etc) British Library etc. DBpedia DPLA Library of Congress Europeana … Dataverse Open Geoportal DPN DatasourcesDatasources e.g. Mirador 5/5/15

Examples ● Mirador ● Digital collection builder ● DRS metadata migration tool — to efficiently retrieve descriptive metadata for migrated digital objects ● Library hackathon apps o On an Amazon page, a button tells you if the book is in Harvard Library o Visualization of library content via Google Fusion o List Harvard of relevant items for a feminist web site o Search the Library from Android phone o Which library is best for a particular subject? 

The Future

Tim Berners-Lee’s 4 Rules for the Semantic Web 1.Use URIs as names for things 2.Use HTTP URIs so that people can look up those names. 3.When someone looks up a URI, provide useful information, using the standards (RDF*, SPARQL) 4.Include links to other URIs, so that they can discover more things.

Semantic Web API (linked data grant project) Uses RDF, the language of the web thisBook “has title” “Moby Dick” – “thisBook” is a URI: 671/catalog 671/catalog – “has title” is a URI: e e – “Moby Dick” is a URI: m m One uniform API for querying and inferencing (SPARQL)

Thank you!

Reference - API Documentation APIDocumentation Library Cloudhttps://wiki.harvard.edu/confluence/display/LibraryStaffDoc/Libra ry+Cloud PRESTOhttp://hul.harvard.edu/ois/systems/webservices/#lookup Dataversehttp://thedata.harvard.edu/guides/dataverse-api-main.html Course reserveshttps://github.com/harvard- library/ecru/blob/master/ecru_url_patterns.md DRS Delivery Services for Image Delivery Service, File Delivery Service, Streaming Delivery Service, Full Text Search Service DASHhttp://openmetadata.lib.harvard.edu/content/digital-access- scholarship-harvard-dash-dataset

Appendix B - Bulk download documentation DatasetDocumentation Bibliographic data sethttp://openmetadata.lib.harvard.edu/bibdata Virtual Collection OAI- PMH data provider harvesting.html Harvard Geospatial Library OAI data provider main.html#data-sharing-api