Presentation is loading. Please wait.

Presentation is loading. Please wait.

Synchronize your resources with ResourceSync July 10, 2013, Open Repositories 2013, PEI, Canada Synchronize your resources with ResourceSync Simeon Warner.

Similar presentations


Presentation on theme: "Synchronize your resources with ResourceSync July 10, 2013, Open Repositories 2013, PEI, Canada Synchronize your resources with ResourceSync Simeon Warner."— Presentation transcript:

1 Synchronize your resources with ResourceSync July 10, 2013, Open Repositories 2013, PEI, Canada Synchronize your resources with ResourceSync Simeon Warner (Cornell University Library) 1

2 Synchronize your resources with ResourceSync July 10, 2013, Open Repositories 2013, PEI, Canada 2 Team sport

3 Synchronize your resources with ResourceSync July 10, 2013, Open Repositories 2013, PEI, Canada 3 more, still more missing JISC Richard Jones Graham Klyne Stuart Lewis OCLC Jeff Young LOCKSS David Rosenthal RedHat Christian Sadilek Ex Libris Inc. Shlomo Sanders Library of Congress Kevin Ford

4 Synchronize your resources with ResourceSync July 10, 2013, Open Repositories 2013, PEI, Canada 4 $ Alfred P. Sloan Foundation

5 Synchronize your resources with ResourceSync July 10, 2013, Open Repositories 2013, PEI, Canada Synchronize keep in sync (colloq.) Following changes over time and Keeping copies on different systems the same Tackle only the unidirectional problem: From a Source, to a Destination 5

6 Synchronize your resources with ResourceSync July 10, 2013, Open Repositories 2013, PEI, Canada Resources aka Web Resources: have URI, HTTP GET representation(s) Many / Few Big / Small Fast / Slow 6

7 Synchronize your resources with ResourceSync July 10, 2013, Open Repositories 2013, PEI, Canada Why?

8 Synchronize your resources with ResourceSync July 10, 2013, Open Repositories 2013, PEI, Canada Scholarly repositories Replicate data/articles for mirroring, reuse, indexing,... OAI-PMH for metadata Many custom solutions for full content 8

9 Synchronize your resources with ResourceSync July 10, 2013, Open Repositories 2013, PEI, Canada Linked data Fundamentally distributed but local copy often required. Either: 1.cache 2.sync local copy... Many custom solutions for local copy 9 Last.FM MusicBrainz GeoNames DBpedia others... BBC

10 Synchronize your resources with ResourceSync July 10, 2013, Open Repositories 2013, PEI, Canada Didnt you sell us OAI-PMH? Or... will ResourceSync replace OAI-PMH? Proven metadata transfer protocol Widely adopted in our community X Predates REST, not of the web X Not adopted for content transfer Can replace, likely coexistence 10

11 Synchronize your resources with ResourceSync July 10, 2013, Open Repositories 2013, PEI, Canada What?

12 Synchronize your resources with ResourceSync July 10, 2013, Open Repositories 2013, PEI, Canada 1. Baseline sync Initial load, copy, or catch-up from source need list of all resources optional packaged content Want to avoid out-of-band setup & customization 12

13 Synchronize your resources with ResourceSync July 10, 2013, Open Repositories 2013, PEI, Canada 2. Incremental sync Keep up-to-date with changes at a source need information about changes optional packaged content minimal primitives: create/update/delete Want allow catch-up after destination offline lower latency and/or greater efficiency than repeated baseline sync 13

14 Synchronize your resources with ResourceSync July 10, 2013, Open Repositories 2013, PEI, Canada 3. Audit Destination should be able to verify whether it is synchronized with a source need list of all resources + fixity info Want lower latency and/or greater efficiency than baseline sync note: subject to some latency 14

15 Synchronize your resources with ResourceSync July 10, 2013, Open Repositories 2013, PEI, Canada How?

16 Synchronize your resources with ResourceSync July 10, 2013, Open Repositories 2013, PEI, Canada

17 Synchronize your resources with ResourceSync July 10, 2013, Open Repositories 2013, PEI, Canada 17 Minor? { "@context": "http://schema.org", "@type": "ImageObject", "contentUrl": "http://images.slideplayer.com/700127/2/slides/slide_16.jpg", "name": "Synchronize your resources with ResourceSync July 10, 2013, Open Repositories 2013, PEI, Canada 17 Minor.", "description": " http://example.com/res1 2013-01-02T13:00:00Z ….", "width": "800" }

18 Synchronize your resources with ResourceSync July 10, 2013, Open Repositories 2013, PEI, Canada Baseline sync & Google Most basic capability is Resource List: Snapshot of state of resources URI, datestamp + optional extra fixity info Destination does GET on each resource ResourceSync Baseline sync & Audit Google/Bing/Yahoo!/etc. harvest 18

19 19 Modular Discovery Four Core Capabilities 1234

20 Synchronize your resources with ResourceSync July 10, 2013, Open Repositories 2013, PEI, Canada Extensible Extensible use of Link Relations from Atom Spec describes use for mirrors, patches, historical, provenance, conneg... Use Extensible attributes for fixity etc. Includes lastmod, fixity, length, type... Extensible framework -> new capabilities 20

21 Synchronize your resources with ResourceSync July 10, 2013, Open Repositories 2013, PEI, Canada Push = Lower latency Pull easy setup, no trust required Push Changes lower latency, better scaling same descriptions as pull standard transports (XMPP, Websockets...) can push discovery info to trigger pull 21

22 Synchronize your resources with ResourceSync July 10, 2013, Open Repositories 2013, PEI, Canada Timeline January 2013 June 2013 July 2013 Fall 2013 Tools and libraries being developed to ease implementation First beta Version 0.9 Update and push spec NISO standardization Tutorials at major conferences (OAI8, OR, JCDL,...) 22

23 23 http://www.openarchives.org/rs/ Framework Archives Push (to come) Links to Google group, associated articles, blogs, etc.

24 24


Download ppt "Synchronize your resources with ResourceSync July 10, 2013, Open Repositories 2013, PEI, Canada Synchronize your resources with ResourceSync Simeon Warner."

Similar presentations


Ads by Google