1. 1 herbert van de sompel CS 502 Computing Methods for Digital Libraries Cornell University – Computer Science Herbert Van de Sompel herbertv@cs.cornell.edu Lab : federated searching: searching distributed data & searching harvested data Access to PC orpcuser orpcpw

2. 2 herbert van de sompel A&I federated services imageFTXTOPACe-print

3. 3 herbert van de sompel federated searching Distributed search approach ~ Z39.50, SDLIP,... today: MetaLib commercial product by Ex Libris searches repositories using “whichever” technique normalizes results before presenting them to the user can merge results after initial presentation Harvesting approach ~ OAI today: ARC, the first OAI service provider

4. 4 herbert van de sompel MetaLib Goal: Unique, consistent interface across library resources (think Google for library collection) Broadcast searching over a large collection of heterogeneous resources: Different metadata syntax (MARC, EAD, Dublin Core, TEI, unspecified,...) Different protocols (Z39.50, HTTP, native ALEPH, screen scraping) Linking via integrated SFX server User personalization Administration of resources

5. 5 herbert van de sompel Application Level: Technology Level: Universal Gateway Accurate, target-sensitive searching Context-sensitive linking User Admin Customized, personalized services Resources’ administering Information Gateway

6. 6 herbert van de sompel Universal Gateway Accurate, target-sensitive searching Context-sensitive linking User Admin Customized, personalized services Information Gateway Resources’ administering

7. 7 herbert van de sompel The Information Gateway: The KnowledgeBase The KnowledgeBase includes all the library Resources Cataloging Information (per collection): Name of collection, owner, subject, services, language R e s o u r c e s C o l l e c t i o n s Configuration Information (per MetaLib resource): Interfacing protocol, internal format, rules of conversion

8. 8 herbert van de sompel KnowledgeBase Example of cataloged collection 245 Title: Queen Elizabeth II Library 270 Location:Memorial University of Newfoundland | St. John’s, Newfoundland | Canada | AC15S7 307 Access Times:Monday-Thursday 8:30-20:45 Closed Saturdays 520 Description:Main library covers humanities, science, computers, physical ed, social sciences, and engineering 546 Language:English 531 Access:Open to the public 901 Administrator:Iscott@mun.ca 650 Subject:Computer Science 650 Subject:Pure Science 650 Subject:Humanities USMARC

9. 9 herbert van de sompel Universal Gateway Accurate, target-sensitive searching Context-sensitive linking User Admin Customized, personalized services Database of catalogs and databases Information Gateway

10. 10 herbert van de sompel D i v e r s e I n f o r m a t i o n R e s o u r c e s ALEPH Z39.50 HTTP OTHER Universal Gateway Search Processed to Conform to Information Resources

11. 11 herbert van de sompel Z39.50 Library of Congress ALEPH KOBV HTTP PubMed Z39.50 Library of Congress Z39.50 MedLine Search Command Adapted to Various Resources HTTP PubMed Z39.50 MedLine ALEPH KOBV Title: 1=Kryger, Meir AND 4=sleep WAU=Kryger, Meir AND WTI=sleep (%20sleep[TITL]%20)%20AND%20(%20 Kryger[AUTH]%20Meir[AUTH]%20) Author: 1003=Kryger-M? AND 4=sleepWAU=Kryger, Meir AND WTI=sleep sleep Kryger, Meir

12. 12 herbert van de sompel Universal Gateway FINDPRESENT COMBINE SET FIND DUPLICATES U n i v e r s a l G a t e w a y F u n c t i o n s The Universal Gateway enables the use of basic components via API

13. 13 herbert van de sompel URLs Distributed approach: MetaLib http://metalib01.exlibris-usa.com/Vhttp://metalib01.exlibris-usa.com/V Harvesting approach: ARC http://arc.cs.odu.edu/http://arc.cs.odu.edu/

14. 14 herbert van de sompel Pop quiz: reference linking papers Go http://63.70.76.27:8080/cs502/http://63.70.76.27:8080/cs502/ Logon Box 1 : Firstname Box 2 : Lastname Box 3 : netid Click take Take Quiz Submit all responses at once

15. 15 herbert van de sompel Make-up Pop quiz: SODA and FEDORA papers Go http://63.70.76.27:8080/cs502/http://63.70.76.27:8080/cs502/ Logon Box 1 : Firstname Box 2 : Lastname Box 3 : netid Click take Take Quiz Submit all responses at once