1. Collaboration on Digital Libraries NEC Dec. 27, 2000 Edward A. Fox fox@vt.edu http://fox.cs.vt.edu CS DLRL Internet TIC Virginia Tech, Blacksburg, VA, USA

2. Acknowledgements (Selected) F Mentors: JCR Licklider, Michael Kessler, Gerard Salton F Sponsors: Adobe, IBM, Microsoft, NLM, NSF, OCLC, SOLINET, SURA, UNESCO, US Dept. of Ed. (FIPSE), … F VT Faculty/Staff: Tony Atkins, Debra Dudley, John Eaton, Gwen Ewing, Peter Haggerty, JAN Lee, Gail McMillan, Manuel Perez, Len Peters, James Powell, …  VT Students: Emilio Arce, Fernando Das Neves, Brian DeVane, Robert France, Marcos Goncalves, Scott Guyer, Robert Hall, Brian Hobbs, Neill Kipp, Paul Mather, Tim McGonigle, Todd Miller, Constantinos Phanouriou, William Schweiker, Ohm Sornil, Hussein Suleman, Patrick Van Metre, Laura Weiss, …

3. URLs  http://fox.cs.vt.edu  http://ei.cs.vt.edu/~dlib (Courseware)  http://www.dlib.org (D-Lib Magazine)  www.smete.org and later www.nsf.gov/nsdl  www.ndltd.org and www.theses.org  www.cstc.org (CSTC and JERIC)  www.openarchives.org  www.jcdl.org (JCDL’2001 – June 24-28)

4. Digital Library Courseware F http://ei.cs.vt.edu/~dlib/ F WWW pages or large PDF copy files F CourseInfo quizzes based on books by Michael Lesk (MKP.com) and William Arms (MIT Press) F Contents based on books, with other popular topics added (e.g., agents) F Separate pages to supplement: Definitions, Resources (People, Projects), and References

5. JCDL 2001  First Joint ACM/IEEE Conference on Digital Libraries (+ NSF DLI-2 PI mtg) F http://www.jcdl.org F June 24-28, 2001 in Roanoke, VA F Conference Committee: F General Chair: Edward A. Fox, Virginia Tech F Program Chair: Christine Borgman, UCLA F Treasurer: Neil Rowe, Naval Postgraduate School F Posters Chair: Craig Nevill-Manning, Rutgers U.

6. Computing (flops) Digital content Communicat i ons (bandwidth, connectivity) Locating Digital Libraries in Computing and Communications Technology Space Digital Libraries technology trajectory: intellectual access to globally distributed information lessmore (Slide from S. Griffin, NSF)

8. PetaPlex Complex FRONT END MACHINE RS/6000, 1G RAM, 4 Proc. Nanoserver Service Machine 1 Service Machine 2 Service Machine 3 Service Machine 4

9. PetaPlex F Digital Library Machine (“super” object store): Parallel computer / storage utility F Research: inverted files, video server, … (supported by IBM, AOL, NSF, …) F Knowledge Systems Incorporated is supplying VT-PetaPlex-1 with 2.5 terabytes through 100 nodes : u Net connection + 25GB disk + 233 MHz Pentium + Linux

10. MARIAN F Multiple Access Retrieval of Information with Annotations F (Marian the Librarian …) F Evolved from CODER system to a distributed Online Public Access Catalog (OPAC), then DL backend, now becoming a full DL system F From C/C++ to Java F Future: NDLTD, NUDL, PetaPlex F Use for campus collection management F Use for www.theses.org as centralized system with gateway services: OAI, Harvest, Z39.50, …

11. MARIAN Layers Database Layer Search Engine Layer User Information Layer User Interface Layer User

12. MARIAN Parallelism

18. ENVISION F NSF “A User-Centered Database from the Computer Science Literature” (1991-93) F Collected bib/typesetter data, converted to SGML F Scanned thousands of page images F MARIAN search engine - can be made available (also applied to the Virginia Tech library catalog) used as part of a prototype object-based DL, with tailored visualization interface (L. Nowell dissertation)

23. DL-Related Timeline 1985 CoRR DLI ETDs 1990 xxx 1995 XML OAI 2000 NCSTRL PDF Proposed Ugrad DL (Envision, EI) NDLTD DLI2 HyperCard TEI SGML PCs Hypertext Conf. DCRDF CSTR NSDL (CSTC, iLumina,…) Scholarly EPub in U’s JPEG, MPEG MPEG-7 WWW Java

24. Borgman et al.: Workshop Report on Social Aspects of Digital Libraries: http://www-lis.gseis. ucla.edu/DL/ Information Life Cycle

25. Core of DL F Collecting –Authoring, Repositories, Archives, Museums, … F Organizing –Packaging of Data and Metadata, Storing –Naming/Identifying and Cataloging –Classification, Clustering, … F Serving –Indexing, Linking, Summarizing, Visualizing –Browsing, Accessing, Searching, Filtering, Retrieving, Distributing, Using, …

26. Digital Libraries Shorten the Chain from Editor Publisher A&I Consolidator Library Reviewer

27. DL = Users Direct (Organized Artifact Mediated Communication) Author Reader Digital Library Editor Reviewer Teacher Learner LibrarianDr.Patient

28. Author tools www.physik.uni-oldenburg.de/EPS/mmm

31. A Digital Library Case Study F Domain: graduate education, research F Genre: ETDs = electronic theses & dissertations F Submission: http://etd.vt.edu F Collection: http://www.theses.org Project: Networked Digital Library of Theses & Dissertations http://www.ndltd.org (NDLTD – remember: ND LTD / NDL TD) (also, newer NUDL: Networked University Digital Library, with e-courseware, etc.)

32. Status of the Local Project F Approved by university governance Spring 1996; required starting 1/1/97 F Submission & access software in place F Submission workshops for students (and faculty) occur often: beginner/adv. F Faculty training as part of Faculty Development Initiative F Over 3000 ETDs in collection –Some have audio, video, large images, software, … –Millions of accesses/yr – 100s to 1000s per work

33. What are the long term goals? F Attract all TDs/yr: 50K D-US, 25K D-Germany, 10K TD-Canada, … F >200K/yr rich hypermedia ETDs that may turn into electronic portfolios (images, video, audio, …) F Dramatic increase in knowledge sharing: literature reviews, bibliographies, … F Services providing lifelong access for students: browse, search, prior searches, citation links F Hundreds/thousands of downloads / year / work

34. Student Gets Committee Signatures and Submits ETD Signed Grad School

35. Library Catalogs ETD, Access is Opened to the New Research WWW NDLTD

36. US University Members (44) F Penn. State University F Rochester Institute of Tech. F U. of Colorado Health Science Center F U. of Florida F U. of Georgia F University of Hawaii, Manoa F U. of Iowa F U. of Kentucky F U. of Maine F U. of North Texas – required since 8/99 F U. of Oklahoma F U. of South Florida F U. of Tennessee, Knoxville F U. of Tennessee, Memphis F U. of Texas at Austin – required in 2001 F U. of Virginia F U. Wisconsin - Madison F Vanderbilt U. F Virginia Commonwealth U. F Virginia Tech - required since 1/97 F West Virginia U. - required fall 1998 F Western Michigan U. F Worcester Polytechnic Inst. F Air University (Alabama) F Baylor University F Brigham Young University (part, whole) F Caltech F Clemson University F College of William & Mary F Concordia University (Illinois) F East Carolina University F East Tenn. State U. – require fall 2000 F Florida Institute of Technology F Florida International University F George Washington University F Louisiana State University F Marshall University (W. Va.) F Miami University of Ohio F Michigan Tech F Mississippi State University F MIT F Naval Postgraduate School (CA) F New Mexico Tech F North Carolina State University

37. National / Regional Projects F Australia –U. New South Wales (lead) –U. of Melbourne –U. of Queensland –U. of Sydney –Australian National U. –Curtin U. of Technology –Griffith U. F Germany –Humboldt University (lead) –3 other universities –5 learned societies: Math, Physics, Chemistry, Sociology, Education –1 computing center –2 major libraries F Consorci de Biblioteques Universitàries de Catalunya, as group, www.cbuc.es: –Universitat de Barcelona –Universitat Autonòma de Barcelona –Universitat Politècnica de Catalunya –Universitat Pompeu Fabra –Universitat de Girona –Universitat de Lleida –Universitat Rovira i Virgili –Universitat Oberta de Catalunya –Biblioteca de Catalunya F OhioLink F South Africa: ECHEA/SEALS F India, Portugal, …

38. Other Countries with Members F Belgium F Brazil F Canada F Germany F Hong Kong F India F Italy F Korea F Mexico F Netherland F Norway F Russia F Singapore F S. Africa F S. Korea F Spain F Taiwan F UK

39. Build Local ETD Site Digital Library Policies Inspection/Approval Workshop/Training ETD

40. CS Teaching Center (CSTC) F Collection of reviewed online resources used to aid in teaching of Computer Science F Supports author submission and peer-review process for new ACM Journal of Educational Resources In Computing (JERIC) F Connected with NSDL (NSF 00-44) F http://www.cstc.org

41. CS Teaching Center (CSTC) F Instead of building large, expensive multimedia packages, that become obsolete and are difficult to re-use, concentrate on small knowledge units. F Learners benefit from having well-crafted modules that have been reviewed and tested. F Use digital libraries as a powerful base of support for learners, upon which a variety of courses, self-study tutorials & reference resources can be built. [See NSF NSDL - National Science (math, engineering, technology education) Digital Library (formerly SMETE-lib) at www.dlib.org/smete/public/smete-public.html; www.smete.org ] F iLumina: NSF NSDL grant with COLLEGIS Research Institute/Eduprise, UNCW, TCNJ, …

43. Browsing (1)

44. Browsing (2)

48. (From Lee Zia, NSF) Programmatic History Digital Libraries Initiative (DLI 1) - NSF/NASA/ARPA, FY 94-97 DLI 2 - NSF, et al., initiated in FY 98, continuing Education FY 98-99 DLI 2 Special Emphasis in Undergrad NSDL Program NSF: FY 00-02 DL Operational Fall, 2002 DLs & UG Earth Systems Education initiated FY 99, continuing

49. Expectations of Tracks F Core Integration: to coordinate a distributed alliance of resource collection and service providers, and to ensure reliable and extensible access to and usability of the resulting network of learning environments and resources F Collections: to aggregate and actively manage a subset of the digital library’s content within a coherent theme or specialty F Services: to increase the impact, reach, efficiency, and value of the digital library in its fully operational form F Targeted Research: to have immediate impact on one or more of the other three tracks

50. Tracks & 29 Projects F 6 Core Integration: Columbia, Cornell, E.Michigan/MERIT, UCAR, UCB, U- Missouri/NCSA (Biology, Eng., Teacher Ed.) F 13 Collections: Atmosphere, Biology, Biosciences, Earth Systems, Engineering, Health Sciences, Math F 9 Services: Competitive Intelligence, Component Environment, Earth Systems J., Metadata NLP, Managing LOs, Peer Review, Video F 1 Targeted Research: Paths

51. NSDL Spine full-service collections full-service collections NSDL Collections referenced items & collections referenced items & collections Referenced Items & Collections NSDL Services NSDL Services Other NSDL Services CI Services discussion CI Services personalization CI Services topic-map registry CI Services query transform Core Collection- Usage Services annotation Core Collection- Building Services protocol mediation Core Collection- Building Services persistence Core Collection- Building Services harvesting Portals & Clients Portals & Clients Portals & Clients (Slide from Dave Fulker, Bill Arms – 11/2/2000)

52. Our Collaboration for NSDL PARTNERS F Hofstra F Villanova F Penn State (with NEC) F Virginia Tech F ACM, IEEE-CS, Morgan Kaufmann, …

53. Our Collaboration for NSDL FUNDING F $1M for 2 years, starting 9/1/2001 - NSF F $225K: Hofstra (1 GRA, 1 PI) F $175K: Villanova(1 GRA, 1 PI) F $175K: Penn State(1 GRA, 1 PI) F $425K: VT (4 GRAs, 3 PIs: Fox, Lee, Perez) F ACM, IEEE-CS, Morgan Kaufmann, …

54. Our Collaboration for NSDL STRENGTHS F PetaPlex, MARIAN, NDLTD, CSTC, JERIC F SIGCSE: SIG, Conference, Bulletin F History as integrating theme; adding demos F Special support for Hispanic community F Niche portals, search engines, links across collections, citation data --- for levels: undergrad, high school, middle school, etc.

55. Our Collaboration for NSDL PROPOSAL PLAN F Student project completed Fall 2000 F Kate will continue in Spring 2001 through an independent study F Meetings: John visited VT, Boots and I visit Hofstra today, I visit NEC on 12/27, John visits VT again, … F Get support letters, refine proposal, …

56. Our Collaboration for NSDL DOCUMENTS F “Computing Digital Library (CoDL)” F Packet prepared by student group F See their slides next F Contents: –Project report –CoDL proposal outline –Proposals from some successful NSDL groups