Electronic Theses and Dissertations (ETDs): Improving Graduate Education through the Networked Digital Library of Theses and Dissertations (NDLTD) U. Kentucky February 24, 2000 Edward A. Fox CC CS DLRL Internet TIC Virginia Tech, Blacksburg, VA, USA

Acknowledgements (Selected) F Sponsors: ACM, Adobe, IBM, Microsoft, NSF, OCLC, US Dept. of Education, … F Co-PIs: Marc Abrams, Robert Akscyn, John Eaton, Gail McMillan F Students: Fernando Das Neves, Robert France, Neill Kipp, Paul Mather, Constantinos Phanouriou, James Powell, Ohm Sornil, David Watkins, Chang Zhang, Jianxin Zhao

Remember! F DLs (technology base on campuses) F ETDs (growing initiative – act now!) F NDLTD (focus on improved graduate education! federation to join! support!) F NUDL, OAI (help establish international cooperative and new era in scholarly communication)

Virginia Tech Background F Largest university in Virginia, land-grant, town population 35K plus 25K students F Blacksburg Electronic Village, since 1992, with 80% of community on Internet F Net.Work.Virginia, largest ATM network, with over 750 sites, for education, research, government F LMDS, Local Multipoint Distribution Service, gigabit wireless networking - 1/3 of Virginia F Math Emporium, 500 workstations F Faculty Development Initiative, round 2

Digital Libraries SGML (1985) PDF (1992) NSF DLI (1994) Library Cancellations (1988) University Scholarly Electronic Pub. (1988) Info. Literacy (1995) Improving Education Internet (1984) WWW (1994) Multimedia (1986)

A Digital Library Case Study F Domain: graduate education, research F Genre:ETDs=electronic theses & dissertations F Submission: F Collection: Project: Networked Digital Library of Theses & Dissertations (NDLTD)

Media ETD Web Site ETDs Got Your Interest? Graduate Students Singapore AM Chronicle of Higher Ed. National Public Radio NY Times... U. Laval

Key Ideas: Networked infrastructure Scalability Education is the rationale University collaboration Workflow, automation Authors must submit Maximal access PDF, SGML, MM Standards Federated search 8th graders vs. grads MARC, DC, URNs

What led to today’s meeting? F 1987 mtg in Ann Arbor: UMI, VT, … F 1992 mtg in Washington: CNI, CGS, UMI, VT and 10 universities with 3 reps each F 1993 mtg in Atlanta to start Monticello Electronic Library (MEL): SURA, SOLINET F 1994 mtg in Blacksburg re ETD project: std of PDF + SGML + multimedia objects F 1996 funding by SURA, US Dept. of Education (FIPSE) for regional, national projects F 1997 meetings in UK, Germany,...

F Aiding universities to enhance grad educ., publishing and IPR efforts F Helping improve the availability and content of theses and dissertations F Educating ALL future scholars so they can publish electronically and effectively use digital libraries (i.e., are Information Literate and can be more expressive) What are we doing?

What are the long term goals? F 400K US students / year getting grad degrees are exposed / involved F 200K/yr rich hypermedia ETDs that may turn into electronic portfolios F Dramatic increase in knowledge sharing: lit. reviews, bibliographies, … F Services providing lifelong access for students: browse, search, prior searches, citation links

ETDs: Library Goals F Improve library services –Better turn-around time –Always available F Reduce work –catalog from e-text –eliminate handling: mailing to UMI, bindery prep, check-out, check-in, reshelving, etc. F Save space

NDLTD Computer Resources Research Literature Student Prepares Thesis or Dissertation

Student Defends and Finalizes ETD My Thesis ETD

Student Gets Committee Signatures and Submits ETD Signed Grad School

Graduate School Approves ETD Student is Graduated Ph.D.

Library Catalogs ETD and New Students Have Access to the New Research WWW NDLTD

Status of the Local Project F Approved by university governance Spring 1996; required starting 1/1/97 F Submission & access software in place F Submission workshops for students (and faculty) occur often: beginner/adv. F Faculty training as part of Faculty Development Initiative F Over 2000 ETDs in collection – some have audio, video, large images, software, …

Archiving ETDs F Every 15 minutes back-ups made of not- yet-approved submissions F Hourly back-ups of newly approved ETDs F Weekly back-ups of entire ETD collection F Copies stored on-site and off-site

VT ETD Cataloging F same as current cataloging policies, except: –author-assigned keywords (not LCSH) –generic (not LC) call no. –fields/subfields as required for computer files –full abstracts F time savings –cataloger familiar with computer files –equipment, software for word processing –5 minutes avg. (10-15 minutes for paper TDs)

Library Costs F $12/vol. for paper thesis processing – catalog, bind, security strip, label, shelve vols./yr. = $11,466 F $3.20/vol. ETD processing – vols./yr. = $3040 F $.07/vol. shelving F $.04/vol. circulation

Costs/Savings at VT F Graduate School stopped shipping to the library 3000 copies of paper TDs/year F Library stopped binding, shelving, and circulating 3000 copies of TDs/year F 166 ft of shelf space saved/year by the library F VT used existing equipment in Library (vs. start-up costs for staff, hardware and software from from a zero-base estimate: $65,000 – see

Institutional Members F Coalition for Networked Information (CNI) F Committee on Institutional Cooperation (CIC) F Diplomica.com F Dissertation.com F Dissertationen Online (Germany) F Ibero-American Science & Technology Education Consortium (ISTEC, F National Library of Portugal (for all universities) F Organization of American States (SEDI/OAS) F UNESCO (

US University Members (37) F Rochester Institute of Tech. F U. of Colorado Health Sci. Cntr. F U. of Florida F U. of Georgia F University of Hawaii, Manoa F U. of Iowa F U. of Maine F U. of Oklahoma F U. of South Florida F U. of Tennessee, Knoxville F U. of Tennessee, Memphis F U. of Texas at Austin F U. of Virginia F U. Wisconsin - Madison F Vanderbilt U. F Virginia Commonwealth U. F Virginia Tech - required since 1/97 F West Virginia U. - required fall 1998 F Worcester Polytechnic Inst. F Air University (Alabama) F Brigham Young University F Cal Tech F Clemson University F College of William & Mary F Concordia University (Illinois) F East Carolina University F East Tenn. State University F Florida Institute of Tech. F Florida International University F George Washington University F Marshall University (W. Va.) F Miami U. of Ohio F MIT F Michigan Tech F Naval Postgraduate School (CA) F North Carolina State U. F Penn. State University

Australian Project Members F U. New South Wales (lead institution) F U. of Melbourne F U. of Queensland F U. of Sydney F Australian National University F Curtin U. of Technology F Griffith U.

German Project Members F Humboldt University (lead institution) F 3 other universities F 5 learned societies –Mathematics, Physics, Chemistry, Sociology, Education F 1 computing center F 2 major libraries

CBUC ( Spain) F Consorci de Biblioteques Universitàries de Catalunya, as group, with 9 members: –Universitat de Barcelona –Universitat Autonòma de Barcelona –Universitat Politècnica de Catalunya –Universitat Pompeu Fabra –Universitat de Girona –Universitat de Lleida –Universitat Rovira i Virgili –Universitat Oberta de Catalunya –Biblioteca de Catalunya

Other International Members F Chinese University of Hong Kong F Chungnam National U., Dept of CS (S. Korea) F City University, London (UK) F Darmstadt U. of Tech. (Germany) F Free University of Berlin (Germany - Vet. Med.) F Gyeongsang National U. (Korea) F India Institute of Technology, Bombay (India) F Nanyang Technological U. (Singapore, part) F National U. of Singapore (Singapore, part) F Polytechnic University of Valencia (Spain) F Rhodes U. (South Africa) F St. Petersburg St. Tech.U (Russia) F Univ. de las Américas Puebla (Mexico) F Univ. of Alicante (Spain) F Univ. of Pisa (Italy) F U. Laval; U. of Guelph; U. Waterloo; Wilfrid Laurier U. (Canada), …

Usage of ETDs in VT Collections Jan-Aug Total requests 37,171247,537465,974907,104 Daily Requests ,7223,121 Abstract requests 25,829112,633177,647143,056 Hosts served 9,01522,72528,02252,663

Popular Works Seevers, Gary L. Identification of Criteria for Delivery of Theological Education Through Distance Education: An International Delphi Study (Ph.D., Educational Research and Evaluation, April 1993; 1353Kb) 432 Hohauser, Robyn Lisa. The Social Construction of Technology: The Case of LSD (MS in Science and Technology Studies, Feb. 1995; 244Kb) 390 Childress, Vincent William. The Effects of Technology Education, Science, and Mathematics Integration Upon Eighth Grader's Technological Problem-Solving Ability (Ph.D. in Vocational and Technical Education, July 1994; 285Kb) 310 Kuhn, William B. Design of Integrated, Low Power, Radio Receivers in BiCMOS Technologies (Ph.D. in Electrical Engineering, Dec. 1995; 2Mb) 287 Sprague, Milo D. A High Performance DSP Based System Architecture for Motor Drive Control ( MS in Electrical Engineering, May 1993; 878Kb) 165 Wallace, Richard A. Regional Differences in the Treatment of Karl Marx by the Founders of American Academic Sociology (MS in Sociology, Nov. 1993; 479Kb) 150 McKeel, Scott Andrew. Numerical Simulation of the Transition Region in Hypersonic Flow (Ph.D. in Aerospace Engineering, Feb. 1996; 3Mb)

Popular Works Liu, Xiangdong. Analysis and Reduction of Moire Patterns in Scanned Halftone Pictures (Ph.D. in Computer Science, May 1996; 6.6Mb) 7656 Petrus, Paul. Novel Adaptive Array Algorithms and Their Impact on Cellular System Capacity (Ph.D. in Electrical Engineering, March 1997; 5Mb) 2781 Agnes, Gregory Stephen. Performance of Nonlinear Mechanical, Resonant-Shunted Piezoelectric, and Electronic Vibration Absorbers for Multi-Degree-of-Freedom Structures (Ph.D. in Engineering Mechanics, Sept. 1997; ? Kb) 2492 Gonzalez, Reinaldo J. Raman, Infrared, X-ray, and EELS Studies of Nanophase Titania (Ph.D. in Physics, July 1996; 4607Kb) 1877 Shih, Po-Jen. On-Line Consolidation of Thermoplastic Composites (Ph.D. in Engineering Mechanics, Feb. 1997; 3.3Mb) 1791 Saldanha, Kevin J. Performance Evaluation of DECT in Different Radio Environments (MS in Electrical Engineering, Aug. 1996; 3.2Mb) 1431 DeVaux, David. A Tutorial on Authorware (MS in CS, April 1996; 2.3Mb) 1394 Kuhn, William B. Design of Integrated, Low Power, Radio Receivers in BiCMOS Technologies (Ph.D. in Electrical Engineering, Dec. 1995; 2518Kb)

International Use   United Kingdom  6082, Australia  Germany  Canada  South Korea  France  Italy  Netherlands  Brazil  Thailand  Greece

NUDL F 1/15/99 NUDL proposal to NSF under DLI2 international program –VT: Library, Grad School, Industrial&Systems Eng. –Partners: UK (2), Singapore, Russia, Korea, Greece, Germany, plus Iberoamerican group (Spain, Portugal, Argentina, Brazil, Chile, Mexico) –Problems: Multilingual search, multimedia submissions, requirements/usability, … F Start with ETDs, then expand to other student works, portfolios, data sets, (CS) courseware,...

NUDL Partners F Ricardo A. Baeza-Yates, Universidad de Chile, Chile F José Luis Brinquete Borbinha, Biblioteca Nacional, Portugal F José Hilario Canós Cerdá, Universidad Politécnica de Valencia, Spain F Stavros Christodoulakis, Technical University of Crete, Greece F Lautaro Guerra Genskowsky, Universidad Técnica Federico Santa Maria,Chile F Juan José Goldschtein, Univesidad de Belgrano, Argentina F Peter Diepold, Humboldt University, Germany F Francisco Javier Jaén Martinez, Spain F Sung Hyon Myaeng, Chungnam National University, Korea F Ana Maria Beltran Pavani, Prédio Cardeal Leme, Brazil F Lim Ee Peng, Nanyang Technological University, Singapore F Alexander I. Plemnek, St.-Petersburg State Technical University, Russia F J. Alfredo Sánchez, Universidad de las Américas-Puebla, Mexico

Who are sponsors / cooperators? F Funding, Donations of hardware/software –SURA –US Dept. of Education (FIPSE) –Adobe Systems –IBM –Microsoft –OCLC F Others Serving on Steering Committee –National/Regional Projects: Australia, French speaking group, Germany, IberoAmerica (ISTEC), UK (UTOG) –CGS, National Lib. Canada, NSF, OAS, SOLINET, UMI, UNESCO,...

Relationship with publishers F Concern of faculty and students that still wish to publish books or journal articles, voiced: campus, Chronicle, NPR, Times F Solution: Approval Form gives students, faculty choices on access, when to change access condition; use IPR controls in DL F Solution: by case, work with publishers and publisher associations to increase access – AAP, AAUP – AAAS, ACM, ACS, Elsevier,...

Some responses from publishers F ACM: need to acknowledge copyright F Elsevier: need to acknowledge copyright F IEEE-CS: endorse initiative F ACS: After first publication, can release F Textbook publishers: different market, manuscript significantly reworked F General: restricting access to local campus will not cause any problems

For professional societies F Like “writing across the curriculum” F Besides writing: computing/communications, information literacy, personal digital library management, tool use, research methods, collaboration, archiving/preservation F Data sets, communities of users of them F Classification systems / browsing / searching F NRC’s “On becoming a researcher”

How does this relate to UMI? (Bell and Howell) F 1987 UMI workshop to explore ETDs F Support letter for US Dept. of Ed. proposal F Steering and technical committee membership F ProQuest Direct pilot of scanning works started 1/1/97, free 2 yr access to front part F Collaborating on: – accepting electronic author submissions – standards (e.g., representation), research

ETD Initiative (and UMI) Students Learn about DL, EPub TDs become more expressive N. Amer. (T)Ds are accessible, archived Global TDs become more accessible, archived UMI Universities

User Search Support (multilingual, XML) Note: All groups shown are connected with NDLTD.

F James Powell student project, D-Lib Magazine description in Sept F XML description of each site –type of search engine / service –language –coverage (for resource discovery) F Adding Z39.50 gateway capability and integrating with MARIAN, along with Harvest and Open Archives protocols (according to Santa Fe Convention) – see

Interoperability Tests Planned F IBM DL: donated equipment, technical support, powerful IPR (see TOIS, D-Lib) F Z39.50: OCLC SiteSearch / VT tailored s/w –university libraries w. catalogs of freely shared MARC records pointing to archival copies –via URNs: handles & PURLs F Dienst / NCSTRL - CS depts., DARPA, NSF, CNRI, Cornell – UVA, MIT have worked on extensions for ETDs - Portugal is studying use for Europe - VT is working on Dienst to Z39.50 gateway

Access Approaches F Goal: Maximize access and services, e.g., by encouraging: F UMI centralized services F Distributed service: Dienst, Z39.50 F Regional services (e.g., OhioLink, AZ/NM) F Local servers with browse, search – From local catalogs to local archives F WWW robot indexing and search services

Access Possibilities Web search engines library catalog clients www. theses. org www. openarchives. org 3 rd Party Services (e.g., Bell & Howell) Virginia Tech National Library of Portugal CBUC (Spain) Ohio Link MITNational Projects: AU, GE, …

MARIAN F Multiple Access Retrieval of Information with Annotations F (Marian the Librarian …) F Evolved from CODER system to a distributed Online Public Access Catalog (OPAC), then DL backend, now becoming a full DL system F From C/C++ to Java F Future: NDLTD, NUDL, PetaPlex F Use for campus collection management F Use for as centralized system with gateway services

MARIAN Layers Database Layer Search Engine Layer User Information Layer User Interface Layer User

Open Archives Initiative (OAI) F Santa Fe meeting, Oct , 1999, protoproto F Next mtg June 3, San Antonio, between HT’00 & DL’00 F LANL, CNI, DLF, Mellon, … F Convention (see Feb. D-Lib Magazine article) F Archives -> Open Archives –Support unique archive identifiers –Implement Open Archives Metadata Set (DC-based, using XML) –Implement Dienst harvesting interface –Register the archive F Build tools, layer other services: linking, searching, …

Approaches to Open Archives Build By Discipline Build By Institution Author Category Interdisciplinary Year Language Query …

Why might a university want to be involved? F To improve graduate education / better prepare your students / increase their knowledge and visibility F To unlock university information F To save money for students and for the university / improve workflow F To build an important digital library

Multiple objectives F Sharing research results –Decrease costs, increase services –Increase knowledge of users F Adding to author knowledge/skills –Epub, DL, IPR F Enhancing organization’s infrastructure –CS department, library –University, Laboratory

DL Submission Software F Similar software developed for W3C’s WCA, CSTC, and NDLTD F CSTC version field-tested to manage papers for ACM Digital Libraries ‘99 F May generalize for –conferences –electronic journal –resource description (e.g., courses, Web content)

How can a university get involved? F Select planning/implementation team – Graduate School – Library – Computing / Information Technology – Institutional Research / Educ. Tech. F Send us letter, give us contact names – F Adapt Virginia Tech solution – Build interest and consensus – Start trial / allow optional submission

Contact Our Project Team Phone Call Visit Video Tape

Convene Local Planning Group ETD

Build Local ETD Site Digital Library Policies Inspection/Approval Workshop/Training ETD

Type 1 Members University Requires ETDs F Adobe Acrobat and/or XML/SGML tools F Automated submission & processing F Archive/access through UMI, (OCLC,) Virginia Tech,... F (Local) WWW site, publicity F (Local) Assistance provided as requested: , phone, listserv(s)

Type 2 Members University Agrees to Require ETDs F Like Type 1 but set date not reached F Usually has an option or pilot F May: wait for new AY; start with all who enter after; … F Build grass roots support – Advisory committee: representative? expert? – Champions to spread by word of mouth – Approval: Senates, Commissions, Deans, Students – Publicity to reach community

NDLTD Members, Types 3-7 F 3. Part of university requires ETDs F 4. University allows ETDs F 5. University investigating, has pilot F 6. University consortium joins: –CIC (Big 10 coordinating body) F 7. Non-university organization joins –CNI (Coalition for Networked Info.)

Support Services Developed F WWW site with > 300 Mb, CD, videotape F Automated submission system (MySQL, UNIX, WWW scripts - grad school/library) F Student guidelines, style sheets, multimedia training materials, FAQs, press info F SGML and XML DTDs for ETDs F SGML to HTML (web generator) F LaTeX, Word templates, converters F FTP site for PS to PDF conversion with UNIX distiller

Accessibility Activities / Plans F Interface design (simple, 3D, VR) F Usability studies F Generic multi-lingual support F Support for those with disabilities F Hybrid collection (paper, MARC, abstracts, full-text, multimedia) F Disciplinary classifications, tools F Visualization of results, collection

CAVE Experiments F Use a familiar metaphor –building / floor / room / shelf / book F Rearrange orderings / shelving –use categories, clustering, ranking –use visualization: colors and gaps –study space mappings: physical, logical F Simplify movement for key tasks

ENVISION F NSF “A User-Centered Database from the Computer Science Literature” ( ) F Collected bib/typesetter data, converted to SGML F Scanned thousands of page images F MARIAN search engine - can be made available (also applied to the Virginia Tech library catalog) used as part of a prototype object-based DL, with tailored visualization interface (L. Nowell dissertation)

Envision Results Window

SPIRE Visualization

Support Offered F Software, documentation, tech support F , listservs -eval, -grad, -library, -technical) F Donations: Adobe, Microsoft F Evaluation: instruments, analysis - solutions/statistics F (Temporary storage / archiving; aid - in setting up an int’l service & archive)

PetaPlex F Digital Library Machine (“super” object store) F Parallel computer / storage utility for scale of 1000 to 1,000,000 gigabytes (terabyte/petabyte) F Knowledge Systems Incorporated is supplying VT- PetaPlex-1 with –high speed backbone connection (OC-12) –2.5 terabytes through 100 “Nanoservers”: –Network connection + IBM 25GB disk MHz Pentium II + Linux

PetaPlex Complex FRONT END MACHINE RS/6000, 1G RAM, 4 Proc. Nanoserver Service Machine 1 Service Machine 2 Service Machine 3 Service Machine 4

Enhancements F Dublin Core spec, MARC crosswalk F DTDs for SGML, XML(+ ML) F Annotation system (author, friends, notes) F Routing system (based on Sift) F Multilingual WWW site, training materials F Better federated search (w. Z39.50, planned with Dienst and Harvest - using MARIAN) F Integrate SFX, CiteSeer (citation database and linking, plagiarism detection)

Future Work - 1 of 2 F Working with publishers to increase level of access as much as possible F Interoperability tests among universities and with UMI to provide integrated services F Study with testbed that emerges, to improve information retrieval, browsing, interface, and other types of user support F Evaluation, improving learning experience, spread to worldwide initiative, sustainable support and coordination

Future Work - 2 of 2 F Adding services currently prototyped –annotation and SDI (routing) capabilities –Dublic Core metadata, crosswalk to MARC –support with IBM DL, OCLC SiteSearch F Adding other services planned –building and using citation database (w. SFX) –implementing plagiarism check (like “SCAM”) F Developing NUDL as a sustainable self governing global institution (w. committees)

Remember! F DLs (technology base on campuses) F ETDs (growing initiative – act now!) F NDLTD (focus on improved graduate education! federation to join! support!) F NUDL, OAI (help establish international cooperative and new era in scholarly communication)