November 2004 NDIIPP: Future Directions and Relevance to Other Countries Beth Dulabahn Office of Strategic Initiatives Library of Congress November 7, 2004

November NDIIPP Legislation and Funding Created by federal legislation (PL ) in December 2000 $100 million in appropriated funds Up to $175 million potentially invested –$75 million of the appropriated funds subject to $ for $ match from non-federal sources

November NDIIPP Goals Develop a national digital collection and preservation strategy Work with government agencies, libraries, archives, and other stakeholders to establish partnerships and form networks Help identify and preserve at-risk digital content Support development of tools, models, and methods for digital preservation

November Who’s Included? Key federal agencies (including NARA, NLM, NAL, Commerce) Libraries, archives, and other cultural institutions Non-profit entities (e.g., RLG, OCLC, CLIR) Non-federal and commercial sectors (e.g., motion picture studios, record labels, publishers)

November Initial Activities Established the NDSAB in Spring 2001 –Representation from federal agencies, industry, research libraries and foundations Convened Stakeholder Meetings in Fall 2001 –3 workshops including representatives from the commercial sector Commissioned environmental scans Conducted Scenario Planning sessions Defined preservation architecture space Facilitated a National Science Foundation research agenda Developed Plan & presented to Congress 2003

November NDIIPP Strategy Iterative approach Learn by doing

November NDIIPP Focus Areas Preservation architecture Digital preservation research Network of preservation partners

November Preservation Architecture Architecture is a conceptual framework to guide development of national preservation network Build upon current work Provide basis for communication about the problem space

November Archive Ingest and Handling Test Document steps taken to ingest heterogeneous set of digital content Testers have digital preservation capabilities: Johns Hopkins, Old Dominion, Harvard, Stanford Each to work with GMU 9/11 Archive –12gb with 57,000 objects associated metadata –Diverse file formats Identify metrics for ensuring preservation of data integrity/document logical integrity

November Archive Test Activities Accept archive as-is Generate metadata Ingest content into the archive Migrate/emulate content as applicable to each archive Export content/metadata out of the archive

November Archive Test Outcomes List of logical candidate architectures for future work Understanding of the strengths and weaknesses of each Rough dollar cost figures for each solution Grasp of the possibilities and challenges of federating

November Research Program Joint LC/National Science Foundation (NSF) digital preservation research grants program NSF administers Agenda shaped by It’s About Time report Looking to fund cutting edge research to address major needs Proposals due 9/14/2004; peer review panels evaluating submissions Grants to be announced early 2005

November NDIIPP Partnerships Agreements finalized Sept Eight consortia involving over 30 partners –State government entities –Universities –Cultural heritage institutions –Private & not-for-profit Awards totaling $15+ million Projects expected to last 3 years Aim is to spur collaboration in selecting and preserving at-risk content

November Diversity of Content Funded projects will work with diverse and challenging content, including –TV broadcasts and digital video –Web sites –State and local government information –Geospatial data –Social science data

November NDIIPP Partner Projects with Web Harvesting Components The Web at Risk: A Distributed Approach to Preserving Our Nation’s Political Cultural Heritage –California Digital Library, lead University of North Texas, New York University –State & local gov’t publications, political campaigns, labor history, former federal agency sites –Develop tools for selection and acquisition

November NDIIPP Partner Projects with Web Harvesting Components (Cont.) Exploring Collaborations to Harness Objects with a Digital Environment for Preservation –University of Illinois at Urbana-Champaign, lead OCLC; Tufts University; Michigan State, Arizona, Connecticut, Illinois, North Carolina, and Wisconsin State libraries –Collect Web-based state gov’t agency publications –Develop tools for selection, acquisition, and access –Test existing repository architectures (Dspace, Greenstone, FEDORA, Eprints )

November The Next NDIIPP Area of Investment… State and Local Governments Currently in planning phase Plan to award $$ to states through IMLS

November Achievements at End of 5 Years A network of partners Vast archive of at-risk content Recommendations to Congress on long- term governance of a national digital preservation