1. Digital | Curation | Centre UK strategies for digital preservation and curation Chris Rusbridge, Digital Curation Centre Funded by:

2. Digital | Curation | Centre 2 Contents Background Digital Preservation Coalition Digital Curation Centre Other strategic activities

3. Digital | Curation | Centre 3 Background CPA/RLG report 1995 JISC/BL workshop, Warwick 1995 CEDARS project starts, 1998 CAMiLEON project starts, 1999 JISC/BL workshop, March 1999 Digital Preservation Coalition formed, 2002 UK Legal Deposit legislation, 2003 Digital Curation Centre formed, 2004

4. Digital | Curation | Centre 4 Digital Preservation Coalition Aim: develop UK digital preservation agenda within international context Established as non-profit company July 2002 May 2003, Digital Preservation Coordinator appointed March 2004, DPC has 27 members (BL, CURL, JISC, MLA, NA Scotland, OCLC, PRONI, TNA, ULCC founding members)

5. Digital | Curation | Centre 5 Rationale Reliance on digital resources increasing rapidly Increasing expectations of long term availability Responsibility for stewardship Cultural and scientific value of resources

6. Digital | Curation | Centre 6 Types of membership Cross-Sectoral Membership Publishing & Media Libraries Archives Museums & Records Data services Science & Technology Government Research & Policy

7. Digital | Curation | Centre 7 What does the DPC do? Raise profile of digital preservation –Run advocacy campaigns, etc Provide examples of good practice Highlight gaps and reponsibilities Act as catalyst for action

8. Digital | Curation | Centre 8 DPC action examples Digital preservation training, advocacy and outreach PR programme to raise media profile Survey members to assess DP needs Regular fora for training and advice “What’s New in Digital Preservation” and Technology Watch reports

9. Digital | Curation | Centre 9 DPC work packages 1.Promoting Digital Preservation 2.Acting to increase funding 3.Fostering collaboration and forging strategic alliances 4.Producing, providing, and disseminating information 5.Promoting and developing services, technology, standards and training 6.Continuing to develop the Coalition’s activities

10. Digital | Curation | Centre 10 For later use? In use now (and the future)? Digital curation continuum Digital preservationDigital curation StaticDynamic

11. Digital | Curation | Centre 11 Digital Curation Centre History –JISC Strategy (Beagrie et al) –Lord and MacDonald report –JISC and e-Science funding –Call for bids 2003 –DCC Project for 3 years… Service began March 2004 Research begun September 2004

12. Digital | Curation | Centre 12 Digital Curation Rationale Definition? “maintaining and adding value to a trusted body of digital information for current and future use”

13. Digital | Curation | Centre 13 Assuring permanent access to the records of science & the humanities? Long term access to primary data Increasing data volumes from eScience and Grid-enabled / cyberinfrastructure applications Changing research paradigm: data-driven science, “big science” Observational data, simulations, large-scale experimentation Multi-media resources, statistical data, surveys, geo-spatial data……

14. Digital | Curation | Centre 14 Reports… Tony Hey et al: The Data Deluge Atkins et al: Blue-Ribbon report on Cyberinfrastructure NSB: Draft report on Long-lived Digital Data Collections Recent report on Cyberinfrastructure in Social, Behavioural and Economic sciences…

15. Digital | Curation | Centre 15 Census Data on the Web

16. Digital | Curation | Centre 16 Internet Archaeology: publication with data

17. Digital | Curation | Centre 17 Lord/Macdonald 1 data producers Which of your data will be of value after project? Primary 79% Summary/derived 90% Published 94% Financial provision not been made? 56%

18. Digital | Curation | Centre 18 Lord/Macdonald 2 Will future users need… Special software? 42% Special hardware? 15% Explanatory documentation? 75% Any data that cannot be re-created if lost? 56%

19. Digital | Curation | Centre 19 Lord/Macdonald 3 data producers re-visited Do you have time or funding to provide needed documentation? <30% Would training be valuable?70% Re-use your own data?50% Others used your data?<40% Expect to use collection-based science in the future? 80%

20. Digital | Curation | Centre 20 Conclusions? Need for continuing care of data More than digital preservation… Hence Digital Curation Centre –Providing advice and support

21. Structure to Engage & Collaborate Industry research collaborators standards bodies testbeds & tools communities of practice: users community support & outreach research development co-ordination service definition & delivery management & admin support curation organisations eg DPC Collaborative Associates Network of Data Organisations

22. Digital | Curation | Centre 22 Matrix structure

23. Digital | Curation | Centre 23 Activities desired…from User Needs Analysis R&D issues: Annotation services, Ontology development, Automating metadata creation, Tools and toolkits, Data Format Description Language, Identifiers, Registries, Economic and cost-benefits studies Advisory services :“Ask-a-Curator”,FAQs, reports, briefings, awareness-raising materials, best practice guidance, Storage media, “Like Erpanet”, advise Government, Research Councils, funding bodies Professional development: Short courses, conferences, seminars, workshops, secondments to DCC and to working repository services Outreach: Leadership for the future, case studies, sharing solutions, collaboration with other partners, international peers, industry links

24. Digital | Curation | Centre 24 Curated databases – some issues Integrating and publishing data so that someone else can use it. Annotating existing data and moving annotations to other databases Provenance: where did this data come from? Archiving: how do you preserve something that is constantly changing?

25. Digital | Curation | Centre 25 Research approaches Publishing & integrating scientific databases ‘Archiving’ past states of volatile databases Database provenance and annotation Organisational dynamics of trusted repositories Automating metadata extraction Cost-benefit analysis of data curation Rights and responsibilities

26. Digital | Curation | Centre 26 Development approach OAIS (Open Archival Information System) linkage: focus on representation information –link to global work on format registries? –Concentrate on scientific data formats? Repository –Representation Information –Standards and Tools –Aim for OAIS compliance Persistent identifiers Certification… RLG task force Open development wiki and email list

27. Digital | Curation | Centre 27 OAIS Reference Model – Functional Model

28. Digital | Curation | Centre 28 Representation Net

29. Digital | Curation | Centre 29 Development Roadmap Registry: complete prototype, link to PRONOM, GDFR etc, handover to service Representation information: describe CCLRC (science) data using EAST, etc Certification work continues Additional tools: metadata extraction Testbeds, interactions with others

30. Digital | Curation | Centre 30 Service definition & delivery Advisory services –Responses to queries—from legal to technical guidance HELPDESK@dcc.ac.uk –Site visits (National Institute of Environmental eScience) Information Services –Briefing Documents - Freedom of Information by Mags McGinley –DIGITAL CURATION MANUAL 20 chapters written by community experts e.g. Metadata written by Michael Day, UKOLN Peer-reviewed Checklist for Compliance with best practices and standards –Technology Watch

31. Digital | Curation | Centre 31 Services: workshops 2005 Programme –Preservation of medical databases: 24-25 May at the Gulbenkian Institute, Lisbon in collaboration with ERPANET & the Wellcome Trust –Persistent identifiers liaising with NISO, 30 June at University of Glasgow –Institutional repositories: 6 July at the University of Cambridge, UK in collaboration with DSpace –Cost models in collaboration with Digital Preservation Coalition July at British Library

32. Digital | Curation | Centre 32 User requirements analysis Commissioned study Leona Carpenter Reporting now Desk-based research Focus groups Interviews Results will inform research, development service definition / delivery and outreach Recommendations and priority tasks

33. Digital | Curation | Centre 33 www.dcc.ac.uk

34. Digital | Curation | Centre 34 www.ijdc.net Launch planned June/July Peer-reviewed contributions Peters Buneman and Burnhill, Editor (issue 1) Production editor Philip Hunter

35. Digital | Curation | Centre 35 Sample issue Full papers Invited articles News & views Papers for submission are very welcome!

36. Digital | Curation | Centre 36 1 st DCC International Conference Location - Bath UK 29-30 September 2005 Keynote speakers  Cliff Lynch CNI  Graham Cameron European Bio-informatics Institute DCC Research update Social highlights

37. Digital | Curation | Centre 37 Associates Network Goals Develop understanding, share best practice, advance research, promote recognition, develop consensus Membership International groups, national bodies, industry partners, funders, research groups, HEIs, FEIs, individuals…… Benefits Early access to R&D outputs, advisory services, training, input to definition and design, community participation Discussion Forum www.dcc.ac.uk Please join us!

38. Digital | Curation | Centre 38 Other strategic activities Legal deposit BL Digital Object Management system The National Archive European activities: DELOS, ERPAnet etc JISC 4/04 Digital Preservation Programme

39. Digital | Curation | Centre 39 JISC preservation programme Assessment of UK Data Archive and The National Archives compliance with OAIS/METS DAAT: Digital Asset Assessment Tool Digital Preservation Training Programme eSPIDA: An effective Strategic model for the Preservation and disposal of Institutional Digital Assets LIFE (Lifecycle Information for E-literature) Managing Digital Assets in Tertiary Education (Mandate)

40. Digital | Curation | Centre 40 JISC preservation programme 2 Managing Risk: a Model Business Preservation Strategy for Corporate Digital Assets METS Awareness Training Personal Archives Accessible in Digital Media (paradigm) PRESERV (PReservation Eprint SERVices) SHERPA Digital Preservation: Creating a Persistent Preservation Environment for Institutional Repositories

41. Digital | Curation | Centre Acknowledgements Slides from Maggie Jones, Liz Lyon, Peters Burnhill & Buneman, David Giaretta and others used with thanks.

42. Digital | Curation | Centre 42 Trusted Repositories of Knowledge The Maori entrusted their knowledge to people, trained to be the repositories,who could: receive information with the utmost accuracy store information with integrity beyond doubt retrieve the information without amendment apply appropriate judgement in the use of the information pass on the information appropriately. Whatarangi Winiata, (2002), Repositories of Röpü Tuku Iho: A Contribution to the Survival of Mäori as a People, Wellington: Library & Information Association of New Zealand Aotearoa Annual Conference, 17-20 November 2002 Special thanks to Professors Derek Law & Seamus Ross

43. Digital | Curation | Centre 43 Aims & Objectives for the DCC ‘quality improvement in data curation & digital preservation’ initial focus: data as evidence for scholarly conclusions wider remit: scholarly communication & eLearning ‘excellence in research & excellence in service’ working with repositories, rather than being one ‘connecting communities’ via Associates Network –universities & research institutes –scientific data tradition & document tradition –international & cross-sectoral