Presentation is loading. Please wait.

Presentation is loading. Please wait.

An Introduction to the Merritt Curation Repository

Published byHelen Wilson Modified over 5 years ago

Similar presentations

Presentation on theme: "An Introduction to the Merritt Curation Repository"— Presentation transcript:

1 An Introduction to the Merritt Curation Repository
UC3 Summer Webinar Series An Introduction to the Merritt Curation Repository University of California Curation Center Team California Digital Library June 9, 2011

2 First, a word about the webinar series…
A forum for timely topics of interest to the UC community Highlighting projects, services, and developments in the areas of digital preservation, web archiving, and data curation Intended to raise awareness of issues, and provide information on useful resources and services available to the UC community 2nd and 4th Thursday of the month, and as scheduled, featuring UC3 staff and UC librarians, content managers, and technologists Teleconference +1 (866) , access code # Webconference

3 First, a word about the webinar series…
Some logistics… Participant phones will be muted during the formal presentation, but we will be monitoring the online chat Slides, Q & A, and web and voice recordings will be posted after each presentation Schedule available at Please suggest additional topics! Take the short survey

4 Now on with the show… Today’s topic is an introduction to the Merritt curation repository Who is it for? What can it do? Why use it? What does it cost? Next steps? Q & A

5 What keeps you up at night?
How much will it cost? What’s the best strategy to ensure permanent availability? How do I know my content is safe? Are there standards or best practices I should be aware of? How can I transfer my content to an appropriate curation environment I have a good discovery platform; how can I add preservation services? Do I need to create new derivatives just for preservation purposes? Can I control who can see my content? How can I get a persistent reference to my content? What if my content needs to evolve over time?

6 “There’s an app for that”
Automatic replication and high-availability redundancy How much will it cost? What’s the best strategy to ensure permanent availability? Storage at $1.04/GB/year How do I know my content is safe? Are there standards or best practices I should be aware of? Periodic fixity audit UC3 consultation How can I transfer my content to an appropriate curation environment I have a good discovery platform; how can I add preservation services? Simple submission UI/API METS “feeder” duplicates existing DPR workflow Modular micro-services “toolkit” Do I need to create new derivatives just for preservation purposes? Can I control who can see my content? How can I get a persistent reference to my content? Model free No packaging, format, or metadata requirements What if my content needs to evolve over time? Curator-defined access control rules Integration with EZID and DataCite Strongly versioned

7 Merritt repository Merritt is available for use by all members of the UC community Libraries/archives/museums ORU/MRUs Faculty/staff Centrally hosted by UC3/CDL on behalf of the UC community Economies of scale Shared experience and expertise Mediated through campus libraries

8 Modes of use: dark archive
Pro-active preservation, but no expectation of direct end user access Legacy DPR content contributed by campus libraries Cultural heritage texts, master images, sound, moving image, data sets All DPR content will be automatically migrated to Merritt

9 Modes of use: bright archive
Provide preservation and end user access NIH Healthy Pathways project on bio-demographics Multi-institutional: UC Davis, University of Colorado, University of Virginia, Syddansk University (Denmark) Need to restrict access to project partners initially, with eventual public access

10 Modes of use: bright archive
Content discovery: search

11 Modes of use: bright archive
Content discovery: search

12 Modes of use: bright archive
Content discovery: browse

13 Modes of use: bright archive
Content discovery: browse

14 Modes of use: preservation “back end”
Preservation only; content discovery/delivery provided by well-known external systems Using direct hooks into Merritt to retrieve content – eScholarship Open access publishing – Open Context Archaeological data publishing – Investigating integration with Islandora/Drupal and Alfresco

15 Modes of use: distributed data grids
DataONE “Enable new science and knowledge creation through universal access to data about life on earth and the environment that sustains it”

16 More information Online help http://merritt.cdlib.org/help
FAQ User’s guide UC3 contact

17 Merritt cost model UC3 provides technical infrastructure, data center hosting, staff, monitoring, maintenance, enhancements, help, outreach, consultation, etc. Contributors are charged only for storage used, at the UC3 recovery rate of $1.04/GB/year Developing an “endowment” model: Pay once, preserve forever Will soon extend model for non-UC contributors How does this compare? Cost of a physical book in RLF † $ 4.62/year Cost of a digital book in HathiTrust ‡ $ 0.15/year Cost of a digital book in Merritt $ 0.06/year † Gary Lawrence (2007) Internal analysis, CDL; ‡ Paul Courant and Matthew Nielsen (2010), On the cost of keeping a book, HathiTrust.

18 Average collection sizes and costs
Objects Size Annual cost CA DOE reports 8,000 12.0 GB $ Cal Cultures 420 65.6 GB $ eScholarship 46,425 118.6 GB $ A “cost calculator” spreadsheet is available at

19 Average ETD size and cost
Campus ETD titles Size Annual cost Berkeley 797 12.4 GB $ 12.88 Davis 837 13.0 GB $ 13.52 Irvine 390 6.1 GB $ Los Angeles 720 11.2 GB $ 11.63 Riverside 192 2.9 GB $ San Diego 558 8.7 GB $ San Francisco * 560 $ Santa Barbara 325 5.0 GB $ Santa Cruz 155 2.4 GB $ Based on 2009 holdings in ProQuest * UCSF based on total ETD holdings in Merritt

20 Average research data size and cost
Almost 50% of all research data is less than 1 GB Size Percentage Annual cost < 1 GB 48.3 % < $ 1 – 100 GB 32.0 % $ – 100 GB – 1 TB 12.1 % $ – 1,040.00 > 1 TB 7.6 % > $ 1,040.00 Source: Science 331:6018 (February 11, 2011): <DOI: /science >

21 Next steps UC3 is working with campus partners to determine ongoing development and collection priorities Annotation Notification Transformation Characterization Fixity / Linked data Replication IdM/Authn/Authz Ingest, Access Inventory, Queuing Storage and Identity Technology watch Metadata standards Policy and business model Data management guidelines Object and collection modeling New content acquisition

22 Next steps In production In progress In planning
Model-free objects Submission via UI and API Persistent identifiers Format identification Version provenance Automated replication Automated fixity audit Role-based access control Collections Semantic index and search Object/version/file download In progress Simplified update Enhanced characterization (JHOVE2) Faceted search and browse (XTF) CMS/DAMS-like function (Islandora) In planning Simplified batch UCTrust integration Linked data Transformation Notification Annotation Support for NGTS/DLSTF recommendations We welcome your feedback on needs and priorities!

23 Simplified update Variant form of object update requiring the submission of only the changed components Client-side tools to simplify the creation of batch manifests #%checkm_0.7 #%profile | #%prefix | mrt: | #%prefix | nfo: | #%fields | nfo:fileUrl | nfo:hashAlgorithm | nfo:hash | m | md5 | #%eof

24 Enhanced characterization
JHOVE2 next-generation framework for format- aware characterization Automated extraction and inference of extensive technical metadata significant for preservation analysis and planning "Module": { "scope": "ICCModule“, "Header": { "scope": "ICCHeader“, "ProfileSize": { "unit": "byte“, "value": 60960 } ,"ProfileVersionNumber": " “ ,"ProfileDeviceClass_raw": "spac“ ,"ProfileDeviceClass_descriptive": "ColorSpace Conversion profile“ ,"ColourSpace_raw": "RGB “ ,"ColourSpace_descriptive": "rgbData“ ,"ProfileConnectionSpace_raw": "Lab “ ,"ProfileConnectionSpace_descriptive": "labData“

25 Enhanced discovery via XTF
eXtensible Text Framework CDL developed/supported open source discovery platform Robust, scalable faceted search and browse

26 CMS/DAMS-like function
Many campuses are looking for CMS/DAMS solutions Investigating integration with Islandora to provide a Drupal CMS/DAMS front-end to Merritt

27 Questions?

28 Upcoming webinars Date/time Topic
Wednesday, June 15 12:30 pm Data Sharing by Scientists: Practices and Perceptions Carol Tenopir, Univ. Tennessee Mike Frame, USGS Thursday, June 30 2:00 pm The Data Management Planning Tool (DMP Tool) Trisha Cruse, UC3 Thursday, July 14 Data as Publication John Kunze, UC3 Catherine Mitchell, CDL Publishing Program Thursday, July 28 Merritt: Depositing Content and Providing Access Thursday, August 11 DCXL (Data Curation Excel) Please take the webinar survey

29 For more information UC Curation Center UC3 webinar series
Stephen Abrams Margaret Low Lisa Colvin David Loy Patricia Cruse Mark Reyes Scott Fisher Tracy Seneca Erik Hetzner Joan Starr Greg Janée Marisa Strong John Kunze Perry Willett UC3 webinar series Merritt repository

Download ppt "An Introduction to the Merritt Curation Repository"

Similar presentations

What is HathiTrust and How Can it Make a Difference? Sourcing and Scaling brought to the collective collection.

What is HathiTrust and How Can it Make a Difference? Sourcing and Scaling brought to the collective collection.
E-Content Service Group Virtual Meeting Digital Preservation: How to Get Started.

E-Content Service Group Virtual Meeting Digital Preservation: How to Get Started.
Introduction to Planets Hans Hofman Nationaal Archief Netherlands Prague, 17 October 2008.

Introduction to Planets Hans Hofman Nationaal Archief Netherlands Prague, 17 October 2008.
A centre of expertise in data curation and preservation DigCCur2007 Symposium, Chapel Hill, N.C., April 18-20, 2007 Co-operation for digital preservation.

A centre of expertise in data curation and preservation DigCCur2007 Symposium, Chapel Hill, N.C., April 18-20, 2007 Co-operation for digital preservation.
Digital Preservation A Matter of Trust. Context * As of March 5, 2011.

Digital Preservation A Matter of Trust. Context * As of March 5, 2011.
Data Management Planning Tool: connecting researchers to resources University of California Curation Center Team California Digital Library July 14, 2011.

Data Management Planning Tool: connecting researchers to resources University of California Curation Center Team California Digital Library July 14, 2011.
Merritt: A Micro-Services-Based Curation Repository University of California Curation Center California Digital Library November 18, 2010.

Merritt: A Micro-Services-Based Curation Repository University of California Curation Center California Digital Library November 18, 2010.
A Micro-Services-Based Approach for Curation and Preservation Solutions Stephen Abrams Patricia Cruse John Kunze Perry Willett University of California.

A Micro-Services-Based Approach for Curation and Preservation Solutions Stephen Abrams Patricia Cruse John Kunze Perry Willett University of California.
The future’s so bright…. DAITSS DIGITAL PRESERVATION SYSTEM: RE-ARCHITECTED, RE- WRITTEN, AND OPEN SOURCE Priscilla Caplan Florida Center for Library Automation.

The future’s so bright…. DAITSS DIGITAL PRESERVATION SYSTEM: RE-ARCHITECTED, RE- WRITTEN, AND OPEN SOURCE Priscilla Caplan Florida Center for Library Automation.
An Introduction to the Merritt Curation Repository University of California Curation Center Team California Digital Library June 9, 2011 UC3 Summer Webinar.

An Introduction to the Merritt Curation Repository University of California Curation Center Team California Digital Library June 9, 2011 UC3 Summer Webinar.
Mairéad Martin, Penn State University Commons Solutions Group Storage Workshop May 2010.

Mairéad Martin, Penn State University Commons Solutions Group Storage Workshop May 2010.
The Merritt Curation Repository Features, Uses, and Benefits University of California Curation Center California Digital Library UC Berkeley, August 13,

The Merritt Curation Repository Features, Uses, and Benefits University of California Curation Center California Digital Library UC Berkeley, August 13,
DRS 2 one in a series of periodic updates Harvard University Library Andrea Goethals October 21, 2009 DRS = Digital Repository Service.

DRS 2 one in a series of periodic updates Harvard University Library Andrea Goethals October 21, 2009 DRS = Digital Repository Service.
Workflows for Digital Curation and Preservation Stacy Kowalczyk PASIG Dublin 2012 October 17, 2012.

Workflows for Digital Curation and Preservation Stacy Kowalczyk PASIG Dublin 2012 October 17, 2012.
Merritt Fixity Authenticity for Managed Digital Assets University of California Curation Center California Digital Library April 7, 2011.

Merritt Fixity Authenticity for Managed Digital Assets University of California Curation Center California Digital Library April 7, 2011.
PREMIS in Thought: Data Center for LC Digital Holdings Ardys Kozbial, Arwen Hutt, David Minor February 11, 2008.

PREMIS in Thought: Data Center for LC Digital Holdings Ardys Kozbial, Arwen Hutt, David Minor February 11, 2008.
Chronopolis: Preserving Our Digital Heritage David Minor UC San Diego San Diego Supercomputer Center.

Chronopolis: Preserving Our Digital Heritage David Minor UC San Diego San Diego Supercomputer Center.
Robust Tools for Archiving and Preserving Digital Data Joseph JaJa, Mike Smorul, and Mike McGann Institute for Advanced Computer Studies Department of.

Robust Tools for Archiving and Preserving Digital Data Joseph JaJa, Mike Smorul, and Mike McGann Institute for Advanced Computer Studies Department of.
Mike Smorul Saurabh Channan Digital Preservation and Archiving at the Institute for Advanced Computer Studies University of Maryland, College Park.

Mike Smorul Saurabh Channan Digital Preservation and Archiving at the Institute for Advanced Computer Studies University of Maryland, College Park.
 an easy-to-use interface for deposit and update  access via persistent URLs  tools for long-term management  permanent storage Merritt is a new cost-effective.

 an easy-to-use interface for deposit and update  access via persistent URLs  tools for long-term management  permanent storage Merritt is a new cost-effective.

Similar presentations

Ads by Google