Digital Storage Solutions John Southall ESDS Qualidata, University of Essex Sounds Good Improving Sound Archives in the East of England 19th November 2007

UKDA: sources of data Data for research and teaching used in various sectors official agencies - mainly central government international statistical time series individual academics - research grants market research agencies public records/historical sources qualitative and quantitative access to international data via links with other data archives worldwide

40 years of the UK Data Archive 5,000+ datasets in the archive 200+ new datasets are added each year 6,500+ orders for data per year 18,000+ datasets distributed worldwide per year history data service in-house (AHDS History) mainly quantitative but some qualitative approaches to storage will differ growth of audio elements

Storage: where to start? Context of your digitisation programme –nature of digital media (active) –overall management strategy –agreement on goals and objectives –working procedures developed and agreed –procedures in place and workable Fruits of your digitisation programme –preservation –conservation –access –usability –each one assures for the future?

Large size of audio files Complex storage structure Preservation –Preserve a single master copy –Preserve playback / delivery copy –Multi-version copies of each? Access to each of the above –Now and in the future –Future proof? Data degradation / corruption Malicious attack If left alone, issues become problems Identifying potential issues

Review existing IT architecture and support Assess size of current and probable future storage needs Effective file management systems –Documentation and metadata considered in depth –Effective file labelling schemes –Internal version control Assess online and offline needs –Master copies offline –Playback copies online Solutions to consider

The problem of unproven new media Policy on proprietary and non-proprietary formats Wisdom of multiple formats Security and restricted access Testing and re-mastering schedules Migrate files when necessary Exit strategy in place (ownership, responsibilities etc.) Solutions to consider

Proven and unproven standards Multiple copies Multiple locations Backup and emergency planning Documentation and metadata Quality control checks Standards WILL change Responses to change All integrated under the preservation life-cycle Storage media

Storage Solutions 5. Access and retrieval 1. Acquisition, selection and appraisal 2. Processing 3. Metadata construction 4. Digital object management Re-purposing Digital preservation and the preservation life-cycle

Digital storage models Within your own organisations Public sector advice and support Commercial services –Hosting and storage service –Storage and delivery service Whatever is used will need to be an ongoing commitment

Further advice and support Within your own organisations Public sector advice and support –The National Archives –Digital Preservation coalition –Regional pilot project archive.ac.uk/news/publications/darp2006.pdf –UK Data Archive