MEDIN Partners Meeting 2010 Submitting data to and using Data Archive Centres

MEDIN aims to provide: secure long-term management of marine data sets by setting up a network of Data Archive Centres (DACs) improved access to authoritative marine data held in this network, through a central discovery metadata portal an agreed set of common standards for metadata, data format and content maintained and supported by partners guidelines, contractual clauses and software tools to support standards and best practice data management

DACS are the beating heart of the MEDIN network and the delivery mechanism

2013 FisheriesMarinewater geophysmarinebathymetry met.column/ geologyspecies oceanog. & habitats Discovery /evaluation metadata Users Data search DAC and data specification standards Metadata standards Data in from partners and govt contracts metadata in from external databases tools Resources, Products and services

Current coverage there are four accredited MEDIN DACs currently: British Geological Survey (BGS) for seabed and sub-seabed geology, geophysics dataBritish Geological Survey (BGS) British Oceanography Data Centre (BODC) for water column oceanographic dataBritish Oceanography Data Centre (BODC) Data Archive for Seabed Species and Habitats (DASSH) for benthic flora, fauna and habitat dataData Archive for Seabed Species and Habitats (DASSH) UK Hydrographic Office (UKHO) for bathymetry dataUK Hydrographic Office (UKHO)

Additional coverage Met data Heritage data Fisheries data

Meeting the MEDIN Data Archive Centre Requirements ORGANISATIONAL FRAMEWORK Generally exhibiting evidence of expertise and a track record in the scientific area of the data Committed to provide sufficient resources for defined period of time and plans for transition if and when it ends Committed to return of data holdings to originators, or lodging with an alternative and suitable repository, if the DAC becomes unsustainable Provide annual report as specified by MEDIN QUALITY CONTROL AND MAINTENANCE Adherence to MEDIN Discovery Metadata Standard and appropriate international principles Data collection according to defined quality principles and accepted procedures Quality assurance of the collected data Committed to advising third party organisations collecting similar types of data on procedures, and providing data-banking (warehousing) and curation facilities for such similar data from other sources TECHNICAL INFRASTRUCTURE Databasing and banking with appropriate metadata standards Auditable process for long term custodianship and updating of data sets, with appropriate disaster planning USER ACCESS AND COMMUNICATION Committed to, and focus on, customer service Committed to raising awareness of the holdings and promoting the use of the data Making datasets freely available wherever possible (not necessarily at zero cost)

Engaging with the DAC network Session on how to work with the DACS and submission of data to the network. Tools now in place to interrogate metadata and to download data from DACS

Future of DACS/MEDIN Structures now in place How to maintain and expand the network? How to ensure the network delivers and is able to deliver to partners? MEDIN Executive team is currently considering the funding options for the MEDIN network and crucially the DACS MEDIN are looking at sustainability, extending the network only where finances permit and establishing a DAC core funders group.

Data Flows – Key Steps First Identify DAC where data will be archived Agree where metadata and data will be published by MEDIN (e.g. to UKLP, INSPIRE) Define access and licence conditions Agree format requirements and archiving costs Collect Data Generate a unique resource identifier code Generate, validate and publish metadata record Prepare data according to appropriate guidelines Apply Quality Control Archive data at DAC Provide data updates as agreed with DAC

Data from consultancy Metadata created using online tool, URI assigned Countryside Agency Copies of data and metadata stored at Countryside agency MEDIN DAC QA Metadata uploaded to server and available through portal Data archived at DAC Updates QA Accesses data according to availability agreed by Countryside Agency USER Searches for appropriate data through the metadata portal Error(s) found Errors in data/metadata reported back to Countryside Agency Flow of Data Flow of Metadata User Case Study 1. Habitat Survey by a Countryside Agency

CSRCruise ReportUpdates Metadata conversion mapping CSR to MEDIN metadata and schematron, URI assigned. This may be carried out either by the fisheries laboratory or the DAC, to be decided with the fisheries lab MEDIN metadata MEDIN DAC QA according to typeMetadata made available online Data archived (Including Cruise Reports and CSRs) USER Searches for appropriate data using metadata on webportal Accesses appropriate data according to availability agreed by Fisheries Laboratory Cruise data Fisheries Laboratory Cruise Data Error(s) found Errors in data reported back to Fisheries lab Flow of Data Flow of Metadata User Case Study 3. A Research Cruise by a Fisheries Laboratory

12345 Habitat Survey by Countryside Agency Environmental Survey by Policy Agency Research Cruise by Fisheries Laboratory Data Collected for CSEMP and submitted to MERMAN Metadata on Routine Monitoring programmes submitted to UKDMOS Unique Resource IdentifierContractor / MEDIN toolData collection contractor or interim data management contractor/ MEDIN tool Fisheries Laboratory / MEDIN tool Organisation/UKDMOSMonitoring Agency / MEDIN tool Metadata Generation Contractor - MEDIN standard / MEDIN mdata tool Data collection contractor or interim data management contractor: MEDIN standard / MEDIN mdata tool Created through mapping from CSR by DAC or Fisheries Lab MERMAN/UKDMOSMonitoring Agency to UKDMOS and transfer to MEDIN ValidationMEDIN ToolMEDIN tool UKDMOS to MEDIN metadata transfer MEDIN translation tool PublicationMEDIN (DAC) MEDIN (DAC)?MEDIN Data GenerationMEDIN standards MEDIN / IOC standardsWQ agencyMonitoring Agency Quality ControlCountryside Agency /DAC on upload Data collection contractor / interim data management contractor / DAC Fisheries Laboratory /DAC on upload WQ agency (Quasimeme, Bequalm) Monitoring Agency / DAC on upload ArchivalMEDIN DACIntermediate storage by intermediate data management contractor then MEDIN DAC MEDIN DAC Monitoring Agency / or MEDIN DAC Update managementCountryside agency advises MEDIN DAC Fisheries Laboratory advises MEDIN DAC Via updates to MERMANMonitoring Agency advises MEDIN DAC Tools used?MEDIN online metadata tool MEDIN tool MEDIN online metadata tool MEDIN Data Clause applied MEDIN tool CSR metadata mapping / MEDIN tool MEDIN tool MERMANMEDIN tool MEDIN Translation Tool