Presentation is loading. Please wait.

Presentation is loading. Please wait.

Metadata generation, control and updating Peter Thijsse - MARIS.

Published byElwin Ferguson Modified over 8 years ago

Similar presentations

Presentation on theme: "Metadata generation, control and updating Peter Thijsse - MARIS."— Presentation transcript:

1 Metadata generation, control and updating Peter Thijsse - MARIS

2 Oostende - 18/19 June 2008 2 Overview Introduction Program time frame General rules for SDN Directory management Mapping to common vocabularies Management of EDMO and EDMERP Management of EDMED Management of CSR Presentation of Mikado tool XML Validation services Practical work

3 Oostende - 18/19 June 2008 3 Programme Metadata generation, control and update. 14:00 - 14:30 - Rules for directory management and update (Peter Thijsse, Maris) o How to submit new records? o How to update existing records? o Management of record identifiers. 14:30 - 14:45 - Management of EDMO and EDMERP metadata (Peter Thijsse, Maris) 14:45 - 15:00 - Mapping the local system to the common vocabulary and EDMO, EDMERP (Peter Thijsse, Maris) 15:00 - 15:15 - Management of EDMED and CDI metadata (Peter Thijsse, Maris) 15:15 - 15:30 - Management of CSR (Anne Che-Bohnenstengel, BSH) 15:30 - 15:50 - Coffee Break 15:50 - 16:20 - Presentation of Mikado tool (Michèle Fichaut- Vanessa Tosello, SISMER) 16-20 - 16:30 - XML Validation services (Michèle Fichaut, SISMER) 16:30 - 17:30 - Practical work o Use EDMO and EDMERP online input forms. o Use CSR online input forms. Wednesday 18 June 2008

4 Oostende - 18/19 June 2008 4 Programme (Cont.) 09:00 - 17:30 - Practical work (cont.) Use of Mikado tool for EDMED, EDMERP, CSR, CDI o Manual use o Automatic use o Use of validation services Thursday 19 June 2008

5 Oostende - 18/19 June 2008 5 Rules for directory management and update (general introduction)

6 Oostende - 18/19 June 2008 6 Rules for directory management and update Overview metadata management How to submit new records? How to update existing records? Format basis Management of record identifiers. Topics

7 Oostende - 18/19 June 2008 7 Overview metadata management SDN overview directories EDMED - Data Sets EDMERP - Research Projects CSR - Cruise Summary Reports EDIOS - Monitoring systems EDMO - Marine Organisations CDI - Common Data Index

8 Oostende - 18/19 June 2008 8 services for metadata Data downloading services Visualization services (WMS) for V2 Ifremer Database BODC Database BSH Database... Download managers in Data centers CSREDIOS EDMED CDI Shopping basket Requests status manager datametadata CSR CDI Project info Metadata & Data catalogues Data request Status of request General requestMetadata request Organisation + data source id Data download at BODCat BSHat MARIS + EDMERP Entry point for access hits EDMO EDIOSEDMED EDMERPEDMO Software Vocabularies StandardsCross search AAA Registr. My transact. User Register User registration

9 Oostende - 18/19 June 2008 9 Overview metadata management Online maintenance by NODCs via Content Management System (incl master editing options) – only EDMERP, EDMO, CSR XML export from local system in a semi-automatic way, with exchange initiated by NODCs at regular intervals XML export from local system in automatic and continuous proces (harvesting system). Most relevant for CDI No use of MS-Access anymore! How to submit/create new and update existing records:

10 Oostende - 18/19 June 2008 10 Overview metadata management The ISO 19115 content model is the basis for the XML formats and exchange schema (XSD). V0 -> V1: The existing ISO 19115 based XSD has been extended using Schematron and OCL to support the checking of mandatory fields (for EDMED), and use of codes from the Common Vocabularies and use of organization codes from EDMO. Format basis Vocabularies Use of SeaDataNet common vocabularies for platform types, parameters, instruments etc. in all directories Use of EDMO as organization vocabulary EDMERP as „project vocabulary“ All available as webservices to enable constant accessibility of last version SDN Vocab Service : http://seadatanet.maris2.nl/v_bodc_vocab/welcome.aspx

11 Oostende - 18/19 June 2008 11 Overview metadata management All systems have to generate unique record identifiers For the vocabularies uniqueness is very important for reference to correct terms. No changes of codes allowed For CDI records the local id is the communication link between portal and local system. Ordering system works on this Local systems have to take this into account Management of record identifiers

12 Oostende - 18/19 June 2008 12 Management of European Directory of Marine Organisations EDMO

13 Oostende - 18/19 June 2008 13 Management of EDMO Editing via CMS forms Access for NODC‘s New records only to be created via MARIS (because EDMO = vocabulary) Available as webservice (export only) Maintenance

14 Oostende - 18/19 June 2008 14 Management of EDMO National collator Country Name Mandatory fields (all entered at creation) Vocabularies applied Countries

15 Oostende - 18/19 June 2008 15 Demo of EDMO http://seadatanet.maris2.nl/vu_organisations/welcome.asp

16 Oostende - 18/19 June 2008 16 Management of European Directory of Marine and Environmental Datasets (EDMED)

17 Oostende - 18/19 June 2008 17 Management of EDMED Supply of EDMED records via MIKADO only Currently work in progress on validation service for EDMED V1 records Upgrade V0 -> V1 procedure: Automated conversion where possible Identical fields copied one-on-one For new fields, or fields that can only manually be corrected: MARIS to create a Content Management system (CMS). EDMED V0 will be imported into this CMS. Partners to update their fields which fall into this category. EDMED V1.3 XML will be exported from the MARIS CMS and imported into the master schema at BODC. Partners will have the option of submitting replacement records in V1.3 in XML for BODC to ingest directly into Oracle. -> Via MIKADO Maintenance

18 Oostende - 18/19 June 2008 18 Management of EDMED edmed-identifier collate-centre (edmo ref) creation-date dataset-name dataset-id (given by the data centre) revision-date originator centre (edmo ref) summary data holding centre (edmo ref) sea-areas parameters availability language used within the dataset main theme of the dataset begin-year geographic coverage (bounding box nwes) Mandatory fields

19 Oostende - 18/19 June 2008 19 Management of EDMED EDMO L231 (SeaDataNet metadata entities) C16 (SeaDataNet Sea Areas) P021 (Parameters PDV) L05 (Devices) L081(Data Access Restriction Policies) Vocabularies used

20 Oostende - 18/19 June 2008 20 Management of European Directory of Marine and Environmental Research Projects (EDMERP)

21 Oostende - 18/19 June 2008 21 Management of EDMERP Editing via CMS forms Access for NODC‘s as master account NODC may create sub-accounts for other institutes in their country (EDMO) New records to be created directly in CMS by NODC Sub-accounts can edit/create new, but this will have to be checked by NODC before activating Available as webservice for XML V1 files (export and import) Maintenance

22 Oostende - 18/19 June 2008 22 Management of EDMERP edmerp-identifier (set by system) collate-centre (edmo ref) creation-date research project name research project acronym revision-date responsible party (edmo ref) summary sea-areas data-themes language used within the dataset main theme of the project Project start date Mandatory fields

23 Oostende - 18/19 June 2008 23 Management of EDMERP EDMO L231 (SeaDataNet metadata entities) C16 (SeaDataNet Sea Areas) P081 (Parameter disciplines) Vocabularies used

24 Oostende - 18/19 June 2008 24 Management of EDMERP 1.Check project list fo projects not coordinated by your country - Projects will have to be moved/deleted - name coordinator (look up EDMO code) - Send information to MARIS (as super-user of EDMERP) 2.Check project list for correct coordination organisation/coordinator - Move to other organisation/person if necessary - Create new person if needed 3.As last step you can create sub-accounts for organiasations that can manage their own collection of projects. - Send them login details - Give assistance - Validation by NODC of their input is needed before changes will be visible online. (editor-modus!) Procedure

25 Oostende - 18/19 June 2008 25 Demo of EDMERP http://seadatanet.maris2.nl/vu_edmerp/welcome.asp Look at: Project SESAME www.sesame-ip.euwww.sesame-ip.eu (coordinator HCMR)

26 Oostende - 18/19 June 2008 26 Use of EDMO Demonstration and Practice (30 mins)

27 Oostende - 18/19 June 2008 27 Practice EDMO Webpage: http://seadatanet.maris2.nl/vu_organisations/welcome.asp Take the list of Institutes from your country that work in the marine sector, and that are not yet listed in EDMO Request new record to be added (MARIS) Add details to new records Alternative: Look up current collection, look up details of organisations via website and edit EDMO record Use of EDMO CMS

28 Oostende - 18/19 June 2008 28 Use of EDMERP Demonstration and Practice (app. 1 hr)

29 Oostende - 18/19 June 2008 29 Practice EDMERP Webpage CMS: http://seadatanet.maris2.nl/vu_edmerp/welcome.asp Discovery: http://seadatanet.maris2.nl/v_edmerp/search.asp Exercise: Log in to CMS Create new (international) project coordinated by an organisation from your country Edit all fields as well as possible Add partner organisations (also from other countries!) IF needed: Request new EDMO record to be added (MARIS) Add details to new EDMO records Alternative: Look up current collection of projects Check if project really is coordinated by an institute from your country Look up other details for the project and add all partner organisations IF needed: Request new EDMO record to be added (MARIS) Add details to new EDMO records Use of EDMERP CMS

Download ppt "Metadata generation, control and updating Peter Thijsse - MARIS."

Similar presentations

OBSERVATIONS & PRÉVISIONS CÔTIÈRES www.seadatanet.org Training Workshop – Ostende – 26-29 October 2009 REFORMATTING TOOLS Med2MedSDN and NEMO M. Fichaut.

OBSERVATIONS & PRÉVISIONS CÔTIÈRES Training Workshop – Ostende – October 2009 REFORMATTING TOOLS Med2MedSDN and NEMO M. Fichaut.
OBSERVATIONS & PRÉVISIONS CÔTIÈRES www.seadatanet.org Metadata and Data Management Activities winthin NA 3-7 S. Iona (HCMR), D. Schaap (MARIS), L. Rickards.

OBSERVATIONS & PRÉVISIONS CÔTIÈRES Metadata and Data Management Activities winthin NA 3-7 S. Iona (HCMR), D. Schaap (MARIS), L. Rickards.
International Research Cruise Database and Website Status October ‘07.

International Research Cruise Database and Website Status October ‘07.
Online data access in the SeaDataNet V1 system by Dick M.A. Schaap – technical coordinator Bologna, September 08.

Online data access in the SeaDataNet V1 system by Dick M.A. Schaap – technical coordinator Bologna, September 08.
Online data access in the SeaDataNet V1 system by Dick M.A. Schaap – technical coordinator Oostende, June 08.

Online data access in the SeaDataNet V1 system by Dick M.A. Schaap – technical coordinator Oostende, June 08.
OBSERVATIONS & PRÉVISIONS CÔTIÈRES www.seadatanet.org 3 rd SeaDataNet training course – Ostende – 16-19 June 2008 MIKADO tool M. Fichaut, V. Tosello, M.

OBSERVATIONS & PRÉVISIONS CÔTIÈRES 3 rd SeaDataNet training course – Ostende – June 2008 MIKADO tool M. Fichaut, V. Tosello, M.
MEDIN Standards M. Charlesworth and the MEDIN Standards Working Group.

MEDIN Standards M. Charlesworth and the MEDIN Standards Working Group.
Cruise Summary Report Content Management 02.07.2012 SDN2 1. Training Workshop - Ostend, Belgium.

Cruise Summary Report Content Management SDN2 1. Training Workshop - Ostend, Belgium.
SIMORC Workshop March 2007 SeaDataNet A Pan-European Infrastructure for Ocean and Marine Data Management.

SIMORC Workshop March 2007 SeaDataNet A Pan-European Infrastructure for Ocean and Marine Data Management.
Status of CDI service (connections, NetCDF introduction, CDI ingestion service and set-up of CDI ingestion pilot) By Dick M.A. Schaap – Technical Coordinator.

Status of CDI service (connections, NetCDF introduction, CDI ingestion service and set-up of CDI ingestion pilot) By Dick M.A. Schaap – Technical Coordinator.
SeaZone Metadata Maestro Ben Spalding 01491 822859.

SeaZone Metadata Maestro Ben Spalding
Pan-European infrastructure for Ocean & Marine Data management An EU Integrated research Infrastructure Initiative (I3) MIKADO : Java tool for XML Creation.

Pan-European infrastructure for Ocean & Marine Data management An EU Integrated research Infrastructure Initiative (I3) MIKADO : Java tool for XML Creation.
A Pan-European Infrastructure for Ocean and Marine Data Management Dick M.A. Schaap – MARIS (SeaDataNet technical coordinator)

A Pan-European Infrastructure for Ocean and Marine Data Management Dick M.A. Schaap – MARIS (SeaDataNet technical coordinator)
SDN2 First Training Course, Oostende IODE-PO, 2-6 July 2012 Metadata Directories Management Sissy Iona, HCMR/HNODC.

SDN2 First Training Course, Oostende IODE-PO, 2-6 July 2012 Metadata Directories Management Sissy Iona, HCMR/HNODC.
EDMED and EDIOS Roy Lowry, Karen Vickers (Technical) Lesley Rickards, Liz Bradshaw (Content) British Oceanographic Data Centre.

EDMED and EDIOS Roy Lowry, Karen Vickers (Technical) Lesley Rickards, Liz Bradshaw (Content) British Oceanographic Data Centre.
2 nd Training Workshop 4 – 5 June 2007 Common Data Index - CDI By Dick M.A Schaap Technical Coordinator SeaDataNet.

2 nd Training Workshop 4 – 5 June 2007 Common Data Index - CDI By Dick M.A Schaap Technical Coordinator SeaDataNet.
Status of upgrading CDI service (user interface, harvesting via GeoNetwork, CDI interoperability options following SeaDataNet D8.7) By Dick M.A. Schaap.

Status of upgrading CDI service (user interface, harvesting via GeoNetwork, CDI interoperability options following SeaDataNet D8.7) By Dick M.A. Schaap.
MEDIN Data Guidelines. Data Guidelines Documents with tables and Excel versions of tables which are organised on a thematic basis which consider the actual.

MEDIN Data Guidelines. Data Guidelines Documents with tables and Excel versions of tables which are organised on a thematic basis which consider the actual.
OBSERVATIONS & PRÉVISIONS CÔTIÈRES www.seadatanet.org 3 rd SeaDataNet training course – Ostende – 16-19 June 2008 NEMO reformatting tool v1 M. Fichaut.

OBSERVATIONS & PRÉVISIONS CÔTIÈRES 3 rd SeaDataNet training course – Ostende – June 2008 NEMO reformatting tool v1 M. Fichaut.
Controlled Vocabularies (Term Lists). Controlled Vocabs Literally - A list of terms to choose from Aim is to promote the use of common vocabularies so.

Controlled Vocabularies (Term Lists). Controlled Vocabs Literally - A list of terms to choose from Aim is to promote the use of common vocabularies so.

Similar presentations

Ads by Google