IODE Ocean Data Portal - technological framework of new IODE system Dr. Sergey Belov, Nikolai Mikhailov et al. National Oceanographic Data Centre, Russia IODE-XXII Pre-Conference Training Course/Workshop, 8 - 9 March 2013, Ensenada, Mexico

Objectives Facilitate and promote the exchange and dissemination of marine data and services; Provide the seamless access to marine data to NODCs across the IODE network through the discovery, evaluation and access to data via web based services; Identify and recommend standards to provide interoperability with IODE data centres to allow shared use of metadata, data and products. 2 IODE-XXII Pre-Conference Training Course/Workshop, 8 - 9 March 2013, Ensenada, Mexico 2

Core principles Interoperability Non-intervention Ocean Data Portal (ODP) should be interoperable with existing systems Non-intervention ODP should not obligate to change NODCs legacy systems (structures, formats, etc.) Data and services available free and without registration According to the IOC Data Exchange Policy (Resolution IOC-XXII-6) 3 IODE-XXII Pre-Conference Training Course/Workshop, 8 - 9 March 2013, Ensenada, Mexico 3

Some words about the history of IODE Ocean Data Portal

History. Phase 1 –Concept 2003 Draft version of the “end-to-end data management” concept presented at the First Session of the JCOMM ETDMP (Expert Team on Data Management Practices) session by Nick Mikhaylov. 5 IODE-XXII Pre-Conference Training Course/Workshop, 8 - 9 March 2013, Ensenada, Mexico 5

History. Phase 2 - Inception 2004 Adoption of the “E2EDM” concept and work plan on prototype by the JCOMM ETDMP First technical specification on the E2EDM technology and alpha-version of the E2EDM software (Data Provider, Integration Server). The E2EDM technology web site http://e2edm.meteo.ru has been launched. 6 IODE-XXII Pre-Conference Training Course/Workshop, 8 - 9 March 2013, Ensenada, Mexico 6

History. Phase 3 - Establishment 2005 Data centres were connected: Flanders Marine Institute (VLIZ, Belgium) National Oceanographic Data Center (RIHMI-WDC, Russia) Ifremer (France) Met Office (UK) Datasets: Research vessels data, real-time GTS data, Argo, voluntary ships First version of the portal user interface was created Prototype was demonstrated on the 18th Session of the IOC Committee on IODE and IOC/WMO JCOMM-II session. 7 IODE-XXII Pre-Conference Training Course/Workshop, 8 - 9 March 2013, Ensenada, Mexico 7

History. Phase 4 - Transformation 2006 -2007 Collaboration between the IODE E2EDM and WIS has been established. The IODE E2EDM became a WIS Data Collection or Production Centres (DCPC) The E2EDM data sources were expanded to provide functions for Marine warning system support (E2EDM Marine Warning System) Demonstration on the 19th Session of the IOC Committee on IODE The E2EDM adopted as a core technology for the IODE Ocean Data Portal project 8 IODE-XXII Pre-Conference Training Course/Workshop, 8 - 9 March 2013, Ensenada, Mexico 8

ODP Implementation & Architecture OCEAN DATA PORTAL V1 2008 -2009 Based on the technical specifications and software of the E2EDM technology OCEAN DATA PORTAL V2 2009 -2012 ODP V2 is aimed to withdraw from standalone web-services, to implement and standardize methods and means of interface interaction. 9 IODE-XXII Pre-Conference Training Course/Workshop, 8 - 9 March 2013, Ensenada, Mexico 9

What ODP does? Provides facility to connect & integrate local data, products and services into the distributed data network ODP Products Services Data IODE-XXII Pre-Conference Training Course/Workshop, 8 - 9 March 2013, Ensenada, Mexico

What ODP does? Provides tools and services for easy, reliable and semi-automated online metadata submission IODE-XXII Pre-Conference Training Course/Workshop, 8 - 9 March 2013, Ensenada, Mexico

What ODP does? Provides tools and services for control and monitoring, reporting and statistics of ODP network IODE-XXII Pre-Conference Training Course/Workshop, 8 - 9 March 2013, Ensenada, Mexico

What ODP does? Provides facility to set up a portals for data consumers IODE-XXII Pre-Conference Training Course/Workshop, 8 - 9 March 2013, Ensenada, Mexico

ODP network of data providers What ODP does? Provides tools and services for data distribution (push and pull) to consumers (end-users, systems, services) queries consumers results Discovery interfaces orders ODP network of data providers FTP Delivery Services Email HTTP push Data services SOAP HTTP REST CSW FTP pull IODE-XXII Pre-Conference Training Course/Workshop, 8 - 9 March 2013, Ensenada, Mexico

What ODP does NOT? NOT making changes in source data NOT creating a new system and NOT competing with other projects NOT using commercial software, only open source and (L)GPL licensed NOT taking any fees for software NOT providing data duplication check NOT handling data QC NOT restricting data access

ODP Key Features. Integration Connect & Share Local databases, structured and unstructured data files, data inventories (FTP,HTTP) 16 IODE-XXII Pre-Conference Training Course/Workshop, 8 - 9 March 2013, Ensenada, Mexico 16

ODP Key Features. Integration Manage & Monitor Automatic data provider nodes maintenance (respectively to the data life-cycle), metadata catalogue update/synchronization/publishing, nodes accessibility monitoring, reporting tools and feedback 17 IODE-XXII Pre-Conference Training Course/Workshop, 8 - 9 March 2013, Ensenada, Mexico 17

ODP Key Features. Integration Unification & scalability Use of NVS (NERC Vocabulary Service) vocabulary dictionary (easy to extend and substitute) and controlled code lists s 18 IODE-XXII Pre-Conference Training Course/Workshop, 8 - 9 March 2013, Ensenada, Mexico 18

ODP Key Features. Access Discovery -> Deliver -> View -> Download 19 IODE-XXII Pre-Conference Training Course/Workshop, 8 - 9 March 2013, Ensenada, Mexico 19

ODP Services HTTP-services and Web-services GIS Analysis service Provides ability to communicate with the ODP on “machine-to-machine” level GIS Analysis service Provides near real-time GIS-layer generation from distributed datasets both with interactive and fast presentation of multidisciplinary data and products on a map 20 IODE-XXII Pre-Conference Training Course/Workshop, 8 - 9 March 2013, Ensenada, Mexico

ODP. Data contributions ODINWESTPAC Australian Ocean Data Network (IMOS/AODN), Australia Integrated Science Data Management (ISDM), Canada Marine Information Research Center (MIRC), Japan Met Office, UK National Marine Data and Information Service (NMDIS), China US National Oceanographic Data Center (NODC), USA ODINBLACKSEA Bulgarian National Oceanographic Data (BGODC/IO-BAS), Bulgaria Tbilisi State University, Georgian DNA (GDNA), Georgia Laboratory of Marine Information Systems, Institute of Biology of the Southern Seas (LaMIS/IBSS), Ukraine Marine Hydrophysical Institute (MHI), Ukraine National Institute for Marine Research and Development "Grigore Antipa" (NODEC/NIMRD), Romania National Oceanographic Data Centre (NODC), Russia ! Ocean Data Portal provides over 1 000 000 oceanographic profiles from 100 datasets – GTSPP, GTS hydro-meteorological data, wind wave, SST, sea level, turbidity, water transparence, oxygen, nutrients, secchi disc, chlorophyll, bioluminescence, etc. ODP preserves references to the data originators ODP provides CF-compliant NetCDF (more Unidata tools can be user to process data) Any organization, project or initiative can contribute to ODP 21 IODE-XXII Pre-Conference Training Course/Workshop, 8 - 9 March 2013, Ensenada, Mexico 21

ODP Capacity Building http://classroom.oceanteacher.org ODP Training for the ODINBlackSea countries 20-21 March 2009, Obninsk, Russian Federation. 5 NODCs/DNAs from Bulgaria, Romania, Russia and Ukraine participated; First IOC/WESTPAC Training Course on the Establishment of National IODE ODP Nodes. 31 August – 4 September 2009, Seoul, Republic of Korea. 10 participants from Republic of Korea, Japan, Malaysia, Thailand, Indonesia and Vietnam ODP Training Course for Georgian and Turkish NODCs 21-23 December 2009, Istanbul, Turkey. 22 IODE-XXII Pre-Conference Training Course/Workshop, 8 - 9 March 2013, Ensenada, Mexico

Questions?