Report on operation of the Partnership Centre for the IODE Ocean Data Portal in 2013-2018 Dr Sergey Belov, et al. Partnership Centre for the IODE Ocean.

Slides:



Advertisements
Similar presentations
Strengthening statistical capacity in support of progress towards the Internationally Agreed Development Goals in countries of South Asia United Nations.
Advertisements

WMO WMO Integrated Global Observing System (WIGOS) CBS EXPERT TEAM ON AIRCRAFT-BASED OBSERVING SYSTEMS 1st Session (Geneva, September, 2013) Dr I.
World Meteorological Organization Working together in weather, climate and water Pilot Project V Integration of marine meteorological and other appropriate.
Ocean Data Interoperability Platform EU-US-Australia collaborative project Grant Number: Call: FP7-INFRASTRUCTURES INFSO Activity: INFRA :
SeaDataNet, pan-European infrastructure for ocean and marine data management A key component of EMODNet A possible building block for GEOSS By Dick M.A.
Critical Role of ICT in Parliament Fulfill legislative, oversight, and representative responsibilities Achieve the goals of transparency, openness, accessibility,
Near East Rural & Agricultural Knowledge and Information Network - NERAKIN Food and Agriculture Organization of the United Nations Near East and North.
INTOSAI Public Debt Working Group Updating of the Strategic Plan Richard Domingue Office of the Auditor General of Canada June 14, 2010.
1 The IODE Ocean Data Portal - current status and future Nikolai Mikhailov, Chair of IODE/JCOMM ETDMP National Oceanographic Data Centre, Russia Four Session.
1 INFRA : INFRA : Scientific Information Repository supporting FP7 “The views expressed in this presentation are those of the author.
Partnership Centre for IODE Ocean Data Portal – goals and tasks Dr. Sergey Belov, et al. Partnership Centre for the IODE Ocean Data Portal MINCyT, Buenos.
IODE Ocean Data Portal - technological framework of new IODE system Dr. Sergey Belov, et al. Partnership Centre for the IODE Ocean Data Portal MINCyT,
IIIrd SeaSearch Full Group Meeting Limassol, Cyprus Tuesday May 25-27, 2004 SeaDataNet-Design Study proposal.
IODE Ocean Data Portal – from data access to integration platform Sergey Belov, Tobias Spears, Nikolai Mikhailov International Oceanographic Data and Information.
IODE : a new era. IODE-XVI Lisbon, 31 October – 8 November participants from 37 countries.
IODE Ocean Data Portal - ODP  The objective of the IODE Ocean Data Portal (ODP) is to facilitate and promote the exchange and dissemination of marine.
ODP Interoperability Package Dr. Sergey Belov, et al. Partnership Centre for the IODE Ocean Data Portal MINCyT, Buenos Aires, Argentina, 7 – 11 October.
National Information Communication Technologies Strategy Vasif Khalafov “National strategy” working group - Web -
Global Geospatial Information Management (GGIM) A UN-DESA Initiative in collaboration with Cartographic Section, DFS Stefan Schweinfest UNSD.
World Meteorological Organization Working together in weather, climate and water WIGOS and WIS WMO M. Berechree (WIGOS) D. Thomas (WIS)
Let’s Work Together to Achieve More IAMSLIC/IOC MOU Brainstorming Session 17 September, Suva Fiji.
E u r o p e a n C o m m i s s i o nCommunity Research Global Change and Ecosystems Malta, 27 January 2004 Alan Edwards EUROPEAN COMMISSION GMES – Implications.
International Oceanographic Data and Information Exchange - Ocean Data Portal (IODE ODP) Enabling science through seamless and open access to marine data.
National Oceanographic Data Center of Ukraine (Marine Biology) LaMIS, IBSS NAS Ukraine Results of work (October 2009 – October 2010) 3-d meeting of the.
II Course on GBIF Node Management Arusha, Tanzania 31 st October and 1 st November 2008 GBIF Training Materials and Future Plans Alberto GONZÁLEZ-TALAVÁN.
Helen Glaves 1 and Dick Schaap 2 1 British Geological Survey, United Kingdom 2 MARIS, The Netherlands.
ISWG / SIF / GEOSS OOS - August, 2008 GEOSS Interoperability Steven F. Browdy (ISWG, SIF, SCC)
Let’s Work Together to Achieve More Proposal for Future Cooperation between IAMSLIC and the Intergovernmental Oceanographic Commission (IOC)
12 th Meeting of the GBIF Participant Nodes Committee 6-7 October 2013, Berlin, Germany Towards a generic work programme for a Node Olaf Bánki Senior Programme.
IODE Ocean Data Portal - technological framework of new IODE system Dr. Sergey Belov, et al. Partnership Centre for the IODE Ocean Data Portal.
Grid Services for Digital Archive Tao-Sheng Chen Academia Sinica Computing Centre
Project: EaP countries cooperation for promoting quality assurance in higher education Maria Stratan European Institute for Political Studies of Moldova.
OPENGIS for Water Management OPENGIS for Water Management in Developing Countries JRC Activities on Water Knowledge Management In Developing Countries.
Southeast Asia Primary Learning Metric (SEA-PLM) II CONSULTATIVE MEETING.
United Nations Statistics Division
ODP Interoperability Package
Ian Bird GDB Meeting CERN 9 September 2003
JCOMM in-situ Observations Programme Support Centre www. jcommops
Review of RA-I 16th Session Resolutions related to
Responsibilities & Tasks Week 2
WORKING PRINCIPLES ECONOMIC COOPERATION ORGANIZATION REGIONAL COORDINATION CENTRE FOR IMPLEMENTATION OF THE ECO/FAO REGIONAL PROGRAMME FOR FOOD SECURITY.
WMO Integrated Global Observing System (WIGOS) 16-RA VI Side Event Helsinki, Finland, 11 September 2013 Dr Miroslav Ondráš, Dr Wenjian Zhang (WMO) Dr.
Hidefumi Imura Professor, Nagoya University
WIGOS Pre-operational Phase
Distributed Marine Data System:
Results of IODE Ocean Data Portal project for
IODE Ocean Data Portal updates
WMO WIGOS is an all-encompassing, holistic approach to the improvement and evolution of the present WMO global observing systems into … (the next slide)
Return to First Principles
IODE Ocean Data Portal - nodes – national, regional/specialized and global Dr. Sergey Belov, et al. Partnership Centre for the IODE Ocean Data Portal.
Overview of working draft v. 29 January 2018
PEMPAL – Facilitating Practical Solutions in PFM across ECA
Institutional Framework, Resources and Management
Geospatial Data Use and sharing Concepts
JCOMM in-situ Observations Programme Support Centre www. jcommops
IODE Ocean Data Portal - technological framework of new IODE system
Introduction to the training
Coordinating Operational Oceanography and Marine Meteorology
Challenges & opportunities for developping regional cooperation
Baudouin Raoult Head of Data and Services Section
The WMO-IOC Regional Marine Instrument Centres
JCOMM in-situ Observations Programme Support Centre www. jcommops
General Information on the Partnership Centre for IODE Ocean Data Portal Dr Sergey Belov, et al. Partnership Centre for the IODE Ocean Data Portal Review.
Support for SOT Activities
Status and Plan of Regional WIGOS Center (West Asia) in
Contents of ODP regional node
United Nations Statistics Division
The WIGOS Pre-Operational Phase
Role of Evaluation coordination group and Capacity Building Projects in Lithuania Vilija Šemetienė Head of Economic Analysis and Evaluation Division.
WMO Global Campus: Open Educational Practice in Action
Presentation transcript:

Report on operation of the Partnership Centre for the IODE Ocean Data Portal in 2013-2018 Dr Sergey Belov, et al. Partnership Centre for the IODE Ocean Data Portal Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

Table of contents Summary on results and achievements (MoU based) Users and clients Quality of services and products Funding and staff Mission and strategy Operational environment Partnership Centre organizational motivation Partnership Centre organizational capacity Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

Introduction Partnership Centre for IODE ODP is responsible for: develop, host and maintain the tools and specifications for the portal and its distributed marine data system operation assist IODE's Ocean Data Information Networks (ODINs), NODCs and other IODE ODP nodes to achieve their regional and thematic objectives develop, strengthen and maintain the IODE ODP data management training programmes and tools monitor and report on the status and availability of the IODE ODP portal, websites, tools and specifications used by the IODE ODP node Provide an infrastructure to develop and test the web-based technologies and tools and also to generate new ideas and perspectives of the IODE ODP; Promote collaboration between relevant experts in integrated marine data management in IOC programmes and projects, other organisations and systems (e.g. OBIS, WIS, GEOSS) Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

1. Summary on results and achievements “(i)Develop, host and maintain the tools and specifications for the portal and its distributed marine data system operation” Results achieved: ODP V2 toolkit, including single components, virtual machine images and technical documentation for the deployment of regional/specialized and national nodes has been developed. Toolkit is available upon request through the website www.oceandataportal.org or by e-mail. ODP V2 has been deployed in ODP global node and SNDM specialized node. Metadata registry has been established to support the exchange of metadata with other systems, projects and programmes - http://metadata.oceandataportal.net (Geonetwork- and jOAI-based) Monitoring system for hardware, software and information resources of the ODP node based on the Zabbix software (http://mon.odp.meteo.ru/zabbix/) has been created. ODP V2 portal includes improved search, retrieval, subscription services and web GIS service. Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

1. Summary on results and achievements “(ii) Assist IODE's Ocean Data Information Networks (ODINs), NODCs and other IODE ODP nodes to achieve their regional and thematic objectives” Following ODP nodes are deployed and technically supported: IODE ODP global node (RIHMI-WDC); National Marine Data System of Argentina (SNDM); ODIN for Africa - ODINAFRICA (Kenya); ODIN for the West Pacific - ODINWESTPAC (China); Work in progress: ODIN for the Black Sea - ODINBlackSea (Turkey, preparatory work) Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

1. Summary on results and achievements “(ii) Assist IODE's Ocean Data Information Networks (ODINs), NODCs and other IODE ODP nodes to achieve their regional and thematic objectives” Following ODP nodes are deployed and technically supported: IODE ODP global node (RIHMI-WDC); National Marine Data System of Argentina (SNDM); ODIN for Africa - ODINAFRICA (Kenya); ODIN for the West Pacific - ODINWESTPAC (China); Work in progress: ODIN for the Black Sea - ODINBlackSea (Turkey, preparatory work) Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

1. Summary on results and achievements “(ii) Assist IODE's Ocean Data Information Networks (ODINs), NODCs and other IODE ODP nodes to achieve their regional and thematic objectives” IODE ODP includes more than 700 data sets (information resources) and connects over 30000 data sets (metadata with references to data, by metadata harvesting) obtained from interacting with related systems: European Data Network - SeaDataNet, WMO Information System - WIS, NOAA National Environmental Information Centre (US NODC), Australian Ocean Data Network (AODN). Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

1. Summary on results and achievements “(iii) Develop, strengthen and maintain the IODE ODP data management training programmes and tools” Specialists from the following organizations were trained in IODE ODP technologies and practices: National Marine Data System of Argentina, regional Southeast Pacific Data and Information Network (SPINCAM); ODINAfrica network; ODINWESTPAC network on the basis of the National marine Data and Information Service (NMDIS), China. Training materials (video lectures, presentations and practical exercises) are available from the IODE OceanTeacher resource (http://classroom.oceanteacher.org/course/search.php?search=ODP) and www.oceandataportal.org web site. Training videos are also available at Vimeo service https://vimeo.com/15185383 Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

1. Summary on results and achievements “(iv) Monitor and report on the status and availability of the IODE ODP portal, websites, tools and specifications used by the IODE ODP node” Annual reports to Roshydromet Annual reports to IODE (as project) Reports to IODE Committee (every 2 years) Reports to JCOMM (every 5 year under JCOMM/IODE ETDMP) Daily reports on data provider availability and data/products accessibility (example: http://is.oceandataportal.net/iserv/stat/10-09-2018_T1.html http://is.oceandataportal.net/iserv/stat/10-09-2018_T1.html) ODP monitoring system in place (http://mon.odp.meteo.ru/zabbix/) External monitoring services used for ODIN nodes (Uptimerobot) Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

1. Summary on results and achievements “(v) Provide an infrastructure to develop and test the web-based technologies and tools and also to generate new ideas and perspectives of the IODE ODP” The IODE ODP global node is deployed on RIHMI-WDC’s telecommunication and computation infrastructure. Agile methodology is used to develop ODP software Bug-tracking and project management system (JIRA) - http://dev.meteo.ru:8080 Source code repository (GITBlit) - http://10.20.147.135:8040 Continuous Integration services (Jenkins) for automated testing and evaluation - http://10.20.147.136:8080 Wiki for the developers (Russian language only) - http://10.20.147.134/dokuwiki/doku.php?id=:ru:welcome “Digital playground” to test new ideas and technologies – brokering services, Big Data, etc. Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

1. Summary on results and achievements “(vi) Promote collaboration between relevant experts in integrated marine data management in IOC programmes and projects, other organisations and systems” Participation in JCOMM/IODE Expert Team on Data Management Practices (ETDMP); Participation in WMO Expert Team on Evolution of WIS (TT-eWIS); Participation in SeaDataCloud project; Participation in EMODNet project The Partnership Centre participated in key global partnership activities, such as the development of connections compatible with GEOSS within the Ocean Data Interaction Platform (ODIP). The IODE ODP technology played the role of an integrator of metadata and references to data of marine information systems of the USA, Europe and Australia. Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

1. Summary on results and achievements “(vi) Promote collaboration between relevant experts in integrated marine data management in IOC programmes and projects, other organisations and systems” Approaches and methods are studied with respect to: mechanisms of interaction (data, metadata and services) with EMODNet Physics; mechanisms of interaction (data and metadata provision) with ODIP and SeaDataCloud; meeting the requirement and recommendations of the Inter-Programme Expert Team on for Integrated Marine Meteorological and Oceanographic Services within WMO and IOC Information Systems (IPET-MOIS); interaction and interoperability of WIS with the World Data System (WDS, updated ICSU WDC system) and the GEO/GEOSS system. Above listed results formed the basis of the IODE ODP of new generation that serves as an infrastructure of the IOC Oceanographic Data and Information System (ODIS). The prototype of the ODIS component related to metadata management is under design. Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

2. Users and clients Users: Average number of IODE ODP unique visitors is 2 700/year. Geography – worldwide. Registered users – over 100 (global node + ODIN nodes). Clients: Data is delivered to the external systems, such as EuroGOOS and EMODNet Physics on routine basis Among them present clients are – WIS (emerging need ocean data in meteo community), ODIP (Prototype 1), GEO/GEOSS. Notice: It should be noted that the level of service depends on the information content in the ODP and during the reporting period it was not possible to solve the organizational issues of attracting data providers (ODIN, NODC, etc.) to the required scale (this activity was carried out by the IODE SG-ODP). SeaDataNet has similar requirements, which are provided through contracts with the EU. Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

3. Quality of services and products As a result of the activities of the Partnership Centre, ODP software and documentation have been developed and maintained as a modern integration platform for ocean data share and exchange. In the context of users, the results of the work of the Partnership Centre allowed: integrate over 700 heterogeneous and distributed sets of oceanographic data in 2 ODIN-regions - ODINAfrica and ODINWESTPAC; to cooperate with SeaDataNet, WIS and EuroGOOS, access to the data and services of these systems directly from the IODE; contribute such projects as ODIP (ODIP-I, ODIP-II) to provide access to the above-mentioned oceanographic observational data and products from consumers of ocean information (at least 2700 unique visitors per year to the IODE ODP with average duration of the session 4.5 minutes); strengthen IODE training programs in data management. The Partnership Centre fulfilled the requirements of the Memorandum. Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

4. Funding and staff During 2013-2018 total funding of the Partnership Centre by Roshydromet and UNESCO IOC was 14.036.400 rubles (US $202.100), around US $33500/year with UNESCO IOC funding (IODE budget) being US $15.000 for the same period. IODE ODP is based on RIHMI-WDC’s technology reserves following the similar Russian System of Information on the World Ocean (ESIMO). In this regard, the results of the development and implementation of the IODE ODP significantly exceed the direct costs for the activities of the Partnership Centre. The effectiveness of the project is also reflected in the development of methodological and technological IODE platform that provides the foundation for building effective ODIS data type systems in the future. Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

4. Funding and staff 3 funded staff positions In 2015 – 2017 a rotation of two staff positions in the Partnership Centre took place At present, the Partnership Centre is completely staffed Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

5. Mission and strategy Adaptation of mission The activities of the Partnership Centre have been adapted to the work of IODE through the work of, both directly, the Partnership Centre, and through the work of the JCOMM/IODE ETDMP. The decisions for the IODE ODP establishment were, in turn, based on: concepts of IODE ODP (adopted by IODE-19, Resolution 19); recommendations of IODE and JCOMM officials for IODE ODP establishment and incorporation to the JCOMM/WIGOS Pilot Project; technical review of the IODE Ocean Data Portal (Steering Group for IODE ODP and WMO Integrated Global Observing System - WIGOS pilot project, 2008) Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

5. Mission and strategy Benefits for data providers: Scalable environment to support the capacity of the data provider’s environment Promotes defacto standards Engaged with other IODE data systems Supported technology for data discovery, evaluation, and access Improved visibility of data and geospatial web services Improved interoperability with other major marine data systems Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

5. Mission and strategy Benefits for data users: One-stop shop for data and web services Increased visibility for one’s research data The ODP provides two primary implementation options: Light Data Provider Hosted on ODP Global or Regional infrastructure– Zero client install Simplest path to contribute data Full Node Implementation (pre-configured Virtual Machines): Modular design Customizable client install - only enable the required services Advanced path to provide data, portal, GIS services Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

6. Operational environment Policies - Russian Federation is interested in the development of IODE and its elements in the form of IODE ODP and other elements which are the major source of international oceanographic data and products for the country Legislation - The legislation of the Russian Federation contains no laws and other regulations that would prohibit or restrict the activity of the Partnership Centre for IODE ODP Regulations - The regulations of the Memorandum of the Partnership Centre for IODE ODP are being realized. Other requirements are not imposed Funding – total funding for 2013-2018 is about US $202.100 (approx. US $33.700 per year) Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

6. Operational environment Allocation decisions - The project for the Partnership Centre activity is included in the Roshydromet R&D Programme (3-year period) for 2014-2016 and 2017-2019. It is expected that the project will continue in Roshydromet’s programmes for the period after 2019. Technological literacy - Modern information technologies are used in the IODE ODP establishment and development. Partnership Centre specialists graduated from higher education institutions with a degree in IT and have a good technological knowledge. Infrastructure and utilities - Partnership Centre’s infrastructure comprises: servers for the software development (allocated by NODC) servers for the maintenance of the IODE ODP central node (two servers of medium power: 2xIntel Xeon E5-2660 @2.2 GHz,128 GB of mainframe memory, 1.63 TB of disk space) local network and Internet 21 sq. m office Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

7. Partnership Centre organizational motivation Proof of concept – Partnership Centre was established in 2013. For 6 years of operation it has delivered a series of node deployments, data providers installations, data provision on regular basis, support of IODE training activities, collaboration with other initiatives on interoperability issues, metadata and data exchange. Major challenges - Difficulties in expanding the number of IODE ODP data sources from NODCs of IOC member states. The organizational decision of IOC and assistance/monitoring of IOC member states are required Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

7. Partnership Centre organizational motivation Adjustments – IODE ODP activities supports the decisions of the Steering Group for IODE ODP and JCOMM/IODE Expert Team for data management practices in close cooperation with IOC Project Office for IODE The change in Partnership Centre’s priorities is based on IODE IOC and JCOMM decisions concerning the development of: - Marine JCOMM Climatic Data System (recommendation IODE-XXIV/3.5, recommendation JCOMM-5 No.4) - IOC Ocean Data and Information System (OCEAN DATA AND INFORMATION SYSTEM, ODIS) (recommendation IODE-XXIV.6.2.1, resolution JCOMM-5 No.9, Recommendation JCOMM-5 No.2). Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

8. Partnership Centre organizational capacity Leadership – head of Partnership Centre for IODE ODP since 2017 is a coordinator of JCOMM Data Management Programme Area (DMPA). 17+ years of service in NODC from scientific officer to head of laboratory Strategic planning Strategic planning is implemented through: definition of the mission and goals; analyzing the environment, including data collection, analysis of Centre’s strengths and weaknesses, as well as its potentialities; choosing a strategy (SWOT analysis); implementing the strategy: the personnel of the Centre are informed of the strategy goals and plans to let them understand for what the organization strives and to involve them in the strategy implementation; implementation assessment and monitoring. Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

8. Partnership Centre organizational capacity Business model The basis of Partnership Centre business model is “Human capital assets as a key factor” and “Everything as a service”. Financial planning Financial planning is done at the level of Roshydromet. The Partnership Centre regularly sends its funding-related demands and wishes to the chief executives of Roshydromet. Governance Governance is implemented by Roshydromet and RIHMI-WDC Facilities and technology management The Partnership Centre is using ITIL, ITSM and Agile approaches. A clear mechanism for the development of software, its testing and implementation is established. Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

Wants and needs it is vitally to expand the number of employees of the Partnership Centre to 5 persons to ensure that all areas of work are well secured long-term financing strategy greater support from IOC member states with data, metadata and services Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

Questions? Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)