HYCOM CONSORTIUM Data and Product Servers ASHWANTH SRINIVASAN 9/22/2018

Goal Selecting a server LAS-and-DODS Project Overview Goal Selecting a server LAS-and-DODS 9/22/2018

Goal To provide public access to HYCOM Consortium generated data and products through standards and technology adopted by the GODAE community. 9/22/2018

Selecting a Server Options: Use existing technology such as FTP Use open source software developed to address the issue of data access specifically for the community Develop in-house software 9/22/2018

Our Choice: Open Source Software initially favored an in-house server development approach … but now favor Open Source packages due to several benefits new and better technology standard user interface standard data formats 9/22/2018

Key Tools – (LAS) Live Access Server Developed at PMEL Allows interactive browsing and visualization of data Allows comparisons between different data sets FOR MORE INFO... www.pmel.noaa.gov/software/las 9/22/2018

Key Tools - DODS Distributed Ocean Data System Developed at URI & MIT Allows remote data access as if it were locally available Supports many of the commonly used data formats now called OPeNDAP FOR MORE INFO... http://unidata.ucar.edu/packages/dods 9/22/2018

LAS-and-DODS Approach LAS and DODS packages are the key tools to serve data to clients over the Internet Chosen by the ocean data and GODAE community Presents a user interface consistent with other data providers 9/22/2018

http://hycom.rsmas.miami.edu/dataServer/ Live Demo 9/22/2018

Implementation Details Hardware Software 9/22/2018

Hardware Server: Dell Power Edge 2500 Dual PIII 1133 MHZ/1.0 GB RAM 400 GB RAID 5 Storage LINUX OS Storage: CHI Corporation NAS ~2 TB of Storage Compute Nodes: 4 dual Intel PIII 550 Systems; 8 dual AMD Athlon systems Network: Fast Ethernet 9/22/2018

Software Open source software tied together by Perl programs DODS 3.2.9 LAS 5.2 Apache web server 2.0 DODS Aggregation Server 0.6 beta NetCDF 3.5.0, COARDS compliant MySQL 3.2.6 9/22/2018

User Client e.g. web browser Campus Network Server ~ 2 TB LAS Master storage Server LAS DODS Perl Programs Metadata 400 GB Online storage Private Network Work Node 01 Work Node 02 Work Node 03 Work Node 04 9/22/2018

Project Status 9/22/2018

Schedule Phase 1- hardware acquisition & setup Phase 2 - LAS and DODS setup Phase 3 - maintenance and collaboration with other data providers Jan Feb Mar Apr May Jun July Sep Oct Nov Dec Phase 1 Phase 2 Phase 3 FOR MORE INFO... http://hycom.rsmas.miami.edu/dataServer 9/22/2018

Current Status Two datasets available via our servers ~ 100 GB of data online ~ 300 GB data available on demand Catalog service is operational 9/22/2018

Future Work Set up of the HYCOM node as a sister server with GODAE partners Implementation of a DODS Aggregation Server to serve datasets as a time-series Add additional datasets and metadata 9/22/2018