1. HYCOM CONSORTIUM Data and Product Servers
ASHWANTH SRINIVASAN
9/22/2018

2. Goal Selecting a server LAS-and-DODS
Project Overview
Goal
Selecting a server
LAS-and-DODS
9/22/2018

3. Goal
To provide public access to HYCOM Consortium generated data and products through standards and technology adopted by the GODAE community.
9/22/2018

4. Selecting a Server Options: Use existing technology such as FTP
Use open source software developed to address the issue of data access specifically for the community
Develop in-house software
9/22/2018

5. Our Choice: Open Source Software
initially favored an in-house server development approach
… but now favor Open Source packages due to several benefits
new and better technology
standard user interface
standard data formats
9/22/2018

6. Key Tools – (LAS) Live Access Server
Developed at PMEL
Allows interactive browsing and visualization of data
Allows comparisons between different data sets
FOR MORE INFO...
9/22/2018

7. Key Tools - DODS Distributed Ocean Data System
Developed at URI & MIT
Allows remote data access as if it were locally available
Supports many of the commonly used data formats
now called OPeNDAP
FOR MORE INFO...
9/22/2018

8. LAS-and-DODS Approach
LAS and DODS packages are the key tools to serve data to clients over the Internet
Chosen by the ocean data and GODAE community
Presents a user interface consistent with other data providers
9/22/2018

9.
Live Demo
9/22/2018

10. Implementation Details
Hardware
Software
9/22/2018

11. Hardware Server: Dell Power Edge 2500 Dual PIII 1133 MHZ/1.0 GB RAM
400 GB RAID 5 Storage
LINUX OS
Storage: CHI Corporation NAS
~2 TB of Storage
Compute Nodes: 4 dual Intel PIII 550 Systems; 8 dual AMD Athlon systems
Network: Fast Ethernet
9/22/2018

12. Software Open source software tied together by Perl programs
DODS 3.2.9
LAS 5.2
Apache web server 2.0
DODS Aggregation Server 0.6 beta
NetCDF 3.5.0, COARDS compliant
MySQL
9/22/2018

13. User Client e.g. web browser Campus Network Server ~ 2 TB LAS Master
storage
Server
LAS
DODS
Perl Programs
Metadata
400 GB
Online
storage
Private Network
Work Node 01
Work Node 02
Work Node 03
Work Node 04
9/22/2018

14. Project Status
9/22/2018

15. Schedule Phase 1- hardware acquisition & setup
Phase 2 - LAS and DODS setup
Phase 3 - maintenance and collaboration with other data providers
Jan
Feb
Mar
Apr
May
Jun
July
Sep
Oct
Nov
Dec
Phase 1
Phase 2
Phase 3
FOR MORE INFO...
9/22/2018

16. Current Status Two datasets available via our servers
~ 100 GB of data online
~ 300 GB data available on demand
Catalog service is operational
9/22/2018

17. Future Work
Set up of the HYCOM node as a sister server with GODAE partners
Implementation of a DODS Aggregation Server to serve datasets as a time-series
Add additional datasets and metadata
9/22/2018