Presentation is loading. Please wait.

Presentation is loading. Please wait.

SAN DIEGO SUPERCOMPUTER CENTER Developing a CUAHSI HIS Data Node, as part of Cyberinfrastructure for the Hydrologic Sciences David Valentine Ilya Zaslavsky.

Similar presentations


Presentation on theme: "SAN DIEGO SUPERCOMPUTER CENTER Developing a CUAHSI HIS Data Node, as part of Cyberinfrastructure for the Hydrologic Sciences David Valentine Ilya Zaslavsky."— Presentation transcript:

1 SAN DIEGO SUPERCOMPUTER CENTER Developing a CUAHSI HIS Data Node, as part of Cyberinfrastructure for the Hydrologic Sciences David Valentine Ilya Zaslavsky David R. Maidment

2 SAN DIEGO SUPERCOMPUTER CENTER Overview Introduction Technology Present Screenshots Near Term Future

3 SAN DIEGO SUPERCOMPUTER CENTER Hydrologic Science Hydrologic conditions (Fluxes, flows, concentrations) Hydrologic Process Science (Equations, simulation models, prediction) Hydrologic Information Science (Observations, data models, visualization Hydrologic environment (Dynamic earth) Physical laws and principles (Mass, momentum, energy, chemistry) It is as important to represent hydrologic environments precisely with data as it is to represent hydrologic processes with equations

4 SAN DIEGO SUPERCOMPUTER CENTER Consortium of Universities for the Advancement of Hydrologic Science, Inc (CUAHSI) Supported by the National Science Foundation Develops cyberinfrastructure and services for hydrologic science in US universities Legally independent organization based in Washington DC SDSC is the cyberinfrastructure partner CUAHSI HydroView Components Hydrologic Synthesis Hydrologic Observatories Hydrologic Information Systems Measurement Technology

5 SAN DIEGO SUPERCOMPUTER CENTER Most used applications are Excel ArcGIS Matlab Which of the four HIS goals is most important to you? DataAccess ScienceObservatories Education CUAHSI Member Survey Results Then come programming languages Fortran C/C++ Visual Basic

6 SAN DIEGO SUPERCOMPUTER CENTER Operating Systems and Software Use

7 SAN DIEGO SUPERCOMPUTER CENTER Water OneFlow Web Services Like Geospatial OneStop, we need a “Water OneStop” – a common window for water data and models Advancement of water science is critically dependent on integration of water information

8 SAN DIEGO SUPERCOMPUTER CENTER NWIS ArcGIS Excel NCAR LTER NAWQA Storet NCDC Ameriflux Matlab AccessSAS Fortran Visual Basic C/C++ Some operational services CUAHSI Web Services Data Sources Applications Extract Transform Load

9 SAN DIEGO SUPERCOMPUTER CENTER Technology Commercial of the shelf (COTS) software Leverage ongoing cyberinfrastructure projects Geosciences Network (GEON) Share data between Earth Science disciplines Grid computing capabilities Web Services

10 SAN DIEGO SUPERCOMPUTER CENTER Operating Systems ESRI ArcGIS Microsoft SQL Server Custom Models ArcHydro Hydrologic Observations Database ASP.NET Web services Web interfaces Provides a platform that scientists are familiar with, and have developed, and a presently using to develop, software. GEON Stack Java Portlets (Gridsphere) Grid Authentication (GAMA) Distributed Storage (SRB) Grid Processing Capabilities Workflow Capabilities Provides data registration searching an archive Shared architecture for Geosciences

11 Multi-platform Design Central CUAHSI HIS Node (Windows) GEON Data Node (Linux) Data Apache Tomcat IIS Web Server ASP.Net Geon Software Stack SQL Server Proxy ArcGIS Technologies HDAS HODM Web Service Web Services Web Service proxies Data Remote CUAHSI HIS Node (Windows) Data IIS Web Server ASP.Net SQL Server ArcGIS Technologies HDAS HODM Web Service Web Services Web Service proxies Remote CUAHSI HIS Node (Windows) Data IIS Web Server ASP.Net SQL Server ArcGIS Technologies HDAS HODM Web Service Web Services Web Service proxies Remote CUAHSI HIS Node (Windows) Data IIS Web Server ASP.Net SQL Server ArcGIS Technologies HDAS HODM Web Service Web Services Web Service proxies Remote CUAHSI HIS Node (Windows) Data IIS Web Server ASP.Net SQL Server ArcGIS Technologies HDAS HODM Web Service Web Services Web Service proxies Remote CUAHSI HIS Nodes (Windows)

12 SAN DIEGO SUPERCOMPUTER CENTER Present (1/2) Water OneFlow Web Services NWIS, AmeriFlux, DAYMET, MODIS Databases Hydrologic Observations Data Model HDAS - Hydrologic Data Access System A map-based access system to hydrologic data We provide production access to data sources via webservices, and access via a map-based interface

13 SAN DIEGO SUPERCOMPUTER CENTER Present (2/2) Problems Occasionally, Geon Services do not work in proxy CUAHSI ArcGIS server interfaces (eg HDAS) have problems being wrapped in a portlet, and were not designed to be wrapped. Producing a node distribution with COTS

14 SAN DIEGO SUPERCOMPUTER CENTER

15

16

17

18

19

20 Demo-Data Registration

21 SAN DIEGO SUPERCOMPUTER CENTER Near Future Water OneFlow web services Standardize methods Refactor present services Provide codebase for community development Dataset specific methods ESRI ArcHydro server extension Point of presence distribution Documentation

22 SAN DIEGO SUPERCOMPUTER CENTER Future Make it easier URL-Based access methods Data Non-Map access methods Ontology search Site browse Attribute browse (by HUC, State, County) Others (tell us) Tools Documentation http://ws.cuahsi.org/station/ameriflux/stationID/Variable/xml http://ws.cuahsi.org/station/ameriflux/stationID/Variable/excel

23 SAN DIEGO SUPERCOMPUTER CENTER Summary CUAHSI HIS is a community driven effort. COTS or open source CUAHSI cyberinfrastructure will be a multi- platform infrastructure that leverages the GEON Infrastructure, and commercial software. Web services will allow for flexible development Community-developed implementations can replace commercial implementations. MapWindows group is developing an OpenHydro data model to provide an open source implementation of the ArcHydro datamodel. best tool for the job.

24 SAN DIEGO SUPERCOMPUTER CENTER Questions Sites http://www.cuahsi.org/his/ Listing of web services http://river.sdsc.edu/HDAS/ Map interface to National Water Information System HIS Contacts valentin@sdsc.edu zavlask@sdsc.edu

25 SAN DIEGO SUPERCOMPUTER CENTER

26

27 WaterOneFlow Web Services Data accessthrough web services Data storage through web services Downloads Uploads Observatory servers SDSC HIS servers 3 rd party servers e.g. USGS, NCDC GIS Matlab IDL Splus, R D2K, I2K Programming (Fortran, C, VB) Web services interface Web portal Interface (HDAS) Information input, display, query and output services Preliminary data exploration and discovery. See what is available and perform exploratory analyses HTML -XML WSDL - SOAP Hydrologic Information System Service Oriented Architecture

28 SAN DIEGO SUPERCOMPUTER CENTER WaterOneFlow Web Services Data accessthrough web services Data storage through web services Downloads Uploads Observatory servers SDSC HIS servers 3 rd party servers e.g. USGS, NCDC GIS Matlab IDL Splus, R D2K, I2K Programming (Fortran, C, VB) Web services interface Web portal Interface (HDAS) Information input, display, query and output services Preliminary data exploration and discovery. See what is available and perform exploratory analyses HTML -XML WSDL - SOAP Hydrologic Information System Service Oriented Architecture


Download ppt "SAN DIEGO SUPERCOMPUTER CENTER Developing a CUAHSI HIS Data Node, as part of Cyberinfrastructure for the Hydrologic Sciences David Valentine Ilya Zaslavsky."

Similar presentations


Ads by Google