Hydrologic Information System GIS – the water environment Water Resources – the water itself CUAHSI HIS: NSF-supported collaborative project: UT Austin + SDSC + Utah State + Drexel + South Carolina ( PI: David R. Maidment (UT-Austin) Goals:. provide rapid uniform access to heterogeneous hydrologic data, and facilities for data publishing;. develop a framework for synthesizing data and models in a region (support for observatories);. strengthen place-based hydrologic science. quantify and visualize the movement of water and chemicals continuously in space and time. hydrologic education CyberInfrastructure project

Point Observations Information Model Data Source Network Sites Variables Values {Value, Time, Qualifier, Offset} USGS Streamflow gages Neuse River near Clayton, NC Discharge, stage (Daily or instantaneous) 206 cfs, 13 August 2006 A data source operates an observation network A network is a set of observation sites A site is a point location where one or more variables are measured A variable is a property describing the flow or quality of water A value is an observation of a variable at a particular time A qualifier is a symbol that provides additional information about the value An offset allows specification of measurements at various depths in water GetSites GetSiteInfo GetVariables GetVariableInfo GetValues

Locations Variable Codes Date Ranges WaterML and WaterOneFlow GetSiteInfo GetVariableInfo GetValues WaterOneFlow Web Service Client STORET NAM NWIS Data Repositories Data EXTRACT TRANSFORM LOAD WaterML WaterML is an XML language for communicating water data WaterOneFlow is a set of web services based on WaterML

WaterOneFlow Set of query functions Returns data in WaterML NWIS Daily Values (discharge), NWIS Ground Water, NWIS Unit Values (real time), NWIS Instantaneous Irregular Data, EPA STORET, NCDC ASOS, DAYMET, MODIS, NAM12K, ODM (multiple sites)

Observation Stations Ameriflux Towers (NASA & DOE)NOAA Automated Surface Observing System USGS National Water Information SystemNOAA Climate Reference Network Map for the US

Multiscale Information System Global data National data State data Project in region …. Principal investigator data

HIS Servers WATERS Network Information System NSF has funded work at 11 testbed sites, each with its own science agenda. A CUAHSI Hydrologic Information Server is installed at each site. Utah State University Texas A&M Corpus Christi National HIS Server at San Diego SuperComputer Center

Corpus Christi Bay WATERS Testbed site Montagna stations SERF stations TCOON stations USGS gages TCEQ stations Hypoxic Regions NCDC station National Datasets (National HIS)Regional Datasets (Testbed HIS) USGSNCDCTCOONDr. Paul MontagnaTCEQSERF

Hydrologic Information Server Supports data discovery, delivery and publication –Data discovery – how do I find the data I want? Map interface and observations catalogs Metadata based Search –Data delivery – how do I acquire the data I want? Use web services or retrieve from local database –Data Publication – how do I publish my observation data? Use Observations Data Model

Hydrologic Information Server Microsoft SQLServer Relational Database Observations Data & Catalogs Geospatial Data GetSites GetSiteInfo GetVariables GetVariableInfo GetValues DASH – data access system for hydrologyWaterOneFlow services ArcGIS Server

SQL Server ODMs and catalogs. All instances exposed as ODM (i.e. have standard ODM tables or views: Sites, Variables, SeriesCatalog, etc.) NWIS-IID NWIS-DV ASOS STORET TCEQ BearRiver... Spatial store Geodatabase or collection of shapefiles or both NWIS-IID points NWIS-DV points ASOS points STORET points TCEQ points BearRiver points... My new ODM My new points More databases More synced layers DASH Web Application Background layers (can be in the same or separate spatial store) WOF services Web services from a common template NWIS-IID WS NWIS-DV WS ASOS WS STORET WS TCEQ WS BearRiver WS... My new WS More WS from ODM-WS template USGS NCDC EPA TCEQ Web Configuration file Stores information about registered networks MXD Stores information about layers WSDLs, web service URLs Connection strings Layer info, symbology, etc. ODM DataLoader WORKGROUP HIS SERVER ORGANIZATION STEPS FOR REGISTERING OBSERVATION DATA

Data Heterogeneity Syntactic mediation –Heterogeneity of format –Use WaterML to get data into the same format Semantic mediation –Heterogeneity of meaning –Each water data source uses its own vocabulary –Match these up with a common controlled vocabulary –Make standard scientific data queries and have these automatically translated into specific queries on each data source

Search multiple heterogeneous data sources simultaneously regardless of semantic or structural differences between them Objective NWIS NARR NAWQA NAM-12 request request return return What we are doing now ….. Michael Piasecki Drexel University

Semantic Mediator What we would like to do ….. NWIS NAWQA NARR generic request GetValues GetValues HODM Michael Piasecki Drexel University

HydroSeek: Hydroseek Demo

What’s coming Integrated real time data management –SDL (Utah State) –DataTurbine (SDSC)DataTurbine (SDSC) Creating a community vocabulary for parameters, and tagging your variables More agency data sources Analysis of catalogs: towards spatial history of hydrologic observations Standards compliance A flexible modeling framework Integration with gridded data, and with other CI projects: LTER, GEON, NEON, etc. Towards digital watershed management Tagger Demo

Scalable, secure, programmable, versatile for different data types and vendor interfaces, developer community, with many applications written (e.g. data viewers and plug-ins), open source, high performance streaming (10mb/s, 1000 frames/s) Typical scenarios: DBMS Monitoring and management apps CS loggers NI loggers Other proprietary or in-house CS loggers Loggernet RBNB DataTurbine (Ring Buffered Network Bus) UCSD-DASH Demo

Work with us Building a larger network of hydrologic data servers –Install a HIS server at your site –Contribute data and services –Join development team –Create hydrologic mashups –Provide feedback Web sites: – project info, downloadable software, manuals, workbookwww.cuahsi.org/his/ –river.sdsc.edu/wiki/ developer notes, issues/bugs tracking, CVS instructions, etc.river.sdsc.edu/wiki/