1. Hydrologic Information Systems David Maidment, Tim Whiteaker, Dean Djokic, Norman Jones ESRI, Redlands CA Sept 4, 2007

2. Linking GIS and Water Resources GIS Water Resources

3. Hydrologic Information System GIS – the water environment Water Resources – the water itself

4. Six Demos ● WaterOneFlow web services in Excel ● Data access system for hydrology (DASH) ● Semantic mediation using HydroSeek ● Arc Hydro for watershed data ● Exploratory space-time analysis ● Automated water balancing using OpenMI

5. Six Demos ● WaterOneFlow web services in Excel ● Data access system for hydrology (DASH) ● Semantic mediation using HydroSeek ● Arc Hydro for watershed data ● Exploratory space-time analysis ● Automated water balancing using OpenMI

6. Point Observations Information Model Data Source Network Sites Variables Values {Value, Time, Qualifier, Offset} USGS Streamflow gages Neuse River near Clayton, NC Discharge, stage (Daily or instantaneous) 206 cfs, 13 August 2006 A data source operates an observation network A network is a set of observation sites A site is a point location where one or more variables are measured A variable is a property describing the flow or quality of water A value is an observation of a variable at a particular time A qualifier is a symbol that provides additional information about the value An offset allows specification of measurements at various depths in water http://www.cuahsi.org/his/webservices.html GetSites GetSiteInfo GetVariables GetVariableInfo GetValues

7. Locations Variable Codes Date Ranges WaterML and WaterOneFlow GetSiteInfo GetVariableInfo GetValues WaterOneFlow Web Service Client STORET NAM NWIS Data Repositories Data EXTRACT TRANSFORM LOAD WaterML WaterML is an XML language for communicating water data WaterOneFlow is a set of web services based on WaterML

8. WaterOneFlow ● Set of query functions ● Returns data in WaterML

9. HIS Servers WATERS Network Information System NSF has funded work at 10 testbed sites, each with its own science agenda. A CUAHSI Hydrologic Information Server is installed at each site. Utah State University Texas A&M Corpus Christi National HIS Server at San Diego SuperComputer Center

10. Multiscale Information System ● Global data ● National data ● State data ● Project in region …. ● Principal investigator data

11. Corpus Christi Bay WATERS Testbed site Montagna stations SERF stations TCOON stations USGS gages TCEQ stations Hypoxic Regions NCDC station National Datasets (National HIS)Regional Datasets (Testbed HIS) USGSNCDCTCOONDr. Paul MontagnaTCEQSERF

12. Six Demos ● WaterOneFlow web services in Excel ● Data access system for hydrology (DASH) ● Semantic mediation using HydroSeek ● Arc Hydro for watershed data ● Exploratory space-time analysis ● Automated water balancing using OpenMI

13. Hydrologic Information Server ● Supports data discovery, delivery and publication  Data discovery – how do I find the data I want? ● Map interface and observations catalogs ● Metadata based Search  Data delivery – how do I acquire the data I want? ● Use web services or retrieve from local database  Data Publication – how do I publish my observation data? ● Use Observations Data Model

14. Observation Stations Ameriflux Towers (NASA & DOE)NOAA Automated Surface Observing System USGS National Water Information SystemNOAA Climate Reference Network Map for the US

15. Observations Catalog Specifies what variables are measured at each site, over what time interval, and how many observations of each variable are available

16. Hydrologic Information Server Microsoft SQLServer Relational Database Observations Data Geospatial Data GetSites GetSiteInfo GetVariables GetVariableInfo GetValues DASH – data access system for hydrologyWaterOneFlow services ArcGIS Server

17. Six Demos ● WaterOneFlow web services in Excel ● Data access system for hydrology (DASH) ● Semantic mediation using HydroSeek ● Arc Hydro for watershed data ● Exploratory space-time analysis ● Automated water balancing using OpenMI

18. Data Heterogeneity ● Syntactic mediation  Heterogeneity of format  Use WaterML to get data into the same format ● Semantic mediation  Heterogeneity of meaning  Each water data source uses its own vocabulary  Match these up with a common controlled vocabulary  Make standard scientific data queries and have these automatically translated into specific queries on each data source

19. ● Search multiple heterogeneous data sources simultaneously regardless of semantic or structural differences between them Objective NWIS NARR NAWQA NAM-12 request request return return What we are doing now ….. Michael Piasecki Drexel University

20. Semantic Mediator What we would like to do ….. NWIS NAWQA NARR generic request GetValues GetValues HODM Michael Piasecki Drexel University

21. Six Demos ● WaterOneFlow web services in Excel ● Data access system for hydrology (DASH) ● Semantic mediation using HydroSeek ● Arc Hydro for watershed data ● Exploratory space-time analysis ● Automated water balancing using OpenMI

22. GIS in Water Resources Consortium Bringing together these two communities by using a common geospatial data model GIS CRWR Water Resources

23. Arc Hydro: GIS for Water Resources Published by ESRI Press The Arc Hydro data model and application tools are in the public domain

24. Arc Hydro — Hydrography

25. Arc Hydro — Hydrology

26. Hydrologic Cycle Components NetCDF in the Atmosphere Arc Hydro for Surface Water Arc Hydro for Groundwater

27. Data Model based on Inventory of data layers

28. Data Model Based on Behavior “Follow a drop of water from where it falls on the land, to the stream, and all the way to the ocean.” R.M. Hirsch, USGS

29. Integrating Data Inventory using a Behavioral Model Relationships between objects linked by tracing path of water movement

30. San Marcos Basin Flow Accumulation Grid Arc Hydro book, p.73

31. Six Demos ● WaterOneFlow web services in Excel ● Data access system for hydrology (DASH) ● Semantic mediation using HydroSeek ● Arc Hydro for watershed data  Arc Hydro tools (Dean Djokic and ESRI Water Resources Group)  Using Arc Hydro to link NHDPlus, water and weather data ● Exploratory space-time analysis ● Automated water balancing using OpenMI

33. Six Demos ● WaterOneFlow web services in Excel ● Data access system for hydrology (DASH) ● Semantic mediation using HydroSeek ● Arc Hydro for watershed data  Arc Hydro tools (Dean Djokic and ESRI Water Resources Group  Using Arc Hydro to link NHDPlus, water and weather data ● Exploratory space-time analysis ● Automated water balancing using OpenMI

34. NHDPlus – River and Catchment Network for the Nation 2.3 million river reaches and catchments Integration of the National Hydrography Dataset, National Elevation Dataset and National Land Cover Dataset just completed by EPA

35. Reach/catchment

36. Arc Hydro book, p. 61 NHDPlus

37. Data Cube Space, L Time, T Variables, V D “What” “Where” “When” A simple data model

38. Continuous Space-Time Model – NetCDF (Unidata) Space, L Time, T Variables, V D Coordinate dimensions {X} Variable dimensions {Y} http://www.daymet.org Gridded climate data – daily time step, 1 km cells

39. Space, FeatureID Time, TSDateTime Variables, TSTypeID TSValue Discrete Space-Time Data Model ArcHydro

40. Flow Time Time Series HydrographyHydro Network Channel System Drainage System Arc Hydro Components HydroID

41. Arc Hydro connects geospatial and temporal water resources data Arc Hydro NHDPlus Weather Streamflow

42. Six Demos ● WaterOneFlow web services in Excel ● Data access system for hydrology (DASH) ● Semantic mediation using HydroSeek ● Arc Hydro for watershed data ● Exploratory space-time analysis ● Automated water balancing using OpenMI

43. CUAHSI Observations Data Model Space-Time Datasets Sensor and laboratory databases From Robert Vertessy, CSIRO, Australia

44. Hydrologic Information System Analysis, Modeling, Decision Making Arc Hydro Geodatabase A synthesis of geospatial and temporal data supporting hydrologic analysis and modeling

45. ● Water Rights Analysis Package (WRAP) is a simulation model used by the Texas Commission for Environmental Quality ● WRAP models have been built for all 23 river and coastal basins in Texas ● They simulate surface water withdrawals at about 10,000 locations where water permits have been issued in Texas ● Uses monthly time steps and ~ 50 year planning period Reservoir levels in the Neches basin Visualizing the output of the WRAP model (Clark Siler)

46. Information Products Desired ● A WRAP model has about 40 output variables defined at each water permit location and time point 1. Plot a map showing for a given time point the value of a selected variable at each permit location 2. Plot a map for a given time interval of the average value of a selected variable over that time interval 3. Plot a graph showing the time variation of an output variable at a selected permit location Read into the geodatabase 500,000 lines of program output in ~ 1 minute

47. Multivariable Table Space Time A set of variables …… Each space-time point is unique and is associated with a set of variables SpaceTimeGraphs Maps

48. Six Demos ● WaterOneFlow web services in Excel ● Data access system for hydrology (DASH) ● Semantic mediation using HydroSeek ● Arc Hydro for watershed data ● Exploratory space-time analysis ● Automated water balancing using OpenMI

49. ● Project sponsored by the European Commission to promote integration of water models within the Water Framework Directive ● Software standards for model linking ● Uses model core as an “engine” ● http://www.openMI.org http://www.openMI.org

50. OpenMI Conceptual Framework VALUES All values are referenced in a what-where-when framework, allowing different data resources or models to communicate data Space, L Time, T Variables, V D An application of the data cube to integrate simulation models Jon Goodall, Duke University

51. Typical model architecture Application User interface + engine Engine Simulates a process – flow in a channel Accepts input Provides output Model An engine set up to represent a particular location e.g. a reach of the Thames Engine Output data Input data Model application Run Write Read User interface

52. AcceptsProvides Rainfall (mm) Runoff (m 3 /s) Temperature (Deg C) Evaporation (mm) AcceptsProvides Upstream Inflow (m 3 /s) Outflow (m 3 /s) Lateral inflow (m 3 /s) Abstractions (m 3 /s) Discharges (m 3 /s) River Model Linking modelled quantities

53. Data transfer at run time Rainfall runoff Output data Input data User interface River Output data Input data User interface GetValues(..)

54. Models for the processes River (InfoWorks RS) Rainfall (database) Sewer (Mouse) RR (Sobek-Rainfall -Runoff)

55. Data exchange 3 Rainfall.GetValues River (InfoWorks-RS) Rainfall (database) Sewer (Mouse) 2 RR.GetValues 7 RR.GetValues RR (Sobek-Rainfall -Runoff) 1 Trigger.GetValues 6 Sewer.GetValues call data 4 5 8 9

56. Digital Watershed How can hydrologists integrate observed and modeled data from various sources into a single description of the environment?

57. Coupling the HIS with Hydrologic Simulation Models using OpenMI ODM Observations Data Model WaterOneFlow Web Services Water Markup Language WOF WaterML MODFLOWHEC-RASOthers SWAT HSPF “academic” models... The Open Modelling Interface (OpenMI)

58. OpenMI ● Component-based modeling framework ● Defines a standard for interfacing models, databases, and web services. WaterOneFlow Web Services WOF OpenMI Linkable Component OpenMI Model Configuration (1) (2) (3)

59. Water OneFlow ● We need a “Water OneFlow” – a common window for water data and models ● Advancement of water science is critically dependent on integration of water information Federal Academic Local State Model Flow Precip

60. Groundwater Data Model and Tools ● Norman Jones to take over here