A Community Data Model for Hydrologic Observations Observations Data Model Schema ODM Data Source and Network SitesVariables ValuesMetadata Depth of snow.

Slides:



Advertisements
Similar presentations
CUAHSI Observations Data Model A relational database stored in Access, PostgreSQL, SQLServer, …. Stores observation data made at points Access data through.
Advertisements

HydroServer A Platform for Publishing Space- Time Hydrologic Datasets Support EAR CUAHSI HIS Sharing hydrologic data Jeffery.
How to share and publish your data using HIS David G Tarboton Jeff Horsburgh Ilya Zaslavsky Tom Whitenack David Valentine Support EAR
Sharing Hydrologic Data with the CUAHSI Hydrologic Information System Support EAR CUAHSI HIS Sharing hydrologic data David.
ICEWATER: INRA Constellation of Experimental Watersheds Cyberinfrastructure to Support Publication of Water Resources Data Jeffery S. Horsburgh, Utah State.
SAN DIEGO SUPERCOMPUTER CENTER HYDROLOGIC METADATA CATALOG AND SEMANTIC SEARCH SERVICES IN CUAHSI HIS CUAHSI HIS Sharing hydrologic.
Project Venue Little Bear River –Cache County, UT –5-20 km from Utah State University –Existing cyberinfra-structure from ongoing projects with EPA/USDA/USU/
Managing Sensor Infrastructure: A Sensor Extension for ODM2 Amber Spackman Jones, Jeffery S. Horsburgh, Juan Caraballo, Maurier Ramírez Utah Water Research.
Linking HIS and GIS How to support the objective, transparent and robust calculation and publication of SWSI? Jeffery S. Horsburgh CUAHSI HIS Sharing hydrologic.
This work is funded by National Science Foundation Grant EAR Accessing and Sharing Data Using the CUAHSI Hydrologic Information System CUAHSI HIS.
ODM2: Developing a Community Information Model and Supporting Software to Extend Interoperability of Sensor and Sample Based Earth Observations Jeffery.
CUAHSI HIS Data Services Project David R. Maidment Director, Center for Research in Water Resources University of Texas at Austin (HIS Project Leader)
SENSORS, CYBERINFRASTRUCTURE, AND EXAMINATION OF HYDROLOGIC AND HYDROCHEMICAL RESPONSE IN THE LITTLE BEAR RIVER OBSERVATORY TEST BED Jeffery S. Horsburgh.
Components of an Integrated Environmental Observatory Information System Cyberinfrastructure to Support Publication of Water Resources Data Jeffery S.
This work was funded by the U.S. National Science Foundation under grant EAR Any opinions, findings and conclusions or recommendations expressed.
HydroServer A Platform for Publishing Space- Time Hydrologic Datasets Support EAR CUAHSI HIS Sharing hydrologic data Jeffery.
SENSORS, CYBERINFRASTRUCTURE, AND WATER QUALITY IN THE LITTLE BEAR RIVER Jeffery S. Horsburgh David K. Stevens, Amber Spackman Jones, David G. Tarboton,
Testing A Community Data Model for Hydrologic Observations David G Tarboton Jeff Horsburgh David R. Maidment Ilya Zaslavsky David Valentine Blair Jennings.
Sharing and publishing data using CUAHSI HIS Outline HIS data publication system WaterML and WaterOneFlow web services Observations data model (ODM) Data.
Development of a Community Hydrologic Information System Jeffery S. Horsburgh Utah State University David G. Tarboton Utah State University.
Two NSF Data Services Projects Rick Hooper, President Consortium of Universities for the Advancement of Hydrologic Science, Inc.
Using GIS in Creating an End-to- End System for Publishing Environmental Observations Data Jeffery S. Horsburgh David G. Tarboton, David R. Maidment, Ilya.
Integrating Historical and Realtime Monitoring Data into an Internet Based Watershed Information System for the Bear River Basin Jeff Horsburgh David Stevens,
Deployment and Evaluation of an Observations Data Model Jeffery S Horsburgh David G Tarboton Ilya Zaslavsky David R. Maidment David Valentine
HIS Team and Collaborators University of Texas at Austin – David Maidment, Tim Whiteaker, Ernest To, Bryan Enslein, Kate Marney San Diego Supercomputer.
An End-to-End System for Publishing Environmental Observations Data Jeffery S. Horsburgh David K. Stevens, David G. Tarboton, Nancy O. Mesner, Amber Spackman.
A Services Oriented Architecture for Water Resources Data David R. Maidment Center for Research in Water Resources University of Texas at Austin EPA Storet.
Tools for Publishing Environmental Observations on the Internet Justin Berger, Undergraduate Researcher Jeff Horsburgh, Faculty Mentor David Tarboton,
Using HydroServer Organize, Manage, and Publish Your Data Support EAR CUAHSI HIS Sharing hydrologic data Jeffery S. Horsburgh.
U.S. Department of the Interior U.S. Geological Survey NWIS Web Services Snapshot for ArcGIS Sally Holl and David Maltby Based on work by David McCulloch.
Setting up a HydroServer Support EAR CUAHSI HIS Sharing hydrologic data Jeffery S. Horsburgh David G. Tarboton, Kimberly.
Ocean Sciences What is CUAHSI? CUAHSI – Consortium of Universities for the Advancement of Hydrologic Science, Inc Formed in 2001 as a legal entity Program.
Information Requirements for Integrating Spatially Discrete, Feature- Based Earth Observations Jeffery S. Horsburgh Anthony Aufdenkampe, Kerstin Lehnert,
Exercises: Organizing, Loading, and Managing Point Observations Using HydroServer Support EAR CUAHSI HIS Sharing hydrologic data
Data Interoperability in the Hydrologic Sciences The CUAHSI Hydrologic Information System David Tarboton, David Maidment, Ilya Zaslavsky, Dan Ames, Jon.
Advancing an Information Model for Environmental Observations Jeffery S. Horsburgh Anthony Aufdenkampe, Richard P. Hooper, Kerstin Lehnert, Kim Schreuders,
Ocean Sciences CUAHSI-Hydrologic Information Systems CUAHSI – Consortium of Universities for the Advancement of Hydrologic Science, Inc Formed in 2001.
CUAHSI, WATERS and HIS by Richard P. Hooper, David G. Tarboton and David R. Maidment.
H43H-1325 Kimberly A.T. Schreuders, David G. Tarboton, Jeffery S. Horsburgh, Avirup Sen Gupta, and Stephanie Reeder Utah State University CUAHSI HIS
Amber Spackman Jones Jeffery S. Horsburgh Stephanie Reeder James Patton iUTAH Cyberinfrastructure to Support Data Collection and Management for the GAMUT.
Water and Catchment Data Services David R. Maidment Center for Research in Water Resources University of Texas at Austin River Science Symposium Swansea,
CBEO:N Chesapeake Bay Environmental Observatory as a Network Node About CBEO The mission of the CBEO project is development of a Chesapeake Bay Environmental.
The HydroServer Collaborative Website Support EAR CUAHSI HIS Sharing hydrologic data Jeffery S. Horsburgh David G. Tarboton,
The CUAHSI Community Hydrologic Information System Jeffery S. Horsburgh Utah Water Research Laboratory Utah State University CUAHSI HIS Sharing hydrologic.
Bringing Water Data Together David R. Maidment Center for Research in Water Resources University of Texas at Austin Texas Water Summit San Antonio Tx,
CUAHSI HIS Features of Observations Data Model. NWIS ArcGIS Excel NCAR Trends NAWQA Storet NCDC Ameriflux Matlab AccessSAS Fortran Visual Basic C/C++
Lecture 4 Data Models Jeffery S. Horsburgh Hydroinformatics Fall 2012 This work was funded by National Science Foundation Grant EPS
The CUAHSI Observations Data Model Jeff Horsburgh David Maidment, David Tarboton, Ilya Zaslavsky, Michael Piasecki, Jon Goodall, David Valentine,
HydroGET A web service client for ArcGIS Ernest To PhD Candidate, University of Texas at Austin August 2008.
Lecture 5 Data Model Design Jeffery S. Horsburgh Hydroinformatics Fall 2012 This work was funded by National Science Foundation Grant EPS
1 CUAHSI Web Services and Hydrologic Information Systems By David R. Maidment, University of Texas at Austin Collaborators: Ilya Zaslavsky and Reza Wahadj,
Using Python to Retrieve Data from the CUAHSI HIS Web Services Jeffery S. Horsburgh Hydroinformatics Fall 2015 This work was funded by National Science.
1 of 42 Lecture 5 Data Model Design Jeffery S. Horsburgh Hydroinformatics Fall 2013 This work was funded by National Science Foundation Grants EPS
Developing a community hydrologic information system David G Tarboton David R. Maidment (PI) Ilya Zaslavsky Michael Piasecki Jon Goodall
Jeffery S. Horsburgh Hydroinformatics Fall 2014
The CUAHSI Hydrologic Information System Spatial Data Publication Platform David Tarboton, Jeff Horsburgh, David Maidment, Dan Ames, Jon Goodall, Richard.
Developing a Community Hydrologic Information System
Using GIS in Creating an End-to-End System for Publishing Environmental Observations Data Jeffery S. Horsburgh David G. Tarboton, David R. Maidment, Ilya.
Using an Observations Data Model in Hydrologic Information Systems
Developing a Community Hydrologic Information System
Sharing Hydrologic Data with the CUAHSI* Hydrologic Information System
The CUAHSI Hydrologic Information System and NHD Plus A Services Oriented Architecture for Water Resources Data David G Tarboton David R. Maidment (PI)
A Community Data Model for Hydrologic Information Systems
Lecture 8 Database Implementation
Hydroinformatics Lecture 15: HydroServer (and HydroServer Lite)
Jeffery S. Horsburgh Hydroinformatics Fall 2014
Welcome to GIS in Water Resources 2017
Space, Time and Variables in Hydrology
Welcome to GIS in Water Resources 2013
Point Observations Information Model
Presentation transcript:

A Community Data Model for Hydrologic Observations Observations Data Model Schema ODM Data Source and Network SitesVariables ValuesMetadata Depth of snow pack Streamflow Windspeed, Precipitation Controlled Vocabularies e.g. mg/kg, cfs e.g. depth e.g. Non-detect, Estimated A site is a point location where one or more variables are measured A data source operates an observation network A network is a set of observation sites Metadata provide information about and context for the observation A variable is a quantity that is measured or observed A value is an observation of a variable at a particular time Credit for this figure goes to Ernest To, University of Texas at Austin ODM Features ODM is designed to store hydrologic observations and sufficient metadata about the values to provide traceable heritage from raw measurements to usable information, allowing the data to be unambiguously interpreted and used. Hydrologic observations are identified by the following fundamental characteristics: The location at which the observations were made (space) The date and time at which the observations were made (time) The type of variable that was observed, such as streamflow, water surface elevation, water quality concentration, etc. (variable) The scale and uncertainty or inaccuracy of each measurement The TimeSupport attribute of each variable quantifies the temporal averaging support associated with each measurement. Spatial support is quantified by the method and site position. Contact Information Ilya Zaslavsky, San Diego Supercomputer Center, University of California, San Diego, San Diego, CA 92093, David Tarboton, Utah State University, 4110 Old Main Hill, Logan, UT (435) , Jeffery Horsburgh, Utah State University, 8200 Old Main Hill, Logan, UT (435) , David Maidment, University of Texas at Austin, Austin, TX 78712, David Valentine, San Diego Supercomputer Center, University of California, San Diego, San Diego, CA 92093, Blair Jennings, San Diego Supercomputer Center, University of California, San Diego, San Diego, CA 92093, The CUAHSI HIS and ODM The CUAHSI Hydrologic Information System (HIS) project is developing information technology infrastructure to support hydrologic science. Hydrologic information science involves the description of hydrologic environments in a consistent way, using data models for information integration. This includes a hydrologic observations data model for the storage and retrieval of hydrologic observations in a relational database designed to facilitate data retrieval for integrated analysis of information collected by multiple investigators. It is intended to provide a standard format to facilitate the effective sharing of information between investigators and to facilitate analysis of information within a single study area or hydrologic observatory, or across hydrologic observatories and regions. The Scale Triplet of Measurements comprising extent, spacing and support (Grayson and Blöschl, 2000, chapter 2). Grayson, R. and G. Blöschl, ed. (2000), Spatial Patterns in Catchment Hydrology: Observations and Modelling, Cambridge University Press, Cambridge, 432p. What Where When

ODM Examples This work is funded by the National Science Foundation Daily Average Discharge Example Daily Average Discharge Derived from 15 Minute Discharge Data Water Chemistry From a Profile in a LakeStage and Streamflow Example ODM Features Data Types Variable Attributes Continuous (Frequent sampling - fine spacing) Instantaneous (Spot sampling - coarse spacing) Cumulative Incremental Average Maximum Minimum Constant over Interval Categorical Offset VariableName, e.g. discharge VariableCode, e.g SampleMedium, e.g. water Valuetype, e.g. field observation, laboratory sample IsRegular, e.g. Yes for regular or No for intermittent TimeSupport (averaging interval for observation) DataType, e.g. Continuous, Instantaneous, Categorical GeneralCategory, e.g. Climate, Water Quality NoDataValue, e.g OffsetValue Distance from a datum or control point at which an observation was made OffsetType defines the type of offset, e.g. distance below water level, distance above ground surface, or distance from bank of river Methods and Samples Method specifies the method whereby an observation is measured, e.g. Streamflow using a V notch weir, TDS using a Hydrolab, sample collected in auto- sampler SampleID is used for observations based on the laboratory analysis of a physical sample and identifies the sample from which the observation was derived. This keys to a unique LabSampleID (e.g. bottle number) and name and description of the analytical method used by a processing lab. Groups and Derived From Associations Accuracy and Precision ObsAccuracyStdDev Numeric value that expresses measurement accuracy as the standard deviation of the error associated with each specific observation Observation Series Data Quality Qualifier Code and Description provides qualifying information about the observations, e.g. Estimated, Provisional, Derived, Holding time for analysis exceeded QualityControlLevel records the level of quality control that the data has been subjected to. - Level 0. Raw Data - Level 1. Quality Controlled Data - Level 2. Derived Products - Level 3. Interpreted Products - Level 4. Knowledge Products ODM Utilities Load – import existing data directly to ODM Query and export – export data series and metadata Visualize – plot and summarize data series Edit – delete, modify, adjust, interpolate, average, etc. ODM Software Tools Observations Database (ODM) Base Station Computer(s) Data Processing Applications Telemetry Network Sensors Internet Sensor to Database Capability Machine to machine communication of data over the internet Users can program against the database as if it were on their local machine Data Distribution Via CUAHSI HIS Web Services Automated tools for ingesting sensor data into the ODM Open Comment Period See for the detailed design specification document. Comments on this design are welcome. The open comment period ends January 31, Send comments to