Information Requirements for Integrating Spatially Discrete, Feature- Based Earth Observations Jeffery S. Horsburgh Anthony Aufdenkampe, Kerstin Lehnert,

Slides:



Advertisements
Similar presentations
Observations Data Model 2.0
Advertisements

Some notes on CyberGIS in hydrology Ilya Zaslavsky Spatial Information Systems Lab San Diego Supercomputer Center UCSD TeraGrid CyberGIS Workshop, February.
ASCR Data Science Centers Infrastructure Demonstration S. Canon, N. Desai, M. Ernst, K. Kleese-Van Dam, G. Shipman, B. Tierney.
HydroServer A Platform for Publishing Space- Time Hydrologic Datasets Support EAR CUAHSI HIS Sharing hydrologic data Jeffery.
This work is funded by the Inland Northwest Research Alliance INRA Constellation of Experimental Watersheds: Cyberinfrastructure to Support Publication.
ICEWATER: INRA Constellation of Experimental Watersheds Cyberinfrastructure to Support Publication of Water Resources Data Jeffery S. Horsburgh, Utah State.
Managing Sensor Infrastructure: A Sensor Extension for ODM2 Amber Spackman Jones, Jeffery S. Horsburgh, Juan Caraballo, Maurier Ramírez Utah Water Research.
C van Ingen, D Agarwal, M Goode, J Gupchup, J Hunt, R Leonardson, M Rodriguez, N Li Berkeley Water Center John Hopkins University Lawrence Berkeley Laboratory.
Linking HIS and GIS How to support the objective, transparent and robust calculation and publication of SWSI? Jeffery S. Horsburgh CUAHSI HIS Sharing hydrologic.
This work is funded by National Science Foundation Grant EAR Accessing and Sharing Data Using the CUAHSI Hydrologic Information System CUAHSI HIS.
ODM2: Developing a Community Information Model and Supporting Software to Extend Interoperability of Sensor and Sample Based Earth Observations Jeffery.
1 Introduction to XML. XML eXtensible implies that users define tag content Markup implies it is a coded document Language implies it is a metalanguage.
CUAHSI HIS Data Services Project David R. Maidment Director, Center for Research in Water Resources University of Texas at Austin (HIS Project Leader)
Components of an Integrated Environmental Observatory Information System Cyberinfrastructure to Support Publication of Water Resources Data Jeffery S.
Metadata Standards for Sample- Based Observations Kerstin Lehnert EGU General Assembly 2011.
This work was funded by the U.S. National Science Foundation under grant EAR Any opinions, findings and conclusions or recommendations expressed.
HydroServer A Platform for Publishing Space- Time Hydrologic Datasets Support EAR CUAHSI HIS Sharing hydrologic data Jeffery.
SENSORS, CYBERINFRASTRUCTURE, AND WATER QUALITY IN THE LITTLE BEAR RIVER Jeffery S. Horsburgh David K. Stevens, Amber Spackman Jones, David G. Tarboton,
Development of a Community Hydrologic Information System Jeffery S. Horsburgh Utah State University David G. Tarboton Utah State University.
PAWN: A Novel Ingestion Workflow Technology for Digital Preservation
Using GIS in Creating an End-to- End System for Publishing Environmental Observations Data Jeffery S. Horsburgh David G. Tarboton, David R. Maidment, Ilya.
Deployment and Evaluation of an Observations Data Model Jeffery S Horsburgh David G Tarboton Ilya Zaslavsky David R. Maidment David Valentine
SAN DIEGO SUPERCOMPUTER CENTER Developing a CUAHSI HIS Data Node, as part of Cyberinfrastructure for the Hydrologic Sciences David Valentine Ilya Zaslavsky.
An End-to-End System for Publishing Environmental Observations Data Jeffery S. Horsburgh David K. Stevens, David G. Tarboton, Nancy O. Mesner, Amber Spackman.
Tools for Publishing Environmental Observations on the Internet Justin Berger, Undergraduate Researcher Jeff Horsburgh, Faculty Mentor David Tarboton,
Using HydroServer Organize, Manage, and Publish Your Data Support EAR CUAHSI HIS Sharing hydrologic data Jeffery S. Horsburgh.
Over-allocation to irrigation Bushfire recovery impacts Expanding plantations Drying and warming climate Uncapped groundwater extraction Expanding farm.
Setting up a HydroServer Support EAR CUAHSI HIS Sharing hydrologic data Jeffery S. Horsburgh David G. Tarboton, Kimberly.
HydroShare: Advancing Hydrology through Collaborative Data and Model Sharing David Tarboton, Ray Idaszak, Jeffery Horsburgh, Dan Ames, Jon Goodall, Larry.
About CUAHSI The Consortium of Universities for the Advancement of Hydrologic Science, Inc. (CUAHSI) is an organization representing 120+ universities.
Abstract Building an integrated information system for publishing heterogeneous Critical Zone Observatory data Thomas Whitenack 1, Mark Williams 2, David.
Exercises: Organizing, Loading, and Managing Point Observations Using HydroServer Support EAR CUAHSI HIS Sharing hydrologic data
Water Web Services David R. Maidment Center for Research in Water Resources University of Texas at Austin Open Waters Symposium Delft, the Netherlands.
Data Interoperability in the Hydrologic Sciences The CUAHSI Hydrologic Information System David Tarboton, David Maidment, Ilya Zaslavsky, Dan Ames, Jon.
Advancing an Information Model for Environmental Observations Jeffery S. Horsburgh Anthony Aufdenkampe, Richard P. Hooper, Kerstin Lehnert, Kim Schreuders,
1 The NERC DataGrid DataGrid The NERC DataGrid DataGrid AHM 2003 – 2 Sept, 2003 e-Science Centre Metadata of the NERC DataGrid Kevin O’Neill CCLRC e-Science.
Introduction to Apache OODT Yang Li Mar 9, What is OODT Object Oriented Data Technology Science data management Archiving Systems that span scientific.
Metadata and Geographical Information Systems Adrian Moss KINDS project, Manchester Metropolitan University, UK
Water and Catchment Data Services David R. Maidment Center for Research in Water Resources University of Texas at Austin River Science Symposium Swansea,
® © 2009 Open Geospatial Consortium, Inc. Existing time series delivery formats and Water Data Services requirements, and OGC-compliant Water Data Services.
EarthCube Building Block for Integrating Discrete and Continuous Data (DisConBB) David Maidment, University of Texas at Austin (Lead PI) Alva Couch, Tufts.
Discovery Metadata for Special Collections Concepts, Considerations, Choices William E. Moen School of Library and Information Sciences Texas Center for.
Abstract Analysis and Visualization of Hydrologic Data and Observations Catalogs Using the OLAP Data Cube Technology Ilya Zaslavsky a, Matthew Rodriguez.
HydroShare: Advancing Hydrology through Collaborative Data and Model Sharing David Tarboton, Ray Idaszak, Jeffery Horsburgh, Dan Ames, Jon Goodall, Larry.
Abstract OLAP Cube Visualization of Hydrologic Data Catalogs Ilya Zaslavsky a, Matthew Rodriguez a, Bora Beran b, David Valentine a, Jillian Wallis c,
Sharing SRP Water Sample Data Using CUAHSI HIS Infrastructure Ilya Zaslavsky, Thomas Whitenack, Keith Pezzoli, Hiram Sarabia University of California at.
Distributed Data Analysis & Dissemination System (D-DADS ) Special Interest Group on Data Integration June 2000.
The CUAHSI Observations Data Model Jeff Horsburgh David Maidment, David Tarboton, Ilya Zaslavsky, Michael Piasecki, Jon Goodall, David Valentine,
Data Model / Database Implementation (continued) Jeffery S. Horsburgh Hydroinformatics Fall 2014 This work was funded by National Science Foundation Grants.
CUAHSI HIS: Science Challenges Linking small integrated research sites (
1 CLASS – Simple NOAA Archive Access Portal SNAAP Eric Kihn and Rob Prentice NGDC CLASS Developers Meeting July 14th, 2008 Simple NOAA Archive Access Portal.
Cyberinfrastructure Overview of Demos Townsville, AU 28 – 31 March 2006 CREON/GLEON.
Developing Metadata Frameworks for Earth System Education NSDL 2003 Annual Meeting October 14, 2003 Katy Ginger and Karon Kelly DLESE Program Center.
The Virtual Observatory and Ecological Informatics System (VOEIS): Using RESTful architecture and an extensible data model to provide a unique data management.
Lecture 5 Data Model Design Jeffery S. Horsburgh Hydroinformatics Fall 2012 This work was funded by National Science Foundation Grant EPS
Hydroinformatics Lecture 15: HydroServer and HydroServer Lite The CUAHSI HIS is Supported by NSF Grant# EAR CUAHSI HIS Sharing hydrologic data.
Developing a community hydrologic information system David G Tarboton David R. Maidment (PI) Ilya Zaslavsky Michael Piasecki Jon Goodall
Jeffery S. Horsburgh Hydroinformatics Fall 2014
The CUAHSI Hydrologic Information System Spatial Data Publication Platform David Tarboton, Jeff Horsburgh, David Maidment, Dan Ames, Jon Goodall, Richard.
Hydroinformatics Lecture: HydroServer .NET/PHP
Using GIS in Creating an End-to-End System for Publishing Environmental Observations Data Jeffery S. Horsburgh David G. Tarboton, David R. Maidment, Ilya.
Developing a Community Hydrologic Information System
Sharing Hydrologic Data with the CUAHSI* Hydrologic Information System
The CUAHSI Hydrologic Information System and NHD Plus A Services Oriented Architecture for Water Resources Data David G Tarboton David R. Maidment (PI)
Jeffery S. Horsburgh Utah State University
Lecture 8 Database Implementation
CUAHSI HIS Sharing hydrologic data
Hydroinformatics Lecture 15: HydroServer (and HydroServer Lite)
OpenSearch and JSON-LD for enhanced Earth observation data and service discovery Dr. Ingo Simonis Workshop on making spatial data discoverable through.
IGARSS 2019 Dr. Ingo Simonis July 2019
Presentation transcript:

Information Requirements for Integrating Spatially Discrete, Feature- Based Earth Observations Jeffery S. Horsburgh Anthony Aufdenkampe, Kerstin Lehnert, Emilio Mayorga, Leslie Hsu, Lulin Song, Ilya Zaslavsky, David Valentine Support:

Challenge Information models of current geoscience cyberinfrastructures: – Represent common information elements in inconsistent ways (e.g., people, units, measured variables, etc.) – Lack extensibility required for supporting additional data types

Given data sharing requirements from funding agencies: What information must accompany observational data for them to be archivable and discoverable within a publication system as well as interpretable once retrieved from such a system for analysis and (re)use?

Overarching Goals Create an information model (ODM2) that is integrative and extensible – Accommodating a wide range of observational data – Aimed at achieving interoperability across multiple disciplines and systems that support publication of earth observations Allow a diverse range of geoscience observations to be consistently managed, shared, discovered, accessed, and interpreted

Common Semantics for Earth Observations Observations Information Model Observations Information Model Domain Cyberinfrastructures CUAHSI HIS CUAHSI HIS EarthChem CZOData IOOS Storage Schema Storage Schema Transfer Schema Transfer Schema Metadata Catalog Schema Metadata Catalog Schema

Design Process Series of community design and prototyping workshops over the past 2 years – Scientists from multiple domains – Cyberinfrastructure experts representing multiple domains/systems Extract requirements, data use cases, test preliminary designs

Requirement: Describe Observed Feature(s)

Sampling Features Stream Gage Source: Weather Station Monitoring Site: A location established for making observations Represented as a point May have a geospatial footprint that is not a point Observation Well Specimens

Sampling Features in ODM2 From OGC’S Observations & Measurements: Sampling Feature = the entities on which or at which observations are made

Requirement: Support Diverse Data Types

Time Series Result Z X Y Fixed Sensor Position DateTemperature (Deg. C) 12/1/2014 8:00 AM /1/2014 9:00 AM /1/ :00 AM /1/ :00 AM Time Series Result Space = Fixed Time = Controlled Variable = Measured

Measurement Result Z X Y Fixed Sampling Position and Time Specimen Total phosphorus = 0.04 mg/L Total suspended solids = 10 mg/L Space = Fixed Time = Fixed Variable = Measured

Section Result Z X Y Discrete point measurements within a section Velocity = 2.5 ft/s Space = Controlled Time = Fixed or Controlled Variable = Measured

Transect Result Z X Y Measurements along a transect pH = 7.2 pH = 7.5 pH = 7.3 pH = 7.0 Space = Controlled Time = Fixed or Controlled Variable = Measured

ODM2 Core Schema + Results People and organizations Actions Results Measured variables Units Processing levels Time Series Measurement Transect... Space Time Measured Values

Transect Result ODM2 Results Attributes that are fixed Attributes that are variable or measured Measurement Result Time Series Result Section Result

ODM2 Results: Measurement Frameworks Documents how space, time, and measured variables are handled

Requirement: Support Observation Provenance

Monitoring Equipment Management Which sensors were deployed at this site? Who installed them? Which soil moisture sensor is buried at 40 cm? Has this turbidity sensor been serviced at the factory? Who programmed this datalogger? How long has that battery been deployed? What is this dissolved oxygen sensor’s calibration history? When was the last time we cleaned this sonde? What were the field conditions of our discharge measurement?

Sensor Workflows Site visits Equipment Field activities Location Date People Conditions Activity type Description Date Model Serial number Owner Vendor Manufacturer Service history Deployments Deployment type Description Dates Offsets Calibrations Method Standard Time Series Observations

Sampling Workflows Sample collection Sample splitting Sample processing Sample analysis Sample analysis actions result in observations Sample type Location / sampled feature Collection method Date People Preservation Identifiers Sampled medium Sample hierarchy Parent/child relationships Preparation method Processing method People Analytical method Instrument People Date

Actions and Results An Action is performed on or at a SamplingFeature using a Method Actions can be related to each other Some Actions produce Results Results have a Variable, Units, and a ProcessingLevel

Monitoring Equipment Management Record site information, site visits, and field activity details Store information on physical equipment Track equipment deployments, calibrations, service events

Requirement: Support Multiple Functional Use Cases

Catalog Data ServerClients Metadata Catalog Data Storage Metadata Harvesting Data Discovery Data Delivery Metadata Transfer Metadata Transfer Data Transfer Information Model Database Encoding XML Schema Encoding Legend Data and Metadata Transfer

Storage Implementation Multiple platform support Storage implementation available for multiple Relational Database Management Systems (RDBMS) Python-based software tools for multiple platforms ODM2

Summary and Status ODM2 is an information model for spatially discrete, feature-based earth observations ODM2 supports sensor and sample based data – and many other result types Integration of sensor and sample-based data in the Critical Zone Observatory Integrated Data Management System (CZOData) Implementation of ODM2 in production systems at IEDA Development of supporting software tools for more general use via BiG CZ SSI project Storage of time series and sample-based data for HydroShare

ODM2 on Available now: – Storage implementations for Microsoft SQL Server, MySQL, PostgreSQL, SQLite – Documentation and use cases for information model – Python API for database interaction Coming soon: – ODM2 data loader(s) and input templates – CUAHSI HIS WaterOneFlow web services – ODM Tools for QA/QC of sensor data – Web interface for recording field activities and sampling workflows Questions? Support: