Sharing models as social objects through HydroShare

Slides:



Advertisements
Similar presentations
Improving Learning Object Description Mechanisms to Support an Integrated Framework for Ubiquitous Learning Scenarios María Felisa Verdejo Carlos Celorrio.
Advertisements

ICEWATER: INRA Constellation of Experimental Watersheds Cyberinfrastructure to Support Publication of Water Resources Data Jeffery S. Horsburgh, Utah State.
MITK Diffusion (under the hood)
Venkatesh Merwade, Purdue University
ODM2: Developing a Community Information Model and Supporting Software to Extend Interoperability of Sensor and Sample Based Earth Observations Jeffery.
The MashMyData project Combining and comparing environmental science data on the web Alastair Gemmell 1, Jon Blower 1, Keith Haines 1, Stephen Pascoe 2,
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
Discussion and conclusion The OGC SOS describes a global standard for storing and recalling sensor data and the associated metadata. The standard covers.
HydroShare: Advancing Hydrology through Collaborative Data and Model Sharing David Tarboton, Ray Idaszak, Jeffery Horsburgh, Dan Ames, Jon Goodall, Larry.
Advances in Technology and CRIS Nikos Houssos National Documentation Centre / National Hellenic Research Foundation, Greece euroCRIS Task Group Leader.
Information Requirements for Integrating Spatially Discrete, Feature- Based Earth Observations Jeffery S. Horsburgh Anthony Aufdenkampe, Kerstin Lehnert,
Impact Activities LOG View over some option for the capture of Impact activities.
HydroShare: An online collaborative environment for the sharing of hydrologic data and models IN11A-1510 We envision that HydroShare will enable more rapid.
ARGONNE  CHICAGO Ian Foster Discussion Points l Maintaining the right balance between research and development l Maintaining focus vs. accepting broader.
The Data Grid: Towards an Architecture for the Distributed Management and Analysis of Large Scientific Dataset Caitlin Minteer & Kelly Clynes.
Introduction to Apache OODT Yang Li Mar 9, What is OODT Object Oriented Data Technology Science data management Archiving Systems that span scientific.
Metadata and Geographical Information Systems Adrian Moss KINDS project, Manchester Metropolitan University, UK
Use of Hierarchical Keywords for Easy Data Management on HUBzero HUBbub Conference 2013 September 6 th, 2013 Gaurav Nanda, Jonathan Tan, Peter Auyeung,
Delivering business value through Context Driven Content Management Karsten Fogh Ho-Lanng, CTO.
Selected Topics in Software Engineering - Distributed Software Development.
ANDS and its Services Phenomics Data & Informatics Workshop 2010, Friday, 23rd April 2010.
1 Metadata –Information about information – Different objects, different forms – e.g. Library catalogue record Property:Value: Author Ian Beardwell Publisher.
Ames Research CenterDivision 1 Information Power Grid (IPG) Overview Anthony Lisotta Computer Sciences Corporation NASA Ames May 2,
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
HydroShare: Advancing Hydrology through Collaborative Data and Model Sharing David Tarboton, Ray Idaszak, Jeffery Horsburgh, Dan Ames, Jon Goodall, Larry.
SDMX IT Tools Introduction
Biodiversity Data Exchange Using PRAGMA Cloud Umashanthi Pavalanathan, Aimee Stewart, Reed Beaman, Shahir Shamsir C. J. Grady, Beth Plale Mount Kinabalu.
AN ORGANISATION FOR A NATIONAL EARTH SCIENCE INFRASTRUCTURE PROGRAM Virtual Geophysics Laboratory (VGL): Scientific workflows Exploiting the Cloud Josh.
The Data Documentation Initiative (DDI) Fostering Community Engagement and Adoption Breakout 9 RDA Sixth Plenary, Paris Mary Vardigan, ICPSR, University.
HydroShare: Advancing Hydrology through Collaborative Data and Model Sharing David Tarboton, Ray Idaszak, Jeffery Horsburgh, Dan Ames, Jon Goodall, Larry.
Earth System Curator and Model Metadata Discovery and Display for CMIP5 Sylvia Murphy and Cecelia Deluca (NOAA/CIRES) Hannah Wilcox (NCAR/CISL) Metafor.
Fire Emissions Network Sept. 4, 2002 A white paper for the development of a NSF Digital Government Program proposal Stefan Falke Washington University.
Mike Hildreth DASPOS Update Mike Hildreth representing the DASPOS project 1.
A Portrait of the Semantic Web in Action Jeff Heflin and James Hendler IEEE Intelligent Systems December 6, 2010 Hyewon Lim.
CONVERSION OF CAD DATA TO GIS LAYERS Challenges and Techniques Compiled by: Tope Bello Summer 2005 Instructor POEC 6387 GIS Workshop Professor Ronald Briggs.
CHC-R 7 th Annual Meeting April 23, 2015 Research Lead  The University of North Carolina at Chapel Hill.
Semantics in Web Service Composition for Risk Management Michael Lutz European Commission – DG Joint Research Centre Ispra, Italy EcoTerm IV, Vienna,
HydroShare: Advancing Hydrology through Collaborative Data and Model Sharing David Tarboton, Ray Idaszak, Jeffery Horsburgh, Dan Ames, Jon Goodall, Larry.
The Virtual Observatory and Ecological Informatics System (VOEIS): Using RESTful architecture and an extensible data model to provide a unique data management.
Get Data to Computation eudat.eu/b2stage B2STAGE How to shift large amounts of data Version 4 February 2016 This work is licensed under the.
1 The XMSF Profile Overlay to the FEDEP Dr. Katherine L. Morse, SAIC Mr. Robert Lutz, JHU APL
The CUAHSI Hydrologic Information System Spatial Data Publication Platform David Tarboton, Jeff Horsburgh, David Maidment, Dan Ames, Jon Goodall, Richard.
European Monitoring Platform for Mapping of QoS and QoE
GeoNetwork OpenSource: Geographic data sharing for everyone
Introduction to HydroShare Workshop CUAHSI Biennial Symposium, July 26
Dwane Young, U.S. EPA Office of Water
Semblog Project Personal Information Distribution with Social Network
Discovering and accessing data from a distributed network of data centres S. Mazzeo (ESA)
What is the National Data Service?
Challenges with Maintaining Legacy Software to Achieve Reproducible Computational Analyses: An Example for Hydrologic Modeling Data Processing Pipelines.
Model Sharing and Collaboration using HydroShare
Heinrich Widmann EUDAT & CKAN Heinrich Widmann
VI-SEEM Data Repository
EPANET-MATLAB Toolkit An Open-Source Software for Interfacing EPANET with MATLAB™ Demetrios ELIADES, Marios KYRIAKOU, Stelios VRACHIMIS and Marios POLYCARPOU.
Rui Wu, Jose Painumkal, Sergiu M. Dascalu, Frederick C. Harris, Jr
Component-Based Software Engineering
EUDAT B2FIND A Cross-Discipline Metadata Service and Discovery Portal
The JISC IE Metadata Schema Registry
An ecosystem of contributions
Geospatial and Problem Specific Semantics Danielle Forsyth, CEO and Co-Founder Thetus Corporation 20 June, 2006.
Hydrographic Data as a Service
BUILDING A DIGITAL REPOSITORY FOR LEARNING RESOURCES
About Thetus Thetus develops knowledge discovery and modeling infrastructure software for customers who: Have high value data that does not neatly fit.
DATATURB Direct simulation data of turbulent flows
Metadata Development in the Earth System Curator
Big DATA.
Brokering as a Core Element of EarthCube’s Cyberinfrastructure
OAC OAC OAC ACI ACI The HydroShare domain-specific repository for archiving and active management.
Palestinian Central Bureau of Statistics
Implementation Plan system integration required for each iteration
Presentation transcript:

Sharing models as social objects through HydroShare Jonathan L. Goodalla, Mohamed M. Morsya , Anthony M. Castronovab, Pabitra Dashc, Venkatesh Merwaded, Jeffrey M. Sadlera, Jeffery Horsburghc, and David G. Tarbotonc aUniversity of Virginia, Charlottesville, VA bCUAHSI, Medford, MA cUtah State University, Logan, UT dPurdue University, West Lafayette, IN

It is time consuming and complicated to build hydrologic models Introduction It is time consuming and complicated to build hydrologic models Improved methods and tools for sharing these models with appropriate metadata are needed to … foster reproducibility of other’s work encourage reuse and extensions of models A challenge is how to achieve model sharing given the diversity of hydrologic models. 2 models gear shift to model share

Why metadata framework for describing and sharing models are needed? We have reached a point of complexity that necessitates methods and tools for organizing existing resources. Think of not just the software required to execute models, but also the many model applications that have been performed using these model software. http://www.homeworkshop.com/ http://www.boem.gov/Library/ A metadata framework is required to support discovery, sharing, access and reuse of the model and its associated datasets.

HydroShare HydroShare is a web-based collaborative system with the goal of: sharing accessing discovering The metadata framework developed here is being used for sharing model resources within HydroShare, but could have other applications too. hydrologic data and models

Examples of efforts done to develop a Earth science model metadata CSDMS developed certain metadata for several Earth surface dynamics model programs. es-doc developed tools to describe Earth system models. These tools are based on the Common Information Model (CIM) standard. CIM is a metadata standard specific to describing Earth system models.

System design Model concepts and relationship In this work, a computational model is represented as two key concepts: model program: the software for executing a model simulation and generating outputs. model instance: the input files required to execute a specific model program. A model instance is executed by a model program.

System design Model resources metadata analysis Model Program

Allow for additional model specific metadata fields System design Model resources metadata analysis Model Instances Can be implemented by ANY model instance Allow for additional model specific metadata fields

System design Model resources metadata analysis Generic Model Instance

System design Model resources metadata analysis SWAT model instance

Example Use Case We completed a model-based study of an urban watershed in Columbia, SC The study focused on distributed LID stormwater infrastructure as a flood mitigation strategy and the study was published in the Journal of Hydrologic Engineering. We wish to share the model instances created through our study through HydroShare. This will allow others to more easily verify, repeat, and expand on our study.

Example Use Case Step 1: Identify HydroShare Resources

Example use case Step 2: Create New Resources in HydroShare Modeling resources available on www.hydroshare.org

Model program specific metadata page in edit mode Example use case Step 3: Enter metadata for new Model Program resource A model program resource stores the software for the specific version of SWMM used in the study. Only need to complete this step if the model program resource is not already within HydroShare Model program specific metadata page in edit mode

Example use case Step 4: Enter metadata for new Model Instance resources Only these two additional metadata fields (beyond Dublin Core) are required for a Generic Model Instance Model instance specific metadata page in edit mode

Example use case Step 4: Enter metadata for new Model Instance resources A Model Instance resource can have spatial and temporal coverage metadata as defined in Dublin Core Model instance coverage metadata page in edit mode

Metadata Capture

Metadata Capture

Model Instance for Rocky Branch simulation Metadata Capture Model Instance for Rocky Branch simulation Morsy, M. (2015). Rocky Branch watershed simulation, HydroShare, http://www.hydroshare.org/resource/12d195906f2c41918cb24e11a5c3ab60

Metadata Capture

Metadata Capture

Model Program for EPA-SWMM 5 Metadata Capture Model Program for EPA-SWMM 5 Rossman, L., T. Schade, D. Sullivan, R. Dickinson, C. Chan, E. Burgess (2016). Storm Water Management Model (SWMM), Version 5.1.010 with Low Impact Development (LID) Controls, http://www2.epa.gov/water-research/storm-water-management-model-swmm, accessed 6/2/2016, replicated in HydroShare at:http://www.hydroshare.org/resource/2cddae40e9594c21b947fdbbe4225439

Metadata Capture

Metadata Capture

Metadata Capture Executed By relation to link the Model Instance with the Model Program used for execution

SWAT model instances can be shared with the 3rd party SWATShare HydroShare to SWATShare

Metadata is compatibility between HydroShare and SWATShare

Summary We present a model metadata framework for general to specific model metadata capture to support the wide range of models used within the hydrology community. The metadata framework is built from general standards including RDF, Dublin Core, and BagIt that allows the resources to be more easily shared within and outside of the discipline. We show how having standard resource descriptions enables interoperability between cyberinfrastructure systems (e.g., HydroShare and SWATShare). Providing the right balance between minimal and rich metadata is a challenge and will require an iterative process.

Next steps New functionality to automate metadata extraction when a resource is uploaded. Expanding metadata framework for more specific model instance resource types. Ideally allow 3rd party developers an easy path for adding their own specific model instance resource types. Providing server-side execution of model instances directly through the HydroShare user interface and potentially through the HydroShare API.

Thank You Contact info: Jon Goodall, goodall@viriginia.edu Associate Professor Department of Civil and Environmental Engineering Department of Computer Science, by courtesy University of Virginia, USA