The Virtual Observatory and Ecological Informatics System (VOEIS): Using RESTful architecture and an extensible data model to provide a unique data management.

Slides:



Advertisements
Similar presentations
A REST-ful Web Services Approach to Library Federated Search using SRU Kevin Reiss Rutgers-Newark Law Library CALI 2005 – June 11th.
Advertisements

ASCR Data Science Centers Infrastructure Demonstration S. Canon, N. Desai, M. Ernst, K. Kleese-Van Dam, G. Shipman, B. Tierney.
Geospatial One-Stop A Federal Gateway to Federal, State & Local Geographic Data
A. Grigorov, A. Georgiev, M. Petrov, S. Varbanov, K. Stefanov Building a Knowledge Repository for Life-long Competence Development.
Hydra Partners Meeting March 2012 Bill Branan DuraCloud Technical Lead.
Jennifer A. Dunne Santa Fe Institute Pacific Ecoinformatics & Computational Ecology Lab Rich William, Neo Martinez, et al. Challenges.
1 Introduction to XML. XML eXtensible implies that users define tag content Markup implies it is a coded document Language implies it is a metalanguage.
1 Archiving Workflow between a Local Repository and the National Library Archive Experiences from the DiVA Project Eva Müller, Peter Hansson, Uwe Klosa,
Caro-COOPS Data Management: Metadata. Cast-Net addresses the need for improved connectivity among coastal observing systems by creating a regional framework.
PAWN: A Novel Ingestion Workflow Technology for Digital Preservation
Integrating Historical and Realtime Monitoring Data into an Internet Based Watershed Information System for the Bear River Basin Jeff Horsburgh David Stevens,
1 BrainWave Biosolutions Limited Accelerating Life Science Research through Technology.
BIOCMS: Resource Integration and Web Application Framework for Bioinformatics DHUNDY R BASTOLA †, *, ANIL KHADKA †, MOHAMMAD SHAFIULLAH † AND HESHAM ALI.
Annual SERC Research Review - Student Presentation, October 5-6, Extending Model Based System Engineering to Utilize 3D Virtual Environments Peter.
Discussion and conclusion The OGC SOS describes a global standard for storing and recalling sensor data and the associated metadata. The standard covers.
Information Requirements for Integrating Spatially Discrete, Feature- Based Earth Observations Jeffery S. Horsburgh Anthony Aufdenkampe, Kerstin Lehnert,
DATA COMMUNICATION DONE BY: ALVIN SAMPATH CARLVIN SAMPATH.
CI Days: Planning Your Campus Cyberinfrastructure Strategy Russ Hobby, Internet2 Internet2 Member Meeting 9 October 2007.
Refactoring the EarthGrid SOAP API to REST style and implementing it to Metacat Serhan Akın Ph.D. candidate in Earth System Sciences Institute of Earth.
Project Builder and MediaMatrix: Redefining Access in the Digital Age Dean Rehberger and Michael Fegan MERLOT August 7-10, 2006 New Orleans, LA.
Presenting Statistical Data Using XML Office for National Statistics, United Kingdom Rob Hawkins, Application Development.
IUScholarWorks is a set of services to make the work of IU scholars freely available. Allows IU departments, institutes, centers and research units to.
material assembled from the web pages at
LAKEVIEWS A Brief Introduction.... Federal/Provincial agreement guided by vision of a “healthy, prosperous, & sustainable Great Lakes Ecosystem” for present.
Indo-US Workshop, June23-25, 2003 Building Digital Libraries for Communities using Kepler Framework M. Zubair Old Dominion University.
The Network Performance Advisor J. W. Ferguson NLANR/DAST & NCSA.
IPlant cyberifrastructure to support ecological modeling Presented at the Species Distribution Modeling Group at the American Museum of Natural History.
What is Cyberinfrastructure? Russ Hobby, Internet2 Clemson University CI Days 20 May 2008.
The Future of the iPlant Cyberinfrastructure: Coming Attractions.
GEM Portal and SERVOGrid for Earthquake Science PTLIU Laboratory for Community Grids Geoffrey Fox, Marlon Pierce Computer Science, Informatics, Physics.
1 Geospatial and Business Intelligence Jean-Sébastien Turcotte Executive VP San Francisco - April 2007 Streamlining web mapping applications.
DataNet – Flexible Metadata Overlay over File Resources Daniel Harężlak 1, Marek Kasztelnik 1, Maciej Pawlik 1, Bartosz Wilk 1, Marian Bubak 1,2 1 ACC.
Experts Workshop on the IPT, v. 2, Copenhagen, Denmark The Pathway to the Integrated Publishing Toolkit version 2 Tim Robertson Systems Architect Global.
2007. Software Engineering Laboratory, School of Computer Science S E Web-Harvest Web-Harvest: Open Source Web Data Extraction tool 이재정 Software Engineering.
1 Computing Challenges for the Square Kilometre Array Mathai Joseph & Harrick Vin Tata Research Development & Design Centre Pune, India CHEP Mumbai 16.
This presentation describes the development and implementation of WSU Research Exchange, a permanent digital repository system that is being, adding WSU.
Crystal Grid Reciprocal Net XPort Crystal Grid Framework Chemical Informatics and Cyberinfrastructure Collaboratory The Crystal Grid A joint project.
Cyberinfrastructure What is it? Russ Hobby Internet2 Joint Techs, 18 July 2007.
The Global Land Cover Facility is sponsored by NASA and the University of Maryland.The GLCF is a founding member of the Federation of Earth Science Information.
The US Long Term Ecological Research (LTER) Network: Site and Network Level Information Management Kristin Vanderbilt Department of Biology University.
NOVA A Networked Object-Based EnVironment for Analysis “Framework Components for Distributed Computing” Pavel Nevski, Sasha Vanyashin, Torre Wenaus US.
CSCE 315 – Programming Studio Spring Goal: Reuse and Sharing Many times we would like to reuse the same process or data for different purpose Want.
7. Grid Computing Systems and Resource Management
U.S. Department of the Interior U.S. Geological Survey Decision Support Tools and USGS Data Management Best Practices Cassandra Ladino USGS Chesapeake.
Cyberinfrastructure Overview Russ Hobby, Internet2 ECSU CI Days 4 January 2008.
Cyberinfrastructure: Many Things to Many People Russ Hobby Program Manager Internet2.
Earth System Curator and Model Metadata Discovery and Display for CMIP5 Sylvia Murphy and Cecelia Deluca (NOAA/CIRES) Hannah Wilcox (NCAR/CISL) Metafor.
Fire Emissions Network Sept. 4, 2002 A white paper for the development of a NSF Digital Government Program proposal Stefan Falke Washington University.
5/19/05 New Geoscience Applications 1 A DISTRIBUTED WORKFLOW DATABASE DESIGNED FOR COREWALL APPLICATIONS Bill KampBill Kamp, Lumnilogical Research Center,
July 19, 2004Joint Techs – Columbus, OH Network Performance Advisor Tanya M. Brethour NLANR/DAST.
Cyberinfrastructure Overview of Demos Townsville, AU 28 – 31 March 2006 CREON/GLEON.
Hydroinformatics Lecture 15: HydroServer and HydroServer Lite The CUAHSI HIS is Supported by NSF Grant# EAR CUAHSI HIS Sharing hydrologic data.
Store and exchange data with colleagues and team Synchronize multiple versions of data Ensure automatic desktop synchronization of large files B2DROP is.
CONTENTdm A proven solution September A complete digital collection management software solution Stores, manages and provides access for all digital.
Lifemapper 2.0 Using and Creating Geospatial Data and Open Source Tools for the Biological Community Aimee Stewart, CJ Grady, Dave Vieglais, Jim Beach.
The CUAHSI Hydrologic Information System Spatial Data Publication Platform David Tarboton, Jeff Horsburgh, David Maidment, Dan Ames, Jon Goodall, Richard.
Chapter 8 Environments, Alternatives, and Decisions.
Integration of Mobile GIS Technologies in the West Virginia Department of Environmental Protection Bond Forfeiture Program Sarah Clapham and Yueming.
Jeffery S. Horsburgh Utah State University
REST: Web Services Abel Sanchez.
Lecture 8 Database Implementation
Joseph JaJa, Mike Smorul, and Sangchul Song
CUAHSI HIS Sharing hydrologic data
Distributed Storage in Automated Data Transfer
Accelerate Your Self-Service Data Analytics
Staying afloat in the sensor data deluge
An ecosystem of contributions
Middleware, Services, etc.
DBOS DecisionBrain Optimization Server
Refactoring Meteorology's Online Weather Center Software Suite
Presentation transcript:

The Virtual Observatory and Ecological Informatics System (VOEIS): Using RESTful architecture and an extensible data model to provide a unique data management solution. Seth J.K. Mason 12, Sean B. Cleveland 2, Pol Llovet 2, Clemente Izurieta 2, Geoffrey C. Poole Department of Computer Sciences, Montana State University, Bozeman, MT 3. Department of Land Resources and Environmental Sciences, Montana State University, Bozeman, MT, Database Schema Project Summary The Virtual Observatory and Ecological Informatics System (VOEIS) intends to provide scientists and data managers with an end-to-end management solution for a wide variety of environmental data types. The system currently provides a framework for data acquisition, quality assurance/control, visualization, and provenance tracking of temporally and spatially located data. Stand-alone Java applications allow users to automatically push real-time sensor network data to VOEIS, or to publish data housed in VOEIS to a HydroServer. VOEIS is built upon a unique and extensible data model, providing an avenue for future support of new data types with unique metadata requirements, while minimizing impacts of such additions to the existing software and user-interfaces. Initially, the data model supports: 1) field observations, 2) samples, 3) simulation results, and 4) derived values. The VOEIS architecture supports Representational State Transfer (REST) methods for each data model object. This allows users to fully integrate VOEIS into existing workflows for automated data retrieval and archiving, data publication, data visualization, or simulation modeling. Furthermore, REST methods provide straightforward access to the VOEIS architecture for those users that require custom user interfaces. VOEIS is an open-source Yogo Data Management Application built with Ruby on Rails® on a PostgresSQL backend. Visit voeis.org for more information. A preview release of the software may be accessed at: RESTful Web Service Client/Browser User Interface API Layer and REST Controller User Request for Resources (URI, Format, Method) Resource/Data Formatting and Output Software Interface to PostgresSQL Backend REST is a popular software architecture style that simplifies the sharing of data on the web. REST methods make data available over the internet by mapping site URLs to data. VOEIS provides a full set of REST methods (RETRIEVE, REPLACE, CREATE, and DESTROY) for each database object. This allows users to easily create new tools, user-interfaces, or applications that work with the data stored in the VOEIS server. Acknowledgements Significance Software Features Simple Data Upload Template Creation Project Based Data Storage and Management QAQC Tools Data Versioning and Roll-Back Complex Data Visualization Data Publication Provenance Tracking Simulation Model Support Highly-Granular User Access Controls HydroServer Publication Gateway Scientific Workflow Integration Ready HTML JSON XML URL This project is generously funded by the National Science Foundation’s (NSF) Experimental Program to Stimulate Competitive Research (EPSCoR), a capacity building program to enhance researchers’ and institutions’ ability to compete for federal research funds. This project is supported jointly by funding from EPSCoR programs in Montana and Kentucky. Researchers collect and analyze a wide variety of environmental data types, each with unique unique formatting and metadata requirements. This data diversity frequently creates a significant barrier to selection and use of simple data management solutions. Thus, many researchers find themselves utilizing multiple data management systems (each requiring some amount of training for proper use), or simply relying on raw data files for all archiving and analysis needs. In recognition of the significant shortcomings of the latter approach to data management, NSF now requires funded researchers to implement data management plans. VOEIS fills this need, providing a breadth of data management features for multiple environmental data types, while simultaneously minimizing the training time required of researchers and lab group members for effective use of the software. VOEIS can be easily integrated into existing data management systems as a robust archive. Alternatively, users may select to use the VOEIS software suite as an end-to-end management solution supporting data archiving, discovery, QAQC, and publication.