IRIS Services Initiative Improving Data Access and Integration for the GeoSciences Linus Kamb, Joanna Muench, Tim Ahern IRIS Data Management Center.

Slides:



Advertisements
Similar presentations
GRADD: Scientific Workflows. Scientific Workflow E. Science laboris Workflows are the new rock and roll of eScience Machinery for coordinating the execution.
Advertisements

1 NASA CEOP Status & Demo CEOS WGISS-25 Sanya, China February 27, 2008 Yonsook Enloe.
Web Services at IRIS DMC Joanna Muench Linus Kamb.
MIA requirements analyis, 13/10/99 1 Introduction to the MODELS Information Architecture (MIA) and the requirements analysis study Rosemary Russell, UKOLN.
California Environmental Resources Evaluation System Environmental Information Sharing and Integration.
14 October 2003ADASS 2003 – Strasbourg1 Resource Registries for the Virtual Observatory R.Plante (NCSA), G. Greene (STScI), R. Hanisch (STScI), T. McGlynn.
Service Oriented Architecture Concepts March 27, 2006 Chris Armstrong
1 Introduction to XML. XML eXtensible implies that users define tag content Markup implies it is a coded document Language implies it is a metalanguage.
Data Grid: GRASP Mike Smorul. Grid Retrieval and Search Platform Based on concepts developed in the Earth Science Data Interface (ESDI) developed at the.
SAN DIEGO SUPERCOMPUTER CENTER Developing a CUAHSI HIS Data Node, as part of Cyberinfrastructure for the Hydrologic Sciences David Valentine Ilya Zaslavsky.
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
Apache Airavata GSOC Knowledge and Expertise Computational Resources Scientific Instruments Algorithms and Models Archived Data and Metadata Advanced.
By Tim Ahern, Program Manager IRIS DMS A “Short” Introduction to the IRIS Data Management Center Data Holdings, Data Organization, and Data Access.
By Tim Ahern, Rick Benson, Rob Casey, Chad Trabant and Bruce Weertman and many more talented people at the IRIS DMC.
The GeoConnections Discovery Portal Michael Robson MacDonald Dettwiler and Associates Brian McLeod, Michael Adair Natural Resources Canada.
GEON Science Application Demos
By Tim Ahern and Chad Trabant.  Federated Services in Seismology (COOPEUS)  Standardized access to seismological Data Centers resulting in federated.
Web Services: a Mechanism for Across-the-Internet On Demand Computing and Communication DMS Workshop Stevenson, WA Wed 08 June 2005 What are Web Services,
CYBERINFRASTRUCTURE FOR THE GEOSCIENCES High Performance Computing applications in GEON: From Design to Production Dogan Seber.
Accessing Data Using Web Services. IRIS Services – service.iris.edu FDSN Web services dataselect station event Documentation IRIS web services fedcatalog.
International Telecommunication Union Geneva, 9(pm)-10 February 2009 ITU-T Security Standardization on Mobile Web Services Lee, Jae Seung Special Fellow,
Dec 9-11, 2003ICADL Challenges in Building Federation Services over Harvested Metadata Hesham Anan, Jianfeng Tang, Kurt Maly, Michael Nelson, Mohammad.
Accessing Data through Web Services. IRIS Services – service.iris.edu  FDSN Web services  dataselect  station  event  Documentation Documentation.
Web Services at IRIS Implementations, Directions, and International Coordination Tim Ahern, Director of Data Services, IRIS Web Services Team: Bruce Weertman,
Metadata and Geographical Information Systems Adrian Moss KINDS project, Manchester Metropolitan University, UK
FDSN WG III Coordination of Products, Tools and Services.
Chad Berkley NCEAS National Center for Ecological Analysis and Synthesis (NCEAS), University of California Santa Barbara Long Term Ecological Research.
Archivists' Toolkit - CDL Presentation, October 17, 2005 The Archivists’ Toolkit Lee Mandell Brad Westbrook.
Application of Provenance for Automated and Research Driven Workflows Tara Gibson June 17, 2008.
Web Services Based on SOA: Concepts, Technology, Design by Thomas Erl MIS 181.9: Service Oriented Architecture 2 nd Semester,
The Digital Library for Earth System Science: Contributing resources and collections Meeting with GLOBE 5/29/03 Holly Devaul.
By Tim Ahern, Program Manager IRIS DMS A “Short” Introduction to the IRIS Data Management Center Data Holdings, Data Organization, and Data Access.
IT at the IRIS DMC: Synergy with the CIG By Tim Ahern, IRIS DMS Program Manager By Tim Ahern, IRIS DMS Program Manager.
Where to find LiDAR: Online Data Resources.
AUTHORS: MIKE P. PAPAZOGLOU WILLEM-JAN VAN DEN HEUVEL PRESENTED BY: MARGARETA VAMOS Service oriented architectures: approaches, technologies and research.
Federated Discovery and Access in Astronomy Robert Hanisch (NIST), Ray Plante (NCSA)
ResEau: A Water Portal SensorWeb Implementation National Information Strategies Division Strategic Information Integration Directorate Environment Canada.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
Service Service metadata what Service is who responsible for service constraints service creation service maintenance service deployment rules rules processing.
The Digital Library for Earth System Science: Contributing resources and collections GCCS Internship Orientation Holly Devaul 19 June 2003.
Kepler includes contributors from GEON, SEEK, SDM Center and Ptolemy II, supported by NSF ITRs (SEEK), EAR (GEON), DOE DE-FC02-01ER25486.
Tim Ahern Non Real Time SEED Request Tools. Workshop Representation Europe – ORFEUS Germany – Geofon United States - IRIS FDSN Centers with Significant.
SIG: Synthetic Seismogram Exchange Standards (formats & metadata) Is it time to establish exchange standards for synthetic seismograms? IRIS Annual Workshop.
Mercury – A Service Oriented Web-based system for finding and retrieving Biogeochemical, Ecological and other land- based data National Aeronautics and.
©2012 LIESMARS Wuhan University Building Integrated Cyberinfrastructure for GIScience through Geospatial Service Web Jianya Gong, Tong Zhang, Huayi Wu.
Independent Insight for Service Oriented Practice Summary: Service Reference Architecture and Planning David Sprott.
Oct 12-14, 2003NSDL Challenges in Building Federation Services over Harvested Metadata Kurt Maly, Michael Nelson, Mohammad Zubair Digital Library.
EO Dataset Preservation Workflow Data Stewardship Interest Group WGISS-37 Meeting Cocoa Beach (Florida-US) - April 14-18, 2014.
Providing web services to mobile users: The architecture design of an m-service portal Minder Chen - Dongsong Zhang - Lina Zhou Presented by: Juan M. Cubillos.
HNDIT Rapid Application Development
Web Services Architecture Presentation for ECE8813 Spring 2003 By: Mohamed Mansour.
The Research Data Archive at NCAR: A System Designed to Handle Diverse Datasets Bob Dattore and Steven Worley National Center for Atmospheric Research.
Click to edit Master title style Click to edit Master text styles –Second level Third level –Fourth level »Fifth level 1 CustomerSoft ESP Contact Operations.
Global Change Master Directory (GCMD) Mission “To assist the scientific community in the discovery of Earth science data, related services, and ancillary.
National Geospatial Enterprise Architecture N S D I National Spatial Data Infrastructure An Architectural Process Overview Presented by Eliot Christian.
By Tim Ahern Program Manager IRIS Data Management System Interoperability Developments at IRIS.
Tim Ahern IRIS Director of Data Services Active Source Data Management Workshop January 2014 – Tucson, Arizona.
Introduction to Service Orientation MIS 181.9: Service Oriented Architecture 2 nd Semester,
1 2.5 DISTRIBUTED DATA INTEGRATION WTF-CEOP (WGISS Test Facility for CEOP) May 2007 Yonsook Enloe (NASA/SGT) Chris Lynnes (NASA)
GEOSS Common Infrastructure (GCI) The GEOSS Common Infrastructure allows Earth Observations users to search, access and use the data, information, tools.
Software Architecture Patterns (3) Service Oriented & Web Oriented Architecture source: microsoft.
A brief introduction to NERA – NA3 work package ‘Networking accelerometric networks and strong- motion data users’ Sinan Akkar On behalf of entire NERA-NA3.
The CUAHSI Hydrologic Information System Spatial Data Publication Platform David Tarboton, Jeff Horsburgh, David Maidment, Dan Ames, Jon Goodall, Richard.
Sharing Hydrologic Data with the CUAHSI* Hydrologic Information System
The Web Service based approach for data distribution at the IRIS DMC
Service-centric Software Engineering
Growing importance of metadata for synthetics: Calculating and Sharing Synthetic Seismic Data Dogan Seber University of California, San Diego San Diego.
WGISS Connected Data Assets Oct 24, 2018 Yonsook Enloe
4/5 May 2009 The Palazzo dei Congressi di Stresa Stresa, Italy
Robert Dattore and Steven Worley
Presentation transcript:

IRIS Services Initiative Improving Data Access and Integration for the GeoSciences Linus Kamb, Joanna Muench, Tim Ahern IRIS Data Management Center

1 About 1100 stations in real time Nearly 50TB of seismic data Growing currently at ~9TB / year EarthScope contribution raises to ~20TB / year Station and instrument metadata

2 Historical Access Methods Request methods – requests BREQ_FAST NetDC –Web-based request tools WILBER, BUD tools Delivery methods –Tapes –FTP

3 DHI CORBA-based system Available since 2001 Standard data access interfaces Core services: –Network (metadata) server –Event (earthquake info) server –Data (waveform) server

4 DHI Implementations Server implementations at: –IRIS, South Carolina, CalTech, Berkeley, Orfeus, Geofon Example client applications: –Vase, JWeed, SOSA, GEE, SOD –SAC, Matlab, GEON SynSeis –EarthMotionMonitor

5 JWeed

6 DHI 2.0

7 New Directions for IRIS Mandate to provide data to broader geosciences community Provide access to data and data products through web services Expand range of services provided –Computational workflows –Added value services

8 IRIS Services Initiative Develop a Service Oriented Architecture to complement and enhance core access services Internally and externally available components Components include: –data access –pre- and post-processing, filters, transformations –plotting and mapping Move some standard computation to the data Provide access methods appropriate to a wider variety of users Get useful and usable information to the end user

9 Characteristics of SOA Services have contracts Provides information about itself Establishes agreement between provider and requestor Services are loosely coupled Can operate together or independently Changes to one implementation should not break another Services are composable Multiple services can be linked together as workflows Implies contracts are compatible eg. raw data seismogram = processed seismogram

10 Current and Planned Services SOA Registry

11 Workflows Structure and order of a series of tasks Movement of data inputs and outputs through computational steps Composed of service components –Must be logical composition Can be expressed, saved, revised, and re-executed

12 Record Section Plot

13 Workflow Example

14 Workflow Example

15 Workflow Example

16 Workflow Example

17 Workflow Example

18 Workflow Example

19 SPADE Searchable Product Archive and Discovery Engine Archive arbitrary XML data products –Hypocenters, CMTs, historic data, PGV maps, etc. –As yet unknown data products Interface to search by product-specific metadata Query across products by common fields –Geospatial, Time, Other (eg., Dublin Core, keywords,... )

20 SPADE Overview

21 Query - Select Product

22 Query - Enter Filters

23 Query - Results

24 Query - Common Metadata

25 Query - Results

26 IRIS Services Architecture Core data access services Enhanced data tools Wider range of products and services Enable scientific workflows Increased value and service to the broader geosciences community

27 Challenges Service –Description, Registration, Discovery Process composition and orchestration –Data management –Value extraction Data type coordination –Controlled vocabularies Interface-level independence

28 Community Value Improve quality and maintainability of IRIS core services Enable customization of user experience Integrate into other organizations’ computational programs through improved accessibility to IRIS data and products Support a broader geosciences services architecture

29

30 Tomographic Visualization MIDSEA project Van der Lee, et al 3D Reference Earth Model Laske, Masters