Indiana University QuakeSim Activities Marlon Pierce, Geoffrey Fox, Xiaoming Gao, Jun Ji, Chao Sun.

Slides:



Advertisements
Similar presentations
Wrapping Scientific Applications as Web Services Gopi Kandaswamy (RENCI) Marlon Pierce (IU)
Advertisements

Supporting Cloud Computing with the Virtual Block Store System Xiaoming Gao, Mike Lowe,
E-DECIDER: QuakeSim Tools and Products Marlon Pierce, Co-Investigator Margaret Glasscoe, PI
IU QuakeSim Updates Co-PIs: Marlon Pierce, Geoffrey Fox Students and Staff: Xiaoming Gao, Jun Ji, Jun Wang, Marie Ma, Josh Rosen.
QuakeSim Science Gateway: ACES Update Marlon Pierce, Jun Wang, Yu Ma, Jun Ji, Xiaoming Gao, Geoffrey Fox Indiana University.
IU QuakeSim Annual Report Slides. IU People Geoffrey Fox and Marlon Pierce are Co-PIs at IU. Xiaoming Gao: graduate student, developer of the RDAHMM-
E-DECIDER Workshop: QuakeSim Tools and Products Marlon Pierce Indiana University.
VxWorks Real-Time Kernel Connectivity
Student Visits August Geoffrey Fox
INTRODUCTION TO CLOUD COMPUTING CS 595 LECTURE 4.
Presented by Sujit Tilak. Evolution of Client/Server Architecture Clients & Server on different computer systems Local Area Network for Server and Client.
Operating Systems Concepts 1. A Computer Model An operating system has to deal with the fact that a computer is made up of a CPU, random access memory.
Google App Engine and Java Application: Clustering Internet search results for a person Aleksandar Kartelj Faculty of Mathematics,
Cloud Computing Systems Lin Gu Hong Kong University of Science and Technology Sept. 21, 2011 Windows Azure—Overview.
Osama Shahid ( ) Vishal ( ) BSCS-5B
Utility Computing Casey Rathbone 1http://cyberaide.org.edu.
A Brief Overview by Aditya Dutt March 18 th ’ Aditya Inc.
IT 210 The Internet & World Wide Web introduction.
Integrating Geographical Information Systems and Grid Applications Marlon Pierce Contributions: Yili Gong,
Cloud Computing for the Enterprise November 18th, This work is licensed under a Creative Commons.
Cloud based storage. Cloud Storage Storage accessed by a web service API It is a block storage, it exposes its storage to clients as Raw storage that.
INTRODUCTION TO CLOUD COMPUTING CS 595 LECTURE 7 2/23/2015.
 Cloud computing  Workflow  Workflow lifecycle  Workflow design  Workflow tools : xcp, eucalyptus, open nebula.
SALSASALSASALSASALSA AOGS, Singapore, August 11-14, 2009 Geoffrey Fox 1,2 and Marlon Pierce 1
Application Web Service Toolkit Geoffrey Fox, Marlon Pierce, Ozgur Balsoy Indiana University July
Cloud Computing. What is Cloud Computing? Cloud computing is a model for enabling convenient, on-demand network access to a shared pool of configurable.
Future Grid Future Grid User Portal Marlon Pierce Indiana University.
Web 2.0: Concepts and Applications 6 Linking Data.
Software Architecture
Cloud Architecture for Earthquake Science 7 th ACES International Workshop 6th October 2010 Grand Park Otaru Otaru Japan Geoffrey Fox
IU QuakeSim/E-DECIDER Effort. QuakeSim Accomplishments (1) Deployed, improved many QuakeSim gadgets for standalone integration into QuakeSim.org – Disloc,
Cloud Computing & Amazon Web Services – EC2 Arpita Patel Software Engineer.
Presented by: Sanketh Beerabbi University of Central Florida COP Cloud Computing.
CSE 548 Advanced Computer Network Security Document Search in MobiCloud using Hadoop Framework Sayan Cole Jaya Chakladar Group No: 1.
QuakeSim Work: Web Services, Portlets, Real Time Data Services Marlon Pierce Contributions: Ahmet Sayar,
GEM Portal and SERVOGrid for Earthquake Science PTLIU Laboratory for Community Grids Geoffrey Fox, Marlon Pierce Computer Science, Informatics, Physics.
Using Topic-Based Publish/Subscribe for Managing Real Time GPS Streams Marlon Pierce, Galip Aydin, Zhigang Qi Community Grids Lab Indiana University 1.
QuakeSim Project: Portals and Web Services for Geo-Sciences Marlon Pierce Indiana University
QuakeSim Project: Portals and Web Services for Geophysics Marlon Pierce Indiana University
ISERVOGrid Architecture Working Group Brisbane Australia June Geoffrey Fox Community Grids Lab Indiana University
QuakeSim Project: Portals and Web Services for Geo-Sciences Marlon Pierce Indiana University
Integrating Geographical Information Systems and Grid Applications Marlon Pierce Contributions: Ahmet Sayar,
QuakeSim Project: Portals and Web Services for Geo-Sciences Marlon Pierce Indiana University
Some comments on Portals and Grid Computing Environments PTLIU Laboratory for Community Grids Geoffrey Fox, Marlon Pierce Computer Science, Informatics,
CLOUD COMPUTING. What is cloud computing ??? What is cloud computing ??? Cloud computing is a general term for anything that involves delivering hosted.
Web Technologies Lecture 13 Introduction to cloud computing.
1 TCS Confidential. 2 Objective : In this session we will be able to learn:  What is Cloud Computing?  Characteristics  Cloud Flavors  Cloud Deployment.
Launch Amazon Instance. Amazon EC2 Amazon Elastic Compute Cloud (Amazon EC2) provides resizable computing capacity in the Amazon Web Services (AWS) cloud.
Interacting Data Services for Distributed Earthquake Modeling Marlon Pierce, Choonhan Youn, and Geoffrey Fox Community Grids Lab Indiana University.
Cloud Computing from a Developer’s Perspective Shlomo Swidler CTO & Founder mydrifts.com 25 January 2009.
AMSA TO 4 Advanced Technology for Sensor Clouds 09 May 2012 Anabas Inc. Indiana University.
Web 2.0: Concepts and Applications 6 Linking Data.
Course: Cluster, grid and cloud computing systems Course author: Prof
Cloud Computing.
Principles of Computer Security
Introduction to Data Management in EGI
Accessing Spatial Information from MaineDOT
Introduction to Cloud Computing
20409A 7: Installing and Configuring System Center 2012 R2 Virtual Machine Manager Module 7 Installing and Configuring System Center 2012 R2 Virtual.
GeoFEST tutorial What is GeoFEST?
Do it now – PAGE 11 You will find your do it now task in your workbook – look for the start button! Wednesday, 21 November 2018.
Outline Virtualization Cloud Computing Microsoft Azure Platform
Introduction to Apache
Tiers vs. Layers.
Managing Services with VMM and App Controller
Internet and Web Simple client-server model
Federated Hierarchical Filter Grids
QuakeSim Quarterly Update
06 | SQL Server and the Cloud
Message Passing Systems
Presentation transcript:

Indiana University QuakeSim Activities Marlon Pierce, Geoffrey Fox, Xiaoming Gao, Jun Ji, Chao Sun

Updates to QuakeSim Services and User Interfaces

Summary of User Interface Revisions Disloc, Simplex, and GeoFEST have been revised interact with the revised QuakeTables database using KML feeds. – One KML description for each fault collection Fault selection map user interface significantly revised to handle multiple KML files. Disloc, Simplex, RDAHMM, and GeoFEST all revised to work as Google gadgets as well as portlets. – Same code base. Difference is just a build option. Gadgets integrated with Google OpenID, so you don’t need a portal login. We have also developed a gadget container in related work. All of this work is Open Source, in our SourceForge SVN, and buildable through Apache Maven.

Simplex running in our OGCE Gadget Container RDAHMM running in iGoogle.

Daily RDAHMM Updates

Support for the JPL data set Same daily RDAHMM processing to the GPS data received from the JPL GIPSY Context Group

Daily RDAHMM service Modified evaluation process using all GPS data since as input Old evaluation process: input RDAHMM evaluation Q Q (model) Q New evaluation process: input RDAHMM evaluation Q input (model) input Effect: always enough input for evaluation Model files

Daily RDAHMM video Web service Daily RDAHMM service Daily RDAHMM video service invoke return video URL Video maker thread add to create access Request queue Make recent video Make all-time video Recent video output Historical video input Update historical video All-time video output Get next request

Daily RDAHMM Portlet State change number vs. time plot for a bounded area

Daily RDAHMM Portlet GPS data plot for different time scales. Developed interactive plotting tools to replace the static images.

Cloud Computing Research

Cloud Computing Overview Computing as a Service (CaaS): Using Data Parallel Tools such as Apache Hadoop and MS Dryad. Infrastructure as a Service (IaaS): Amazon Cloud Services (EC2, S3, EBS), MS Azure Platform as a Service (PaaS): QuakeSim Virtual Appliances running on IaaS RDAHMM GPS Processing IU Virtual Block Store Project Future Effort

Infrastructure as a Service For this particular project, we identified an open equivalent to Amazon’s Virtual Block Store. Provides the Virtual Data equivalent to Virtual Machines. Major Related Efforts: IU leads the $15M Future Grid project (NSF Track 2d award). – Future Grid is not a Cloud but a test-bed for evaluating Cloud and other technologies. – Closed early user testing is going on now, more open early user testing in the next 6 months (approx). We note in addition major production Clouds from DOE, NASA, and other agencies are coming.

VBS Web Services Architecture Volume Server (LVM) Volume Delegate Virtual Machine Manager (Xen Dom 0) VMM Delegate VM instance ( Xen Dom U) VBS Web Service VBS Client VBD iSCSI Create Volume, Export Volume, Create Snapshot, etc. Import Volume, Attach Device, Detach Device, etc. LVM: Logical Volume Manager iSCSI: internet SCSI protocol VBD: Virtual Block Device

VBS Integration with Nimbus Volume Server Volume Delegate Xen Dom 0 Xen Delegate Xen Dom U VBS Web Service VBS Client VBD iSCSI Create Volume, Export Volume, Create Snapshot,Etc. Import Volume, Attach Device, Detach Device,Etc. Nimbus Workspace Service VBS_Nimbus Web Service Attch-volume Query for Xen Dom0 Host and DomUId with

Processing Real-Time GPS Streams 16 ryo2nb Raw Data RYO Ports NB Server ryo2asciiascii2gmlascii2pos Single Station Displacement Filter Station Health Filter RDAHMM Filter Scripps RTD Server Scripps RTD Server ryo2nb Raw Data ryo2asciiascii2pos Single Station RDAHMM Filter A Complete Sensor Message Processing Path, including a data analysis application. /SOPAC/GPS/CRTN01/RYO /SOPAC/GPS/CRTN01/ASCII /SOPAC/GPS/CRTN01/POS /SOPAC/GPS/CRTN01/DSME GPS Networks

Computing as a Service: Hadoop and GPS Processing We identified the Real-Time RDAHMM GPS processing pipeline as a good candidate for evaluating Hadoop, Dryad, and other systems. Our current system is a custom-built distributed pipeline based on publish/subscribe semantics. But it matches well with the goals of both Hadoop and Dryad, which do the same thing. This evaluation is on-going. We also have a significant effort in researching these and other technologies for parallel computing that is outside the scope of the QuakeSim project. – See for example _final-with-diagrams.pdf – Recent efforts have focused on bioinformatics, but the research is general.

IU Participants Xiaoming Gao, Ph. D student – RDAHMM/GPS infrastructure and user interfaces – Virtual Block Storage system. Jun Ji, Master’s student, intern – Disloc, Simplex, and GeoFEST revisions – Google gadget development – OpenID for gadgets Chao Sun, Master’s student, independent study – Hadoop investigation of RDAHMM GPS

More Information QuakeSim Web Site: Portal URL: Portal SourceForge Page: Code SVN: id/ id/