OnTimeMeasure Integration with Gush Prasad Calyam, Ph.D. (PI) Tony Zhu (Software Programmer) Alex Berryman (REU Student) GEC10 Selected.

Slides:



Advertisements
Similar presentations
Implementing Tableau Server in an Enterprise Environment
Advertisements

OnTimeMeasure Integration with Gush Prasad Calyam, Ph.D. (PI) Paul Schopis, (Co-PI) Tony Zhu (Software Programmer) Alex Berryman (REU Student)
Tableau Software Australia
Module 1: Introduction to SQL Server Reporting Services.
GENI Experiment Control Using Gush Jeannie Albrecht and Amin Vahdat Williams College and UC San Diego.
An Overview of Gush Jeannie Albrecht David Irwin
Project Overview Goal: Instrumentation and Measurement capabilities for GENI experimenters and operations Outcomes: Software to perform centralized and.
Page 1 Ricardo Villalobos Windows Azure Architect Evangelist Microsoft Corporation Designing, Building, and Deploying Windows Azure applications.
University of Kentucky GENI User Tools and the Control Plane Zongming Fei, Jim Griffioen University of Kentucky.
This presentation is intended as a detailed WebEx, to bring potential customers to an understanding of Dream Report capabilities. This presentation focuses.
Sponsored by the National Science Foundation Systematic Experimentation Case Study: Virtual Router Failure Restoration Xuan Liu UMKC/GENI Project Office.
A Java Architecture for the Internet of Things Noel Poore, Architect Pete St. Pierre, Product Manager Java Platform Group, Internet of Things September.
Software Frameworks for Acquisition and Control European PhD – 2009 Horácio Fernandes.
Distributed Application Management Using PLuSH Jeannie Albrecht, Christopher Tuttle, Alex C. Snoeren, and Amin Vahdat UC San Diego CSE {jalbrecht, ctuttle,
Sponsored by the National Science Foundation An Introduction to GENI Tools Sarah Edwards GENI Project Office.
Sponsored by the National Science Foundation netKarma Spiral 2 Year-end Project Review Indiana University Beth Plale (PI) School of Informatics and Computing.
Using the jFed tool to experiment from zero to hero Brecht Vermeulen FGRE, July 7 th, 2015.
Reproducible Environment for Scientific Applications (Lab session) Tak-Lon (Stephen) Wu.
Enterprise Reporting with Reporting Services SQL Server 2005 Donald Farmer Group Program Manager Microsoft Corporation.
Resource Allocation in Virtual Desktop Clouds: VMLab-GENI Experiment Rohit Patali, Prasad Calyam, Mukundan Sridharan, Alex Berryman The Ohio State University,
GEC3 Oct www.geni.net1 Experiment Workflow and Services Working Group System Engineering Report Vicraj (Vic) Thomas, Ph.D. Working Group System.
Sponsored by the National Science Foundation Operational Monitoring Kevin Bohan, GMOC
Customized cloud platform for computing on your terms !
Building service testbeds on FIRE D5.2.5 Virtual Cluster on Federated Cloud Demonstration Kit August 2012 Version 1.0 Copyright © 2012 CESGA. All rights.
Sponsored by the National Science Foundation Omni: a command line GENI resource reservation tool Niky Riga, Sarah Edwards GENI Project Office 13 March,
Sarah Edwards, GENI Project Office
Sponsored by the National Science Foundation Scaling Up: Growing the Topology of an Existing Experiment in GENI Sarah Edwards GENI Project Office Xuan.
C Copyright © 2009, Oracle. All rights reserved. Appendix C: Service-Oriented Architectures.
Andy Bavier, PlanetWorks Scott Baker, SB-Software July 27, 2011.
National Science Foundation Arlington, Virginia January 7-8, 2013 Tom Lehman University of Maryland Mid-Atlantic Crossroads.
INFSO-RI Module 01 ETICS Overview Alberto Di Meglio.
Microsoft SharePoint Server 2010 for the Microsoft ASP.NET Developer Yaroslav Pentsarskyy
ApplicationXtender Quickly capture, organize, and deliver fixed-content images, documents, reports, and other business-critical information.
INFSO-RI Module 01 ETICS Overview Etics Online Tutorial Marian ŻUREK Baltic Grid II Summer School Vilnius, 2-3 July 2009.
GEC5 Security Summary Stephen Schwab Cobham Analytical Services July 21, 2009.
GEC 101 The GENI ShadowNet Project Jim Griffioen (Kentucky) Zongming Fei (Kentucky) Kobus Van der Merwe (AT&T) Eric Boyd (Internet 2)
Sponsored by the National Science Foundation GENI I&M Update: Architecture Overview and Current Status GENI Engineering Conference 10 San Juan, PR GPO.
Sponsored by the National Science Foundation Behind the Scenes of GENI Experimentation An Introduction to GENI Tools Sarah Edwards, GENI Project Office.
OnTimeMeasure-GENI: Centralized and Distributed Measurement Orchestration Software Prasad Calyam, Ph.D. (PI) Paul Schopis, (Co-PI) Weiping Mandrawa (Network.
Sponsored by the National Science Foundation Tutorial: Introduction to Omni Niky Riga GENI Project Office GREESC13 $ omni.py createsliver aliceslice myRSpec.xml.
Wrapping Scientific Applications As Web Services Using The Opal Toolkit Wrapping Scientific Applications As Web Services Using The Opal Toolkit Sriram.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
Sponsored by the National Science Foundation GMOC Support for GENI Racks Kevin Bohan, GMOC Eldar Urumbaev, GMOC.
ABone Architecture and Operation ABCd — ABone Control Daemon Server for remote EE management On-demand EE initiation and termination Automatic EE restart.
GeniDesktop : The GEMINI Portal (and more) Hussam Nasir University of Kentucky.
LAMP: Bringing perfSONAR to ProtoGENI Martin Swany.
Microsoft Management Seminar Series SMS 2003 Change Management.
Sponsored by the National Science Foundation Understanding the AM API through a simple Hadoop experiment.
Microsoft Project Reporting with Reporting Services.
Sponsored by the National Science Foundation GENI Aggregate Manager API Tom Mitchell March 16, 2010.
Upcoming GENI Architecture Topics: The Future of Experiment Management with Gush Jeannie Albrecht David Irwin.
Sponsored by the National Science Foundation Behind the Scenes of GENI Experimentation An Introduction to GENI Tools Sarah Edwards, GENI Project Office.
System/SDWG Update Management Council Face-to-Face Flagstaff, AZ August 22-23, 2011 Sean Hardman.
Sponsored by the National Science Foundation Raven Provisioning Service Spiral 2 Year-end Project Review Department of Computer Science University of Arizona.
Sponsored by the National Science Foundation 1 March 15, 2011 GENI I&M Update: I&M Service Types, Arrangements, Assembling Goals Architecture Overview.
Sponsored by the National Science Foundation Behind the Scenes of GENI Experimentation An Introduction to GENI Tools Sarah Edwards GENI Project Office.
Use-cases for GENI Instrumentation and Measurement Architecture Design Prasad Calyam, Ph.D. (PI – OnTimeMeasure, Project #1764) March 31.
Sponsored by the National Science Foundation Understanding the AM API through a simple Hadoop experiment.
Origami: Scientific Distributed Workflow in McIDAS-V Maciek Smuga-Otto, Bruce Flynn (also Bob Knuteson, Ray Garcia) SSEC.
Slide 1 © 2016, Lera Technologies. All Rights Reserved. SAP BO vs SPLUNK vs OBIEE By Lera Technologies.
Sampling and Analysis Tools for E-Center for Multi-domain Internet Performance Measurement Prasad Calyam, Ph.D. Winter.
5/29/2001Y. D. Wu & M. Liu1 Content Management for Digital Library May 29, 2001.
Sponsored by the National Science Foundation GEC17 Plenary Session: Architecture Marshall Brinn, GPO July 22, 2013.
Run a Complete Experiment
Self Healing and Dynamic Construction Framework:
Consulting Services JobScheduler Architecture Decision Template
Understanding the AM API through a simple experiment
Module 01 ETICS Overview ETICS Online Tutorials
GENI Exploring Networks of the Future
This material is based upon work supported by the National Science Foundation under Grant #XXXXXX. Any opinions, findings, and conclusions or recommendations.
Presentation transcript:

OnTimeMeasure Integration with Gush Prasad Calyam, Ph.D. (PI) Tony Zhu (Software Programmer) Alex Berryman (REU Student) GEC10 Selected Project Highlights Session March 15 th 2011

Topics of Discussion OnTimeMeasure Overview Gush Overview OnTimeMeasure-Gush User Workflow Integration Details 2

OnTimeMeasure Overview Goal: Provide GENI community with capabilities for provisioning on- going and on-demand measurement requests –Used in forecasting, anomaly detection, and fault-location diagnosis in GENI experiments and GENI operations Outcomes: –Software to perform centralized and distributed measurement orchestration and provisioning of measurements Centralized orchestration for continuous monitoring, persistent measurements storage and processed network measurement feeds Distributed orchestration for on-demand (real-time) measurement requests without need for persistent measurements storage –Measurement service that enables users to utilize OnTimeMeasure software in GENI experiments Registers users, slices, maintains meta-data, and allows user control of measurement service functions –Researcher Web-portal – for interactive user control of measurement servicehttp://ontime.oar.net –Command-line tools for measurement service control automation 3

OnTimeMeasure Architecture 4

Gush Overview Gush runs on a user desktop and executes commands on Client nodes in a GENI Slice The application description is written in an XML format with following specs: –Web addresses of software packages –List of target clients –Commands to be executed Two configuration files are required in Gush (filled in using a helper script): 1.Directory.xml: defines where to locate resources during execution of experiment  Gush queries PlanetLab database about user slice and auto populates the Directory.xml file 2.Gush.prefs: define working directory and client prefix Source: Gush project website - 5

Advantages of OnTimeMeasure-Gush Integration Improves Experiment Measurements in Classroom: –Students can instrument/query/analyze active and passive measurements within GENI using their familiar Gush interface –Get on-demand plots of measurement time series results of their experiments with simple commands in Gush Don’t need to teach students GNUPlot Eases Installation of OnTimeMeasure: –Configure once and re-use in slices using their familiar Gush interface –Login and install on a number of nodes from user desktop Gush takes care of ProtoGENI/PlanetLab authentication Improves Automation, Scalability and Security of OnTimeMeasure : –Identical configuration steps on Node Beacons can be done in parallel across large number of nodes –GENI experimenter can securely script the request/management/query of OnTimeMeasure measurements through Gush 6

User Workflow (ProtoGENI or PlanetLab Aggregates) 1.User creates an experiment slice using ProtoGENI or PlanetLab control framework tools –For ProtoGENI slice creation, see –For PlanetLab slice creation, see User registers at the “Researcher Web-Portal” ( 3.User installs OnTimeMeasure measurement instance in experiment slice –Slice RSpec should include reservation of any required measurement resources –Node/Root Beacons need to be installed as slivers based on the instructions provided in Step-1 for the specific aggregate 4.User installs Gush and uses OnTimeMeasure xml files to: i.Submit measurement requests ii. Control the measurement service iii. Query measurement data For details, see - See Demo of OnTimeMeasure-Gush at GEC10 Project Demo & Networking Event… 7

Deployment Steps for OnTimeMeasure-Gush ProtoGENI/PlanetLab slice must be created using an RSpec file or using graphical interfaces XML file of the application description must be created with at least two parts: –Commands to be executed only on the Root Beacon –Commands to be executed on all of the Node Beacons Description of the slice resources must be written in directory.xml Gush.prefs must be configured correctly as per Gush setup instructions Gush Controller Otm- deploy.xml Root Beacon Node Beacon Root Beacon directory.xml gush.prefs Node Beacon GENI Slice 8

OnTime Control (Stand-alone Mode) User installs OnTime Control on his/her desktop –Requires Python install –Manually configure slice topology in.yaml files User executes python scripts that query a SQL database of measurements on the Root Beacon –Requires root db user information Measurement result time-series files/plots are automatically downloaded into current directory on user desktop User Desktop OnTime Control Python Scripts Slice Topolgy.yaml files Root Beacon Root Beacon DB Node Beacon Node Beacon Node Beacon Node Beacon Node Beacon Node Beacon GENI Slice 9

OnTime Control (GUSH Integration mode) OnTime Control package resides on Root/Node Beacon; Gush is installed on user desktop Write a set of XML experiment files in the Gush format that interacts with the OnTime Control python scripts Gush topology description (directory.xml) is passed to the OnTime Control Output of the OnTime Control is a URL of a text/plot file containing the results of the measurement User Desktop OnTime Control Python Scripts Slice Topology Root Beacon Root Beacon DB Node Beacon Node Beacon Node Beacon Node Beacon Node Beacon Node Beacon GUSH Controller otm- control.xml directory.xml GENI Slice 10

Reference List OnTime Control Wiki – OnTimeMeasure-PlanetLab Wiki – OnTimeMeasure-ProtoGENI Wiki – OnTimeMeasure-Gush Wiki – 11

12 Thank you for your attention ! This material is based upon work supported by the National Science Foundation under Grant No. CNS Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of BBN Technologies, Corp., the GENI Project Office, or the National Science Foundation.