GIMI I&M and Monitoring Mike Zink University of Massachusetts Amherst GEC 15, Houston, October 23 rd 1.

Slides:



Advertisements
Similar presentations
Current Status (Tutorial tomorrow)
Advertisements

Sponsored by the National Science Foundation I&M Status and Topics GEC18 - October 27, 2013 Jeanne Ohren and Marshall Brinn GENI Project Office.
Sponsored by the National Science Foundation DEMO: Designing and Monitoring OpenFlow Load Balancing Experiments using GIMI Shufeng Huang, Divyashri Bhat.
FIBRE-BR Meeting GENI I&M Marcelo Pinheiro. Agenda GENI Overview GENI User groups GENI I&M Use Cases GENI I&M Services.
GIMI I&M and Monitoring Mike Zink, Max Ott, Ilya Baldine University of Massachusetts Amherst GEC 18, Brooklyn, October 27 st 1.
Project Overview Goal: Instrumentation and Measurement capabilities for GENI experimenters and operations Outcomes: Software to perform centralized and.
University of Kentucky GENI User Tools and the Control Plane Zongming Fei, Jim Griffioen University of Kentucky.
Connect. Communicate. Collaborate Click to edit Master title style MODULE 1: perfSONAR TECHNICAL OVERVIEW.
Using the jFed tool to experiment from zero to hero Brecht Vermeulen FGRE, July 7 th, 2015.
Sponsored by the National Science Foundation July 7 th 2015 Sponsored by the National Science Foundation LabWiki The Complete Experiment Lifecycle in a.
Sponsored by the National Science Foundation A Virtual Computer Networking Lab Mike Zink, Max Ott, Jeannie Albrecht GEC 23, June 16 th 2015.
Customized cloud platform for computing on your terms !
Sponsored by the National Science Foundation GIMI/LabWiki Tutorial Mike Zink, Divyashri Bhat, Cong Wang, Thierry Rakotoarivelo GEC20 March 22 nd 2014,
Jolyon White GEC9, 4 th November 2010 Measurement Flow Architecture in OML.
GEMINI Indiana University, University of Kentucky.
National Science Foundation Arlington, Virginia January 7-8, 2013 Tom Lehman University of Maryland Mid-Atlantic Crossroads.
Sponsored by the National Science Foundation Campus/Experiment Topics in Monitoring and I&M GENI Engineering Conference 15 Houston, TX Sarah Edwards Chaos.
GIMI Tutorial GIMI Team University of Massachusetts Amherst GEC 14, Boston, July 9 th 1.
Client Authentication & Authorization for GENI XMPP Messaging Service Anirban Mandal, Shu Huang, Ilia Baldine (RENCI) Rudra Dutta (NSCU) GEC14 I&M Session.
Sponsored by the National Science Foundation GEC16 Service Developers Roundtable: Strawman Unified I&M Tools and Services Marshall Brinn, GPO March 19,
Using the jFed tool to experiment from zero to hero Brecht Vermeulen Thijs Walcarius GEC 22, March 24 th, 2015.
Dynamic Firewalls and Service Deployment Models for Grid Environments Gian Luca Volpato, Christian Grimm RRZN – Leibniz Universität Hannover Cracow Grid.
Sponsored by the National Science Foundation GEC17: Developer Track Introduction Marshall Brinn, GPO July 21, 2013.
Jolyon White GEC9, 4 th November 2010 OMF Aggregate Manager API.
5th GridLab Review, 8 April 2005, Amsterdam WP12: Access for mobile users What's new in mobile user support Piotr Grabowski, Bartek Lewandowski
Sponsored by the National Science Foundation GENI I&M Workshop GIMI: Large-scale GENI Instrumentation and Measurement Infrastructure Mike Zink November.
Sponsored by the National Science Foundation 1 March 15, 2011 GENI I&M Update: Gathering, Transferring and Sharing MD Goals Architecture Overview –Process.
GEC 15 Houston, Texas October 23, 2012 Tom Lehman Xi Yang University of Maryland Mid-Atlantic Crossroads (MAX)
Sponsored by the National Science Foundation 1 March 15, 2011 GENI I&M Update: MD Objects and Descriptors Goals Architecture Overview –Process –Functional.
Sponsored by the National Science Foundation GEC16 Plenary Session: GENI Solicitation 4 Tool Context Marshall Brinn, GPO March 20, 2013.
Sponsored by the National Science Foundation GENI I&M Update: Architecture Overview and Current Status GENI Engineering Conference 10 San Juan, PR GPO.
Sponsored by the National Science Foundation 1 September 15, 2015 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you do the.
Sponsored by the National Science Foundation GENI Exploring Networks of the Future
Sponsored by the National Science Foundation GENI Exploring Networks of the Future Sarah Edwards, GPO
Sponsored by the National Science Foundation GENI I&M and Monitoring GENI Engineering Conference 14 Boston, MA Sarah Edwards Chaos Golubitsky Jeanne Ohren.
Sponsored by the National Science Foundation Monitoring Demonstration Kevin Bohan, GMOC
Sponsored by the National Science Foundation Lab Zero: A First Experiment using GENI Sarah Edwards, GENI Project Office.
Sponsored by the National Science Foundation LabWiki Tutorial (OMF/OML) Divya Bhat, Mike Zink, Pieter Becue, Brecht Vermeulen GEC20 July 8 th 2014, Ghent,
Sponsored by the National Science Foundation 1 Last updated April 1, 2013 Are you ready for the tutorial? 1.Sign In 2.Grab a Worksheet 3.Did you do the.
Sponsored by the National Science Foundation Tutorial: OpenFlow in GENI with Instrumentation and Monitoring Divya Bhat Shufeng Huang Niky Riga GENI Project.
Sponsored by the National Science Foundation GEC17: GENI Instrumentation and Measurement Sessions Sun. July 21, Mon. July 22, 2013 Marshall Brinn, Jeanne.
Ilia Baldine, Jeff Chase, Mike Zink, Max Ott.  14 GPO-funded racks ◦ Partnership between RENCI, Duke and IBM ◦ IBM x3650 M3/M4 servers  1x146GB 10K.
GIMI Update Mike Zink University of Massachusetts Amherst GEC 13, Los Angeles, March 13 th 1.
Sponsored by the National Science Foundation Lab Zero: A First Experiment using GENI.
Sponsored by the National Science Foundation Developper Session Mike Zink GEC20 March 22 nd 2014, UC Davis, CA.
Measurement Data Workspace and Archive: Current State and Next Steps GEC15 Oct 2012 Giridhar Manepalli Corporation for National Research Initiatives
GeniDesktop : The GEMINI Portal (and more) Hussam Nasir University of Kentucky.
LAMP: Bringing perfSONAR to ProtoGENI Martin Swany.
Solutions using Microsoft Content Management Server 2002 Connector for SharePoint Technologies Sue Corke Mark Harrison Microsoft UK.
GEMINI + An MDIP Proposal 120/07/2012 Raphael Dourado Fibre-BR I&M Team Meeting.
Sponsored by the National Science Foundation 1 Nov 4, 2010 Inst & Meas WG Meeting at GEC9 Thur, Nov 4, 9am – 10:30am Introductions (9am) Topic 2: Meas.
Data-Intensive Cloud Control for GENI GEC 10 Orca control framework March 15 th, 2011 Michael Zink, Prashant Shenoy, Jim Kurose, David Irwin and Emmanuel.
Use-cases for GENI Instrumentation and Measurement Architecture Design Team members: Paul Barford - University of Wisconsin – Madison Jim Griffioen - Univ.
From imagination to impact © 2009 NICTA. All Rights Reserved. Max Ott for the TEMPO NICTA OML Update Instrumentation and Measurement.
LAMP and INSTOOLS A configuration overview 118/05/2012 Raphael Dourado.
Sponsored by the National Science Foundation A Virtual Computer Networking Lab Mike Zink, Jim Kurose, Max Ott, Jeannie Albrecht NSF Workshop on GENI in.
Sponsored by the National Science Foundation GENI Exploring Networks of the Future
Sponsored by the National Science Foundation A Virtual Computer Networking Lab Mike Zink, Max Ott, Jeannie Albrecht GEC 20, March 24 th 2015.
GIMI Tutorial GIMI Team GEC 16, Salt Lake City, March 19 th 1.
Sponsored by the National Science Foundation GENI Exploring Networks of the Future
Sponsored by the National Science Foundation 1 March 15, 2011 GENI I&M Update: I&M Service Types, Arrangements, Assembling Goals Architecture Overview.
Use-cases for GENI Instrumentation and Measurement Architecture Design Prasad Calyam, Ph.D. (PI – OnTimeMeasure, Project #1764) March 31.
Current GEMINI use of instrumentize script to initialize & configure services Hussam Nasir University of Kentucky.
Sponsored by the National Science Foundation 1 March 15, 2011 GENI I&M Update: Sharing MD Objects with Researchers, MDA Service Goals Architecture Overview.
GIMI Update Mike Zink University of Massachusetts Amherst GEC 14, Boston, July 9 th 1.
Sponsored by the National Science Foundation 1 GEC18: GEMINI & GeniDesktop Update Added support for more newer OSes on both Instageni and Exogeni in GEMINI.
Sponsored by the National Science Foundation GEC17 Plenary Session: Architecture Marshall Brinn, GPO July 22, 2013.
Using the jFed tool to experiment from zero to hero
Run a Complete Experiment
A Virtual Computer Networking Lab
Presentation transcript:

GIMI I&M and Monitoring Mike Zink University of Massachusetts Amherst GEC 15, Houston, October 23 rd 1

Overview Introduction Goals GIMI and ExoGENI, iRODS, IREEL Tutorial Monitoring Next steps 2

Introduction Develop and deploy the GIMI instrumentation and measurement framework Capable of supporting needs of GENI experimenters and GENI infrastructure operators Uses OMF/OML and integrated Rule Oriented Data System (iRODS) as its basis Will provide libraries to instrument resources, to filter and process measurement flows, and to consume measurement flows It will use the iRODS data grid for archiving and further processing Will include access control based on accepted GENI policy and authorization mechanisms 3

Goals Provide easy-to-use I&M services for experimenters: deploying slices in GENI on selected types of servers, VMs and racks, WiMAX installation, and sensor networks. interconnected by various types of network paths Provide comprehensive infrastructure measurement services for infrastructure operators: deploying measurement slices on selected types of servers, VMs and racks, and WiMAX installations interconnected by a various types of network paths In addition slices established by other infrastructure operators, or by experimenters, can be authorized to gather data from the measurement slices 4

Goals This project will build and operate two persistent services: the GENI Measurement Data Archive Service (i.e., iRODs) and the GENI Experimenter Portal Service Collaborate with existing I&M Spiral 2 projects and GEMINI 5

GIMI and ExoGENI GIMI and ExoGENI integration: – ExoGENI image with GIMI tools publicly available – Process to automatically set up measurement while acquiring resources Client tools in GIMI user workspace Will be major part of today’s tutorial 6

GIMI and iRODS Measurement data is automatically stored in iRODS by OML server Metadata is automatically add and can be manually augmented Users can store and retrieve measurement data in iRODS iRODS client in GIMI user workspace 7

Persistent Server Tutorial VM 8 OML Server AM iRODS XMPP Server EC Visualization iRODS Client Tutorial (Thursday Morning) IREEL RC MLML MLML MLML MLML MLML MLML MLML MLML MLML MLML

9 Experiment Topology Link 4 Link 2 Link 3 Link 5 Link / / / / /24 Link /24

10 RC ML RC ML RC ML XMPP Messaging EC Visualization iRODS Client OML Server AM iRODS XMPP Server IREEL

11 RC ML RC ML RC ML EC/RC Messaging OML Server AM iRODS XMPP Server IREEL EC Visualization iRODS Client

12 RC ML RC ML RC ML Data Collection OML Server AM iRODS XMPP Server IREEL EC Visualization iRODS Client

Monitoring Passive monitoring of slice is possible with GIMI tools Include OMF/OML tools in basic ExoGENI image E.g., nmetrics could be reported to monitoring service. Experiment scripts run by monitoring service Measurement data collection run by monitoring service. 13

Next Steps Monitoring support (from GEC14) – Access control? – What will be monitored? Additional questions: – How will monitoring data impact actual measurement? 14

Thank You Questions? 15