GEC21 Experimenter/Developer Roundtable (Experimenter) Paul Ruth RENCI / UNC Chapel Hill

Slides:



Advertisements
Similar presentations
ExoGENI Rack Architecture Ilia Baldine Jeff Chase Chris Heermann Brad Viviano
Advertisements

The Instageni Initiative
Sponsored by the National Science Foundation1April 8, 2014, Testbeds as a Service: GENI Heidi Picher Dempsey Internet2 Annual Meeting April 8,
Sponsored by the National Science Foundation GEC20-June Sponsored by the National Science Foundation GENI Network Stitching Test Findings GEC.
GIMI I&M and Monitoring Mike Zink, Max Ott, Ilya Baldine University of Massachusetts Amherst GEC 18, Brooklyn, October 27 st 1.
University of Kentucky GENI User Tools and the Control Plane Zongming Fei, Jim Griffioen University of Kentucky.
ExoGENI Racks Ilia Baldine
ORCA Overview LEARN Workshop Ilia Baldine, Anirban Mandal Renaissance Computing Institute, UNC-CH.
Kansei Connectivity Requirements: Campus Deployment Case Study Anish Arora/Wenjie Zeng, GENI Kansei Project Prasad Calyam, Ohio Supercomputer Center/OARnet.
Sponsored by the National Science Foundation Systematic Experimentation Case Study: Virtual Router Failure Restoration Xuan Liu UMKC/GENI Project Office.
Using the jFed tool to experiment from zero to hero Brecht Vermeulen FGRE, July 7 th, 2015.
Ilya Baldin 2.
Sponsored by the National Science Foundation A Virtual Computer Networking Lab Mike Zink, Max Ott, Jeannie Albrecht GEC 23, June 16 th 2015.
Sponsored by the National Science Foundation Operational Monitoring Kevin Bohan, GMOC
Sponsored by the National Science Foundation GIMI/LabWiki Tutorial Mike Zink, Divyashri Bhat, Cong Wang, Thierry Rakotoarivelo GEC20 March 22 nd 2014,
Sponsored by the National Science Foundation Scaling Up: Growing the Topology of an Existing Experiment in GENI Sarah Edwards GENI Project Office Xuan.
National Science Foundation Arlington, Virginia January 7-8, 2013 Tom Lehman University of Maryland Mid-Atlantic Crossroads.
Resource Representations in GENI Rob Sherwood, OpenFlow Hongwei Zhang, Wireless sensor network description language Ilia Baldine, Yufeng Xin, Semantic.
Sponsored by the National Science Foundation Campus/Experiment Topics in Monitoring and I&M GENI Engineering Conference 15 Houston, TX Sarah Edwards Chaos.
GENI Racks: Infrastructure Overview
Sponsored by the National Science Foundation Getting Started With Your Own Experiment Sarah Edwards, GENI Project Office.
Using the jFed tool to experiment from zero to hero Brecht Vermeulen Thijs Walcarius GEC 22, March 24 th, 2015.
Sponsored by the National Science Foundation GENI and Cloud Computing Niky RIga GENI Project Office
Sponsored by the National Science Foundation GEC17: Developer Track Introduction Marshall Brinn, GPO July 21, 2013.
Sponsored by the National Science Foundation Programmable Networks and GENI Marshall Brinn, GPO GEC October 25, 2012.
1 Evolution of OSG to support virtualization and multi-core applications (Perspective of a Condor Guy) Dan Bradley University of Wisconsin Workshop on.
Sponsored by the National Science Foundation Introduction to GENI Sarah Edwards GENI Project Office (GPO)
608D CloudStack 3.0 Omer Palo Readiness Specialist, WW Tech Support Readiness May 8, 2012.
GEC 15 Houston, Texas October 23, 2012 Tom Lehman Xi Yang University of Maryland Mid-Atlantic Crossroads (MAX)
Resource Representations in GENI: A path forward Ilia Baldine, Yufeng Xin Renaissance Computing Institute,
Sponsored by the National Science Foundation Scaling Up: Growing the Topology of an Existing Experiment in GENI Sarah Edwards GENI Project Office with.
1 ©2010 HP Created on xx/xx/xxxxof 222 Nick Bastin, Andy Bavier, Jessica Blaine, Joe Mambretti, Rick McGeer, Rob Ricci, Nicki Watts PlanetWorks, HP, University.
Sponsored by the National Science Foundation GENI Exploring Networks of the Future
OnTimeMeasure-GENI: Centralized and Distributed Measurement Orchestration Software Prasad Calyam, Ph.D. (PI) Paul Schopis, (Co-PI) Weiping Mandrawa (Network.
Luis Russi¹, Carlos R. Senna¹, Edmundo R. M. Madeira¹, Xuan Liu², Shuai Zhao², and Deep Medhi² Hadoop-in-a-Hybrid-Cloud GEC21 The 21st GENI Engineering.
Sponsored by the National Science Foundation Monitoring Demonstration Kevin Bohan, GMOC
Sponsored by the National Science Foundation LabWiki Tutorial (OMF/OML) Divya Bhat, Mike Zink, Pieter Becue, Brecht Vermeulen GEC20 July 8 th 2014, Ghent,
Systematic Experimentation: Automating Experiments and ExoGENI Image Snapshots Paul Ruth, RENCI / UNC Chapel Hill.
Sponsored by the National Science Foundation Getting Started With Your Own Experiment Sarah Edwards, GENI Project Office.
Sponsored by the National Science Foundation ExoGENI
GIMI I&M and Monitoring Mike Zink University of Massachusetts Amherst GEC 15, Houston, October 23 rd 1.
Sponsored by the National Science Foundation Systematic Experimentation in GENI.
Ilia Baldine, Jeff Chase, Mike Zink, Max Ott.  14 GPO-funded racks ◦ Partnership between RENCI, Duke and IBM ◦ IBM x3650 M3/M4 servers  1x146GB 10K.
P. Kuipers Nikhef Amsterdam Computer- Technology Nikhef Site Report Paul Kuipers
Using GENI for computational science Ilya Baldin RENCI, UNC – Chapel Hill.
Sponsored by the National Science Foundation Developper Session Mike Zink GEC20 March 22 nd 2014, UC Davis, CA.
LAMP: Bringing perfSONAR to ProtoGENI Martin Swany.
Sponsored by the National Science Foundation Systematic Experimentation in GENI Sarah Edwards GENI Project Office.
Sponsored by the National Science Foundation Understanding the AM API through a simple Hadoop experiment.
Sponsored by the National Science Foundation GENI Aggregate Manager API Tom Mitchell March 16, 2010.
Sponsored by the National Science Foundation Behind the Scenes of GENI Experimentation An Introduction to GENI Tools Sarah Edwards, GENI Project Office.
GEC22 Experimenter/Developer Roundtable (Developer) Victor Orlikowski Duke University
Sponsored by the National Science Foundation Getting Started With Your Own Experiment.
Data-Intensive Cloud Control for GENI Cluster D Session July 20 th, 2010.
Sponsored by the National Science Foundation GENI Exploring Networks of the Future
Sponsored by the National Science Foundation Behind the Scenes of GENI Experimentation An Introduction to GENI Tools Sarah Edwards GENI Project Office.
Shared Nothing Architecture Allen Archer. What is Shared Nothing architecture? It is a distributed architecture in which each node is independent and.
Sponsored by the National Science Foundation Understanding the AM API through a simple Hadoop experiment.
ExoGENI OpenFlow support Ilya Baldin Paul Ruth RENCI Director for Network Research and.
ExoGENI GENI Going Forward Tasks Ilya Baldin RENCI Director for Network Research and Infrastructure.
GIMI Update Mike Zink University of Massachusetts Amherst GEC 14, Boston, July 9 th 1.
Sponsored by the National Science Foundation GEC17 Plenary Session: Architecture Marshall Brinn, GPO July 22, 2013.
Today’s Plan Everyone will build their own clouds
Using the jFed tool to experiment from zero to hero
Introduction to GENI Ben Newton University of North Carolina at Chapel Hill
GENI Terminology Sponsored by the National Science Foundation.
NSF cloud Chameleon: Phase 2 Networking
Chameleon and ExoGENI Paul Ruth (PI) Bonus Demo:
GENI Exploring Networks of the Future
Managing allocatable resources
Presentation transcript:

GEC21 Experimenter/Developer Roundtable (Experimenter) Paul Ruth RENCI / UNC Chapel Hill

The 21st GENI Engineering Conference October 20-23, 2014 Indiana University, Bloomington, IN ADCIRC Storm Surge Model Finite Element Very high spatial resolution (~1.2M triangles) Efficient MPI implementation, scales to thousands of cores Typically use cores for forecasting applications Used for coastal flooding simulations –FEMA flood insurance studies –Forecasting systems –Research applications

The 21st GENI Engineering Conference October 20-23, 2014 Indiana University, Bloomington, IN ADCIRC Storm Surge Model on GENI Slice attributes –38 VMs (152 compute cores) –6 GENI racks –Custom image replicated across testbeds –ExoGENI Groups Storage (1 TB) –InstaGENI Shared VLANs Xen VMs (4 core, 4 GB memory, 30 GB storage) –Inter-domain GENI Stitching ExoGENI Stitching 3

The 21st GENI Engineering Conference October 20-23, 2014 Indiana University, Bloomington, IN Demo GENI Slice 4 … … Condor Scheduler iSCSI Storage … … NFS W W W W W W W W OVS InstaGENI ExoGENI

The 21st GENI Engineering Conference October 20-23, 2014 Indiana University, Bloomington, IN Demo GENI Slice 5 … … Condor Scheduler iSCSI Storage … … NFS W W W W W W W W OVS Not just one slice! 3 slices 1 Stitcher call 4 Omni calls Not just one slice! 3 slices 1 Stitcher call 4 Omni calls InstaGENI ExoGENI

The 21st GENI Engineering Conference October 20-23, 2014 Indiana University, Bloomington, IN Demo GENI Slice 6 InstaGENI ExoGENI

The 21st GENI Engineering Conference October 20-23, 2014 Indiana University, Bloomington, IN Slice 1: ADCIRC-CORE 7 … Condor Scheduler iSCSI Storage … NFS W W W W OVS -1 call to the stitcher -5 GENI calls by the stitcher -1 call to the stitcher -5 GENI calls by the stitcher GENI Calls: 1.ExoSM 2.Ion 3.GPO-IG 4.ILL-IG 5.WI-IG InstaGENI ExoGENI

The 21st GENI Engineering Conference October 20-23, 2014 Indiana University, Bloomington, IN Shared VLANs 8 … Condor Scheduler iSCSI Storage … NFS W W W W OVS Perform Operational Action: Create Shared VLANS Perform Operational Action: Create Shared VLANS InstaGENI ExoGENI

The 21st GENI Engineering Conference October 20-23, 2014 Indiana University, Bloomington, IN Slice 2: Wisconsin Group 9 … … Condor Scheduler iSCSI Storage … NFS W W W W W W OVS InstaGENI ExoGENI

The 21st GENI Engineering Conference October 20-23, 2014 Indiana University, Bloomington, IN Slice 2: Illinois Group 10 … … Condor Scheduler iSCSI Storage … … NFS W W W W W W W W OVS InstaGENI ExoGENI

The 21st GENI Engineering Conference October 20-23, 2014 Indiana University, Bloomington, IN Complete Slice(s) 11 … … Condor Scheduler iSCSI Storage … … NFS W W W W W W W W OVS InstaGENI ExoGENI

The 21st GENI Engineering Conference October 20-23, 2014 Indiana University, Bloomington, IN Experiences Happy that it works at all! GENI Stitching –Failures can cascade –Limited to one stitch per slice per ExoGENI site. –Can restart complicated ExoGEN slice InstaGENI –Slow booting compute nodes –Yay! Bigger nodes (4 cores, 30 GB disks) –Shared VLANs are awkwards Tools –None of the tools can visualize all aspects of slices 12

GEC21 Experimenter/Developer Roundtable (Developer) Victor Orlikowski Duke University

The 21st GENI Engineering Conference October 20-23, 2014 Indiana University, Bloomington, IN ORCA 5 Recovery –Should not be seen by users –Restart and redeploy ExoGENI services without effecting running slices. Storage on bare metal Hybrid mode Distributed actor registry 14

The 21st GENI Engineering Conference October 20-23, 2014 Indiana University, Bloomington, IN Rspec Extension Storage –~5 TB of sliverable storage on most racks –Add an iSCSI target to a slice –Can now be used with Rspecs 15

The 21st GENI Engineering Conference October 20-23, 2014 Indiana University, Bloomington, IN RSpec Extension: Groups Multiple nodes with shared specification –Same: image, instance type, location, networks Templated postboot scripts customize the nodes 16

The 21st GENI Engineering Conference October 20-23, 2014 Indiana University, Bloomington, IN Thanks 17