GENI Racks: Infrastructure Overview Heidi Dempsey March 14, 2012 www.geni.net 1

Agenda: GENI Racks MesoScale Regionals and GENI core evolution GENI Racks Status ExoGENI Racks InstaGENI Racks OpenSource and International OF and Racks MesoScale Regionals and GENI core evolution Production Evolution Using the Infrastructure

GENI Racks Status GENI Racks projects are taking place to build out the GENI Infrastructure in the US. Racks provide reservable sliceable compute and network resources using a single Aggregate Manager. AM API compliance GENI v3 Rspec support Federation with Slice Authorities (GPO, PG, PLC)

GENI Racks Status GENI Racks design based on GPO requirements. GPO Infrastructure team will run Acceptance Tests to validate integration, experimenter and monitoring features. GENI Racks projects timeline:

GENI Racks Status GPO software team has developed GENI AM API Acceptance Tests, now available in GCF 1.6.1: http://trac.gpolab.bbn.com/gcf/wiki/GettingGcf http://trac.gpolab.bbn.com/gcf/wiki/AmApiAcceptanceTests Acceptance Tests are used by rack teams to verify GENI AM API compliance. Aggregates that passed AM API acceptance tests: PG Utah (RSpecs pass rspeclint) PLC (RSpecs pass rspeclint) FOAM 0.6.3

GENI Racks Status GPO Infrastructure team has defined a System Acceptance Test Plan for GENI Racks: http://groups.geni.net/geni/wiki/GENIRacksHome/AcceptanceTests System Acceptance Tests will be run on each of the GENI Racks when rack development is completed. Focus is on : Experimenter requirements Integrated rack solution Monitoring features reaching production level As part of each GENI Racks deployment, the GPO is an initial aggregate owner and will run a delivery evaluation.

GENI Racks Status GENI Racks Projects being deployed: ExoGENI A high performance, flexible virtual networking topologies solution including OpenFlow, that also delivers a powerful platform for multi-site cloud applications. These racks are typically deployed as an integrated part of a campus network. InstaGENI - A mid-range, expandable GENI Racks solution that can will be deployed at a large number of campuses, delivering Internet cloud applications support, along with Openflow and VLAN networking. These racks are normally deployed outside a site firewall. Starter Racks: Deployed by the GPO, a project to deliver an early low-end solution for GENI Racks.

GENI Racks - ExoGENI ExoGENI High-performance GENI Racks a partnership between RENaissance Computing Institute (RENCI), Duke and IBM. ExoGENI racks deliver support for multi-domain cloud structure with flexible virtual networking topologies that allow combining ExoGENI, Meso-scale OpenFlow and WiMAX resources.

GENI Racks - ExoGENI ExoGENI deployment schedule 2012:

GENI Racks - InstaGENI InstaGENI mid-range, expandable GENI Racks at large number of campuses A small ProtoGENI cluster with OpenFlow networking and FOAM aggregate management Typically found outside the site firewall.

GENI Racks - InstaGENI InstaGENI deployment schedule 2012:

Open Source and International OF and Racks NEC Proposing new racks Using NEC switches, TREMA and OpenStack Implemented with open source community Based on commercial components already used in GENI OFELIA An European Union venture with 12 industry and academic partners Includes 5 OpenFlow campuses Solution includes an aggregate manager that is similar to the GENI AM.

Mesoscale: Building at-scale Infrastructure What do I need besides racks? GENI VLAN data plane Public IP control plane GENI AM API programmable interface GENI shared monitoring and reporting GENI operations policies and support Brave IT staff and researchers on campuses Brave regionals and core networks Tools

Mesocale Overview

MesoScale Spiral4 Deployments

MesoScale - Utah Education Network UEN, ProtoGENI and InstaGENI:

Mesoscale – Southern Crossroads SOX OF Regional

Regionals: CENIC (California) CENIC proposed OpenFlow Topology dedicated fiber

Regionals - Midwest OpenFlow Crossroads MOXI Architecture – Aggregating Regionals

Regionals - Shared Fiber MOXI I-Light Architecture

Expanding regional testbeds - GpENI + KanREN

StarLight/MREN GENI OF SW InstaGENI Rack With OF SW iCAIR GENInet at University of Illinois Urbana Champaign I2 at StarLight ESnet at StarLight GENInet at Facility MREN E1200l Switch Optical ICCN/I-WIRE StarLight E1200 NLR At I2 ION ESnet Multiple EU, Asian, South American Sites NDDI DYNES InstaGENI Rack With OF SW iCAIR GENI OF SW Multiple National Regional, State Net Connections

University of Victoria InstaGENI Spiral 4 University of Utah, Princeton University, GPO, Northwestern University, Clemson University, Georgia Tech , University of Kansas , New York University University of Victoria BCNET CANARIE GENI Core backbone NOX SL/MREN NYSERNET UEN GPN MAGPI SOX

ExoGENI Spiral 4 FIU tbd

NLR OpenFlow Expansion

Internet2 OpenFlow Expansion and NDDI

OpenFlow integration and test Working closely with ONF and Stanford FOAM AM now at all Spiral 4 OpenFlow sites New firmware upgrades for some switches Stanford campus expansion and CENIC migration Any-to-any OpenFlow connections in Spiral 4

Evolving Production Support Help: help@geni.net mailing list GMOC helpdesk (Marianne Chitwood at Experimenter Tools and Services GEC13 session) http://gmoc.grnoc.iu.edu/gmoc/index/support.html GEC "coding" sprints IRC/chat (informal) Prototype monitoring and status for Meso-scale sites: http://monitor.gpolab.bbn.com (at GPO) http://gmoc-db.grnoc.iu.edu (at GMOC) much more new coming with GENI Rack deployments GPO working with GMOC and GENI Rack Teams to get production level monitoring and statistics. Implement the GMOC Concept of Operations by refining the GMOC API format.

Evolving Production Support Meso-scale site statistics from GEC12-GEC13 GPO PG Usage statistics: Overall slice creation attempts: 1992 (Successes: 1989 Failures: 3 ) Experimenter slices: 265 ( 29 distinct non-GPO PG users ) Site Availability Statistics: Site % Internet2 99.8 NLR 96.1 Stanford 74.3 GPO 99.4 Clemson 97.7 Rutgers 93.0 GATech 94.7

Evolving Production Support Defining incidence response procedures Legal, Law Enforcement and Regulatory Plan Emergency Stop Procedure Security and GENI Legal, Law Enforcement and Regulatory Contacts: Adam Slagell (slagell@illinois.edu) primary Steve Schwab (schwab@isi.edu)

Using the Infrastructure Experiments Slice Around the World! A GENI international collaboration To include various types of racks located in 4 continents to provide resources into a common slice Sites in Japan (CoreLab), Germany (G-Lab), and Brazil (LARC) Several US GENI Rack sites (TBD) To take place July 2012 at GEC 14 What do you want to do?