GENI Exploring Networks of the Future

Slides:



Advertisements
Similar presentations
Future Internet Research and Experiments EU vs USA 7 June, 2012 Róbert Szabó Dept. of Telecommunications and Media Informatics Budapest University of Technology.
Advertisements

Enabling GENI Connections Quilt GENI Workshop Heidi Picher Dempsey July 22, 2010.
The Instageni Initiative
Sponsored by the National Science Foundation1April 8, 2014, Testbeds as a Service: GENI Heidi Picher Dempsey Internet2 Annual Meeting April 8,
Sponsored by the National Science Foundation GENI Exploring Networks of the Future
Internet2 and AL2S Eric Boyd Senior Director of Strategic Projects
Title or Title Event/Date Presenter, PresenterTitle, Internet2 Network Virtualization & the Internet2 Innovation Platform To keep our community at the.
Internet2 Network: Convergence of Innovation, SDN, and Cloud Computing Eric Boyd Senior Director of Strategic Projects.
1 In VINI Veritas: Realistic and Controlled Network Experimentation Jennifer Rexford with Andy Bavier, Nick Feamster, Mark Huang, and Larry Peterson
1 GENI: Global Environment for Network Innovations Jennifer Rexford Princeton University
Sponsored by the National Science Foundation An Introduction to GENI Tools Sarah Edwards GENI Project Office.
Workshop on Prototyping and Deploying Software Defined Exchanges Chip Elliott, BBN / GENI June 5, 2014.
Sponsored by the National Science Foundation Omni: a command line GENI resource reservation tool Niky Riga, Sarah Edwards GENI Project Office 13 March,
Sponsored by the National Science Foundation Tutorial: Advanced Topics in Networking Experiments using GENI Niky Riga, Sarah Edwards GENI Project Office.
National Science Foundation Arlington, Virginia January 7-8, 2013 Tom Lehman University of Maryland Mid-Atlantic Crossroads.
Sponsored by the National Science Foundation Campus/Experiment Topics in Monitoring and I&M GENI Engineering Conference 15 Houston, TX Sarah Edwards Chaos.
Sponsored by the National Science Foundation GENI Exploring Networks of the Future Niky Riga, GENI Project Office
GENI Racks: Infrastructure Overview
Sponsored by the National Science Foundation GENI as a Virtual Laboratory for Networking and Distributed Systems Classes Workshop 7 at SIGCSE ‘14 Sarah.
Sponsored by the National Science Foundation Getting Started With Your Own Experiment Sarah Edwards, GENI Project Office.
1 Supporting the development of distributed systems CS606, Xiaoyan Hong University of Alabama.
Sponsored by the National Science Foundation Programmable Networks and GENI Marshall Brinn, GPO GEC October 25, 2012.
GEC3 – October 28-30, 20081www.geni.net1 Substrate WORKING GROUP System Engineering Report John Jacob SWG System Engineer groups.geni.net GENI working.
Sponsored by the National Science Foundation GENI Exploring Networks of the Future Quilt Workshop An invitation to join in GENI Meso-scale Prototyping.
GEC3www.geni.net1 GENI Spiral 1 Control Frameworks Global Environment for Network Innovations Aaron Falk Clearing.
Sponsored by the National Science Foundation Introduction to GENI Sarah Edwards GENI Project Office (GPO)
GEC 15 Houston, Texas October 23, 2012 Tom Lehman Xi Yang University of Maryland Mid-Atlantic Crossroads (MAX)
Resource Representations in GENI: A path forward Ilia Baldine, Yufeng Xin Renaissance Computing Institute,
Sponsored by the National Science Foundation GEC16 Plenary Session: GENI Solicitation 4 Tool Context Marshall Brinn, GPO March 20, 2013.
Sponsored by the National Science Foundation GEC14 Session: SDN * in GENI Marshall Brinn, GPO July 11, 2012 * Software-Defined Networking.
Sponsored by the National Science Foundation GENI Integration of Clouds and Cyberinfrastructure Chip Elliott GENI Project Director
Sponsored by the National Science Foundation Behind the Scenes of GENI Experimentation An Introduction to GENI Tools Sarah Edwards, GENI Project Office.
Sponsored by the National Science Foundation GENI Exploring Networks of the Future
Sponsored by the National Science Foundation Introduction to GENI Network Architecture
Sponsored by the National Science Foundation GENI Exploring Networks of the Future
Sponsored by the National Science Foundation GENI Exploring Networks of the Future Sarah Edwards, GPO
Sponsored by the National Science Foundation GENI Goals & Milestones GENI CC-NIE Workshop NSF Mark Berman January 7,
Sponsored by the National Science Foundation 1 Last updated April 1, 2013 Are you ready for the tutorial? 1.Sign In 2.Grab a Worksheet 3.Did you do the.
Sponsored by the National Science Foundation Getting Started With Your Own Experiment Sarah Edwards, GENI Project Office.
Sponsored by the National Science Foundation GENI Exploring Networks of the Future Sarah Edwards, GPO
Sponsored by the National Science Foundation GENI Campus Ops Workflow Chaos Golubitsky San Juan, Puerto Rico Mar
Sponsored by the National Science Foundation 1 GEC16, March 21, 2013 Are you ready for the tutorial? 1.Did you do the pre-work? A.Are you able to login.
Sponsored by the National Science Foundation GENI Aggregate Manager API Tom Mitchell March 16, 2010.
Behind the Scenes of GENI Experimentation Understanding GENI AM API and RSpec Sponsored by the National Science Foundation
Sponsored by the National Science Foundation GENI Exploring Networks of the Future
Sponsored by the National Science Foundation Behind the Scenes of GENI Experimentation An Introduction to GENI Tools Sarah Edwards, GENI Project Office.
Sponsored by the National Science Foundation 1 Train the TA – Sept 13, 2012 Getting Help after Today GENI wiki –Pages for Instructors and Experimenters.
Virtualization as Architecture - GENI CSC/ECE 573, Sections 001, 002 Fall, 2012 Some slides from Harry Mussman, GPO.
Sponsored by the National Science Foundation GENI Exploring Networks of the Future
Sponsored by the National Science Foundation GENI Exploring Networks of the Future
Behind the Scenes of GENI Experimentation An Introduction to GENI Tools Sponsored by the National Science Foundation.
Sponsored by the National Science Foundation GENI Exploring Networks of the Future
Sponsored by the National Science Foundation Behind the Scenes of GENI Experimentation An Introduction to GENI Tools Sarah Edwards GENI Project Office.
Sponsored by the National Science Foundation Understanding the AM API through a simple Hadoop experiment.
Sponsored by the National Science Foundation Introduction to GENI Network Architecture
Sponsored by the National Science Foundation GENI Terminology Sarah Edwards, GENI Project Office Violet Syrotiuk, Arizona State University.
Sponsored by the National Science Foundation GEC17 Plenary Session: Architecture Marshall Brinn, GPO July 22, 2013.
GENI Exploring Networks of the Future Vic Thomas
GENI Exploring Networks of the Future Vic Thomas
Introduction to GENI Ben Newton University of North Carolina at Chapel Hill
Understanding the AM API through a simple experiment
NextGENI: The Nation’s Edge Cloud
Getting Started With Your Own Experiment
The Need Addressed by CloudLab
GENI Terminology Sponsored by the National Science Foundation.
GENI Exploring and Teaching Networks of the Future Vicraj “Vic” Thomas
GENI Integration of Clouds and Cyberinfrastructure
Basic Tutorial Part II 31/12/2018.
GENI Exploring Networks of the Future
Presentation transcript:

GENI Exploring Networks of the Future www.geni.net

Outline What is GENI? How is GENI being used? Key GENI Concepts Demo: A simple experiment using GENI

GENI: Infrastructure for Experimentation GENI is a nationwide suite of infrastructure for “at scale” experiments in networking, distributed systems, security, and novel applications. GENI opens up huge new opportunities Leading-edge research in next-generation internets Rapid innovation in novel, large-scale applications Key GENI concept: slices & deep programmability Internet: open innovation in application programs GENI: open innovation deep into the network GENI provides compute resources that can be connected in experimenter specified Layer 2 topologies.

GENI: Infrastructure for Experimentation GENI is a nationwide suite of infrastructure for “at scale” experiments in networking, distributed systems, security, and novel applications. GENI opens up huge new opportunities Leading-edge research in next-generation internets Rapid innovation in novel, large-scale applications Key GENI concept: slices & deep programmability Internet: open innovation in application programs GENI: open innovation deep into the network GENI provides compute resources that can be connected in experimenter specified Layer 2 topologies.

Multiple GENI Experiments run Concurrently Experiments live in isolated “slices” Resources can be shared between slices

GENI is “Deeply Programmable” I install software I want throughout my network slice (into routers, switches, …) or control switches using OpenFlow Experimenters set up custom: topologies protocols forwarding OpenFlow part of the experiment not only the infrastructure

GENI Compute Resources Existing Testbeds Emulab Planetlab ORBIT GENI Racks GENI Wireless compute nodes

Creating and deploying GENI racks Ilia Baldine RENCI More resources / rack, fewer racks Latest addition Rajesh Narayanan DELL KC Wang Clemson Rick McGeer HP Labs Fewer resources / rack, more racks

GENI Networking Resources National Research Backbones (e.g. Internet2) Networking within a Rack Regional Networks (e.g. CENIC) 4G/3G GENI network WiMAX Base Stations

Federation GENI grows by GENI-enabling heterogeneous infrastructure My experiment runs across the evolving GENI federation. GENI Rack Commercial Clouds Backbone #1 Campus My GENI Slice Corporate GENI suites Access #1 Regional Research Testbed Non-US Testbeds This approach looks remarkably familiar . . . GENI Rack Avoid technology “lock in” and grow quickly by incorporating existing infrastructure 10

GENI Architecture g Flexible network / cloud research infrastructure Metro Research Backbones Internet ISP Regional Networks Campus g Legend GENI-enabled hardware Layer 3 Control Plane Layer 2 Data Plane Flexible network / cloud research infrastructure Also suitable for physics, genomics, other domain science Distributed cloud (racks) for content caching, acceleration, etc.

More WiMAX base stations with Android handsets Current GENI buildout More WiMAX base stations with Android handsets GENI-enable 5-6 regional networks Inject more OpenFlow switches into Internet2 Add GENI Racks to 50-80 locations within campuses, regionals, and backbone networks GENI Racks serve as programmable routers, distributed clouds, content distribution nodes, caching or transcoding nodes, etc

GMOC Google Calendar keeps track of reservations/outages GENI Operations GMOC: GENI Meta-operation Center Keeps track of outages Notification system for resource reservation Monitors most GENI Aggregates GMOC Google Calendar keeps track of reservations/outages

Federation Extends the Reach of GENI and International Peer Testbeds Initial plan to federate testbeds on five continents

Testbeds Involved Modified slide from: http://groups.geni.net/geni/attachment/wiki/GEC18Agenda/MonPlenary/GEC18_brecht_vermeulen_International_Federation.pdf

Outline What is GENI? How is GENI being used? Key GENI Concepts Demo: A simple experiment using GENI

As of October 2014, GENI has over 2700 users! How is GENI being Used? Research Future Internet architectures Software defined networking Large scale evaluation of smart grid protocols Education Over 50 classes using GENI in all levels Networking and Distributed systems classes Cloud computing classes WiMAX classes As of October 2014, GENI has over 2700 users!

Outline What is GENI? How is GENI being used? Key GENI Concepts Demo: A simple experiment using GENI

GENI: Terms and Definitions Slice Abstraction for a collection of resources capable of running experiments An experiment uses resources in a slice Slices isolate experiments Experimenters are responsible for their slices

Clearinghouse and Aggregates users slices clearinghouse projects Create & Register Slice Slice credentials Aggregate Manager API - listResources - createSliver … Researcher Tool Aggregate Manager Aggregate Resources Clearinghouse: Manages users, projects and slices Standard credentials shared via custom API or new Common CH API GENI supported accounts: GENI Portal/CH, PlanetLab CH, ProtoGENI CH Aggregate: Provides resources to GENI experimenters Typically owned and managed by an organization Speaks the GENI AM API Examples: PlanetLab, Emulab, GENI Racks on various campuses

GENI: Terms and Definitions A slice : One or more resources provided by an aggregate E.g. Bare machines, virtual machines, VLANs GENI Rack #3 Commercial Clouds My slice contains slivers from many aggregates. Backbone #1 GENI Rack #1 My GENI Slice Corporate GENI suites Access #1 Backbone #2 Research Testbed Other-Nation Projects GENI Rack #2

Resource Specifications (RSpecs) RSpecs: Lingua franca for describing and requesting resources “Machine language” for negotiating resources between experiment and aggregate Experimenter tools eliminate the need for most experimenters to write or read RSpec <?xml version="1.0" encoding="UTF-8"?> <rspec xmlns="http://www.protogeni.net/resources/rspec/2" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.protogeni.net/resources/rspec/2 http://www.protogeni.net/resources/rspec/2/request.xsd" type="request" > <node client_id="my-node" exclusive="true"> <sliver_type name="raw-pc" /> </node> </rspec> RSpec for requesting a single node

Resource Reservation using RSpecs and the AM API Advertisement RSpec: What does an aggregate have? Request RSpec: What does the experimenter want? Manifest RSpec: What does the experimenter have? ListResources(…) Advertisement RSpec Client CreateSliver(Request RSpec, …) Aggregate Manager Manifest RSpec ListResources(SliceName, …) Manifest RSpec

Outline What is GENI? How is GENI being used? Key GENI Concepts Demo: A simple experiment using GENI

Putting it all Together: Demo Create a slice Create a sliver at one aggregate Two computers (raw PCs), connected by a LAN Install and run software on the machines View output of software Delete sliver Experimenter tool: Jacks client (VM) server (VM)

HowTo pages on the GENI Wiki Ways to Get Help Sign Up for : geni-users@googlegroups.com Use #geni IRC chatroom HowTo pages on the GENI Wiki http://groups.geni.net/geni/wiki/GENIExperimenter/GetHelp

Other Important Lists geni-announce Experimenters Experimenter-ops GENI news and events Experimenters Announcements of interest to GENI experimenters Experimenter-ops Announcements about infrastructure maintenance Full list at: http://groups.geni.net/geni/wiki/GENICommunicationChannels

Answer is help@geni.net Have a question? Answer is help@geni.net which is an email list which only goes to members of the GPO including… Sarah Edwards Niky Riga Vic Thomas Have a question? The answer is always help@geni.net. help@geni.net goes to a number of friendly faces including Niky, Sarah & Vic. We’ll answer your question or redirect it the appropriate place. Always email help@geni.net instead of emailing us directly, as it ensures a more timely response. (However, the archive of the list is public)

Questions?

Backup Slides

Build GENI at sufficient scale Infeasible to build a testbed as big as the Internet HP ProCurve 5400 Switch NEC WiMAX Base Station GENI-enabled equipment GENI-enabled campuses, students as early adopters “At scale” GENI prototype GENI-enable testbeds, commercial equipment, campuses, regional and backbone networks Campus photo by Vonbloompasha

Current GMOC Operational Support Monitor and triage problem resolution on the GENI Integrate OpenFlow Core network (Mesoscale) Emergency Stop GENI Experimenter Support Manage network/systems alarms, outages, maintenances, Mesoscale provisioning, maintenance freezes, demo reservations and disruptive experiment reservations (and post-mortem) Notifications, Escalation and Reporting Engineering configuration (Internet2, MOXI, Indiana) and new Aggregate site, regional and GENI rack turn-up GMOC Measurement API for GENI Aggregates Develop new tools for network monitoring and measurement Modified slide from: http://groups.geni.net/geni/attachment/wiki/GEC18Agenda/RackOpsAndMeasurement/GEC18%20GMOC%20Presentation.pdf