1. Sponsored by the National Science Foundation GENI Exploring Networks of the Future Niky Riga, GENI Project Office (nriga@bbn.com) www.geni.net

2. Sponsored by the National Science Foundation2GENI Introduction – NTUA 17 February 2014www.geni.net Outline GENI – Exploring future internets at scale The GENI Concept Building GENI Experimental and Classroom use of GENI GENI: An experimenter’s view

3. Sponsored by the National Science Foundation3GENI Introduction – NTUA 17 February 2014www.geni.net Credit: MONET Group at UIUC Society Issues We increasingly rely on the Internet but are unsure we can trust its security, privacy or resilience Science Issues We cannot currently understand or predict the behavior of complex, large-scale networks Innovation Issues Substantial barriers to at-scale experimentation with new architectures, services, and technologies Global networks are creating extremely important new challenges

4. Sponsored by the National Science Foundation4GENI Introduction – NTUA 17 February 2014www.geni.net GENI: Infrastructure for Experimentation GENI provides compute resources that can be connected in experimenter specified Layer 2 topologies.

5. Sponsored by the National Science Foundation5GENI Introduction – NTUA 17 February 2014www.geni.net GENI: Infrastructure for Experimentation GENI provides compute resources that can be connected in experimenter specified Layer 2 topologies.

6. Sponsored by the National Science Foundation6GENI Introduction – NTUA 17 February 2014www.geni.net Multiple GENI Experiments run Concurrently Resources can be shared between slices Experiments live in isolated “slices”

7. Sponsored by the National Science Foundation7GENI Introduction – NTUA 17 February 2014www.geni.net GENI is “Deeply Programmable” I install software I want throughout my network slice (into routers, switches, …) or control switches using OpenFlow Experimenters can set up custom topologies, protocols and switching of flows

8. Sponsored by the National Science Foundation8GENI Introduction – NTUA 17 February 2014www.geni.net GENI Compute Resources GENI Racks Existing Testbeds (e.g. Emulab) GENI Wireless compute nodes

9. Sponsored by the National Science Foundation9GENI Introduction – NTUA 17 February 2014www.geni.net GENI Networking Resources Networking within a Rack National Research Backbones (e.g. Internet2) Regional Networks (e.g. CENIC) WiMAX Base Stations

10. Sponsored by the National Science Foundation10GENI Introduction – NTUA 17 February 2014www.geni.net Outline GENI – Exploring future internets at scale The GENI Concept Building GENI Experimental and Classroom use of GENI GENI: An experimenter’s view

11. Sponsored by the National Science Foundation11GENI Introduction – NTUA 17 February 2014www.geni.net “I have a great idea.” “That will never work.” A bright idea

12. Sponsored by the National Science Foundation12GENI Introduction – NTUA 17 February 2014www.geni.net Let’s try it out! My new architecture worked great in the lab, so now I’m going to try a larger experiment for a few months. He uses a modest slice of GENI, sharing its infrastructure with many other concurrent experiments.

13. Sponsored by the National Science Foundation13GENI Introduction – NTUA 17 February 2014www.geni.net It turns into a really good idea His slice of GENI keeps growing, but GENI is still running many other concurrent experiments. This service looks very useful

14. Sponsored by the National Science Foundation14GENI Introduction – NTUA 17 February 2014www.geni.net “Looks like an app to me.” “It’s my very own GENI slice.” Attracts real users

15. Sponsored by the National Science Foundation15GENI Introduction – NTUA 17 February 2014www.geni.net “Boy did I learn a lot!” “What a cool service.” (I wonder how it works.) “I always said it was a great idea.” (But way too conservative.)

16. Sponsored by the National Science Foundation16GENI Introduction – NTUA 17 February 2014www.geni.net ??

17. Sponsored by the National Science Foundation17GENI Introduction – NTUA 17 February 2014www.geni.net Moral of this story GENI is meant to enable... –At-scale experiments –Internet-incompatible experiments –Both repeatable and “in the wild” experiments –‘Opt in’ for real users –Instrumentation and measurement tools GENI creates a huge opportunity for ambitious research!

18. Sponsored by the National Science Foundation18GENI Introduction – NTUA 17 February 2014www.geni.net Outline GENI – Exploring future internets at scale The GENI Concept Building GENI Experimental and Classroom use of GENI GENI: An experimenter’s view

19. Sponsored by the National Science Foundation19GENI Introduction – NTUA 17 February 2014www.geni.net Growing GENI’s footprint

20. Sponsored by the National Science Foundation20GENI Introduction – NTUA 17 February 2014www.geni.net Federation GENI grows by GENI-enabling heterogeneous infrastructure Avoid technology “lock in” and grow quickly by incorporating existing infrastructure Backbone #1 Regional GENI Rack Access #1 Commercial Clouds Corporate GENI suites Non-US Testbeds Research Testbed Campus My experiment runs across the evolving GENI federation. My GENI Slice This approach looks remarkably familiar...

21. Sponsored by the National Science Foundation21GENI Introduction – NTUA 17 February 2014www.geni.net “At scale” GENI prototype Campus photo by Vonbloompasha Build GENI at sufficient scale Infeasible to build a testbed as big as the Internet GENI-enabled campuses, students as early adopters HP ProCurve 5400 Switch NEC WiMAX Base Station GENI-enabled equipment GENI-enable testbeds, commercial equipment, campuses, regional and backbone networks

22. Sponsored by the National Science Foundation22GENI Introduction – NTUA 17 February 2014www.geni.net GENI architecture Flexible network / cloud research infrastructure Also suitable for physics, genomics, other domain science Support “hybrid circuit” model plus much more (OpenFlow) Distributed cloud (racks) for content caching, acceleration, etc. Metro Research Backbones Internet ISP Regional Networks Campus g g g Legend GENI-enabled hardware Layer 3 Control Plane Layer 2 Data Plane

23. Sponsored by the National Science Foundation23GENI Introduction – NTUA 17 February 2014www.geni.net Toroki LightSwitch 4810 Georgia Tech: a great example Nick Feamster PI Russ Clark, GT-RNOC Ellen Zegura Ron Hutchins, OIT OpenFlow in 4 GT lab buildings now Aware Home Students will “live in the future” – Internet in one slice, multiple future internets in additional slices Trials of “GENI-enabled” commercial equipment Arista 7124S Switch HP ProCurve 5400 SwitchJuniper MX240 Ethernet Services Router NEC IP8800 Ethernet Switch NEC WiMAX Base Station HTC Android smart phone GENI racks

24. Sponsored by the National Science Foundation24GENI Introduction – NTUA 17 February 2014www.geni.net Example regional network CENIC OpenFlow buildout

25. Sponsored by the National Science Foundation25GENI Introduction – NTUA 17 February 2014www.geni.net GENI on Internet2 A major step towards campus expansion Collaboration to implement national-scale infrastructure –sliced and deeply-programmable –incorporating OpenFlow/SDN switches, GENI Racks, etc. –high-speed (10-100 Gbps) With software that supports shared use by faculty, students, and campus IT organizations In-progress migration from “prototype GENI” to AL2S production system Scaling to an envisioned goal of 100-200 GENI campuses ION AM to support dynamic provisioning within Internet2

26. Sponsored by the National Science Foundation26GENI Introduction – NTUA 17 February 2014www.geni.net GENI WiMAX Agreements Agreement with Clearwire –Clearwire and Rutgers University have signed a master agreement –encompassing all WiMAX sites, to ensure operation in the EBS Band. –An emergency stop procedure, in case of interference with Clearwire service, has been agreed upon. GENI Mobile Virtual Network Operator (MVNO) - Partner with Sprint and Arterra (a Sprint partner) to create and operate an (MVNO) that serves the academic research community - The effort is led by Jim Martin, Clemson Univ, and is underway with a 1 year NSF EAGER

27. Sponsored by the National Science Foundation27GENI Introduction – NTUA 17 February 2014www.geni.net Current GENI buildout More WiMAX base stations with Android handsets GENI-enable 5-6 regional networks Inject more OpenFlow switches into Internet2 Add GENI Racks to 50 locations within campuses, regionals, and backbone networks GENI Racks serve as programmable routers, distributed clouds, content distribution nodes, caching or transcoding nodes, etc

28. Sponsored by the National Science Foundation28GENI Introduction – NTUA 17 February 2014www.geni.net Creating and deploying GENI racks ExoGENI Rack Installed at GPO – Feb 22, 2012 Ilia Baldine RENCI More resources / rack, fewer racks Rick McGeer HP Labs Fewer resources / rack, more racks

29. Sponsored by the National Science Foundation29GENI Introduction – NTUA 17 February 2014www.geni.net GENI WiMAX 2013 Researcher-owned, researcher-operated 4G cellular systems 26 Wimax Base Stations in 13 Sites Sliced, virtualized and interconnected On the Air Not On the Air

30. Sponsored by the National Science Foundation30GENI Introduction – NTUA 17 February 2014www.geni.net Federation Extends the Reach of GENI and International Peer Testbeds Initial plan to federate testbeds on five continents

31. Sponsored by the National Science Foundation31GENI Introduction – NTUA 17 February 2014www.geni.net Testbeds Involved Modified slide from: http://groups.geni.net/geni/attachment/wiki/GEC18Agenda/MonPlenary/GEC18_brecht_vermeulen_International_Fe deration.pdf

32. Sponsored by the National Science Foundation32GENI Introduction – NTUA 17 February 2014www.geni.net GENI Operations GMOC: GENI Meta-operation Center Keeps track of outages Notification system for resource reservation Monitors most GENI Aggregates GMOC Google Calendar keeps track of reservations/outages

33. Sponsored by the National Science Foundation33GENI Introduction – NTUA 17 February 2014www.geni.net GMOC Calendar Scheduled Unscheduled

34. Sponsored by the National Science Foundation34GENI Introduction – NTUA 17 February 2014www.geni.net Current GMOC Operational Support Monitor and triage problem resolution on the GENI Integrate OpenFlow Core network (Mesoscale) Emergency Stop GENI Experimenter Support Manage network/systems alarms, outages, maintenances, –Mesoscale provisioning, maintenance freezes, demo reservations and disruptive experiment reservations (and post-mortem) Notifications, Escalation and Reporting Engineering configuration (Internet2, MOXI, Indiana) and new Aggregate site, regional and GENI rack turn-up GMOC Measurement API for GENI Aggregates Develop new tools for network monitoring and measurement Modified slide from: http://groups.geni.net/geni/attachment/wiki/GEC18Agenda/RackOpsAndMeasurement/GEC18%20GMOC%20Prese ntation.pdf

35. Sponsored by the National Science Foundation35GENI Introduction – NTUA 17 February 2014www.geni.net GENI Monitoring System “Complete” monitoring system functionality motivated by three representative use cases: –LLR inquiry (Legal, Law Enforcement & Regulatory) –Usage and health report –Problem alerting and status Components of system needed to support use cases: –Overview of components –Current status (what’s complete, what’s not started, what’s in progress) More on GENI Operations http://groups.geni.net/geni/wiki/GEC18Agenda/RackOpsAndMeasurement

36. Sponsored by the National Science Foundation36GENI Introduction – NTUA 17 February 2014www.geni.net Outline GENI – Exploring future internets at scale The GENI Concept Building GENI Experimental and Classroom use of GENI GENI: An experimenter’s view

37. Sponsored by the National Science Foundation37GENI Introduction – NTUA 17 February 2014www.geni.net How is GENI being Used? Research Future Internet architectures Software defined networking Large scale evaluation of smart grid protocols Education Networking and Distributed systems classes Cloud computing classes WiMAX classes As of October 2013, GENI had over a 1200 users!

38. Sponsored by the National Science Foundation38GENI Introduction – NTUA 17 February 2014www.geni.net Three FIA Teams have Slices on GENI GENI is the only testbed that can support these teams. XIA (demo at GEC15) NDN (demo at GEC 13) MobilityFirst (demo at GEC 12 & GEC18)

39. Sponsored by the National Science Foundation39GENI Introduction – NTUA 17 February 2014www.geni.net Multi-radar NetCDF Data Nowcast Processing 1.Spin up system in Amazon commercial EC2 and S3 services on demand “raw” live data Generate “raw” live data ViSE/CASA radar nodes Generate “raw” live data ViSE/CASA radar nodes http://stb.ece.uprm.edu/current.jsp ViSE views steerable radars as shared, virtualized resources http://geni.cs.umass.edu/vise ViSE views steerable radars as shared, virtualized resources http://geni.cs.umass.edu/vise Nowcast images for display Nowcast images for display Weather NowCasting University of Massachusetts David Irwin et al Create and run realtime “weather service on demand” as storms turn life-threatening

40. Sponsored by the National Science Foundation40GENI Introduction – NTUA 17 February 2014www.geni.net Virtual Desktop Cloud Prasad Calyam University of Missouri Program realtime load- balancing functionality deep into the network to improve QoE

41. Sponsored by the National Science Foundation41GENI Introduction – NTUA 17 February 2014www.geni.net GENI in the Classroom Undergrad Classes –Reinforce learning of key concepts Graduate classes –Hands-on experience of advanced concepts –Project in GENI Classes in: –Computer Networking, Wireless and Mobile Networking, Distributed Systems, Cloud Computing 10-20 classes per semester

42. Sponsored by the National Science Foundation42GENI Introduction – NTUA 17 February 2014www.geni.net GENI at Upcoming Conferences

43. Sponsored by the National Science Foundation43GENI Introduction – NTUA 17 February 2014www.geni.net Outline GENI – Exploring future internets at scale The GENI Concept Building GENI Experimental and Classroom use of GENI GENI: An experimenter’s view

44. Sponsored by the National Science Foundation44GENI Introduction – NTUA 17 February 2014www.geni.net Access to GENI For many experimenters: no new passwords familiar login screens Leverage InCommon for single sign-on authentication Experimenters from 304 educational and research institutions have InCommon accounts GENI Project Office runs a federated IdP to provide accounts for non-federated organizations.

45. Sponsored by the National Science Foundation45GENI Introduction – NTUA 17 February 2014www.geni.net The GENI Portal is… A web-based tool for experimenters to manage experimenters, projects, and slices.

46. Sponsored by the National Science Foundation46GENI Introduction – NTUA 17 February 2014www.geni.net For GENI IdP Accounts … 1.Sign up with an institutional email address (ie ntua.gr email) that you have access to –Forwarding on that email address is ok 2.Reply to follow up email confirming that you made the request –The account creation process can take a couple of days.

47. Sponsored by the National Science Foundation47GENI Introduction – NTUA 17 February 2014www.geni.net GENI: Terms and Definitions –An experiment uses resources in a slice –Slices isolate experiments –Experimenters are responsible for their slices Slice Abstraction for a collection of resources capable of running experiments

48. Sponsored by the National Science Foundation48GENI Introduction – NTUA 17 February 2014www.geni.net Slice credentials GENI: Terms and Definitions Slice authority: Creates and registers slices –GENI slice authorities: PlanetLab, ProtoGENI, GPO Lab Aggregate: Provides resources to GENI experimenters –Typically owned and managed by an organization –Examples: PlanetLab, Emulab, GENI Rack on various campuses –Aggregates implement the GENI AM API Create & Register Slice Researcher Slice Authority Aggregate Manager API - listResources - createSliver … Aggregate Manager Aggregate Resources

49. Sponsored by the National Science Foundation49GENI Introduction – NTUA 17 February 2014www.geni.net GENI: Terms and Definitions Sliver: One or more resources provided by an aggregate –E.g. Bare machines, virtual machines, VLANs Backbone #1 Backbone #2 Campus #3 Campus #2 Access #1 Commercial Clouds Corporate GENI suites Other-Nation Projects Research Testbed Campus My GENI Slice My slice contains slivers from many aggregates.

50. Sponsored by the National Science Foundation50GENI Introduction – NTUA 17 February 2014www.geni.net RSpecs RSpecs: Lingua franca for describing and requesting resources –“Machine language” for negotiating resources between experiment and aggregate –Experimenter tools eliminate the need for most experimenters to write or read RSpec <rspec xmlns="http://www.protogeni.net/resources/rspec/2" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.protogeni.net/resources/rspec/2 http://www.protogeni.net/resources/rspec/2/request.xsd" type="request" > <node client_id="my-node" exclusive="true"> RSpec for requesting a single node

51. Sponsored by the National Science Foundation51GENI Introduction – NTUA 17 February 2014www.geni.net Sliver Creation using Rspecs and the AM API Advertisement RSpec: What does an aggregate have? Request RSpec: What does the experimenter want? Manifest RSpec: What does the experimenter have? Aggregate Manager Client ListResources(…) Advertisement RSpec CreateSliver(Request RSpec, …) Manifest RSpec ListResources(SliceName, …) Manifest RSpec

52. Sponsored by the National Science Foundation52GENI Introduction – NTUA 17 February 2014www.geni.net Putting it all Together: Demo 2 Demos –Create a slice –Create a sliver at one aggregate Two computers (VMs), connected by a LAN –Install and run software on the machines* –View output of software –Delete sliver Experimenter tool: Flack *Second Demo Server VM client VM

53. Sponsored by the National Science Foundation53GENI Introduction – NTUA 17 February 2014www.geni.net Start Demo Login to GENI Experimenter Portal Create slice Launch Flack Draw topology Create sliver Verify sliver creation was successful

54. Sponsored by the National Science Foundation54GENI Introduction – NTUA 17 February 2014www.geni.net GENI Tools: Instrumentation & Measurement Two major I&M systems being implemented –GEMINI (Indiana U. & U. of Kentucky) –GIMI (U. of Massachusetts, RENCI, NICTA) Support for active and passive measurements Repositories for archiving (and searching) for measurement data & meta-data The GENI Desktop and GEMINI LabWiki and GIMI

55. Sponsored by the National Science Foundation55GENI Introduction – NTUA 17 February 2014www.geni.net Omni: Resource Reservation tool A command line experimenter tool Useful for making AM API calls on aggregates Written in and scriptable from Python Works with aggregates that implement the GENI AM API –ProtoGENI, PlanetLab, OpenFlow, InstaGENI, ExoGENI $ omni.py createsliver aliceslice myRSpec.xml INFO:omni:Loading config file omni_config INFO:omni:Using control framework pgeni INFO:omni:Slice urn:publicid:IDN+pgeni.gpolab. expires within 1 day on 2011-07-07 INFO:omni:Creating sliver(s) from rspec file INFO:omni:Writing result of createsliver for INFO:omni:Writing to ‘aliceslice-manifest-rspe INFO:omni: ----------------------------------- INFO:omni: Completed createsliver: Options as run: aggregate: https://www.emulab. framework: pgeni native: True Args: createsliver aliceslice myRSpec.xml Result Summary: Slice urn:publicid:IDN+pgeni Reserved resources on https://www.emulab.net/p Saved createsliver results to aliceslice-man INFO:omni: =================================== http://trac.gpolab.bbn.com/gcf/wiki/Omni

56. Sponsored by the National Science Foundation56GENI Introduction – NTUA 17 February 2014www.geni.net Do Try This at Home! Tutorials on the GENI wiki –Look for the icon on the GENI wiki and then click on for tutorials Ensure you have a GENI account today!

57. Sponsored by the National Science Foundation57GENI Introduction – NTUA 17 February 2014www.geni.net QUESTIONS?