Sponsored by the National Science Foundation Getting Started With Your Own Experiment Sarah Edwards, GENI Project Office.

Slides:



Advertisements
Similar presentations
Sponsored by the National Science Foundation GENI Exploring Networks of the Future
Advertisements

Sponsored by the National Science Foundation Running a class in GENI GENI Project Office.
Sponsored by the National Science Foundation Campus Policies for the GENI Clearinghouse and Portal Sarah Edwards, GPO March 20, 2013.
Sponsored by the National Science Foundation Working with Collaborators.
Sponsored by the National Science Foundation Lab Zero: A First Experiment.
Sponsored by the National Science Foundation Practical Advice for Using GENI in the Classroom Sarah Edwards, Niky Riga GENI Project Office.
Sponsored by the National Science Foundation 1 Lab Zero – November 6, 2014 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you.
Sponsored by the National Science Foundation An Introduction to GENI Tools Sarah Edwards GENI Project Office.
Using the jFed tool to experiment from zero to hero Brecht Vermeulen FGRE, July 7 th, 2015.
Sponsored by the National Science Foundation A Virtual Computer Networking Lab Mike Zink, Max Ott, Jeannie Albrecht GEC 23, June 16 th 2015.
Sponsored by the National Science Foundation Omni: a command line GENI resource reservation tool Niky Riga, Sarah Edwards GENI Project Office 13 March,
Sponsored by the National Science Foundation Tutorial: Advanced Topics in Networking Experiments using GENI Niky Riga, Sarah Edwards GENI Project Office.
Sarah Edwards, GENI Project Office
National Science Foundation Arlington, Virginia January 7-8, 2013 Tom Lehman University of Maryland Mid-Atlantic Crossroads.
Sponsored by the National Science Foundation Campus/Experiment Topics in Monitoring and I&M GENI Engineering Conference 15 Houston, TX Sarah Edwards Chaos.
Sponsored by the National Science Foundation Running a Class in GENI GENI Project Office.
Sponsored by the National Science Foundation1GENI Introduction – SIGCSE ‘14 – 5 March 2014www.geni.net Agenda Presentation and Demo: An Introduction to.
Using the jFed tool to experiment from zero to hero Brecht Vermeulen Thijs Walcarius GEC 22, March 24 th, 2015.
Sponsored by the National Science Foundation Running a class: Account Management Sarah Edwards GENI Project Office.
Sponsored by the National Science Foundation GEC19-March Are you ready for the tutorial? Grab a Worksheet and instructions Did you do the pre-work?
Sponsored by the National Science Foundation GEC16 Plenary Session: GENI Solicitation 4 Tool Context Marshall Brinn, GPO March 20, 2013.
Sponsored by the National Science Foundation 1 September 15, 2015 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you do the.
Sponsored by the National Science Foundation Behind the Scenes of GENI Experimentation An Introduction to GENI Tools Sarah Edwards, GENI Project Office.
Sponsored by the National Science Foundation GENI Exploring Networks of the Future
Sponsored by the National Science Foundation GENI Exploring Networks of the Future Sarah Edwards, GPO
Sponsored by the National Science Foundation GENI Terminology.
Sponsored by the National Science Foundation GENI Terminology: How All the Pieces Fit Together Sarah Edwards GENI Project Office.
Sponsored by the National Science Foundation Running a Class in GENI Sarah Edwards GENI Project Office.
Sponsored by the National Science Foundation 1 GREESC15– May 25, 2015 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you do.
Sponsored by the National Science Foundation GENI Current Ops Workflow Connectivity John Williams San Juan, Puerto Rico Mar
Sponsored by the National Science Foundation Lab Zero: A First Experiment using GENI Sarah Edwards, GENI Project Office.
Sponsored by the National Science Foundation 1 Last updated April 1, 2013 Are you ready for the tutorial? 1.Sign In 2.Grab a Worksheet 3.Did you do the.
Sponsored by the National Science Foundation Tutorial: Introduction to Omni Niky Riga GENI Project Office GREESC13 $ omni.py createsliver aliceslice myRSpec.xml.
Sponsored by the National Science Foundation Getting Started With Your Own Experiment Sarah Edwards, GENI Project Office.
Sponsored by the National Science Foundation Systematic Experimentation in GENI.
Sponsored by the National Science Foundation GMOC Support for GENI Racks Kevin Bohan, GMOC Eldar Urumbaev, GMOC.
Sponsored by the National Science Foundation 1 ICDCS13: July 8, 2013 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you do the.
Sponsored by the National Science Foundation GENI Exploring Networks of the Future Sarah Edwards, GPO
Sponsored by the National Science Foundation 1 GEC16: March 20, 2013 Are you ready for the tutorial? 1.Did you do the pre-work? A.Are you able to login.
Sponsored by the National Science Foundation Lab Zero: A First Experiment using GENI.
Sponsored by the National Science Foundation Systematic Experimentation in GENI Sarah Edwards GENI Project Office.
Sponsored by the National Science Foundation Understanding the AM API through a simple Hadoop experiment.
Sponsored by the National Science Foundation 1 GEC16, March 21, 2013 Are you ready for the tutorial? 1.Did you do the pre-work? A.Are you able to login.
Sponsored by the National Science Foundation 1 GREE SC: June 24, 2013 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you do.
Behind the Scenes of GENI Experimentation Understanding GENI AM API and RSpec Sponsored by the National Science Foundation
Sponsored by the National Science Foundation Behind the Scenes of GENI Experimentation An Introduction to GENI Tools Sarah Edwards, GENI Project Office.
Sponsored by the National Science Foundation GEC19 Outbrief: GENI in the Classroom, Experimenter-Developer Roundtable, Tutorials Vic Thomas, Niky Riga.
Sponsored by the National Science Foundation 1 Train the TA – Sept 13, 2012 Getting Help after Today GENI wiki –Pages for Instructors and Experimenters.
Sponsored by the National Science Foundation Lab Zero: A First Experiment using GENI Sarah Edwards GENI Project Office.
Sponsored by the National Science Foundation Getting Started With Your Own Experiment.
Sponsored by the National Science Foundation Today’s Exercise.
Sponsored by the National Science Foundation 1 Lab Zero – October 20, 2014 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you.
Sponsored by the National Science Foundation GENI Exploring Networks of the Future
Sponsored by the National Science Foundation A Virtual Computer Networking Lab Mike Zink, Max Ott, Jeannie Albrecht GEC 20, March 24 th 2015.
Sponsored by the National Science Foundation 1 Lab Zero – March 14, 2014 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you.
Sponsored by the National Science Foundation Wrap Up Sarah Edwards GENI Project Office.
Sponsored by the National Science Foundation Behind the Scenes of GENI Experimentation An Introduction to GENI Tools Sarah Edwards GENI Project Office.
Sponsored by the National Science Foundation Understanding the AM API through a simple Hadoop experiment.
Sponsored by the National Science Foundation Systematic Experimentation Sarah Edwards GENI Project Office.
Sponsored by the National Science Foundation GENI Terminology Sarah Edwards, GENI Project Office Violet Syrotiuk, Arizona State University.
Sponsored by the National Science Foundation 1 GEC16: March 19, 2013 Are you ready for the tutorial? 1.Sign In 2.Grab a Worksheet 3.Did you do the pre-work?
Sponsored by the National Science Foundation GEC17 Plenary Session: Architecture Marshall Brinn, GPO July 22, 2013.
Using the jFed tool to experiment from zero to hero
Run a Complete Experiment
Lab Zero: A First Experiment using GENI
GENI Exploring Networks of the Future
Understanding the AM API through a simple experiment
Getting Started With Your Own Experiment
GENI Terminology Sponsored by the National Science Foundation.
GENI Exploring Networks of the Future
Presentation transcript:

Sponsored by the National Science Foundation Getting Started With Your Own Experiment Sarah Edwards, GENI Project Office

Sponsored by the National Science Foundation GENI Accounts and Projects Advice and Intermediate Topics Getting Help / Learning More GENI Accounts and Projects

Sponsored by the National Science Foundation 3 IC2E ‘14 – March 10, 2014 Access to GENI For many experimenters: no new passwords familiar login screens Leverage InCommon for single sign-on authentication Experimenters from 342 educational and research institutions have InCommon accounts GENI Project Office runs a federated IdP to provide accounts for non-federated organizations.

Sponsored by the National Science Foundation 4 IC2E ‘14 – March 10, 2014 Projects Projects organize research in GENI Projects contain both people and their experiments A project is led by a single responsible individual: the project lead Project Lead Members Slice

Sponsored by the National Science Foundation 5 IC2E ‘14 – March 10, 2014 Project Membership example Projects have 1 Lead and any number of Admins, Members, and Auditors Typical Class Expiration Typical Research Project

Sponsored by the National Science Foundation 6 IC2E ‘14 – March 10, 2014 Populating a Project 1.Member-initiated Each experimenter asks to join a project, approval needed Typical for Research projects 1.Admin-initiated Project Lead/Admin bulk-adds experimenters Typical for Classrooms or Tutorials

Sponsored by the National Science Foundation 7 IC2E ‘14 – March 10, 2014 Slice Membership example Slices have: 1 Lead (person who created the slice) any number of Admins, Members, and Auditors Project Lead/Admins added as slice Admins Research Asst Slice Lead Research Asst Slice Lead Post-Doc Slice Member Professor Slice Admin Professor Slice Admin

Sponsored by the National Science Foundation 8 IC2E ‘14 – March 10, 2014 Project and Slice Roles Create project Modify project & manage membership Create sliceView project Project Lead ✔✔✔✔ Admin ✔✔✔ Member ✔✔ Auditor ✔ Manage slice membership Act on sliceView sliceAccount/ keys loaded on slice Slice Lead ✔✔✔✔ Admin ✔✔✔✔ Member ✔✔✔ Auditor ✔✔

Sponsored by the National Science Foundation 9 IC2E ‘14 – March 10, 2014 Slice Access Being a member of a slice means you can act on a slice: –Add resources –Check status –Delete resources –Renew resources With any tool!

Sponsored by the National Science Foundation GENI Accounts and Projects Intermediate Topics Getting Help / Learning More Advice and Intermediate Topics

Sponsored by the National Science Foundation 11 IC2E ‘14 – March 10, 2014 Designing your experiment Decide on compute resources (raw PCs, VMs, memory, etc) Decide on networking needs Start small –Debug your experiment is small, isolated topologies that you control all pieces

Sponsored by the National Science Foundation 12 IC2E ‘14 – March 10, 2014 GENI Compute Resources ExoGENI, InstaGENI, ProtoGENI are they different and how do I choose? The important thing is your experiment, so you should always start by designing your experiment and don’t worry about the aggregate. ExoGENI, InstaGENI: GENI racks developed by different teams ProtoGENI: Pre-existing testbeds that are GENI enabled, InstaGENI is based on ProtoGENI software

Sponsored by the National Science Foundation 13 IC2E ‘14 – March 10, 2014 Inter-aggregate Links Stitching –Creates an inter-domain VLAN –Stitcher: Distributed with gcf/omni –Flukes: ExoGENI-only (not via GENI AM API) GRE tunnels over control interface –Use Flack to connect IG nodes via a GRE tunnel –Manually configure GRE tunnels between EG nodes Shared VLANs –Some pre-configured inter-domain shared VLANs are available –Some are OpenFlow-enabled

Sponsored by the National Science Foundation 14 IC2E ‘14 – March 10, 2014 Running your experiment Automate your experiment –Make it easy to bring up and run it Save the Rspec Backup your software –Resources can expire –Nodes may fail –Aggregates might go on maintanance

Sponsored by the National Science Foundation 15 IC2E ‘14 – March 10, 2014 Reproducible Experiments Two approaches: –Use existing images with install scripts –Use custom images or snapshots Image creation –ExoGENI provides a sandbox for image creation Snapshot images –InstaGENI provides standard images which are easy to snapshot Snapshot image: taGENI … or combine the two approaches

Sponsored by the National Science Foundation 16 IC2E ‘14 – March 10, 2014 Disruptive experiments Experiments: with high resource constraints –e.g. high bandwidth, many compute resources OpenFlow experiments with “risky” topologies –e.g with loops traversing national backbones requiring performance isolation Notify resource owners and the community

Sponsored by the National Science Foundation 17 IC2E ‘14 – March 10, 2014 GMOC GMOC: GENI Meta-operation Center Keeps track of outages Notification system for resource reservation GMOC Google Calendar keeps track of reservations/outages

Sponsored by the National Science Foundation GENI Accounts and Projects Advice and Intermediate Topics Getting Help / Learning More Getting Help / Learning More

Sponsored by the National Science Foundation 19 IC2E ‘14 – March 10, 2014 Answer is Have a question? Sarah Edwards Niky Riga Vic Thomas which is an list which only goes to members of the GPO including… (However, the archive of the list is public)

Sponsored by the National Science Foundation 20 IC2E ‘14 – March 10, 2014 Ways to Get Help Sign Up for : Use #geni IRC chatroom Go over HowTo pages

Sponsored by the National Science Foundation 21 IC2E ‘14 – March 10, 2014 General debug advice 1. Gather as much information as you can –Be specific about what is not working Step-by-step run through usually helps –Include what you see (screenshots, omni output errors) –Always include: type of account you are using (eg portal) the tool you are using (eg Flack, omni, portal) your slice name or URN aggregates you are using a detailed description of what's wrong including any error messages 2.Contact for help 3.Register for resource mailing lists

Sponsored by the National Science Foundation 22 IC2E ‘14 – March 10, 2014 Finding other resources GENI wiki –Pages for Instructors and Experimenters

Sponsored by the National Science Foundation 23 IC2E ‘14 – March 10, 2014 Popular Samples Tutorials: Lab Zero Basic GENI understanding, ensures students setup their environment Intro To OpenFlow Basic OpenFlow introductory tutorial, students learn how to setup OVS and write simple controllers Assignments: IPv4 Routing Students understand IPv4 forwarding and how to configure static routes TCP Network Awareness Students explore different TCP flavors and TCP parameters

Sponsored by the National Science Foundation 24 IC2E ‘14 – March 10, 2014 “How To” pages Listed under the “Experimenters” section Each “How To” is a short descriptions of how to do various tasks New entries being added all the time

Sponsored by the National Science Foundation 25 IC2E ‘14 – March 10, 2014 Ways to Learn More Sign up for to be notified about: GENI Engineering Conferences, 3x/year, open to all: –Planning & discussion for experimenters, software, infrastructure –Tutorials and workshops –Travel grants to US academics for participant diversity –GEC19 March 17-19, 2014, Georgia Tech, Atlanta GENI Summer Camp Train-the-TA at the start of each semester (online-only) Sign up at:

Sponsored by the National Science Foundation 26 IC2E ‘14 – March 10, Thank you for attending! Please fill out the survey

Sponsored by the National Science Foundation 27 IC2E ‘14 – March 10, 2014 Backup

Sponsored by the National Science Foundation Solutions to Common Problems

Sponsored by the National Science Foundation 29 IC2E ‘14 – March 10, 2014 Common Problems Problem: Resources disappeared Possible causes: –Slice expired –Resources (aka slivers) expired Debug strategy: –Check slice/sliver status –Reserve resources again if expired  –Don’t rely on nodes for storage Edit scripts locally and scp to your nodes Copy data off machines

Sponsored by the National Science Foundation 30 IC2E ‘14 – March 10, 2014 Expiration and renewal slice expiration time ≤ project expiration time each resource expiration time ≤ slice expiration time each resource expiration time ≤ aggregate’s max expiration project slice resource (optional) project expiration time slice expiration time resource expiration time now In general, to extend the lifetime of your resource reservation, you must renew the slice and all resources resource

Sponsored by the National Science Foundation 31 IC2E ‘14 – March 10, 2014 Extend slice/resour ce expirations Slice and Sliver Expiration $ omni renewslice $ omni renewsliver –a gpo-ig myslice $ omni renewsliver –a renci-eg myslice $ omni renewsliver –a missouri-ig myslice

Sponsored by the National Science Foundation 32 IC2E ‘14 – March 10, 2014 Common Problems Problem: Can’t login to a node Possible causes: –Wrong username –Public key isn’t loaded / Private key is wrong or non-existing –Private key has wrong permissions (it should have 0600) –Slice/sliver expired –Technical issue with node Debug strategy: –Ask another member of the slice to login to the node If successful look for your account –cd..; ls Look for loaded keys –sudo cat /.ssh/authorized_keys –Ask them to use ‘-v’ option ssh –v

Sponsored by the National Science Foundation 33 IC2E ‘14 – March 10, 2014 Common Problems Problem: Can’t access AMs Possible causes: –Firewall issues –AM is down Debug strategy: –Check the GMOC calendars for planned/unplanned outages calendars.html –Try to telnet to the port: e.g. telnet Complete list of ports: –Frequent issues on Campus Guest WiFi networks

Sponsored by the National Science Foundation 34 IC2E ‘14 – March 10, 2014 Common Problems Problem: Slice did not come up (“not green”) Possible causes: –Did not wait long enough –Problem with RSpec Debug strategy: –Check slice/sliver status –Use rspeclint on your rspecs

Sponsored by the National Science Foundation 35 IC2E ‘14 – March 10, 2014 Common Problems Problem: Omni is not working Possible causes: –Computer is not connected to the Internet/behind firewall –$PATH/$PYTHONPATH is not correct Python error –omni is not configured Debug strategy: –Verify omni working: Omni installed: omni --version Omni configured to speak to the clearinghouse: omni getusercred -o Omni can speak to an aggregate: omni getversion -a ig-gpo –Check $PATH and $PYTHONPATH variables: echo $PATH echo $PYTHONPATH –Verify connectivity to: The Internet: ping To the CH: telnet ch.geni.net 8443 To the AMs: telnet bbn-hn.exogeni.net telnet instageni.gpolab.bbn.com 12369