Sponsored by the National Science Foundation A GENI WiMAX Infrastructure for Research Experiments Harry Mussman GENI Project Office at Raytheon BBN Technologies Sept 20,

Sponsored by the National Science Foundation2Sept 20, 2010 What is GENI? –Infrastructure for research in network science and engineering –Prototyping using spiral development –Conceptual design Meso-scale infrastructure build-out WiMAX base station WiMAX research experiments

Sponsored by the National Science Foundation3Sept 20, 2010 What is GENI? The Global Environment for Network Innovations (GENI) is a novel suite of infrastructure now being designed to support experimental research in network science and engineering. Networks are broadly defined with multiple layers of abstraction, from physical substrates, through the architecture and protocols, to networks of people, organizations, and societies.

Sponsored by the National Science Foundation4Sept 20, 2010 Prototyping GENI GENI prototyping began in 2007, when NSF awarded the GENI Project Office (GPO) role to BBN Technologies. The GPO subsequently initiated a community-based design and planning process, and issued a set of academic / industrial subcontracts to begin to build, integrate and operate the earliest GENI prototype called GENI Spiral 1. With the completion of Spiral 1 after one year, a second round of subcontracts was issued to begin to build GENI Spiral 2. See for a comprehensive view of GENI.

Sponsored by the National Science Foundation5Sept 20, 2010 Spiral Development GENI Prototyping Plan Use Planning Design Build outIntegration Use Now: End of GENI Spiral 2 Early experiments, meso-scale build, interoperable control frameworks, ongoing integration, system designs for security and instrumentation, definition of identity management plans. Envisioned ultimate goal Incorporates large-scale distributed computing resources, high-speed backbone nodes, nationwide optical networks, wireless & sensor nets, etc. Spiral development process Re-evaluate goals and technologies yearly by a systematic process, decide what to prototype and build next.

Sponsored by the National Science Foundation6Sept 20, 2010 Spiral 2 Academic-Industrial Teams CNRI

Sponsored by the National Science Foundation7Sept 20, 2010 Conceptual Design Federated heterogeneous infrastructure Evolving over time via spiral development Deeply programmable Virtualized (shared)

Sponsored by the National Science Foundation8Sept 20, 2010 What is GENI? Meso-scale infrastructure build-out –Started in Spiral 2 –Includes WiMAX build-out at 9 sites WiMAX base station WiMAX research experiments

Sponsored by the National Science Foundation9Sept 20, 2010 Meso-scale Infrastructure Build-out WiMAX ShadowNet Salt Lake City Kansas City DC Atlanta Stanford UCLA UC Boulder Wisconsin Rutgers NYU Polytechnic UMass Columbia BBN Technologies OpenFlow Backbones Seattle Salt Lake City Sunnyvale Denver Kansas City Houston Chicago DC Atlanta OpenFlow Stanford U Washington Wisconsin Indiana Rutgers Princeton Clemson Georgia Tech

Sponsored by the National Science Foundation10Sept 20, 2010 WiMAX Build-out Essentials Operation in Educational Broadband Services band WiMAX base station kit provided for each site Experiment control structure using OMF/OML

Sponsored by the National Science Foundation11Sept 20, 2010 WiMAX Base Station

Sponsored by the National Science Foundation12Sept 20, 2010 WiMAX Build-out Essentials (1) Operation in Educational Broadband Services band –2.6 GHz, 10MHz or 5MHz bands –Educational licenses still held by some universities –Many universities have leased license to Clearwire, but Clearwire is obligated to continue some “educational use” –Can often get experimental license for a band, subject to use by owner/lessee (e.g., Clearwire) –Some 5 MHz bands found with no owners/lessees –See and Tony Michel at Raytheon BBN Technologies

Sponsored by the National Science Foundation13Sept 20, 2010 WiMAX Build-out Essentials (2) WiMAX base station kit provided for each site –Open and programmable –Virtualizible (can be shared, to support multiple experiments) –Affordable (because limited to one 120-degree sector) –Software developed by Rutgers WINLAB and NEC Labs; see –Commercial WiMAX hardware (and low-level software) provided by NEC –Kits built and distributed by Rutgers WINLAB; see

Sponsored by the National Science Foundation14Sept 20, 2010 WiMAX Build-out Essentials (3) Experiment control structure uses OMF/OML –ORBIT Management Framework (OMF) –ORBIT Measurement Library (OML) –Both developed and supported by Rutgers WINLAB and NICTA (Australia) –OMF provides tools to describe, instrument, and execute experiments; see –OML allows sampling, processing and collection of measurements from resources within an experiment; see –OMF/OML has been extended to support mobile experiments; see

Sponsored by the National Science Foundation15Sept 20, 2010 WiMAX Build-out Status See current view at All sites have FCC licenses –Most obtained experimental license within a few weeks after application to the FCC Sites in operation: –Rutgers WINLAB (2Q09) –BBN Technologies (3Q10) –NYU Polytechnic (3Q10) –Stanford (separate process) Sites still being planned or installed: –UCLA –UC Boulder –Wisconsin (will add two kits to existing Cisco system) –UMass Amherst –Columbia Univ

Sponsored by the National Science Foundation16Sept 20, 2010 WiMAX installation at Rutgers WINLAB Outdoors: –NEC 120-degree sector antenna Indoors: –NEC Outdoor Unit (ODU) –NEC Indoor Unit (IDU) –Server with ASN GW

Sponsored by the National Science Foundation17Sept 20, 2010 Coverage map of the WiMAX BaseStation Measured RSSI

Sponsored by the National Science Foundation18Sept 20, 2010 WiMAX installation at Raytheon BBN Technologies Outdoors: –Omni antenna (on top) –NEC 120-degree sector antenna (aimed towards Boston) –Patch antenna –GPS antenna (for timing) –NEC Outdoor Unit (ODU) –Coax switching and power junction box Indoors: –NEC Indoor Unit (IDU) –Base Station Server –OMF/OML Server

Sponsored by the National Science Foundation19Sept 20, 2010 WiMAX installation at NYU Polytechnic Outdoors: –NEC 120-degree sector antenna –GPS antenna (for timing) –NEC Outdoor Unit (ODU) Indoors: –NEC Indoor Unit (IDU) –Server with ASN GW

Sponsored by the National Science Foundation20Sept 20, 2010 WiMAX Build-out Next Steps Next steps for operating sites : –Complete integration, harden software package –Procure endpoint devices (Windows PCs with dongle, Linux PCs with WiMAX card, Android handsets, mobile nodes, etc.) –Add site monitoring –Evaluate coverage and throughput (consider antenna choice: sector and/or omni) –Establish OMF/OML –Connect to GENI backbone –Federate with other sites for coordinated experiments Next steps for non-operating sites : –Complete site selection and planning, particularly RF cell design –Complete installation and bring-up

Sponsored by the National Science Foundation21Sept 20, 2010 Outline What is GENI? Meso-scale infrastructure build-out WiMAX base station –Kit –Data path –OMF/OML for experiment control –Clients WiMAX research experiments

Sponsored by the National Science Foundation22Sept 20, 2010 WiMAX Base Station

Sponsored by the National Science Foundation23Sept 20, 2010 WiMAX Base Station Kit Kit provided for each site –Additional kits can be ordered Kits built and distributed by Rutgers WINLAB; see Commercial WiMAX hardware (and low-level software) provided by NEC –Affordable (because limited to one 120-degree sector) –Full 360-dgree cell possible with additional hardware Software developed by Rutgers WINLAB and NEC Labs; see –Open and programmable (or configurable) where possible –Virtualizible: can be shared, to support multiple experiments

Sponsored by the National Science Foundation24Sept 20, 2010 Base Station Kit: NEC Hardware

Sponsored by the National Science Foundation25Sept 20, 2010 Base Station Data Path Virtualizable into multiple slices for multiple researchers/experiments –Each Client is assigned to one slice –Traffic flows from different slices are handled separately –All packet forwarding is done at L2, so can be used for experiments with non-IP protocols Programmable –Can set WiMAX radio configurations for all traffic –API defined for each virtual base station –Similar features to that provided on the raw base station (Add client, remove client, setup service flows …)

Sponsored by the National Science Foundation26Sept 20, 2010 Base Station Data Path: BTS The BTS itself is a black box Hence, the slice isolation mechanism and control framework is outside of this box ASN GW VirtualBTS Base Station (BTS) Un-modified WiMAX BTS (Black box) Data and control pipes

Sponsored by the National Science Foundation27Sept 20, 2010 Base Station Data Path: ASN GW Removed all default IP routing, simplified ASN controller* All switching purely based on MAC addresses Implemented the VNTS shaping mechanism in click for slice isolation ASN GW VirtualBTS Base Station (BTS) * work done at NEC

Sponsored by the National Science Foundation28Sept 20, 2010 Base Station Data Path: VirtualBTS Redirect all traffic from VLANs to individual slices Similar redirection from slices to outbound VLAN interfaces AggMgr for creation, destruction, maintenance of slices, adding clients, slice allocation control … Virtual machine instances Dynamically created VLANs ASN GW VirtualBTS Base Station (BTS) 28

Sponsored by the National Science Foundation29Sept 20, 2010 OMF/OML for Experiment Control

Sponsored by the National Science Foundation30Sept 20, 2010 WiMAX Clients Windows PC with USB-connected WiMAX modem –Example: AWB (Accton Wireless Broadband) US210 WiMAX USB adapter, using Beceem chips, and works with any network ID –No current support for application on PC –Summary: Limited use Linux PC with Intel 5150/5350 mini-PCI express card WiMAX modem Android handset with WIMAX capability Mobile Linux PC platform with WiMAX modem

Sponsored by the National Science Foundation31Sept 20, 2010 WiMAX Client: Linux PC Linux PC with Intel 5150/5350 mini- PCI express card WiMAX modem –Examples: Samsung NC10, Dell Inspiron Mini 1012 –Open-source driver, can work with any network ID –Full support for custom applications –Full support for OMF/OML applications and control, including image loading –Summary: Currently the most capable client Intel 5150/5350 mini-PCI express card with Linux driver

Sponsored by the National Science Foundation32Sept 20, 2010 WiMAX Client: Android Handset Android handset with WIMAX capability –Example: HTC EVO 4G handset, sold by Sprint –As sold, locked to Sprint; how to allow connection to GENI network? –How to support custom applications? –How to support OMF/OML applications and control? –Summary: Very attractive for certain uses; working to resolve issues

Sponsored by the National Science Foundation33Sept 20, 2010 WiMAX Client: Mobile Linux PC Platform Mobile Linux PC platform with WiMAX modem –Example: Modified ORBIT node, developed by Rutgers WINLAB with added WiMAX modem –Full support for OMF/OML applications and control –Summary: Has worked well for significant mobile experiments ORBIT Node

Sponsored by the National Science Foundation34Sept 20, 2010 What is GENI? Meso-scale infrastructure build-out WiMAX base station WiMAX research experiments –Default slice for Internet access –Coverage and throughput evaluation –Custom applications for campus opt-in –Mobile experiments using OMF/OML features –Next?

Sponsored by the National Science Foundation35Sept 20, 2010 WiMAX Experiments: Internet Access Internet access –Default slice –Mobile associates, after matching with entry in access list –Mobile gets added to default slice, starts UL traffic –Allows browsing, etc., from mobile, and verifies basic functionality –Status: Working Physical BTS ASN-GW Air Interface Internet

Sponsored by the National Science Foundation36Sept 20, 2010 WiMAX Experiments: Site Coverage WiMAX site coverage and throughput evaluation –Needs to be done for each site –Use Linux PC with Intel card, GPS sensor, and full support for OMF/OML applications and control –Need to measure RSSI vs location, and run iperf, to evaluate coverage and throughput –Status: Started, based on existing WiFi application Physical BTS Air Interface

Sponsored by the National Science Foundation37Sept 20, 2010 WiMAX Experiments: Campus Opt-In Campus opt-in –Custom applications of any type, networking to social –Handset or laptop, or both? –One site or multiple sites? –Is coverage at site sufficient? outside and inside? –How do we attract such experiments? –How do we support such experiments? –What would you like to do? Physical BTS ASN-GW Air Interface Application Server

Sponsored by the National Science Foundation38Sept 20, 2010 WiMAX Experiments: Mobile Mobile experiments –Use OMF/OML mobility features: cache when disconnected; GPS-driven trip wire/area –Example: ParkNet experiment; done using WiFi; see Marco Gruteser and “ParkNet: Drive-by Sensing of Road-Side Parking Statistics”, at MobiSys 2010 –See planned demo for GEC9, using WiMAX –What would you like to do?

Sponsored by the National Science Foundation39Sept 20, 2010 WiMAX Experiments: Mobile Ultrasonic sensor on car, connected to mobile Linux PC with GPS sensor

Sponsored by the National Science Foundation40Sept 20, 2010 WiMAX Experiments: Mobile Visualization of data on available parking spaces

Sponsored by the National Science Foundation41Sept 20, 2010 WiMAX Experiments: Next? Next? –Compare handover mechanisms? –Evaluate transport mechanisms? –Try new security mechanisms? –What would you like to do? How? –The GPO is here to help –Become part of the GENI community –Evaluate what can be done –Utilize one of the GENI sites, working with owner –Contribute new capabilities Limited only by your imagination!

Sponsored by the National Science Foundation42Sept 20, 2010 Acknowledgements Ray Raychaudhuri (Rutgers WINLAB) has championed the inclusion of wireless infrastructure into GENI for many years All GENI WiMAX projects are supported by awards from the NSF Ray Raychaudhuri (Rutgers WINLAB), Sampath Rangarajan (NEC Labs) and Ivan Seskar (Rutgers WINLAB) are responsible for the GENI WiMAX kit project Rajesh Mahindra (NEC Labs), Gautam Bhanage (Rutgers WINLAB) and Ivan Seskar (Rutgers WINLAB) have contributed much to the base station software Max Ott (NICTA), Ivan Seskar (Rutgers WINLAB) and Marco Gruteser (Rutgers WINLAB) have contributed much to OMF/OML, and it’s use with the WiMAX base station Tony Michel (Raytheon BBN Technologies) has much radio expertise and has contributed to the FCC license process Manu Gosain (Raytheon BBN Technologies) has been responsible for installing the site at BBN

Sponsored by the National Science Foundation43Sept 20, 2010 Learning more about GENI Check Ask those who are involved with WiMAX; see acknowledgements Attend the next GENI Engineering Conference: –Nov 2-4, Wash DC –Travel grants are available