Sponsored by the National Science Foundation Scalable, Extensible, and Safe Monitoring of GENI Spiral 2 Year-end Project Review PI: Sonia Fahmy, Purdue University Puneet Sharma, Prakash Kumar Malligemane, HP Labs Students: Sriharsha Gangam, Ethan Blanton, Purdue University August 30 th, 2010 Sensing Information Management Backplane

Sponsored by the National Science Foundation 2 August 30 th, 2010 Project Summary Project wiki: Online system portal: The Scalable Sensing Service (S 3 ) provides network measurement information to any user, experimenter, or administrator such that both active and passive measurements can be taken in a safe manner –By safety, we mean that users cannot trigger arbitrarily large/frequent measurement probes that exceed a specified budget –Example tools: pathrate, pathchirp, spruce, tulip –User can specify requested periodic measurement frequency The careful admission control of measurement requests allows administrators to prioritize the measurements they admit according to their policies –The measurement resource budget is utilized better by dynamically invoking inference mechanisms when needed –Careful scheduling also reduces interference among active measurement tools

Sponsored by the National Science Foundation 3 August 30 th, 2010 Milestone & QSR Status IDMilestoneStatusOn Time? On Wiki? GPO signoff? S2.aDesign document for measurement system on ProtoGENI DeliveredOn timeYes S2.bSensor pod implementation for a single ProtoGENI node DeliveredOn timeYes S2.cDemonstration 1Demonstrated on-demand measurements EarlyYes S2.dV0.1 release (on-demand measurements) DeliveredEarlyYes S2.eV0.2 release (periodic measurements scheduled at arbitrary frequencies and stored in database) Operational, but improving code and documentation TestingNo S2.fDemonstration 2Demonstrated all featuresOn timeNo S2.gEvaluation reportEvaluated on 15 nodesIn progress No QSR: 4Q2009DeliveredOn timeYes QSR: 1Q2010DeliveredOn timeYes QSR: 2Q2010DeliveredOn timeYes

Sponsored by the National Science Foundation 4 August 30 th, 2010 Accomplishments 1: Advancing GENI Spiral 2 Goals Relationship to GENI Spiral 2 Goals are described in “GENI Spiral 2 Overview”, section 7:GENI Spiral 2 Overview Continuous experimentation –Demo page up at: The help pages for that can be accessed at: Instrumentation and measurement –Collaborating with other researchers on GENI I&M specification document version 0.5 Integration with ProtoGENI Interoperation with other control frameworks, e.g., PlanetLab Increased security –Careful admission control and scheduling of measurement requests prevents misuse

Sponsored by the National Science Foundation 5 August 30 th, 2010 Accomplishments 2: Other Project Accomplishments Discussions on similarities and differences with other measurement projects; participation in conference calls, etc. Service on TPCs of SIGMETRICS, INFOCOM, ICNP, COMSNETS, … Presentation on INFOCOM panel Posters on the project at several events Publications: –“Distributed Partial Inference under Churn,” Sriharsha Gangam, Sonia Fahmy, In Proceedings of the IEEE Global Internet Symposium, 6 pp., March –"Leveraging Correlations Between Capacity and Available Bandwidth To Scale Network Monitoring,” Praveen Yalagandula, Sung-Ju Lee, Puneet Sharma, Sujata Banerjee, In Proceedings of IEEE GlobeCom 2010, accepted for publication. –"On the Cost of Network Inference Mechanisms," Ethan Blanton, Sonia Fahmy, Greg N. Frederickson, Sriharsha Gangam, IEEE Transactions on Parallel and Distributed Systems (TPDS), 14 pp., accepted for publication.

Sponsored by the National Science Foundation 6 August 30 th, 2010 Issues Interface with other projects Redundancy with other projects Delays due to contracts, staffing, etc.

Sponsored by the National Science Foundation 7 August 30 th, 2010 Plans Plans for the remainder of Spiral 2: –Code/documentation improvements Increase usability –Testing and performance evaluation –Specification document Potential Spiral 3 work: –Dynamic invocation of inference based on measurement workload: Large overhead for probing and data exchange –O(N 2 ) measurements in a network of N nodes –Dynamically changing  Need frequent probing Inference based on incomplete information –Exploit properties such as triangular inequality –A coarse estimate may suffice for many applications –Admission control/scheduling Characterize active measurement tools Prioritize measurement requests according to defined policies Schedule measurements to mitigate interference –Integration with other measurement projects