1. Measurement and Fault-Finding Using MAGGIE and PIPES. Presented at the HENP SIG Internet2 Members Meeting, Indianapolis, October 2003. Paola Grosso (SLAC) and Warren Matthews (GA Tech)

2. Internet2 Members Meeting, Indianapolis, October 2003. 2 Background There are a large number of tools available to help diagnose network problems.There are a large number of tools available to help diagnose network problems. Many networks have a network monitoring project, often with a web page showing graphs.Many networks have a network monitoring project, often with a web page showing graphs.

3. Internet2 Members Meeting, Indianapolis, October 2003. 3 Toward a monitoring Infrastructure Grid tools and data intensive science require a cross-domain monitoring infrastructure with standardized publishing.Grid tools and data intensive science require a cross-domain monitoring infrastructure with standardized publishing. –Resource Brokers –DoE science community Monitoring InfrastructureMonitoring Infrastructure –IEPM-BW and MAGGIE (SLAC and DoE) –AMI and PIPES (Internet2)

4. Internet2 Members Meeting, Indianapolis, October 2003. 4 IEPM-BWIEPM-BW SLAC Stanford CENICAbilene SLAC SNV HSTN SEA ATL CLV IPLS NY Rice UTDallas NCSA UMich I2 SOX UFL APAN RIKEN INFN-Roma INFN-Milan CESnet APAN Geant (Only routes from SLAC crossing Abilene are shown)

5. Internet2 Members Meeting, Indianapolis, October 2003. 5 AMIAMI STTL SNVA LOSA NYCM WASH ATLA CHIN IPLS KSCY DNVR HSTN

6. Internet2 Members Meeting, Indianapolis, October 2003. 6 Mysterious low throughput peak. Human intervention required.

7. Internet2 Members Meeting, Indianapolis, October 2003. 7 Graph contains 99.31% of the data. Tail (not shown) contains 0.69% of the data. By utilizing other measurement projects, problem location can be narrowed. Measurements indicate a very tight distribution of delays across Abilene

8. Internet2 Members Meeting, Indianapolis, October 2003. 8 PublishingPublishing Unfeasible to look at (possibly hundreds) of graphs.Unfeasible to look at (possibly hundreds) of graphs. Publish the data in standard wayPublish the data in standard way W3C Web Service, GGF OGSI Grid ServiceW3C Web Service, GGF OGSI Grid Service –Currently XMLRPC and SOAP servers

9. Internet2 Members Meeting, Indianapolis, October 2003. 9 DemoDemo /usr/local/bin/perl use SOAP::Lite; my $web_service = SOAP::Lite -> service('http://ndb1-blmt.abilene.ucaid.edu/aep/nmwg.wsdl') -> NetworkMeasurement('V4', ’SNVA', 'IPLS', '20031001000000', '20031002000000'); print $web_service->{resultSet}->{result}->{summaryData}->{minimum},"\n"; print $web_service->{resultSet}->{result}->{summaryData}->{average},"\n"; print $web_service->{resultSet}->{result}->{summaryData}->{maximum},"\n"; 22.3 22.4 82.5 (Soap::lite extracts the data from the XML) Client: Response:

10. Internet2 Members Meeting, Indianapolis, October 2003. 10 VisualizationVisualization Numerous tools are being developed to assist with visualizing measurementsNumerous tools are being developed to assist with visualizing measurements –Monalisa, Advisor, Internet Detective, Anemos Some will leverage 3rd party measurements via web servicesSome will leverage 3rd party measurements via web services

11. Internet2 Members Meeting, Indianapolis, October 2003. 11 Fault Finding Tools will (or should) provide some automated fault-finding as a starting point for human interventionTools will (or should) provide some automated fault-finding as a starting point for human intervention Use techniques such as Tony McGregor’s plateau concept for AMP and RIPE-TT rolling average to determine unusual behaviour.Use techniques such as Tony McGregor’s plateau concept for AMP and RIPE-TT rolling average to determine unusual behaviour. Write to logWrite to log

12. Internet2 Members Meeting, Indianapolis, October 2003. 12 Trouble Detection $ tail maggie.log 09/29/2003 14:58:47 (1:14) gnt4 0.51 Alarm (AThresh=38.33) 09/29/2003 16:25:45 (1:16) gnt4 3.83 Concern (CThresh=87.08) 09/29/2003 17:55:21 (1:17) gnt4 169.57 Within boundaries Date and TimeBinNodeThroughput (iperf) Status

13. Internet2 Members Meeting, Indianapolis, October 2003. 13 Net RAT In addition to quantitative measurements from ping, iperf etcIn addition to quantitative measurements from ping, iperf etc NetRAT will provide qualitative classification of nodes, hops and routes.NetRAT will provide qualitative classification of nodes, hops and routes. Cross-referencing data will identify hotspots (hop.performance = “poor”).Cross-referencing data will identify hotspots (hop.performance = “poor”).

14. Internet2 Members Meeting, Indianapolis, October 2003. 14 SummarySummary Sites, Networks, Grids must interoperate to meet the needs of modern science and demanding applications.Sites, Networks, Grids must interoperate to meet the needs of modern science and demanding applications. A Monitoring Infrastructure consisting of measurements from many projects published in standard ways is required.A Monitoring Infrastructure consisting of measurements from many projects published in standard ways is required.

15. Internet2 Members Meeting, Indianapolis, October 2003. 15 LinksLinks IEPM Home PageIEPM Home PageIEPM Home PageIEPM Home Page Internet2 e2epi and PIPES home pageInternet2 e2epi and PIPES home pageInternet2 e2epi and PIPES home pageInternet2 e2epi and PIPES home page OWAMP dataOWAMP dataOWAMP dataOWAMP data GGF NMWGGGF NMWGGGF NMWGGGF NMWG Monalisa, Advisor, Internet Detective, AnemosMonalisa, Advisor, Internet Detective, AnemosMonalisaAdvisor,Internet Detective,AnemosMonalisaAdvisor,Internet Detective,Anemos AMP Event DetectionAMP Event DetectionAMP Event DetectionAMP Event Detection