Hans-Werner Braun Ronn Ritke NLANR/MNA (UCSD/SDSC) Funded by the National Science Foundation/CISE/ANIR NLANR/MNA Measurement and Network Analysis

Goals and objectives Creation of the Network Analysis Infrastructure (NAI) to support measurements and network analysis –header traces, performance, statistics Network measurement and analysis research activities Tool development for analysis and visualizations All data, analyses, graphs, visualizations, and tools are made public available for use by all researchers.

Public Interface Internet Trace User Community Attendance and presentation at meetings Host PAM2003 Workshop. Result reporting for the high performance environment –Web interface –newsletters (Networking Analysis Times, Packets) –published papers

NLANR/MNA Publications – 7 (28/32 were peer reviewed) PAM2002 3/18 papers, 1/3 posters

Internet Trace User Community Led by Joerg Micheel We are seeking constructive discussion on monitor placement strategies, trace duration, trace variety, etc. For example, a number of researchers have requested longer duration traces. As a result, a set of passive traces from Auckland that consists of single and multiple day duration traces were made available. Researchers have published at least 7 papers based on those traces. Which PMA trace summaries are most helpful in allowing other researchers to choose from available trace data sets?

Completely noninvasive, no impact on forwarding paths. Aggregated traffic signature at a measurement point. OC3/OC12, ATM and POS, OC48 (develop OC192 capability). Between June 2000 and Jan 2001 (7 months) 6,000 PMA trace files were downloaded (31 per day) from at least 193 different sites. Trace analysis summaries include (total packets, Bytes, top port numbers by volume, top 100 throughput connections, etc.) (Passive traffic collection and analysis at optical carrier speeds) Passive Measurement and Analysis (PMA) project

NCAR U. Colorado, Boulder AIX/MAE-West NASA-Ames Argonne Nat. Lab U. of Michigan Michigan State U. Ohio State U. STARTAP/APAN Rice U. Baylor College of Medicine U. of Houston Texas A&M U. Old Dominion U. MCNC North Carolina State U. U. of North Carolina Duke U. U. of Florida Miami U. Florida State U. 26 September 2000 SDSC, U. California, San Diego Passive measurement deployment status FDDI OC3 ATM OC3 PoS OC12 ATM OC12 PoS NCSA FIX-West Tel Aviv U. (I-2) Colorado State Front Range GigaPoP Texas GigaPoP U. Memphis Indiana State Columbia U.

rank Mbps Throughput site applic. triplet Bytes duration ==== =============== ======= =============== ANL 6:12061: ANL 6:6001: TXS 17:1033: ANL 6:6001: ANL 6:6001: ANL 6:6001: ANL 6:6001: ANL 6:6001: ANL 6:6001: ANL 6:6001: Top 100 PMA Throughput Connections

fiber connection end-point optical interfaces with own subsystem (e.g., DAG3, FORE) main system memory host system bus optical interconnection optical splitters fiber connection end-point host collection and analysis process Passive monitor components

Automated packet header trace collection “n” seconds (e.g., 90) measurement collected every three hours from measurement objects random start in first hour, but synchronized across machines sent to central collector (via encrypted ssh) daily analysis and encoded traces created encoded files available via ftp and http maximum time for delayed start time for network analysis tasks remaining available time for transmission NAIMOAT

Active Measurement Project (AMP) Led by Tony McGregor Focus on site-to-site measurement across high performance networks Attempt to deploy FreeBSD-based AMP machines at all HPC sites about 130 machines currently deployed and operational RTT, topology, and loss; user/event driven throughput We currently measure RTT to each of the other monitors every minute and the route to each every 10 minutes

23 February 2000 UCSD Active measurement deployment status SDSU UIowa Princeton Dartmouth NCREN/NCSC BU UCSC NCSA UMass GATech UCB CSU-SB UCBoulder NCAR Harvard SDSC UMiami Duke CMU/PSC UAB UWashington FSU UWyoming FNAL UWisc- Milwaukee UNC-CH UArizona UC-Irvine UWaikato NTNU NSF SDSMT Oklahoma State Washington State U. Stanford UCLA UVirginia UDel UKansas UFlorida UMd UNM UA UVermont UOregon Kansas State MIT JHU ColoState Rice WUSTL IU UMissouri Mississippi State ODU Montana State NCSU UCF NDSU Emory U. WVU UMich SLAC GMU URochester MSU Yale USF UofUtah CSUPomona Columbia Iowa State PSU SMU UPenn UMBC Georgetown UAH UIC UAlaska UWisc UofOklahoma UC NWU ACCESS ASU Vanderbilt Oregon State Startap MTU WSU UofGeorgia UConn UTK UHawaii UIUC NMSU

AMP web info (1)

AMP web info (2)

AMP web info (3)

Event Detection Tony McGregor AMP system consists of around 130 monitors in a full mesh. A set of graphs is available for each of the approximately 14,000 measured paths. The Automated Event Detection is a system for detection of events in data collected by active monitors. The system is divided into algorithms; each algorithm detects one class of network event. Currently, three algorithms are implemented. The "Plateau Detector" detects a change in the base RTT between a pair of monitors. A second algorithm detects a change in the RTT variance over a path. While the last algorithm triggers when packet losses are above an input threshold value.

Collaborations Internet2 1. regarding the IPLS router instrumentation at the Indiana GigaPOP (Joerg Micheel in discussions with Matt Zekauskas). 2. continuing discussions with I2 researchers regarding AMP involvement in E2E project (Tony McGregor, Ronn Ritke). 3. participation on the Internet2 End-to-End Performance Initiative Design Team (Ronn Ritke). Deployment of AMP machines at NASA Goddard and JPL. The machine at JPL is part of the JPL Performance Reference System. We now have AMP monitors at LBNL, SLAC, Argonne National Lab and Fermi DOE facilities.

Collaborations (Cont’d) Phil Dykstra and Cindy Dykstra, WareOnEarth (WCI, Inc.) regarding the AMP peer network with Defense Research and Engineering Network (DREN), as well as other activities. Other NLANR sites and their researchers and administrators, including weekly conference calls, and other activities. Kevin Walsh and Jay Dombrowski network systems group at SDSC (SDSC Enterprise Network Services [ENS]) on creating the data compute engine/repository containing a replica of AMP data, as well as additional activities.

International Collaborations Discussions with Tom DeFanti have included the monitoring of STAR LIGHT, and early insertion of optical splitters to allow quick installation of PMA machines. We are in talks with AMPATH regarding the placement of an OCXmon and AMP machine to measure the traffic from AMPATH. We are in contact with Greg Cole of FASTnet (formerly MIRnet) and are discussing several possible measurement activities.

International Collaborations (Cont’d) We have a PMA monitor in Israel, and AMP machines in Korea, Norway, Australia, and New Zealand (soon Japan). We are working with Canada, Korea, and Australia to help them install their own local AMP meshes. We are working with the Pacific Rim Applications & Grid Middleware Assembly (PRAGMA) effort at SDSC. Interest has also been expressed by other countries (Japan and Thailand) in both the AMP and PMA projects.

KOREA Network Map : ~2001 HPCnet SingAREN STAR TAP KIX Seoul XP KwangjuTaejonSeoul HPCnet APAN Tokyo XP Suwon Renater 2 TaeguPusan ATM/SONET 155Mbps/310Mbps ATM/SONET 622Mbps 2M ATM 8M 2M 45M

Hans-Werner Braun Ronn Ritke NLANR/MNA (UCSD/SDSC) Funded by the National Science Foundation/CISE/ANIR NLANR/MNA Measurement and Network Analysis

Goals and objectives Creation of the Network Analysis Infrastructure (NAI) to support measurements and network analysis Network measurement and analysis research activities Tool development for analysis and visualizations All data, analyses, graphs, visualizations, and tools are made public available for use by all researchers.

Completely noninvasive, no impact on forwarding paths. Aggregated traffic signature at a measurement point. OC3/OC12, ATM and POS, OC48 (develop OC192 capability). Between June 2000 and Jan 2001 (7 months) 6,000 PMA trace files were downloaded (31 per day) from at least 193 different sites. Trace analysis summaries include (total packets, Bytes, top port numbers by volume, top 100 throughput connections, etc.) (Passive traffic collection and analysis at optical carrier speeds) Passive Measurement and Analysis (PMA) project

NCAR U. Colorado, Boulder AIX/MAE-West NASA-Ames Argonne Nat. Lab U. of Michigan Michigan State U. Ohio State U. STARTAP/APAN Rice U. Baylor College of Medicine U. of Houston Texas A&M U. Old Dominion U. MCNC North Carolina State U. U. of North Carolina Duke U. U. of Florida Miami U. Florida State U. 26 September 2000 SDSC, U. California, San Diego Passive measurement deployment status FDDI OC3 ATM OC3 PoS OC12 ATM OC12 PoS NCSA FIX-West Tel Aviv U. (I-2) Colorado State Front Range GigaPoP Texas GigaPoP U. Memphis Indiana State Columbia U.

Active Measurement Project (AMP) Led by Tony McGregor Focus on site-to-site measurement across high performance networks Attempt to deploy FreeBSD-based AMP machines at all HPC sites about 130 machines currently deployed and operational RTT, topology, and loss; user/event driven throughput We currently measure RTT to each of the other monitors every minute and the route to each every 10 minutes

23 February 2000 UCSD Active measurement deployment status SDSU UIowa Princeton Dartmouth NCREN/NCSC BU UCSC NCSA UMass GATech UCB CSU-SB UCBoulder NCAR Harvard SDSC UMiami Duke CMU/PSC UAB UWashington FSU UWyoming FNAL UWisc- Milwaukee UNC-CH UArizona UC-Irvine UWaikato NTNU NSF SDSMT Oklahoma State Washington State U. Stanford UCLA UVirginia UDel UKansas UFlorida UMd UNM UA UVermont UOregon Kansas State MIT JHU ColoState Rice WUSTL IU UMissouri Mississippi State ODU Montana State NCSU UCF NDSU Emory U. WVU UMich SLAC GMU URochester MSU Yale USF UofUtah CSUPomona Columbia Iowa State PSU SMU UPenn UMBC Georgetown UAH UIC UAlaska UWisc UofOklahoma UC NWU ACCESS ASU Vanderbilt Oregon State Startap MTU WSU UofGeorgia UConn UTK UHawaii UIUC NMSU

AMP web info (1)

AMP web info (2)

AMP web info (3)

International Collaborations Discussions with Tom DeFanti have included the monitoring of STAR LIGHT, and early insertion of optical splitters to allow quick installation of PMA machines. We are in talks with AMPATH regarding the placement of an OCXmon and AMP machine to measure the traffic from AMPATH. I recently attended a meeting in Russia with Greg Cole of NaukaNet (formerly Fastnet) and are discussing several possible measurement activities.

International Collaborations (Cont’d) We have a PMA monitor in Israel, and AMP machines in Korea, Norway, Australia, and New Zealand (soon Japan). We are working with Canada, Korea, and Australia to help them install their own local AMP meshes. We are working with the Pacific Rim Applications & Grid Middleware Assembly (PRAGMA) effort at SDSC. Interest has also been expressed by other countries (Japan, China and Thailand) in both the AMP and PMA projects.

KOREA Network Map : ~2001 HPCnet SingAREN STAR TAP KIX Seoul XP KwangjuTaejonSeoul HPCnet APAN Tokyo XP Suwon Renater 2 TaeguPusan ATM/SONET 155Mbps/310Mbps ATM/SONET 622Mbps 2M ATM 8M 2M 45M

AARNet’s International Connections Current and Planned Singapore South Asia Middle East Europe APAN Abilene CANet GEANT StarTap Fiji Global GRID Forum South America AARNet International Transit Network Japan New Zealand Taiwan Hawaii SLO Seattle PNG Sydney Perth

Possible CA*net 4 Topology January 1, 2002 Halifax Edmonton Seattle Vancouver Winnipeg Quebec City Montreal Ottawa Chicago Halifax New York Regina Fredericton Charlottetown Victoria Windsor London Sudbury Thunder Bay Saskatoon Kamloops Buffalo Spokane Minneapolis Albany St. John's Calgary Toronto Prince George Hamilton Kingston CA*net 4 Node Mini-IX Possible Future Breakout Possible Future link or Option CA*net 4 OC192

Cichlid