1. Masaki Hirabaru masaki@nict.go.jp Network Performance Measurement and Monitoring APAN Conference 2005 in Bangkok January 27, 2005 Advanced TCP Performance Measurement with BWCTL

2. Contents Case Studies of Utilizing Performance Measurement Infrastructure Stable and Global Operations of the Infrastructure in APAN/TransPAC Story of Midnight on Tuesday, 25 th Story of Midnight on Tuesday, 25 th Packet losses at 50Mbps Too large optical loss between NECTEC and the hotel ATM interface parameter adjustment for DV Ethernet operating mode (auto-half-full) (Insufficient performance of a host where iperf running) After this kind of trouble shooting, my story will begin.

3. Large Bandwidth-Delay Product Network Issue in VLBI (Very Long Baseline Interferometry) delay radio signal from a star correlator A/D clock A/D Internet clock e-VLBI geographically distributed observation, interconnecting radio antennas over the world Large Bandwidth-Delay Product Network issue in TCP over Internet ASTRONOMY GEODESY ~Gbps Longer Distance, Wider Bandwidth => Better Resolution, Sensitivity A B A B d

4. Typical Low TCP Performance Cases Widow size bottleneck cases Too fast slow-start Hard bottleneck cases Tokyo – Michigan 180ms BDP for 100Mbps 100*180 / 8 = 2.25MB Web100 http://www.web100.org

5. Analyzing Advanced TCP Dynamic Behavior in a Real Network ( Example: From Tokyo to Indianapolis at 1G bps with HighSpeed TCP ) The data was obtained during e-VLBI demonstration at Internet2 Member Meeting in October 2003. like electrocardiogram

6. TransPAC/I2 #1:Reno (Win 64MB)

7. Kwangju Busan 2.5G Fukuoka Korea 2.5G SONET KOREN Taegu Daejon 10G 1G (10G) 1G Seoul XP Genkai XP Kitakyushu Kashima 1G (10G) Fukuoka Japan 250km 1,000km 2.5G JGN II 9,000km 4,000km Los Angeles Chicago Washington DC MIT Haystack 10G 2.4G APII/JGNII Abilene Koganei 1G(10G) Indianapolis 100km bwctl server Experiment for High-Performance Scientific Data Transfer 10G Tokyo XP / JGN II I-NOC *Performance Measurement Point Directory http://e2epi.internet2.edu/pipes/pmp/pmp-dir.html perf server e-vlbi server JGNII 10G GEANT SWITCH 7,000km TransPAC Pittsburgh U of Tokyo A BWCTL account available for CMM including Korean researchers International collaboration to support for science applications U. Hawaii

8. Steps Run BWCTL OK. Done Examine TCP Behavior Measure Path Replay in Lab Tune TCP Start Improve Network

9. TransPAC/I2 #2: High Speed (Win 12MB)

10. Tokyo to Chicago Case

11. RouterSwitch a) Tokyo XP Case Bottleneck Queue Sizes Congestion Point ReceiverSender Capacit y C packet train lost packet measured packet Queue Size = C x (Delay max – Delay min ) Queue ~100 Queue ~1000 VLANs Method Problem & Solution

12. Tokyo XP Case of Advanced TCPs with different bottleneck queue sizes BIC TCP queue size 100 packetsFAST TCP queue size 100 packets BIC TCP queue size 1000 packetsFAST TCP queue size 1000 packets BIC TCP: http://www.csc.ncsu.edu/faculty/rhee/export/bitcp/ FAST TCP: http://netlab.caltech.edu/FAST/

13. Remote host B RTT 200ms (100ms one-way) Case 3: Emulating Network Delay and Bottleneck ENP2611 board Code was developed by Kobayashi @ NICT Internet Local host A Only 800 Mbps available bwctl server NE

14. Discussions 1G bps test over 10G backbone 1G bps test over 1G backbone Iperf vs sophisticated ways (pathload, pathq, etc.) Research and operations APAN NOCs cooperation beyond borders Tokyo NOC bwctl server list available at http://www.jp.apan.net/NOC/bwctl/pmp.html Huygens e-VLBI (Japan – Australia – China – JIVE) Demonstrations (SC2004, JGN II Symposium in Osaka, APAN Bangkok, etc.)

15. Observatory by Mr. Ikeda KDDI Labs / Tokyo NOC Observatory is a measurement infrastructure managed by NOC. It can provide the stable measurement service as one of the advanced NOC service. the data sets and tools network diagram Further information can be found at http://www.jp.apan.net/NOC/Observatory/http://www.jp.apan.net/NOC/Observatory/ Data settoolmachine ThroughputIperf & BWCTLnms1 One-way delayOWAMPnms4 netflowflow-toolsnms3 Usage statisticsucd-snmp & SNAPPnms2 Routing …under consideration