APAN 10Gbps End-to-End Performance Measurement Masaki Hirabaru (NICT), Takatoshi Ikeda (KDDI/NICT), and Yasuichi Kitamura (NICT) July 19, 2006 Network.

Slides:

Advertisements

Similar presentations

TCP Performance over IPv6 Yoshinori Kitatsuji KDDI R&D Laboratories, Inc.

Advertisements

TCP transfers over high latency/bandwidth network & Grid TCP Sylvain Ravot

♦ Commodity processor with commodity inter- processor connection Clusters Pentium, Itanium, Opteron, Alpha GigE, Infiniband, Myrinet, Quadrics, SCI NEC.

Iperf Tutorial Jon Dugan Summer JointTechs 2010, Columbus, OH.

Ahmed El-Hassany CISC856: CISC 856 TCP/IP and Upper Layer Protocols Slides adopted from: Injong Rhee, Lisong Xu.

TCP loss sensitivity analysis ADAM KRAJEWSKI, IT-CS-CE.

TCP on High-Speed Networks Sangtae Ha and Injong Rhee North Carolina State University.

Mapping a Network by Latency (and other things) Client connecting to , UDP port.

1 Characterization and Evaluation of TCP and UDP-based Transport on Real Networks Les Cottrell, Saad Ansari, Parakram Khandpur, Ruchi Gupta, Richard Hughes-Jones,

1 TCP-LP: A Distributed Algorithm for Low Priority Data Transfer Aleksandar Kuzmanovic, Edward W. Knightly Department of Electrical and Computer Engineering.

CALICE UCL, 20 Feb 2006, R. Hughes-Jones Manchester 1 10 Gigabit Ethernet Test Lab PCI-X Motherboards Related work & Initial tests Richard Hughes-Jones.

DataTAG Meeting CERN 7-8 May 03 R. Hughes-Jones Manchester 1 High Throughput: Progress and Current Results Lots of people helped: MB-NG team at UCL MB-NG.

PFLDNet Argonne Feb 2004 R. Hughes-Jones Manchester 1 UDP Performance and PCI-X Activity of the Intel 10 Gigabit Ethernet Adapter on: HP rx2600 Dual Itanium.

ESLEA Bedfont Lakes Dec 04 Richard Hughes-Jones Network Measurement & Characterisation and the Challenge of SuperComputing SC200x.

All rights reserved © 2006, Alcatel Accelerating TCP Traffic on Broadband Access Networks  Ing-Jyh Tsang 

Sven Ubik, Petr Žejdl CESNET TNC2008, Brugges, 19 May 2008 Passive monitoring of 10 Gb/s lines with PC hardware.

Grid simulation (AliEn) Network data transfer model Eugen Mudnić Technical university Split -FESB.

KEK Network Qi Fazhi KEK SW L2/L3 Switch for outside connections Central L2/L3 Switch A Netscreen Firewall Super Sinet Router 10GbE 2 x GbE IDS.

Tools for TEIN2 operation Yoshitaka Hattori Jin Tanaka APAN-JP.

1 A Basic R&D for an Analysis Framework Distributed on Wide Area Network Hiroshi Sakamoto International Center for Elementary Particle Physics (ICEPP),

Masaki Hirabaru NICT The 3rd International HEP DataGrid Workshop August 26, 2004 Kyungpook National Univ., Daegu, Korea High Performance.

TNC 2007 Bandwidth-on-demand to reach the optimal throughput of media Brecht Vermeulen Stijn Eeckhaut, Stijn De Smet, Bruno Volckaert, Joachim Vermeir,

Large File Transfer on 20,000 km - Between Korea and Switzerland Yusung Kim, Daewon Kim, Joonbok Lee, Kilnam Chon

J. Bunn, D. Nae, H. Newman, S. Ravot, X. Su, Y. Xia California Institute of Technology High speed WAN data transfers for science Session Recent Results.

J. Bunn, D. Nae, H. Newman, S. Ravot, X. Su, Y. Xia California Institute of Technology State of the art in the use of long distance network International.

Masaki Hirabaru ISIT and Genkai Genkai / Hyeonhae Workshop in Fukuoka Feb. 27, 2003 Performance of G / H Link.

Masaki Hirabaru Internet Architecture Group GL Meeting March 19, 2004 High Performance Data transfer on High Bandwidth-Delay Product Networks.

Electronic visualization laboratory, university of illinois at chicago A Case for UDP Offload Engines in LambdaGrids Venkatram Vishwanath, Jason Leigh.

Network Tests at CHEP K. Kwon, D. Han, K. Cho, J.S. Suh, D. Son Center for High Energy Physics, KNU, Korea H. Park Supercomputing Center, KISTI, Korea.

Masaki Hirabaru CRL, Japan APAN Engineering Team Meeting APAN 2003 in Busan, Korea August 27, 2003 Common Performance Measurement Platform.

Masaki Hirabaru CRL, Japan ITRC MAI BoF Kochi November 6, 2003 広帯域・高遅延ネットワークでのＴＣＰ性能計測.

Measurement of Routing Switch-over Time with Redundant Link Masaki Hirabaru (NICT), Teruo Nakai (KDDI), Yoshitaka Hattori (KDDI), Motohiro Ishii (QIC),

Data transfer over the wide area network with a large round trip time H. Matsunaga, T. Isobe, T. Mashimo, H. Sakamoto, I. Ueda International Center for.

E-VLBI and End-to-End Performance Masaki HirabaruYasuhiro KoyamaTetsuro Kondo NICT KoganeiNICT Kashima

High TCP performance over wide area networks Arlington, VA May 8, 2002 Sylvain Ravot CalTech HENP Working Group.

APII/APAN Measurement Framework: Advanced Network Observatory Masaki Hirabaru (NICT), Takatoshi Ikeda (KDDI Lab), Motohiro Ishii (QIC), and Yasuichi Kitamura.

High-speed TCP  FAST TCP: motivation, architecture, algorithms, performance (by Cheng Jin, David X. Wei and Steven H. Low)  Modifying TCP's Congestion.

Masaki Hirabaru Tsukuba WAN Symposium 2005 March 8, 2005 e-VLBI and End-to-End Performance over Global Research Internet.

Masaki Hirabaru Network Performance Measurement and Monitoring APAN Conference 2005 in Bangkok January 27, 2005 Advanced TCP Performance.

APAN SIP SERVER Hosted at the APAN Tokyo XP Thanks to  Prof. Konishi for organizing this  Takatoshi Ikeda/ KDDI for mounting the server at APAN TokyoXP.

Harnessing Multicore Processors for High Speed Secure Transfer Raj Kettimuthu Argonne National Laboratory.

NLANR The National Laboratory for Applied Network Research funded by the National Science Foundation, provides engineering,

Masaki Hirabaru NICT Koganei 3rd e-VLBI Workshop October 6, 2004 Makuhari, Japan Performance Measurement on Large Bandwidth-Delay Product.

Wide Area Network Performance Analysis Methodology Wenji Wu, Phil DeMar, Mark Bowden Fermilab ESCC/Internet2 Joint Techs Workshop 2007

First of ALL Big appologize for Kei’s absence Hero of this year’s LSR achievement Takeshi in his experiment.

1 Characterization and Evaluation of TCP and UDP-based Transport on Real Networks Les Cottrell, Saad Ansari, Parakram Khandpur, Ruchi Gupta, Richard Hughes-Jones,

Sep. 17, 2002BESIII Review Meeting BESIII DAQ System BESIII Review Meeting IHEP · Beijing · China Sep , 2002.

TCP transfers over high latency/bandwidth networks Internet2 Member Meeting HENP working group session April 9-11, 2003, Arlington T. Kelly, University.

An Evaluation of Fairness Among Heterogeneous TCP Variants Over 10Gbps High-speed Networks Lin Xue*, Suman Kumar', Cheng Cui* and Seung-Jong Park* *School.

Status of Tokyo LCG tier-2 center for atlas / H. Sakamoto / ISGC07 Status of Tokyo LCG Tier 2 Center for ATLAS Hiroshi Sakamoto International Center for.

Final EU Review - 24/03/2004 DataTAG is a project funded by the European Commission under contract IST Richard Hughes-Jones The University of.

INDIANAUNIVERSITYINDIANAUNIVERSITY Status of FAST TCP and other TCP alternatives John Hicks TransPAC HPCC Engineer Indiana University APAN Meeting – Hawaii.

1 Masaki Hirabaru and Yasuhiro Koyama PFLDnet 2006 Febrary 2, 2006 International e-VLBI Experience.

S. Ravot, J. Bunn, H. Newman, Y. Xia, D. Nae California Institute of Technology CHEP 2004 Network Session September 1, 2004 Breaking the 1 GByte/sec Barrier?

L1/HLT trigger farm Bologna setup 0 By Gianluca Peco INFN Bologna Genève,

An Analysis of AIMD Algorithm with Decreasing Increases Yunhong Gu, Xinwei Hong, and Robert L. Grossman National Center for Data Mining.

Masaki Hirabaru (NICT) and Jin Tanaka (KDDI) Impact of Bottleneck Queue on Long Distant TCP Transfer August 25, 2005 NOC-Network Engineering Session Advanced.

Connect communicate collaborate Performance Metrics & Basic Tools Robert Stoy, DFN EGI TF, Madrid September 2013.

T3: TCP-based High-Performance and Congestion-aware Tunneling Protocol for Cloud Networking Satoshi Ogawa† Kazuki Yamazaki† Ryota Kawashima† Hiroshi Matsuo†

Recent experience with PCI-X 2.0 and PCI-E network interfaces and emerging server systems Yang Xia Caltech US LHC Network Working Group October 23, 2006.

Connect. Communicate. Collaborate 4 Gigabit Onsala - Jodrell Lightpath for e-VLBI Richard Hughes-Jones.

iperf a gnu tool for IP networks

CALICE TDAQ Application Network Protocols 10 Gigabit Lab

The transfer performance of iRODS between CC-IN2P3 and KEK

Efficient utilization of 40/100 Gbps long-distance network

Networking between China and Europe

Multi-PCIe socket network device

TransPAC HPCC Engineer

MB-NG Review High Performance Network Demonstration 21 April 2004

Achieving reliable high performance in LFNs (long-fat networks)

Presentation transcript:

APAN 10Gbps End-to-End Performance Measurement Masaki Hirabaru (NICT), Takatoshi Ikeda (KDDI/NICT), and Yasuichi Kitamura (NICT) July 19, 2006 Network Engineering Workshop APAN 2006 Singapore

10G Capable Machines Ready in Japan NoHostH/W10G NICBusOSTCP Stack Iperf TCP 1nms5RAM3100 -CPU Opteron GHz x2 -Memory PC3200 LC2 512ME x2 Chelsio T210 (TOE) PCI-X1.0a (64bit, 133MHz) Red Hat AS 4 up 3 (Kernel ) Chelsio TOE 7.5G 2nms6 3nms7IBM x366 -CPU Xeon MP 3.66GHz x2 -Memory ECC RDIMM Chipkill 8GB Netrion XframeII PCI-X 2.0 (64bit, 266MHz) Red Hat AS 4 up 3 (Kernel ) New Reno +Bic 8.6G 4nms8 5x366aIBM x366 -CPU Xeon MP 3.66GHz x2 -Memory ECC RDIMM Chipkill 2GB Neterion XframeII PCI-X 2.0 (64bit, 266MHz) Red Hat WS 4 (Kernel ) New Reno +Bic 5.0G 6x366b 7genkai- ia64 HP RX2620 -CPU Itanium2 1.6GHz x1 -Memory 1G Chelsio N210 PCI-X1.0a (64bit, 133MHz) Red Hat AS 3 up4 (Kernel ) New Reno 6.8G 8ia64a 9optaHP DL145 G2 -CPU Opteron GHz x2 - Memory 1GB Myricom 10G-PCIE- 8A-R PCI-E x8 (250MB/s x8) Fedora Core 5 (Kernel ) New Reno +Bic 7.2G 10optb -CPU Opteron GHz x1 - Memory 2GB

JGN2 Network Configuration for 10G Experiment genkai-ia64 sumit400 (summit400) MS7 (AX7808S) tpr5tpr4 nms5 nms8 nms6 nms7 NICT (GS4k) NICT (GS4k) x366b NICT (MG8) x366aia64 opta optb kfok (GS4k) oym (GS4k) osa (GS4k) note (GS4k) note (GS4k) GenkaiXP Koganei TokyoXP 10G-LW line L2 path L3 device(Router) L2 device(Switch) Server Neterion Xframe-II Chelsio N210 Chelsio T210 Mericom 10GPCI-E 10G-LR line B.132 B.130 B.131 B.133 B.134 A.227 B.210 B.214 C.193 B.202 VID:24 VID:40 VID:38 VID:39 VID:1036 MS6 (BI15k) Procket Juniper T320 TransPAC2 10Gx4

TokyoXP Initial Result (under congestion) genkai-ia64 tpr4 nms7 nms8 tpr5 ia Server listening on TCP port 5001 TCP window size: 60.0 MByte (WARNING: requested 30.0 MByte) [ 4] local port 5001 connected with port [ 4] sec 587 MBytes 4.92 Gbits/sec [ 4] sec 728 MBytes 6.10 Gbits/sec [ 4] sec 721 MBytes 6.04 Gbits/sec [ 4] sec 186 MBytes 1.56 Gbits/sec [ 4] sec 74.2 MBytes 623 Mbits/sec [ 4] sec 83.7 MBytes 702 Mbits/sec [ 4] sec 90.2 MBytes 756 Mbits/sec [ 4] sec 93.1 MBytes 781 Mbits/sec [ 4] sec 93.8 MBytes 787 Mbits/sec [ 4] sec 94.9 MBytes 796 Mbits/sec Server listening on TCP port 5001 TCP window size: 20.0 MByte (WARNING: requested 10.0 MByte) [ 4] local port 5001 connected with port [ 4] sec 880 MBytes 7.38 Gbits/sec [ 4] sec 1012 MBytes 8.49 Gbits/sec [ 4] sec 1023 MBytes 8.58 Gbits/sec [ 4] sec 1.00 GBytes 8.63 Gbits/sec [ 4] sec 1.01 GBytes 8.64 Gbits/sec [ 4] sec 1.00 GBytes 8.63 Gbits/sec [ 4] sec 1.00 GBytes 8.62 Gbits/sec [ 4] sec 1.00 GBytes 8.62 Gbits/sec [ 4] sec 1.00 GBytes 8.62 Gbits/sec [ 4] sec 1.00 GBytes 8.61 Gbits/sec Congestion! 8.6Gbps 6Gbps Bandwidth is taken by new flow 0.8Gbps RTT: 20ms RTT: 0ms JGN2 GenkaiXPKoganei Total 9.4Gbps ~100M bps APII commodity traffic flows background

Experiment Plan with Large BWDP Performance measurement in JP with 10G delay box –Performance measurement by using several 10G NICs –Evaluation of the several congestion avoidance algorithms on the 10G Ethernet congested at a bottleneck. (e.g. fast, highspeed, scalable,,,) Performance measurement between JP and US –Performance measurement Between JP and US machines, if US colleague has machines. (A) –Performance measurement the path go around the Pacific Ocean and the US domestic. (B) A A B Where is a congestion point created?