Large File Transfer on 20,000 km - Between Korea and Switzerland - 2004.8.26 Yusung Kim, Daewon Kim, Joonbok Lee, Kilnam Chon

Slides:

Advertisements

Similar presentations

Lee, Seungjun ( ) Korea Advanced Institute of Science and Technology August 28, 2003 APAN Measurement WG meeting eTOP End-to-end.

Advertisements

E2E performance measurement

TCP transfers over high latency/bandwidth network & Grid TCP Sylvain Ravot

Cheng Jin David Wei Steven Low FAST TCP: design and experiments.

Current Testbed : 100 GE 2 sites (NERSC, ANL) with 3 nodes each. Each node with 4 x 10 GE NICs Measure various overheads from protocols and file sizes.

High-Performance Throughput Tuning/Measurements Davide Salomoni & Steffen Luitz Presented at the PPDG Collaboration Meeting, Argonne National Lab, July.

FAST TCP in Linux Cheng Jin David Wei

Embedded Transport Acceleration Intel Xeon Processor as a Packet Processing Engine Abhishek Mitra Professor: Dr. Bhuyan.

ESLEA Bedfont Lakes Dec 04 Richard Hughes-Jones Network Measurement & Characterisation and the Challenge of SuperComputing SC200x.

02 nd April 03Networkshop Managed Bandwidth Next Generation F. Saka UCL NETSYS (NETwork SYStems centre of excellence)

Sponsored by the National Science Foundation WiMAX Campus deployment Status & measurements Thanasis Korakis Polytechnic Institute of NYU July 27, 2011.

KEK Network Qi Fazhi KEK SW L2/L3 Switch for outside connections Central L2/L3 Switch A Netscreen Firewall Super Sinet Router 10GbE 2 x GbE IDS.

Masaki Hirabaru NICT The 3rd International HEP DataGrid Workshop August 26, 2004 Kyungpook National Univ., Daegu, Korea High Performance.

IRODS performance test and SRB system at KEK Yoshimi KEK Building data grids with iRODS 27 May 2008.

1 Update Jacqueline Brown University of Washington APAN Meeting Busan, Korea 29 August 2003.

Best-Case WiBro Performance for a Single Flow 1 MICNET 2009 Shinae Woo †, Keon Jang †, Sangman Kim † Soohyun Cho *, Jaehwa Lee *, Youngseok Lee ‡, Sue.

Profiling Grid Data Transfer Protocols and Servers George Kola, Tevfik Kosar and Miron Livny University of Wisconsin-Madison USA.

J. Bunn, D. Nae, H. Newman, S. Ravot, X. Su, Y. Xia California Institute of Technology High speed WAN data transfers for science Session Recent Results.

Slide 1 DESIGN, IMPLEMENTATION, AND PERFORMANCE ANALYSIS OF THE ISCSI PROTOCOL FOR SCSI OVER TCP/IP By Anshul Chadda (Trebia Networks)-Speaker Ashish Palekar.

J. Bunn, D. Nae, H. Newman, S. Ravot, X. Su, Y. Xia California Institute of Technology State of the art in the use of long distance network International.

Masaki Hirabaru ISIT and Genkai Genkai / Hyeonhae Workshop in Fukuoka Feb. 27, 2003 Performance of G / H Link.

Masaki Hirabaru Internet Architecture Group GL Meeting March 19, 2004 High Performance Data transfer on High Bandwidth-Delay Product Networks.

Network Tests at CHEP K. Kwon, D. Han, K. Cho, J.S. Suh, D. Son Center for High Energy Physics, KNU, Korea H. Park Supercomputing Center, KISTI, Korea.

CA*net 4 International Grid Testbed Tel:

Masaki Hirabaru CRL, Japan APAN Engineering Team Meeting APAN 2003 in Busan, Korea August 27, 2003 Common Performance Measurement Platform.

Masaki Hirabaru CRL, Japan ITRC MAI BoF Kochi November 6, 2003 広帯域・高遅延ネットワークでのＴＣＰ性能計測.

LambdaStation Monalisa DoE PI meeting September 30, 2005 Sylvain Ravot.

Data transfer over the wide area network with a large round trip time H. Matsunaga, T. Isobe, T. Mashimo, H. Sakamoto, I. Ueda International Center for.

A Measurement Based Memory Performance Evaluation of High Throughput Servers Garba Isa Yau Department of Computer Engineering King Fahd University of Petroleum.

FAST TCP in Linux Cheng Jin David Wei Steven Low California Institute of Technology.

High TCP performance over wide area networks Arlington, VA May 8, 2002 Sylvain Ravot CalTech HENP Working Group.

ENW-9800 Copyright © PLANET Technology Corporation. All rights reserved. Dual 10Gbps SFP+ PCI Express Server Adapter.

High-speed TCP  FAST TCP: motivation, architecture, algorithms, performance (by Cheng Jin, David X. Wei and Steven H. Low)  Modifying TCP's Congestion.

Investigating the Performance of Audio/Video Service Architecture II: Broker Network Ahmet Uyar & Geoffrey Fox Tuesday, May 17th, 2005 The 2005 International.

CS 164: Slide Set 2: Chapter 1 -- Introduction (continued).

Masaki Hirabaru Network Performance Measurement and Monitoring APAN Conference 2005 in Bangkok January 27, 2005 Advanced TCP Performance.

1 ANF IPv6 TF Activities in Korea August 28, 2007 Dae Young KIM ANF IPv6 Task Force.

KREONET/KREONet2 Lambda Networking Lambda Networking BoF APAN2004, Cairns July 5, 2004 Dongkyun Kim Supercomputing Center, KISTI.

Internet data transfer record between CERN and California Sylvain Ravot (Caltech) Paolo Moroni (CERN)

Masaki Hirabaru NICT Koganei 3rd e-VLBI Workshop October 6, 2004 Makuhari, Japan Performance Measurement on Large Bandwidth-Delay Product.

KREONET/KREONet2 Updates North Asia Network Meeting July 5, 2004 Dongkyun Kim Supercomputing Center, KISTI.

First of ALL Big appologize for Kei’s absence Hero of this year’s LSR achievement Takeshi in his experiment.

Project Results Thanks to the exceptional cooperation spirit between the European and North American teams involved in the DataTAG project,

TCP transfers over high latency/bandwidth networks Internet2 Member Meeting HENP working group session April 9-11, 2003, Arlington T. Kelly, University.

Performance Engineering E2EpiPEs and FastTCP Internet2 member meeting - Indianapolis World Telecom Geneva October 15, 2003

TCP transfers over high latency/bandwidth networks & Grid DT Measurements session PFLDnet February 3- 4, 2003 CERN, Geneva, Switzerland Sylvain Ravot

FAST Protocols for High Speed Network David netlab, Caltech For HENP WG, Feb 1st 2003.

Final EU Review - 24/03/2004 DataTAG is a project funded by the European Commission under contract IST Richard Hughes-Jones The University of.

INDIANAUNIVERSITYINDIANAUNIVERSITY Status of FAST TCP and other TCP alternatives John Hicks TransPAC HPCC Engineer Indiana University APAN Meeting – Hawaii.

1 Testing TCP Westwood+ over Transatlantic Links at 10 Gigabit/Second rate Saverio Mascolo Dipartimento di Elettrotecnica ed Elettronica Politecnico di.

S. Ravot, J. Bunn, H. Newman, Y. Xia, D. Nae California Institute of Technology CHEP 2004 Network Session September 1, 2004 Breaking the 1 GByte/sec Barrier?

Mbps over 5,626 km ~ 4e15 bit meters per second 4 Peta Bmps (“peta bumps”) Single Stream TCP/IP throughput Information Sciences Institute Microsoft.

The EU DataTAG Project Richard Hughes-Jones Based on Olivier H. Martin GGF3 Frascati, Italy Oct 2001.

Gigabit IPv6 Infrastructure in Korea Seungyun Lee and Ju-Won Park.

Masaki Hirabaru (NICT) and Jin Tanaka (KDDI) Impact of Bottleneck Queue on Long Distant TCP Transfer August 25, 2005 NOC-Network Engineering Session Advanced.

1 FAST TCP for Multi-Gbps WAN: Experiments and Applications Les Cottrell & Fabrizio Coccetti– SLAC Prepared for the Internet2, Washington, April 2003

Recent experience with PCI-X 2.0 and PCI-E network interfaces and emerging server systems Yang Xia Caltech US LHC Network Working Group October 23, 2006.

Performance measurement of transferring files on the federated SRB

The transfer performance of iRODS between CC-IN2P3 and KEK

Networking between China and Europe

Transport Protocols over Circuits/VCs

Link from SLAC to SC2003.

TransPAC HPCC Engineer

CERN-USA connectivity update DataTAG project

MB-NG Review High Performance Network Demonstration 21 April 2004

Experiences from SLAC SC2004 Bandwidth Challenge

Link from SLAC to SC2003 Les Cottrell, SLAC.

High-Performance Data Transport for Grid Applications

Presentation transcript:

Large File Transfer on 20,000 km - Between Korea and Switzerland Yusung Kim, Daewon Kim, Joonbok Lee, Kilnam Chon The 3 rd International HEP DataGrid Workshop Korea Advanced Institute of Science and Technology

Content 1. Objective 2. Factors Affecting Performance 3. Experiment Overview 4. Experiment on 20,000 km between Korea and Switzerland 5. Experiment on 10,000 km between Korea and USA 6. Experiment Result Summary 7. Issues 8. Further Work 9. Conclusion Appendix

1. Objective To obtain maximum throughput on 20,000 km between Korea and Switzerland

2. Factors Affecting Performance 1) Distance 2) Number of Streams 3) Transport Protocol 4) Routing 5) Server –CPU, RAM, OS (Linux,…)

3. Experiment Overview Distance 20,000 km Korea – Switzerland 10,000 km Korea – USA OrganizationKAIST – CERNKAIST – Caltech RTT (hop count)360 ms (5 hops)203 ms (7 hops) Effective Bandwidth622 Mbps Transport ProtocolsTCP Reno, FAST TCP, BIC TCP Number of Streamsfrom 1 to 100 streams

4. Experiment on 20,000 km between Korea and Switzerland Organization KAIST – CERN RTT (hop count) 360 ms (5 hops) Experiment Period ~ trials, each trial for 1 hour ~ trials, each trial for 30 min Effective Bandwidth 622 Mbps Transport Protocols TCP Reno, FAST TCP, BIC TCP Number of Streams from 1 to 100 streams

4.1 Network Diagram : 20,000 km between Korea and Switzerland 1 G 10 G 622M Edoardo Martelli / CERN Switzerland USA/Canada CA*net 4 host 3Com 4924 host KREONET Korea 1GbE OC 192 KAIST StarLight 1 GbE DataTag / CERN 2 x 1GbE Cisco 7609 GSR ONS Daejeon ONS Seattle 2 x OC 12 ONS Chicago 1GbE Starlight Force10 Juniper T GbE Cisco 7609

4.2 Experiment results on 20,000 km between Korea and Switzerland BIC TCP FAST TCP TCP Reno number of streams throughput (Mbps) RTT : 360 ms (5hops) Effective Bandwidth : 622 Mbps

5. Experiment on 10,000 km between Korea and USA OrganizationKAIST – Caltech RTT (hop count)203 ms (7 hops) Experiment Period ~ trials, each trial for 30 min Effective Bandwidth622 Mbps Transport ProtocolsTCP Reno, FAST TCP, BIC TCP Number of Streamsfrom 1 to 100 streams

5.1 Network Diagram : 10,000 km between Korea and USA Yang Xia / Caltech host Daejeon, Korea KREONET Seattle, US 3com 4924 KAIST Caltech 1 G 10 G 622 Mbps 2 x OC 12 2 x 1GbE 1GbE PNG OC 192 Cisco7606 host GSR Cisco 7609 Abilene LA CENIC OC 192 ONS Foundry BigIron 400 ONS 15454

5.2 Experiment results on 10,000 km between Korea and USA BIC TCP FAST TCP TCP Reno number of streams throughput (Mbps) RTT : 203 ms (7hops) Effective Bandwidth: 622 Mbps TCP Reno by SLAC* 10,000 km between Stanford Linear Accelerator Center (SLAC) and CERN, RTT 170 ms, 622 Mbps (see Appendix A)

5.3 Result comparison : 20,000 km, 10,000 km, and 200km 20,000 km : Korea – Switzerland 10,000 km : Korea – USA 200 km : Korea – Korea number of streams Link utilization (%) DistanceOrganizationRTT (hop count)BandwidthTCP 20,000 kmKAIST – CERN360 ms (5hops)622 Mbps BIC TCP 10,000 kmKAIST – Caltech170 ms (7hops)622 Mbps 200 kmKAIST – Kyungpook Univ.2.7 ms (2hops)1 Gbps

6. Experiment Result Summary Maximum Throughput TCP RenoFAST TCPBIC TCP 20,000km between Korea and Switzerland ( 360ms, 5 hpos, 622 Mbps) 385 Mbps (62%) at 100 streams 380 Mbps (61%) at 100 streams 532 Mbps (86%) at 100 streams BIC TCP performed better than others.

7. Issues 1) Lambda Networking can support higher throughput on high speed and long latency network? 2) We need to analyze TCP behavior including window size management on TCP Reno, FAST TCP, and BIC TCP. 3) Some multiple streams showed lower throughput than those with smaller number of streams. (specially on 10,000 km)

8. Further Work Large File Transfer experiment with 10 Gbps on 20,000 km in late 2004 or early 2005

9. Conclusion We experimented large file transfer on 20,000km with 3 kinds of transport protocols. BIC TCP performed better than others. We need a further investigation of the multiple stream performance.

Appendix A. 10,000 km experiment between SLAC and CERN on RTT : 170 ms Effective Bandwidth : 622 Mbps Each transfer for 20 min TCP Reno TCP Reno 16 streams FAST TCPBIC TCP Throughput 278 Mbps (45%) 433 Mbps (70%) 317 Mbps (51%) 338 Mbps (54%) [ * SLAC : Stanford Linear Accelerator Center, * CERN : Conseil Européen pour la Recherche Nucléaire,

B. 10Gbps experiment on 10,000 km between Caltech and CERN on [ km (172 ms) 7Gbps: transferred 860 GB in 16 min Using 8 streams

C. End host configuration KAIST Kyungpook Univ. CaltechCERN CPU Intel Xeon 2.8 GHz AMD dual 2.1 GHz Intel Xeon dual 2.8 GHz Intel Xeon dual 2.4 GHz RAM2 G Network Interface card Gigabit Ethernet OS Linux Redhat 9.0 (kernel ) Transport Protocol TCP Reno, FAST TCP, BIC TCP ApplicationIperf 1.7.0

D. Experiment on 200km between KAIST and Kyungpook Univ. Period ~ trials, each trial for 30 min RTT (hop count)2.7 ms (2 hops) Bandwidth1 Gbps Transport ProtocolsTCP Reno, FAST TCP, BIC TCP Number of Streamsfrom 1 to 100 streams

D.1. Network Diagram: KAIST - Kyungpook Univ. 3Com 4924 KAIST 2.5 G 1GbE KREONET 1GbE Kyungpook Univ. host Cisco 7609 Cisco 7507 DaejeonDaegu

D.2 Experiment results on 200km between KAIST and Kyungpook Univ. BIC TCP FAST TCP TCP Reno number of streams throughput (Mbps) RTT : 2.7 ms (2 hops) 1 Gbps link