1 Masaki Hirabaru and Yasuhiro Koyama APEC-TEL APGrid Workshop September 6, 2005 e-VLBI: Science over High-Performance Networks.

Slides:

Advertisements

Similar presentations

Engineering Meeting Report Aug. 29, 2003 Kazunori Konishi.

Advertisements

e-VLBI Deployments with Research Internet

Fundamentals of Computer Networks ECE 478/578

The CVN Real Time Correlator Zhang Xiuzhong, Chen Zhong Shanghai Astronomical Observatory China 4th e-VLBI Workshop Sydney

Advanced Computer Networking Congestion Control for High Bandwidth-Delay Product Environments (XCP Algorithm) 1.

XCP: Congestion Control for High Bandwidth-Delay Product Network Dina Katabi, Mark Handley and Charlie Rohrs Presented by Ao-Jan Su.

Recent Research in Congestion Control The problem of high bandwidth-delay product connections By Guillaume Marceau Presented for WPI CS577, Advanced Computer.

The Effect of Router Buffer Size on HighSpeed TCP Performance Dhiman Barman Joint work with Georgios Smaragdakis and Ibrahim Matta.

1 Emulating AQM from End Hosts Presenters: Syed Zaidi Ivor Rodrigues.

Current plan for e-VLBI demonstrations at iGrid2005 and SC2005 Yasuhiro Koyama *1, Tetsuro Kondo *1, Hiroshi Takeuchi *1, Moritaka Kimura, Masaki Hirabaru.

Ongoing e-VLBI Developments with K5 VLBI System Hiroshi Takeuchi, Tetsuro Kondo, Yasuhiro Koyama, and Moritaka Kimura Kashima Space Research Center/NICT.

E-VLBI Development at Haystack Observatory Alan Whitney Chet Ruszczyk Kevin Dudevoir Jason SooHoo MIT Haystack Observatory 24 March 2006 EVN TOG meeting.

E-VLBI Development at Haystack Observatory Alan Whitney Chet Ruszczyk MIT Haystack Observatory 10 Jan 2006 IVS General Meeting Concepion, Chile.

Electronic Transmission of Very- Long Baseline Interferometry Data National Internet2 day, March 18, 2004 David LapsleyAlan Whitney MIT Haystack Observatory,

E-VLBI developments with the K5 VLBI system Koyama Yasuhiro *1, Kondo Tetsuro *1, Kimura Moritaka *1, Takeuchi Hiroshi *1, and Masaki Hirabaru *2 *1 Kashima.

Masaki Hirabaru NICT The 3rd International HEP DataGrid Workshop August 26, 2004 Kyungpook National Univ., Daegu, Korea High Performance.

E-VLBI: Connecting the Global Array of Radio Telescopes through High-Speed Networks Participating U.S. organizations: MIT Haystack Observatory MIT Lincoln.

Developments for real-time software correlation e-VLBI Y. Koyama, T. Kondo, M. Kimura, M. Sekido, M. Hirabaru, and M. Harai Kashima Space Research Center,

Trial on the Efficient Use of Trunk Communcation Lines for VLBI in Japan Noriyuki Kawaguchi NATIONAL Astronomial Observatory,Japan eVLBI Workshop

E-VLBI at ≥ 1 Gbps -- “unlimited” networks? Tasso Tzioumis Australia Telescope National Facility (ATNF) 4 November 2008.

Masaki Hirabaru ISIT and Genkai Genkai / Hyeonhae Workshop in Fukuoka Feb. 27, 2003 Performance of G / H Link.

上海天文台 Shanghai Astronomical Observatory e-VLBI Progress in China Zhang Xiuzhong, team of Chinese VLBI Network Shanghai Astronomical Observatory Chinese.

Masaki Hirabaru Internet Architecture Group GL Meeting March 19, 2004 High Performance Data transfer on High Bandwidth-Delay Product Networks.

Data GRID Activity in Japan Yoshiyuki WATASE KEK (High energy Accelerator Research Organization) Tsukuba, Japan

The Internet Hall of Fame Induction Memorial Party for the late Dr. Masaki Hirabaru Shigeki Goto JPNIC Wednesday 4 March,

Radio Astronomy Applications Group Kashima Space Research Center National Institute of Information and Communications Technology EGU2005 GI1-1TH5P-0026.

1 ASTER DATA Transfer System Earth Remote Sensing Data Analysis Center Kunjuro Omagari ERSDAC 23th APAN Meeting.

E-VLBI over TransPAC Masaki HirabaruDavid LapsleyYasuhiro KoyamaAlan Whitney Communications Research Laboratory, Japan MIT Haystack Observatory, USA Communications.

Hirabaru, Koyama, and Kimura NICT APAN NOC Meeting January 20, 2005 e-VLBI updates.

High Bandwidth Data Acquisition and Network Streaming in VLBI Jan Wagner, Guifré Molera et al. TKK / Metsähovi Radio Observatory.

Network Tests at CHEP K. Kwon, D. Han, K. Cho, J.S. Suh, D. Son Center for High Energy Physics, KNU, Korea H. Park Supercomputing Center, KISTI, Korea.

Masaki Hirabaru CRL, Japan APAN Engineering Team Meeting APAN 2003 in Busan, Korea August 27, 2003 Common Performance Measurement Platform.

Masaki Hirabaru CRL, Japan ITRC MAI BoF Kochi November 6, 2003 広帯域・高遅延ネットワークでのＴＣＰ性能計測.

Measurement of Routing Switch-over Time with Redundant Link Masaki Hirabaru (NICT), Teruo Nakai (KDDI), Yoshitaka Hattori (KDDI), Motohiro Ishii (QIC),

Data transfer over the wide area network with a large round trip time H. Matsunaga, T. Isobe, T. Mashimo, H. Sakamoto, I. Ueda International Center for.

APAN 10Gbps End-to-End Performance Measurement Masaki Hirabaru (NICT), Takatoshi Ikeda (KDDI/NICT), and Yasuichi Kitamura (NICT) July 19, 2006 Network.

VLBI/eVLBI with the 305-m Arecibo Radio Telescope Chris Salter Tapasi Ghosh Emmanuel Momjian Arun Venkataraman Jon Hagen.

1 Gbps Disk-Based VLBI Observation for Future East Asia VLBI Observations Kiyoaki Wajima 18 March 2009 동아시아 VLBI 워크샵 Yamaguchi University Introduction.

E-VLBI: Creating a Global Radio Telescope via High-Speed Networks Alan R. Whitney MIT Haystack Observatory SLAC Data Management Workshop 17 March 2004.

E-VLBI and End-to-End Performance Masaki HirabaruYasuhiro KoyamaTetsuro Kondo NICT KoganeiNICT Kashima

APII/APAN Measurement Framework: Advanced Network Observatory Masaki Hirabaru (NICT), Takatoshi Ikeda (KDDI Lab), Motohiro Ishii (QIC), and Yasuichi Kitamura.

High-speed TCP  FAST TCP: motivation, architecture, algorithms, performance (by Cheng Jin, David X. Wei and Steven H. Low)  Modifying TCP's Congestion.

Masaki Hirabaru Tsukuba WAN Symposium 2005 March 8, 2005 e-VLBI and End-to-End Performance over Global Research Internet.

E-VLBI – Creating a Global Radio-Telescope Array via High-Speed Networks Alan R. Whitney MIT Haystack Observatory Internet2 Fall Member Meeting San Diego,

E-VLBI Activity in NICT National Institute of Information and Communications Technology (NICT) Kashima Space Research Center M. Sekido, 、 Y. Koyama, M.

Possible Engineering Support for Dual Polarization and Ultra Wide Band Observation with EAVN N. Kawaguchi National Astronomical Observatory East Asia VLBI.

Masaki Hirabaru Network Performance Measurement and Monitoring APAN Conference 2005 in Bangkok January 27, 2005 Advanced TCP Performance.

Status and future of East Asia VLBI network H.Kobayashi(NAOJ) East Asia VLBI

Masaki Hirabaru NICT Koganei 3rd e-VLBI Workshop October 6, 2004 Makuhari, Japan Performance Measurement on Large Bandwidth-Delay Product.

Masaki Hirabaru 情報処理学会四国支部講演会 December 17, 2004 インターネットでの長距離高性能データ転送.

1. Introduction REU 2006-Packet Loss Distributions of TCP using Web100 Zoriel M. Salado, Mentors: Dr. Miguel A. Labrador and Cesar D. Guerrero 2. Methodology.

Performance Engineering E2EpiPEs and FastTCP Internet2 member meeting - Indianapolis World Telecom Geneva October 15, 2003

Giga-bit Geodesy e-VLBI at 22GHz Ｈｉｒｏｓｈｉ Takaba Gifu University, Japan.

1 Masaki Hirabaru Network Architecture Group PL Meeting New Generation Network Research Center July 26, 2006 A Role of Network Architecture in e-VLBI.

Masaki Hirabaru NICT APAN JP NOC Meeting August 31, 2004 e-VLBI for SC2004 bwctl experiment with Internet2.

Data Transport Challenges for e-VLBI Julianne S.O. Sansa* * With Arpad Szomoru, Thijs van der Hulst & Mike Garret.

E. Momjian, T. Ghosh, C. Salter, & A. Venkataraman (NAIC-Arecibo Observatory) eVLBI with the 305 m Arecibo Radio Telescope ABSTRACT Using the newly acquired.

TCP transfers over high latency/bandwidth networks & Grid DT Measurements session PFLDnet February 3- 4, 2003 CERN, Geneva, Switzerland Sylvain Ravot

E-VLBI: A Brief Overview Alan R. Whitney MIT Haystack Observatory.

Possible eVLBI connection between Eastern Asian Observatories Noriyuki KAWAGUCHI National Astronomical Observatory, Japan eVLBI Workshop

1 Masaki Hirabaru and Yasuhiro Koyama PFLDnet 2006 Febrary 2, 2006 International e-VLBI Experience.

Radio Astronomy Applications Group Kashima Space Research Center IUGG2003, Sapporo (C) ISAS Orbit Determination of The NOZOMI Spacecraft using Differential.

Data delayed Real Time Data Transfer for Very Long Baseline Interferometry Simon Casey, Richard Hughes-Jones, Stephen Kershaw, Ralph Spencer, Matt Strong.

An Analysis of AIMD Algorithm with Decreasing Increases Yunhong Gu, Xinwei Hong, and Robert L. Grossman National Center for Data Mining.

Masaki Hirabaru (NICT) and Jin Tanaka (KDDI) Impact of Bottleneck Queue on Long Distant TCP Transfer August 25, 2005 NOC-Network Engineering Session Advanced.

E-VLBI – Creating a Global Radio-Telescope Array via High-Speed Networks Alan R. Whitney MIT Haystack Observatory Optical Waves: Who Needs Them and Why?

e-VLBI: Creating a Global Radio Telescope via High-Speed Networks

Alan R. Whitney MIT Haystack Observatory

e-VLBI Deployments with Research Internet

Presentation transcript:

1 Masaki Hirabaru and Yasuhiro Koyama APEC-TEL APGrid Workshop September 6, 2005 e-VLBI: Science over High-Performance Networks

2 Radio Telescopes NICT Kashima Space Center 34m Onsala Space Observatory 20m (left) Perks 64m (right) Australia Telescope National Facility MIT Haystack 18m Shanghai 25m

3 Geophysics and Plate Tectonics VLBI Applications  0.5 mm/year  0.3 mm/year 1.3  0.5 mm/year Kauai Fairbanks Kashima Kashima-Kauai Baseline Length Fairbanks-Kauai Baseline Length Kashima-Fairbanks Baseline Length

4 VLBI Applications (2) Halca （ Muses-B ） NGC4261 Radio Telescope Satellite ‘Halca’ and its images Earth Orientation Parameters Radio Astronomy : High Resolution Imaging, Astro-dynamics Reference Frame : Celestial / Terrestrial Reference Frame Earth Orientation Parameters, Dynamics of Earth’s Inner Core

5 VLBI (Very Long Baseline Interferometry) e-VLBI geographically distributed observation, interconnecting radio antennas over the world ASTRONOMY GEODESY Gigabit / real-time VLBI multi-gigabit rate sampling delay radio signal from a star correlator A/D clock A/D Internet clock ~Gbps A B A B d Large Bandwidth-Delay Product Network issue

6 VLBI System Transitions K5 Data Acquisition Terminal 1st Generation 2nd Generation 1983~ Open-Reel Tape Hardware Correlator 1990~ Cassette Tape Hardware Correlator e-VLBI over ATM 3rd Generation 2002~ PC-based System Hard-disk Storage Software Correlator e-VLBI over Internet K3 Correlator (Center) K3 Recorder (Right) K4 Terminal K4 Correlator 64Mbps 256Mbps 1 ～ 2Gbps

7 Recent e-VLBI System Developments K5 by NICT ADS1000 (1024Msample/sec 1ch 1bit or 2bits) ADS2000 (64Msample/ch·sec, 16ch, 1bit or 2bits) IP-VLBI Board (~16Msample/ch·sec, ~4ch, ~8bits) PC : Data Acquisition Correlation VSI Correlator other DAS Internet PC-VSI Board (Supports VSI-H specifications) VSI VSI-E RTP/RTCP

8 Motivations MIT Haystack – NICT Kashima e-VLBI Experiment on August 27, 2003 to measure UT1-UTC in 24 hours –41.54 GB NICT → MIT 107 Mbps (~50 mins) GB MIT → NICT 44.6 Mbps (~120 mins) –RTT ~220 ms, UDP throughput Mbps However TCP ~6-8 Mbps (per session, tuned) –BBFTP with 5 x 10 TCP sessions to gain performance HUT – NICT Kashima Gigabit VLBI Experiment -RTT ~325 ms, UDP throughput ~70 Mbps However TCP ~2 Mbps (as is), ~10 Mbps (tuned) -Netants (5 TCP sessions with ftp stream restart extension) There was bandwidth available but we could not utilize.

9 Observing Bandwidth  Data rate  (Precision of Time Delay) -1  (SNR) 1/2 Wave Length / Baseline Length  Angular Resolution Baseline Length  (EOP Precision) -1 VLBI - Characteristics Faster Data Rate = Higher Sensitivity Longer Distance = Better Resolution

10 Long Distant Rover Control (at least) 7 minutes one way delay Image Command Earth Mars When operator saw collision, it was too late.

11 Long-Distance End-to-End Congestion Control Merge (Bottleneck) A+B > C Overflow Sender (JP) Receiver (US) Feedback BWDP: Amount of data sent but not yet acknowledged 64Kbps x 200ms = 1600B ~ 1 Packet 1Gbps x 200ms = 25MB ~ Packets 200ms round trip delay A B C

12 Average TCP Throughput less than 20Mbps Q=50 Example How much speed can we get? Receiver Sender High- Speed Backbone L2/L3 SW 1G 100M Delay at light speed: 100ms 1G

13 Analyzing Advanced TCP Dynamic Behavior in a Real Network ( Example: From Tokyo to Indianapolis at 1G bps with HighSpeed TCP ) The data was obtained during e-VLBI demonstration at Internet2 Member Meeting in October Throughput RTT Window Sizes Packet Losses

14 Kwangju Busan 2.5G Fukuoka Korea 2.5G SONET KOREN Taegu Daejon 10G 1G (10G) 1G Seoul XP Genkai XP Kitakyushu Kashima 1G (10G) Fukuoka Japan 250km 1,000km 10G JGN II 9,000km 4,000km Los Angeles Chicago Washington DC MIT Haystack 10G 2.4G APII/JGN II Abilene Koganei 1G(10G) Indianapolis 100km bwctl server Performance Measurement Platform for High-Performance Scientific Data Transfer 10G Tokyo XP / JGN II I-NOC *Performance Measurement Point Directory perf server e-vlbi server JGNII 10G GEANT SWITCH 7,000km TransPAC Pittsburgh U of Tokyo Locate the problem International collaboration to support for science applications U. Hawaii

15 Solutions by Advanced TCPs Loss-Based ► AQM (Advanced Queue Management) Reno, Scalable, High-Speed, BIC, … Delay-Based Vegas, FAST Explicit Router Notification ECN, XCP, Quick Start, SIRENS, MaxNet How can wee foresee collision (queue overflow)?

16 TCP Performance with Different Queue Sizes

17 * set to 100M for measurement Measuring Bottleneck Queue Sizes Switch / Router Queue Size Measurement Result ReceiverSender Capacit y C packet train lost packet measured packet Queue Size = C x (Delay max – Delay min ) Device Queuing Delay (µs) Capacity (Mbps) Estimated Queue Size (1500B) Switch A *50p/75KB Switch B *180p/270KB Switch C *169p/254KB Switch D p/90KB Switch E p/447KB Router F p/18MB Router G p/23MB cross traffic injected for measurement

18 RouterSwitch 1Gbps (10G) 100Mbps (1G) b-1) Typical Bottleneck Cases RouterSwitch a) Queue ~100 Queue ~1000 VLANs Switch/ Router 10G LAN-PHY Ethernet Untag b-2) 9.5G WAN-PHY 802.1q Tag

19 e-VLBI Demonstration in JGN II Osaka (Jan. 2005)  e-VLBI data transfer achieved ~700Mbps from Haystack to Osaka ~900Mbps from Kashima to Osaka  Software Cross Correlation ~240Mbps per station Dr. Koyama 4 Apple G5 Server machines (8 CPUs in Total) Osaka #7,#8 1G Raid Disks 1G x4 Raid Disks #5,#6 #1,#2 #3,#4 CPU x8 10G Tokyo NICT Kashima Abilene (10G) MIT Haystack CHI WAS JGN II Int’l (10G) 1G /10G 1G/2.5G *TCP parameters were tuned for the path.

20 VLBI Antenna Locations in North-East Asia Shintotsukawa 3.8m Tomakomai 11m, FTTH (100M) 70km from Sapporo Mizusawa 10m 20m 118km from Sendai Tsukuba 32m, OC48/ATMx2 SuperSINET Kashima 34m, 1Gx2 JGN II, OC48/ATM Galaxy Yamaguchi 32m 1G, 75M SINET Gifu 11m 3m, OC48/ATMx2 SuperSINET Usuda 64m, OC48/ATM Galaxy Nobeyama 45m OC48/ATM Galaxy Nanshan (Urumqi) 25m 70km from Urumqi Koganei 34m, 1Gx2 JGN II, OC48/ATM Galaxy Miyun (Beijing) 50m 50km from Beijing 2Mbps Yunnan (Kunming) 3m (40m) 10km from Kunming Sheshan (Shanghai) 25m 30km from Shanghai Observatory is on CSTNET at 100M Jeju 20m Tamna U Seoul 20m Yonsei U Ulsan 20m U Ulsan Daejon 14m Taeduk Ishigaki 20m Ogasawara 20m Chichijima 10m Iriki 20m Kagoshima 6m Aira 10m Legend connected not yet connected antenna under construction

21 e-VLBI Data Transfer Real-time e-VLBI – flat-rate live data transfer Internet Synchronize Correlation Common e-VLBI – file transfer Carry the disk to the nearest station to put on-line Correlate among many combinations concurrently to get more precise data (like a virtual huge antenna) Future – e-VLBI infrastructure multicast and automated

22 Summary High-performance scientific data transfer faces on network issues we need to work out. Big science applications like e-VLBI and High- Energy Physics need cooperation with network and Grid researchers. Deployment of performance measurement Infrastructure over research networks is ongoing on world-wide basis.