Presentation is loading. Please wait.

Presentation is loading. Please wait.

EVN-NREN meeting, Schiphol, 28-1-2005, A. Szomoru, JIVE Recent eVLBI developments at JIVE Arpad Szomoru Joint Institute for VLBI in Europe.

Published byKory Chase Modified over 8 years ago

Similar presentations

Presentation on theme: "EVN-NREN meeting, Schiphol, 28-1-2005, A. Szomoru, JIVE Recent eVLBI developments at JIVE Arpad Szomoru Joint Institute for VLBI in Europe."— Presentation transcript:

1 EVN-NREN meeting, Schiphol, 28-1-2005, A. Szomoru, JIVE Recent eVLBI developments at JIVE Arpad Szomoru Joint Institute for VLBI in Europe

2 EVN-NREN meeting, Schiphol, 28-1-2005, A. Szomoru, JIVE Outline Introduction Protocols, tuning issues Tests and results ftp-based Dual buffered Single buffered Real-time Jumbo frames Network monitoring Centralised control

3 EVN-NREN meeting, Schiphol, 28-1-2005, A. Szomoru, JIVE Introduction Move to disk-based operations nearly complete More reliable, data quality Cheaper to maintain Ease of use Direct access compared Unattended operations eVLBI: the future? No consumables High bandwidth Fast turn-around Disk based recording eVLBI using fiber

4 EVN-NREN meeting, Schiphol, 28-1-2005, A. Szomoru, JIVE for the EVN and JIVE Feasibility of eVLBI:- Costs, timescales, logistics. Standards:- Protocols, parameter tuning, procedures at telescope and correlator. New Capabilities:- Higher data rates, improved reliability, quicker response. for GÉANT and the NRENs To see significant network usage with multiple Gbit streams converging on JIVE. Minimum is three telescopes (not including Westerbork) Must be seen to enable new science and not just solve an existing data-transport problem Real-time operation is seen as the ultimate aim, buffered operation accepted as a development stage. POC targets:

5 EVN-NREN meeting, Schiphol, 28-1-2005, A. Szomoru, JIVE Fibre pair from Amsterdam Optical Splitters GE lines to correlator LX Optics converters Cisco ONS 15252 Correlator Interface Current status: JIVE: 6 lambdas via Netherlight, each capable of 1 Gbps 1 Gbps connections to Westerbork, Torun, Onsala, (Metsahovi?), 2.5 to Jodrell 155 Mbps to Arecibo Connection of Medicina at 1 Gbps planned later this year Current status: JIVE: 6 lambdas via Netherlight, each capable of 1 Gbps 1 Gbps connections to Westerbork, Torun, Onsala, (Metsahovi?), 2.5 to Jodrell 155 Mbps to Arecibo Connection of Medicina at 1 Gbps planned later this year

6 EVN-NREN meeting, Schiphol, 28-1-2005, A. Szomoru, JIVE Protocols Use of existing protocols, available hardware TCP: maximal reliability, very sensitive to congestion UDP: connectionless, fast(er) but not reliable (enough?) Different protocols will be tested in the near future (tsunami?)

7 EVN-NREN meeting, Schiphol, 28-1-2005, A. Szomoru, JIVE Tuning issues Dramatic improvement of TCP performance possible by adjusting default settings: congestion window: product of roundtrip time and bandwidth size of queues between kernel and NIC SACK (Selective Acknowledgment) implementation MTU size (jumbo frames) Interrupt moderation: cpu may be bottleneck http://sravot.home.cern.ch/sravot

8 EVN-NREN meeting, Schiphol, 28-1-2005, A. Szomoru, JIVE Tuning issues Dramatic improvement of TCP performance possible by adjusting default settings: congestion window: product of roundtrip time and bandwidth size of queues between kernel and NIC SACK (Selective Acknowledgment) implementation MTU size (jumbo frames) Interrupt moderation: cpu may be bottleneck

9 EVN-NREN meeting, Schiphol, 28-1-2005, A. Szomoru, JIVE Mem-mem transfer via patch

10 EVN-NREN meeting, Schiphol, 28-1-2005, A. Szomoru, JIVE Disk2net2disk via patch, jumbo

11 EVN-NREN meeting, Schiphol, 28-1-2005, A. Szomoru, JIVE Disk2net-net2disk Dwingeloo-Bologna

12 EVN-NREN meeting, Schiphol, 28-1-2005, A. Szomoru, JIVE Network stress test (iperf)

13 EVN-NREN meeting, Schiphol, 28-1-2005, A. Szomoru, JIVE Iperf (TCP) 30s intervals

14 EVN-NREN meeting, Schiphol, 28-1-2005, A. Szomoru, JIVE Intel(R) SE7501BR2 Intel(R) 7501 chip set Dual Intel(R) Xeon (single, 2.8G, 512K L2 cash installed) Dual channel DDR266 registered SDRAM (512MB) Dual peer PCIX 64/100, 2+2 slots 32/33 PCI, 2 slots On-board TX1000 and T10/100 NICs On-board Ultra320 SCSI On-board PATA Mark 5 Motherboard Upgrade

15 EVN-NREN meeting, Schiphol, 28-1-2005, A. Szomoru, JIVE Memory-memoryDisk2net-net2disk In2net- net2disk In2net- net2out UDPTCPUDPTCP Bench via patch930250256 Idem, jumbo frames960544512 Bench via Amsterdam500360256 Idem, jumbo frames341456 Westerbork-JIVE867680256 Idem, jumbo frames249378 Bologna-JIVE670128307 Jodrell-JIVE507064256 Arecibo-JIVE8832 Torun-JIVE800260256 Onsala-JIVE177256 JIVE-Haystack61271 Test results

16 EVN-NREN meeting, Schiphol, 28-1-2005, A. Szomoru, JIVE Memory-memoryDisk2net-net2disk In2net- net2disk In2net- net2out UDPTCPUDPTCP Bench via patch930250256 Idem, jumbo frames960544512 Bench via Amsterdam500360256 Idem, jumbo frames341456 Westerbork-JIVE867680256 Idem, jumbo frames249378 Bologna-JIVE670128307 Jodrell-JIVE507064256 Arecibo-JIVE8832 Torun-JIVE800260256 Onsala-JIVE177256 JIVE-Haystack61271 Test results

17 EVN-NREN meeting, Schiphol, 28-1-2005, A. Szomoru, JIVE Huygens descent tracking Data recorded at Mopra and Parkes, flown to Sydney, transported via dedicated 1Gbps lightpath to Jive Peak transfer rate ~400Mbps Use of modified tsunami protocol “slow start” algorithm Transfer freezes occasionally Quite buggy (but not everybody thinks so..)

18 EVN-NREN meeting, Schiphol, 28-1-2005, A. Szomoru, JIVE eVLBI Transfer modes ftp-based: bandwidth not critical, has greatly improved response to technical problems at telescopes Dual buffered: recorded on Mk5 diskpack, transferred through disk2net and net2disk, played back at correlator Single buffered: streamed directly from formatters to diskpacks at JIVE Real-time: directly from formatters to correlator without disk buffering

19 EVN-NREN meeting, Schiphol, 28-1-2005, A. Szomoru, JIVE eVLBI Transfer modes ftp-based: bandwidth not critical, has greatly improved response to technical problems at telescopes Dual buffered: recorded on Mk5 diskpack, transferred through disk2net and net2disk, played back at correlator Single buffered: streamed directly from formatters to diskpacks at JIVE Real-time: directly from formatters to correlator without disk buffering First real-time eVLBI Image

20 EVN-NREN meeting, Schiphol, 28-1-2005, A. Szomoru, JIVE MERLIN, March 2002 eVLBI, September 2004 IRC+10420

21 EVN-NREN meeting, Schiphol, 28-1-2005, A. Szomoru, JIVE Jumbo frames Tested with: Onsala @4470 Torun @8192 Westerbork @9000 Results inconclusive, but… Transfer between Mk5’s (bench) UDP: <500 Mbps TCP: >500 Mbps, ONLY with jumbo frames Other hardware platform needed?

22 EVN-NREN meeting, Schiphol, 28-1-2005, A. Szomoru, JIVE Network monitoring BWCTL installed at most stations More measuring points along the way needed Script-based tools for inspection and visualisation of state of network

23 EVN-NREN meeting, Schiphol, 28-1-2005, A. Szomoru, JIVE Centralised control New operating model for EVN; correlator as integral part of network

24 EVN-NREN meeting, Schiphol, 28-1-2005, A. Szomoru, JIVE

25 Centralised control New operating model for EVN; correlator as integral part of network Monitoring tools at stations Reliability of correlator, stability of Mark5 units Choice of platform?

26 EVN-NREN meeting, Schiphol, 28-1-2005, A. Szomoru, JIVE Conclusions Mark5 not very well suited for eVLBI Hardware limitations (interrupt conflicts, outdated motherboards, proprietary hardware) Software limitation (stuck to kernel 2.4 because of Jungo drivers, proprietary software) Next platform? support for 4Gbps, PCI Xpres? as much off-the-shelf as possible as simple as possible (no disks!) Dedicated lightpaths…

Download ppt "EVN-NREN meeting, Schiphol, 28-1-2005, A. Szomoru, JIVE Recent eVLBI developments at JIVE Arpad Szomoru Joint Institute for VLBI in Europe."

Similar presentations

Connecting Academic Networks The ORIENT, TEIN and GÉANT Projects: International Research Networks John Chevers, DANTE International eVLBI Workshop Shanghai,

Connecting Academic Networks The ORIENT, TEIN and GÉANT Projects: International Research Networks John Chevers, DANTE International eVLBI Workshop Shanghai,
Project Partners Project Collaborators The Council for the Central Laboratory of the Research Councils Funded by EPSRC GR/T04465/01 www.eslea.uklight.ac.uk.

Project Partners Project Collaborators The Council for the Central Laboratory of the Research Councils Funded by EPSRC GR/T04465/01
The CVN Real Time Correlator Zhang Xiuzhong, Chen Zhong Shanghai Astronomical Observatory China 4th e-VLBI Workshop Sydney 2005.7.

The CVN Real Time Correlator Zhang Xiuzhong, Chen Zhong Shanghai Astronomical Observatory China 4th e-VLBI Workshop Sydney
PERT – EVN-NREN –Amsterdam 28/1/05 – Toby Rodwell The PERT and Network Performance Monitoring EVN-NREN, Amsterdam 28//01/05.

PERT – EVN-NREN –Amsterdam 28/1/05 – Toby Rodwell The PERT and Network Performance Monitoring EVN-NREN, Amsterdam 28//01/05.
First e-EVN Science and Future Astronomy projects via EXPReS Michael Garrett Joint Institute for VLBI in Europe e-VLBI Workshop, Sydney, 13 July 2005.

First e-EVN Science and Future Astronomy projects via EXPReS Michael Garrett Joint Institute for VLBI in Europe e-VLBI Workshop, Sydney, 13 July 2005.
Arpad Szomoru Joint Institute for VLBI in Europe

Arpad Szomoru Joint Institute for VLBI in Europe
© 2006 Open Grid Forum Interactions Between Networks, Protocols & Applications HPCN-RG Richard Hughes-Jones OGF20, Manchester, May 2007,

© 2006 Open Grid Forum Interactions Between Networks, Protocols & Applications HPCN-RG Richard Hughes-Jones OGF20, Manchester, May 2007,
E-VLBI Development at Haystack Observatory Alan Whitney Chet Ruszczyk Kevin Dudevoir Jason SooHoo MIT Haystack Observatory 24 March 2006 EVN TOG meeting.

E-VLBI Development at Haystack Observatory Alan Whitney Chet Ruszczyk Kevin Dudevoir Jason SooHoo MIT Haystack Observatory 24 March 2006 EVN TOG meeting.
VLBI Report LBA Operations & eVLBI Tasso Tzioumis ATNF May 2008.

VLBI Report LBA Operations & eVLBI Tasso Tzioumis ATNF May 2008.
E-VLBI Development at Haystack Observatory Alan Whitney Chet Ruszczyk MIT Haystack Observatory 10 Jan 2006 IVS General Meeting Concepion, Chile.

E-VLBI Development at Haystack Observatory Alan Whitney Chet Ruszczyk MIT Haystack Observatory 10 Jan 2006 IVS General Meeting Concepion, Chile.
Electronic Transmission of Very- Long Baseline Interferometry Data National Internet2 day, March 18, 2004 David LapsleyAlan Whitney MIT Haystack Observatory,

Electronic Transmission of Very- Long Baseline Interferometry Data National Internet2 day, March 18, 2004 David LapsleyAlan Whitney MIT Haystack Observatory,
E-VLBI Development at Haystack Observatory 5 th Annual e-VLBI Workshop Haystack Observatory 20 September 2006 Alan R. Whitney Kevin Dudevoir Chester Ruszczyk.

E-VLBI Development at Haystack Observatory 5 th Annual e-VLBI Workshop Haystack Observatory 20 September 2006 Alan R. Whitney Kevin Dudevoir Chester Ruszczyk.
Next Gen. Correlator Workshop, Groningen, June 2006, A. Szomoru, JIVE NEW USE for An old correlatoR Arpad Szomoru Joint Institute for VLBI in Europe.

Next Gen. Correlator Workshop, Groningen, June 2006, A. Szomoru, JIVE NEW USE for An old correlatoR Arpad Szomoru Joint Institute for VLBI in Europe.
Current LBA Developments Chris Phillips CSIRO ATNF 13/7/2005.

Current LBA Developments Chris Phillips CSIRO ATNF 13/7/2005.
E-VLBI: Connecting the Global Array of Radio Telescopes through High-Speed Networks Participating U.S. organizations: MIT Haystack Observatory MIT Lincoln.

E-VLBI: Connecting the Global Array of Radio Telescopes through High-Speed Networks Participating U.S. organizations: MIT Haystack Observatory MIT Lincoln.
Marcin Okoń Pozna ń Supercomputing and Networking Center, Supercomputing Department e-Science 2006, Amsterdam, Dec. 4-6 2006 Virtual Laboratory as a Remote.

Marcin Okoń Pozna ń Supercomputing and Networking Center, Supercomputing Department e-Science 2006, Amsterdam, Dec Virtual Laboratory as a Remote.
E-VLBI at ≥ 1 Gbps -- “unlimited” networks? Tasso Tzioumis Australia Telescope National Facility (ATNF) 4 November 2008.

E-VLBI at ≥ 1 Gbps -- “unlimited” networks? Tasso Tzioumis Australia Telescope National Facility (ATNF) 4 November 2008.
E-VLBI over TransPAC Masaki HirabaruDavid LapsleyYasuhiro KoyamaAlan Whitney Communications Research Laboratory, Japan MIT Haystack Observatory, USA Communications.

E-VLBI over TransPAC Masaki HirabaruDavid LapsleyYasuhiro KoyamaAlan Whitney Communications Research Laboratory, Japan MIT Haystack Observatory, USA Communications.
International Networking for e-VLBI. What is JIVE? Operate the EVN correlator and support astronomers doing VLBI. A collaboration of the major radio-

International Networking for e-VLBI. What is JIVE? Operate the EVN correlator and support astronomers doing VLBI. A collaboration of the major radio-
High Data Rate Transfer for HEP and VLBI Ralph Spencer, Richard Hughes-Jones and Simon Casey The University of Manchester Netwrokshop33 March 2005.

High Data Rate Transfer for HEP and VLBI Ralph Spencer, Richard Hughes-Jones and Simon Casey The University of Manchester Netwrokshop33 March 2005.

Similar presentations

Ads by Google