IGRID2002 Radio Astronomy VLBI Demo. uWeb based demonstration sending VLBI data A controlled stream of UDP packets 256-500 Mbit/s on the production network.

Slides:

Advertisements

Similar presentations

SURFnets connections to StarLight Erik-Jan Bos Manager Network Services SURFnet STAR TAP SM INET 2001 Annual Meeting Stockholm, Sweden - June 5th, 2001.

Advertisements

TERENA Networking Conference, Lyngby, May 2007, R. Hughes-Jones Manchester 1 The Performance of High Throughput Data Flows for e-VLBI in Europe Multiple.

GridPP Meeting Edinburgh 4-5 Feb 04 R. Hughes-Jones Manchester 1 High Performance Networking for ALL Members of GridPP are in many Network collaborations.

TCP transfers over high latency/bandwidth network & Grid TCP Sylvain Ravot

ICFA SCIC Meeting CERN Dec 01 R. Hughes-Jones Manchester Network Connectivity and Projects – a Perspective from the UK Richard Hughes-Jones PPNCG SuperJANET4.

MB - NG MB-NG Meeting UCL 1 Nov 02 R. Hughes-Jones Manchester 1 Status of Task 2 Traffic Generation and Measurement.

MB - NG MB-NG Technical Meeting 03 May 02 R. Hughes-Jones Manchester 1 Task2 Traffic Generation and Measurement Definitions Pass-1.

MB - NG MB-NG Jan 2002 R. Hughes-Jones Manchester Some Edge (Bbone) Router requirements Connect to the test systems in the IP domain. Accept marked packets.

Advanced Internet Research Wim Sjouw Santiago de Compostela 14 February 2003.

DataTAG CERN Oct 2002 R. Hughes-Jones Manchester Initial Performance Measurements With DataTAG PCs Gigabit Ethernet NICs (Work in progress Oct 02)

Spring 2000CS 4611 Introduction Outline Statistical Multiplexing Inter-Process Communication Network Architecture Performance Metrics.

Project Partners Project Collaborators The Council for the Central Laboratory of the Research Councils Funded by EPSRC GR/T04465/01

BZUPAGES.COM 1 User Datagram Protocol - UDP RFC 768, Protocol 17 Provides unreliable, connectionless on top of IP Minimal overhead, high performance –No.

ER2002 Radio Astronomy VLBI Demo. uWeb based demonstration sending VLBI data A controlled stream of UDP packets Mbit/s on the production network.

JIVE VLBI Network Meeting 15 Jan 2003 R. Hughes-Jones Manchester The EVN-NREN Project Richard Hughes-Jones The University of Manchester.

Meeting on ATLAS Remote Farms. Copenhagen 11 May 2004 R. Hughes-Jones Manchester Networking for ATLAS Remote Farms Richard Hughes-Jones The University.

GridPP meeting Feb 03 R. Hughes-Jones Manchester WP7 Networking Richard Hughes-Jones.

CAIDA Bandwidth Estimation Meeting San Diego June 2002 R. Hughes-Jones Manchester 1 EU DataGrid - Network Monitoring Richard Hughes-Jones, University of.

CdL was here DataTAG/WP7 Amsterdam June 2002 R. Hughes-Jones Manchester 1 EU DataGrid - Network Monitoring Richard Hughes-Jones, University of Manchester.

5 Annual e-VLBI Workshop, September 2006, Haystack Observatory R. Hughes-Jones Manchester 1 The Network Transport layer and the Application or TCP/IP.

Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 1 Introduction to the PPNCG Networking for the PPARC Community  Introduction to the.

Optical Networking Status of Discussion in the UK Richard Hughes-Jones The University of Manchester Particle Physics Network Coordination Group TERENA.

DataTAG - WP3 Objectives, activities and progress by UvA: Wim Sjouw, Hans Blom, Jason Lee, Cees de Laat INRIA: Mathieu Goutelle CERN: tbd.

DataGrid WP7 Meeting CERN April 2002 R. Hughes-Jones Manchester Some Measurements on the SuperJANET 4 Production Network (UK Work in progress)

JIVE VLBI Network Meeting 28 Jan 2004 R. Hughes-Jones Manchester Brief Report on Tests Related to the e-VLBI Project Richard Hughes-Jones The University.

CALICE UCL, 20 Feb 2006, R. Hughes-Jones Manchester 1 10 Gigabit Ethernet Test Lab PCI-X Motherboards Related work & Initial tests Richard Hughes-Jones.

DataTAG Meeting CERN 7-8 May 03 R. Hughes-Jones Manchester 1 High Throughput: Progress and Current Results Lots of people helped: MB-NG team at UCL MB-NG.

EDG WP7 Networking Demonstration uDemonstration sending HEP data CERN to SARA Multiple streams of TCP packets Tuned TCP parameters: ifconfig eth0 txqueuelen.

PFLDNet Argonne Feb 2004 R. Hughes-Jones Manchester 1 UDP Performance and PCI-X Activity of the Intel 10 Gigabit Ethernet Adapter on: HP rx2600 Dual Itanium.

© 2006 Open Grid Forum Interactions Between Networks, Protocols & Applications HPCN-RG Richard Hughes-Jones OGF20, Manchester, May 2007,

ESLEA Bedfont Lakes Dec 04 Richard Hughes-Jones Network Measurement & Characterisation and the Challenge of SuperComputing SC200x.

CdL was here DataTAG CERN Sep 2002 R. Hughes-Jones Manchester 1 European Topology: NRNs & Geant SuperJANET4 CERN UvA Manc SURFnet RAL.

ESLEA Bits&Bytes, Manchester, 7-8 Dec 2006, R. Hughes-Jones Manchester 1 VLBI & Protocols vlbi_udp Multiple Flow Tests Richard Hughes-Jones The University.

July 2000 PPNCG Meeting R. Hughes-Jones Performance Measurements of LANs MANs and SuperJANET III This is PRELIMINARY uBaseline data for Grid development.

02 nd April 03Networkshop Managed Bandwidth Next Generation F. Saka UCL NETSYS (NETwork SYStems centre of excellence)

GGF4 Toronto Feb 2002 R. Hughes-Jones Manchester Initial Performance Measurements Gigabit Ethernet NICs 64 bit PCI Motherboards (Work in progress Mar 02)

R. Hughes-Jones ESnet Meeting Kyoto July 2000 Networking for HEP in the UK uIntroduction to the PPNCG uNetwork Topologies uMonitoring Activities uPeering.

Internet2, Washington, 10 April 2003 eVLBI Research in the European VLBI Network Steve Parsley Joint Institute for VLBI in Europe Dwingeloo, Netherlands.

AMPATH, FIU, Miami, 31 January 2003 eVLBI Research in the European VLBI Network Steve Parsley Joint Institute for VLBI in Europe Dwingeloo, Netherlands.

ESLEA PMB, Manchester, 23 Nov 2006, R. Hughes-Jones Manchester 1 Protocols Progress with Current Work. Richard Hughes-Jones The University of Manchester.

High Rate Internet Data Transfer for eVLBI Ralph Spencer, Richard Hughes-Jones and Simon Casey The University of Manchester All Hands Sept 2005.

Introduction VLBI_UDP is an application being developed to transfer VLBI data using the UDP protocol. Initially developed by Richard Hughes- Jones for.

Network Performance for ATLAS Real-Time Remote Computing Farm Study Alberta, CERN Cracow, Manchester, NBI MOTIVATION Several experiments, including ATLAS.

TOPS “Technology for Optical Pixel Streaming” Paul Wielinga Division Manager High Performance Networking SARA Computing and Networking Services

Less than Best Effort -- Nicolas Simar Less than Best Effort QoS IP 2003, Milan (Italy), Nicolas Simar, Network Engineer.

76-m Lovell Telescope Jodrell Bank, UK Even big telescopes see no more detail than the naked eye High bandwidth data transfer - the future of European.

CAIDA Bandwidth Estimation Meeting San Diego June 2002 R. Hughes-Jones Manchester UDPmon and TCPstream Tools to understand Network Performance Richard.

Collaboration Meeting, 4 Jul 2006, R. Hughes-Jones Manchester 1 Collaborations in Networking and Protocols HEP and Radio Astronomy Richard Hughes-Jones.

High bit rate tests between Manchester and JIVE Looking at data rates attainable with UDP along with packet loss and reordering statistics Simon Casey,

DataGrid WP7 Meeting Amsterdam Nov 01 R. Hughes-Jones Manchester 1 UDPmon Measuring Throughput with UDP  Send a burst of UDP frames spaced at regular.

Advances Toward Economic and Efficient Terabit LANs and WANs Cees de Laat Advanced Internet Research Group (AIRG) University of Amsterdam.

VLBI_UDP An application for transferring VLBI data via UDP protocol Simon Casey e-VLBI meeting, Haystack 20 Sep 2006.

GNEW2004 CERN March 2004 R. Hughes-Jones Manchester 1 Lessons Learned in Grid Networking or How do we get end-2-end performance to Real Users ? Richard.

Networks ∙ Services ∙ People Richard-Hughes Jones eduPERT Training Session, Porto A Hands-On Session udpmon for Network Troubleshooting 18/06/2015.

Final EU Review - 24/03/2004 DataTAG is a project funded by the European Commission under contract IST Richard Hughes-Jones The University of.

1 eVLBI Developments at Jodrell Bank Observatory Ralph Spencer, Richard Hughes- Jones, Simon Casey, Paul Burgess, The University of Manchester.

ESLEA VLBI Bits&Bytes Workshop, 31 Aug 2006, R. Hughes-Jones Manchester 1 vlbi_udp Throughput Performance and Stability. Richard Hughes-Jones The University.

Data delayed Real Time Data Transfer for Very Long Baseline Interferometry Simon Casey, Richard Hughes-Jones, Stephen Kershaw, Ralph Spencer, Matt Strong.

1 TCP ProtocolsLayer name DNSApplication TCP, UDPTransport IPInternet (Network ) WiFi, Ethernet Link (Physical)

Connect. Communicate. Collaborate 4 Gigabit Onsala - Jodrell Lightpath for e-VLBI Richard Hughes-Jones.

iperf a gnu tool for IP networks

NL Service Challenge Plans

R. Hughes-Jones Manchester

Networking between China and Europe

Networking for grid Network capacity Network throughput

Mar 2001 ATLAS T2UK Meeting R. Hughes-Jones

MB-NG Review High Performance Network Demonstration 21 April 2004

Wide Area Networking at SLAC, Feb ‘03

MB – NG SuperJANET4 Development Network

Presentation transcript:

iGRID2002 Radio Astronomy VLBI Demo. uWeb based demonstration sending VLBI data A controlled stream of UDP packets Mbit/s on the production network Man  Amsterdam 32 bit words bits vertical Bit Stream ~ 7.1 UDP Packets / Data Track Frame Timestamp Data Data Track Frame

European Topology: NRNs, Geant, Sites SuperJANET4 CERN iGrid 2002 Manchester Jodrell SURFnet JIVE

The Works: n bytes Wait time time  Raid0 Disc UDP Data Raid0 Disc RingBuffer TCP Control Web Interface

Receiving Packets Time Incoming packet ids Move 6 Continue with 7 uPackets have Header with packet id + Data Put header directly into control area Put data directly into ring buffer No extra copy uAssume UDP packet arrive in order none lost Deposit data into next consecutive slot uInspect Header Move data onward to correct location Record: The received inter-packet spacing 1-way delay

UDP Throughput on the Production WAN Manc-UvA SARA 750 Mbit/s SJANET4 + Geant + SURFnet 75% Manchester Access link Manc-UvA SARA 825 Mbit/s

Acknowledgements uBoston Ltd supply of the SuperMicro servers & donation of SCSI disks and backplane Dev, Alex Tyagi, Gili-Ross uBrunell University Peter van Santen uJIVE Steve Parsley, Sergei Pogrebenko uMetsähovi Radio Observatory Ari Mujunen uSURFnet & Universiteit van Amsterdam Pieter de Boer, Erik.Radius, Cees de Laat, Mieke van de Berg uUKERNA Robin Arrack, Bob Day, Jeremy Sharp uUniversity of Manchester Richard Hughes-Jones, Ralph Spencer, Paul Burgess Robin Hughes-Jones Design of web interface (Undergraduate, Oxford University)

Gigabit TCP Throughput on the Production WAN Throughput vs TCP buffer size TCP window sizes in Mbytes calculated from RTT*bandwidth LinkRound trip time ms TCP Window for BW 1 Gbit/s TCP Window for UDP BW 750 Mbit/s TCP Window for UDP BW 460 Mbit/s Man – Ams Man - CERN

UDP Throughput: SLAC - Man SLAC – Manc 470 Mbit/s 75% of the 622 Mbit access link SuperJANET4 peers with ESnet at 622Mbit in NY