Connect. Communicate. Collaborate Support by GÉANT2 and NRENs for eVLBI in Europe John Chevers, DANTE In collaboration with: Toby Rodwell (DANTE) Steve.

Slides:



Advertisements
Similar presentations
Connect. Communicate. Collaborate GÉANT2 (and 3) CCIRN XiAn 26 August 2007 David West DANTE.
Advertisements

TERENA Networking Conference, Lyngby, May 2007, R. Hughes-Jones Manchester 1 The Performance of High Throughput Data Flows for e-VLBI in Europe Multiple.
Dominik Stoklosa Poznan Supercomputing and Networking Center, Supercomputing Department EGEE 2007 Budapest, Hungary, October 1-5 Workflow management in.
Connecting Academic Networks The ORIENT, TEIN and GÉANT Projects: International Research Networks John Chevers, DANTE International eVLBI Workshop Shanghai,
Dominik Stokłosa Pozna ń Supercomputing and Networking Center, Supercomputing Department INGRID 2008 Lacco Ameno, Island of Ischia, ITALY, April 9-11 Workflow.
Progress With iBOBs at Jodrell Bits & Bytes Meeting, JBO, th Dec 2007 Jonathan Hargreaves Electronic Engineer, Jodrell Bank Observatory.
Connect. Communicate. Collaborate The Performance Enhancement Response Team: Origins and Evolution Ann Harding, HEAnet Toby Rodwell,
Project Partners Project Collaborators The Council for the Central Laboratory of the Research Councils Funded by EPSRC GR/T04465/01
JIVE VLBI Network Meeting 15 Jan 2003 R. Hughes-Jones Manchester The EVN-NREN Project Richard Hughes-Jones The University of Manchester.
Xmas Meeting, Manchester, Dec 2006, R. Hughes-Jones Manchester 1 e-Science work ESLEA & EXPReS vlbi_udp Multiple Flow Tests DCCP Tests EXPReS-Dante Collaboration.
Copyright © 2005 Department of Computer Science CPSC 641 Winter WAN Traffic Measurements There have been several studies of wide area network traffic.
Meeting on ATLAS Remote Farms. Copenhagen 11 May 2004 R. Hughes-Jones Manchester Networking for ATLAS Remote Farms Richard Hughes-Jones The University.
GridPP meeting Feb 03 R. Hughes-Jones Manchester WP7 Networking Richard Hughes-Jones.
First e-EVN Science and Future Astronomy projects via EXPReS Michael Garrett Joint Institute for VLBI in Europe e-VLBI Workshop, Sydney, 13 July 2005.
JIVE VLBI Network Meeting 28 Jan 2004 R. Hughes-Jones Manchester Brief Report on Tests Related to the e-VLBI Project Richard Hughes-Jones The University.
© 2006 Open Grid Forum Interactions Between Networks, Protocols & Applications HPCN-RG Richard Hughes-Jones OGF20, Manchester, May 2007,
ESLEA Bits&Bytes, Manchester, 7-8 Dec 2006, R. Hughes-Jones Manchester 1 VLBI & Protocols vlbi_udp Multiple Flow Tests Richard Hughes-Jones The University.
VLBI Report LBA Operations & eVLBI Tasso Tzioumis ATNF May 2008.
GÉANT and The Future of Pan-European Networking CCIRN, 3 rd July 2004 John Boland CEO HEAnet Member of DANTE Board of Directors.
Poznań city, PSNC - who are we? Poznań city, PSNC - who are we? Introduction into Virtual Laboratory Introduction into Virtual Laboratory VLab architecture.
Marcin Okoń Pozna ń Supercomputing and Networking Center, Supercomputing Department e-Science 2006, Amsterdam, Dec Virtual Laboratory as a Remote.
E-VLBI at ≥ 1 Gbps -- “unlimited” networks? Tasso Tzioumis Australia Telescope National Facility (ATNF) 4 November 2008.
EVN-NREN Meeting, Zaandan, 31 Oct 2006, R. Hughes-Jones Manchester 1 FABRIC 4 Gigabit Work & VLBI-UDP Performance and Stability. Richard Hughes-Jones The.
Internet2, Washington, 10 April 2003 eVLBI Research in the European VLBI Network Steve Parsley Joint Institute for VLBI in Europe Dwingeloo, Netherlands.
AMPATH, FIU, Miami, 31 January 2003 eVLBI Research in the European VLBI Network Steve Parsley Joint Institute for VLBI in Europe Dwingeloo, Netherlands.
Connect. Communicate. Collaborate GÉANT2 User Support: helping to enable international research projects John Chevers, DANTE TERENA Networking Conference.
High Data Rate Transfer for HEP and VLBI Ralph Spencer, Richard Hughes-Jones and Simon Casey The University of Manchester Netwrokshop33 March 2005.
EVN-NREN meeting, Schiphol, , A. Szomoru, JIVE Recent eVLBI developments at JIVE Arpad Szomoru Joint Institute for VLBI in Europe.
Support for Radio Astronomy Michael Enrico DANTE.
High Rate Internet Data Transfer for eVLBI Ralph Spencer, Richard Hughes-Jones and Simon Casey The University of Manchester All Hands Sept 2005.
VLBI/eVLBI with the 305-m Arecibo Radio Telescope Chris Salter Tapasi Ghosh Emmanuel Momjian Arun Venkataraman Jon Hagen.
Introduction VLBI_UDP is an application being developed to transfer VLBI data using the UDP protocol. Initially developed by Richard Hughes- Jones for.
ORIENT/ORIENTplus - Connecting Academic Networks in China and Europe Jennifer(Jie) An CERNET Center/Tsinghua University 14 Feb.2012.
4th e-VLBI workshop, Sydney, July 2005, A. Szomoru, JIVE e-VLBI and EXPReS Arpad Szomoru.
Masaki Hirabaru Network Performance Measurement and Monitoring APAN Conference 2005 in Bangkok January 27, 2005 Advanced TCP Performance.
Arecibo (JIVE/EXPReS +) Presented by : Tapasi Ghosh Other active players: Arun Venkataraman, Chris Salter, & Emmanuel Momjian. A brief history.
Marian García - GÉANT Support for Research GÉANT Support for Research Within and Beyond Europe TNC 2003, Zagreb May Marian Garcia, Operations Manager.
E-VLBI FP6 Proposal. Outline Background The Call Content of Proposal & Aim Possible Participants Overall preparation plan.
Connect. Communicate. Collaborate GÉANT2 User Support for eVLBI John Chevers, Project Manager, DANTE Forskningsnet Konference 2005 Middelfart, Denmark.
76-m Lovell Telescope Jodrell Bank, UK Even big telescopes see no more detail than the naked eye High bandwidth data transfer - the future of European.
Online-Offsite Connectivity Experiments Catalin Meirosu *, Richard Hughes-Jones ** * CERN and Politehnica University of Bucuresti ** University of Manchester.
IVS General Meeting, Feb 2004, Ottawa eVLBI Research in the European VLBI Network Steve Parsley JIVE
High bit rate tests between Manchester and JIVE Looking at data rates attainable with UDP along with packet loss and reordering statistics Simon Casey,
New Generation Network GN2 Project Tomaž Kalin
Westerbork Netherlands Dedicated Gbit link Onsala Sweden Gbit link Jodrell Bank UK Dwingeloo DWDM link Cambridge UK MERLIN Medicina Italy Chalmers University.
Connect communicate collaborate LHCONE Diagnostic & Monitoring Infrastructure Richard Hughes-Jones DANTE Delivery of Advanced Network Technology to Europe.
E. Momjian, T. Ghosh, C. Salter, & A. Venkataraman (NAIC-Arecibo Observatory) eVLBI with the 305 m Arecibo Radio Telescope ABSTRACT Using the newly acquired.
1 eVLBI Developments at Jodrell Bank Observatory Ralph Spencer, Richard Hughes- Jones, Simon Casey, Paul Burgess, The University of Manchester.
Data delayed Real Time Data Transfer for Very Long Baseline Interferometry Simon Casey, Richard Hughes-Jones, Stephen Kershaw, Ralph Spencer, Matt Strong.
Dai Davies : General Manager : DANTE Ltd TERENA Networking Conference 7-10 June 2004 Rhodes, Greece GÉANT 2: A NEW.
NEXPReS Period 3 Overview WP 6: High Bandwidth on Demand Paul Boven, JIVE.
SA1: second year overview Arpad Szomoru JIVE January 30EXPReS Board Meeting, Utrecht, the Netherlands: SA1Slide #2 Outline Accomplishments in 2007.
2007 April 17EXPReS Annual ReviewSlide #: 1. EXPReS Annual Review April 17 EXPReS Project Team JIVE, Coordinating Institution.
PRESENTATION DATEEXPReS- TITLE OF YOUR PRESENTATIONSlide #1 What is EXPReS? EXPReS = Express Production Real-time e-VLBI Service Three year project (March.
8 th EVN Symposium, Torun, September 2006, A. Szomoru, JIVE Recent e-EVN Developments Arpad Szomoru.
NEXPReS Period 3 Overview WP2 EVN-NREN Richard Hughes-Jones, DANTE.
SPIE, Orlando, May 2006, A. Szomoru, JIVE VLBI in Transition Arpad Szomoru Joint Institute for VLBI in Europe.
EInfrastructures: Usage Policy Mike Garrett Joint Institute for VLBI in Europe (JIVE, Dwingeloo, The Netherlands) eInfrastructure meeting, Dublin, April.
Presentation Title Presentation subtitle Your name Your title, organisation.
What is FABRIC? Future Arrays of Broadband Radio-telescopes on Internet Computing Huib Jan van Langevelde, JIVE Dwingeloo.
SA1: Production e-VLBI service Previous 12 Month Overview Arpad Szomoru JIVE EXPReS is made possible through the support of the European Commission (DG-INFSO),
Connect. Communicate. Collaborate 4 Gigabit Onsala - Jodrell Lightpath for e-VLBI Richard Hughes-Jones.
TOG, Dwingeloo, March 2006, A. Szomoru, JIVE Status of JIVE Arpad Szomoru.
SA1: overview, first results
eInfrastructures: Usage Policy
E-EVN developments in 2006 Arpad Szomoru.
EXPReS Annual Review April 17
Arecibo (JIVE/EXPReS +)
e-EVN: practical considerations
SA1: third year overview
Presentation transcript:

Connect. Communicate. Collaborate Support by GÉANT2 and NRENs for eVLBI in Europe John Chevers, DANTE In collaboration with: Toby Rodwell (DANTE) Steve Parsley, Arpad Szomoru (Joint Institute for VLBI in Europe) Paul Burgess, Simon Casey, Richard Hughes-Jones, Adam Mathews, Stephen O’Toole, Ralph Spencer (University of Manchester) TNC2005 Poznan, Poland 8 th June 2005

Connect. Communicate. Collaborate User Support in GÉANT2 GÉANT2 has 3 million+ users in 34 countries in Europe and beyond How to support them? Pan-European projects with ‘demanding’ requirements –International user groups –High bandwidth requirement? –Specialised service requirement? Aim to introduce new levels of accountability, transparency and service Custom solutions for the particular user group To manage the lifecycle of the networking aspects of each user project Customer focused

Connect. Communicate. Collaborate User Support Mechanism for GÉANT2 Initial Contact –Establish eligibility of user application –Inform all NRENs involved –Assign point of contact User Questionnaire –Requirement gathering Evaluation –Consultation between DANTE and NRENs –Define stakeholders

Connect. Communicate. Collaborate User Support Mechanism for GÉANT2 (II) Planning and Implementation –Action plan –Design of OPN –Risk Register Continued Support –A service charter for the user –Change management QUALITY OF CUSTOMER SERVICE IS VITAL!

Connect. Communicate. Collaborate Networking for eVLBI in Europe European eVLBI Network: collaboration of radio observatories in Europe, Asia and South Africa Presently 5 telescopes connected: Torun, Onsala, Cambridge, Westerbork, Jodrell Bank Many more to be connected soon Large data flows, monitoring required A demanding user!

Connect. Communicate. Collaborate The future of the distant past: using networks for VLBI Connecting observatories to create a telescope as big as Europe! Continental-scale baselines produce the most detailed images ever of the most distant objects! Improving the resolution of observations to see further back in time Eliminating out-moded tape technology and speeding up results Harnessing the power of many radio telescopes in real time – only possible with GÉANT2 Allowing new ‘Window of Opportunity’ experiments: dynamic scheduling Distributing results to users across the world

Connect. Communicate. Collaborate GÉANT2/NREN eVLBI Network Connect. Communicate. Collaborate se1 - Juniper uk1 - Juniper nl1 - Juniper cz1 - Juniper pl1 - Juniper de1 - Juniper it1- Juniper de2 - Juniper STM-64 (10Gbps) ws4.it Dell geant-gw3 lond-scr3 man'-bar Cisco warr-scr Cisco read-scr3 Milan GSR Bologna GSR Bologna GARR bwctlMk5 MB STM-16 (2.5Gbps) Gigabit Ethernet ManCompCen Transmode 3Com CR1 JIVE, NL JODRELL BANK, UK Mk5s BOLOGNA, IT ws4.uk Dell Mk5 Torun oso-gw chalmers2 goteborg2 boras2 jonkoping1stockholm1 stockholm2 se-kth Mk5 Cisco ONSALA, SE TORUN, PL Unknown Netherlight

Connect. Communicate. Collaborate GÉANT2 User Support for eVLBI The EVN-NREN forum: the communities meet face-to-face! –Planning –Problem solving –Discussion of results –Increasing understanding GÉANT Weathermap and Taxametro tools Counters on GÉANT links Diagnostic tools (BWCTL) in GÉANT and NREN network nodes PERT account created –letting SMEs loose on the problem! Also use of specialised tools eg UDPmon

Connect. Communicate. Collaborate Progress in eVLBI /04 First disc-buffered eVLBI image 04/04 Three-telescope eVLBI session 06/04 eVLBI network stress tests (iPerf) 09/04 4 telescope eVLBI 09/04 First real-science eVLBI 12/04 Fringes at 256 Mbps JB-Tr 02/05 Network data transfer tests (BWCTL) between 6 eVLBI sites 03/05 eVLBI science session involving 6 telescopes: Wb, Ar, JB, Cm, On, Tr 03/05 EXPReS Proposal: –‘Production’ eVLBI –16 telescopes –High Data Rates –Global eVLBI 06/05 Connection of Medicina observatory: brings total to 6 telescopes in 5 countries across Europe

Connect. Communicate. Collaborate 4 th Year MPhys Project Adam Mathews Steve O’Toole Throughput vs packet spacing Manchester: 2.0 GHz Xeon Dwingeloo: 1.2 GHz PIII Near wire rate, 950 Mbps Packet loss CPU Kernel Load Receiver UDP Throughput Nov 2003 Manchester-SuperJANET4-GEANT-Surfnet-Dwingeloo Effect on local traffic

Connect. Communicate. Collaborate 1472 byte Packets man -> JIVE Relative 1-way delay Packet Loss & 1-way Delay

Connect. Communicate. Collaborate Measure the time between lost packets in the time series of packets sent. Lost 1410 in 0.6s Is it a Poisson process? Assume Poisson is stationary λ(t) = λ Use Prob. Density Function: P(t) = λ e -λt Mean λ = 2360 / s [426 µs] Plot log: slope expect Could be additional process involved Packet Loss Distribution Is it Poisson?

Connect. Communicate. Collaborate eVLBI Data Transfers over GÉANT: Long term tests of Bandwidth Jodrell-UKERNA-GÉANT-SURFnet-JIVE

Connect. Communicate. Collaborate eVLBI Data Transfers over GÉANT: Long term tests of Packet Loss Jodrell-UKERNA-GÉANT-SURFnet-JIVE 6 runs out of 747 showed any loss 1097 packets lost out of 81 million sent – 1.3x10 -3 %

Connect. Communicate. Collaborate UDP Tests Jan 2005 Simon Casey (PhD project) Between JBO and JIVE in Dwingeloo, using production network Period of high packet loss (3%):

Connect. Communicate. Collaborate GEANT – UKLight Comparison May 2005 Simon Casey (PhD project) Between JBO and JIVE in Dwingeloo Using production network Using UKLight network

Connect. Communicate. Collaborate Results of Jodrell-JIVE eVLBI Transfer Tests Overall link quality Manchester/Jodrell to JIVE very good – near line rate possible Occasional negligible losses, very infrequent noticeable losses Packet re-ordering observed Monitoring equipment will help to discover point in the link where losses occur These tests had no ‘exclusive’ access to machines – possible for other users to have an effect Real eVLBI sessions should be able to control access of machines

Connect. Communicate. Collaborate Conclusions and the FUTURE Data rates of 256Mbps feasible on real eVLBI runs Data rates of 900Mbps possible with UDP protocol The EXPRes EU eVLBI proposal: 16 telescopes in Europe, Asia, Australia, Latin America and North America JBO-Onsala test link at 4 Gbps, submitted March 19 th 2005 eVLBI tests in EVN at ~ 1 per month Network tests at up to 950 Mb/s – statistics of packet loss Investigate alternatives to TCP, UDP – tsunami, VSI-E etc. ESLEA tests on MB-NG and UKLight eVLBI will be routine in 2006!!

Connect. Communicate. Collaborate Backup Slides

Connect. Communicate. Collaborate Packet loss distribution: Cumulative distribution Cumulative distribution of packet loss, each bin is 12  sec wide Long range effects in the data? Poisson

Connect. Communicate. Collaborate Divide time series of packets into 1000 slices of 50 packets Total lost packets 1410 Average number / slice = 1.4 Calc Poisson Probability P(n, µ) = µ n e -µ n! Curves close but not exact Could be more than 1 process VLBI Project: Packet Loss – Is it Poisson?

Connect. Communicate. Collaborate Aggregated Variance Method Divide time series length N into blocks of size m Calc mean of each section Xm(k) k= 1 … N/m Calc variance VXm of these Xm(k) Vary m size of the blocks Plot on log-log & fit slope β Hurst parameter H β = 2H -2 Measure: β = H H =1 no long range dependence VLBI Project: Packet Loss – Long Range Effects?