NEXPReS Period 3 Overview WP 6: High Bandwidth on Demand Paul Boven, JIVE

Introduction Current e-VLBI connections static links, supporting 1024 Mb/s Higher bandwidths now available at some telescopes (4Gb/s) International BoD would offer flexible, efficient network configuration that matches e-VLBI usage patterns well NSI is a new protocol for BoD management ▫ Developed by OGF working group ▫ On standardization track ▫ Each network operator controls its own network resources ▫ Build an international path from demarcation to demarcation JIVE created the NEXPReS NSI client, to be able to submit network reservations to the NSI providers Slide: 2 NEXPReS P3 Review – Dwingeloo, NL - 19 September 2013 WP6 – High Bandwidth on Demand

Tasks 1: Integration of e-VLBI with Bandwidth-on-Demand ▫ JIVE, SURFnet, NORDUnet, OSO, CSIRO 2: On-demand access for large archives ▫ ASTRON, SURFnet 3: Testing and validation of on-demand circuits ▫ UMAN, JIVE 4: Multi Gbps on-demand for e-VLBI ▫ JIVE, SURFnet, NORDUnet, OSO Slide: 3 NEXPReS P3 Review – Dwingeloo, NL - 19 September 2013 WP6 – High Bandwidth on Demand

Deliverables in P3 D#TitleMonthStatusType D6.02Operational use of BoD on at least one e-VLBI connection36 4R D6.04BoD scheduling interface for LTA30 4R D6.05Demonstration of BoD for an operational LTA33 4D D6.06Demonstration of integrated BoD testing and validation30 4D D6.08Demonstration of international BoD connectivity at 10Gb/s30 4D Slide: 4 NEXPReS P3 Review – Dwingeloo, NL - 19 September 2013 WP6 – High Bandwidth on Demand

D6.04: BoD scheduling interface for LTA LOFAR Long Term Archive, storage of correlated observation data Hierarchical tiers ▫ Tier 0: LOFAR Central Processing ▫ Tier 1: Long Term Archive  Groningen (Target)  Amsterdam (BigGrid)  Jülich (FZJ) ▫ Tier 2: Public and External systems (local storage at universities) Design of an interface for the LTA management systems to automatically create BoD network reservations to support planned data migrations Slide: 5 NEXPReS P3 Review – Dwingeloo, NL - 19 September 2013 WP6 – High Bandwidth on Demand

D6.04: BoD scheduling interface for LTA Slide: 6 NEXPReS P3 Review – Dwingeloo, NL - 19 September 2013 WP6 – High Bandwidth on Demand Blue: code created in this deliverable. Green: NEXPReS Red: external

D6.05: Demonstration of BoD for an operational LTA Slide: 7 NEXPReS P3 Review – Dwingeloo, NL - 19 September 2013 WP6 – High Bandwidth on Demand

D6.05: Demonstration of BoD for an operational LTA Slide: 8 NEXPReS P3 Review – Dwingeloo, NL - 19 September 2013 WP6 – High Bandwidth on Demand Screenshot of real-time status overview

D6.05: Demonstration of BoD for an operational LTA Slide: 9 NEXPReS P3 Review – Dwingeloo, NL - 19 September 2013 WP6 – High Bandwidth on Demand Selected a dataset of 500 files (415GB) at Amsterdam (SURFSara) Select destination to be Target (Groningen) Use 10Gb/s BoD link (SURFnet7), controlled via NSI (D6.03)

D6.06: Demonstration of integrated BoD testing and validation Automated testing of international BoD links prior to use Use ‘udpmon’ as traffic source/sink ▫ On ‘Flexbuf’ servers (WP8) Test at 100% and 50% of the requested data rate ▫ Distinguish between congestion and other loss sources Inform end-user of test result Store results in database for historical trend analysis Slide: 10 NEXPReS P3 Review – Dwingeloo, NL - 19 September 2013 WP6 – High Bandwidth on Demand

D6.06: Demonstration of integrated BoD testing and validation Slide: 11 NEXPReS P3 Review – Dwingeloo, NL - 19 September 2013 WP6 – High Bandwidth on Demand

D6.08: Demonstration of international BoD at 10Gb/s Several 10Gb/s locations made available via NSI ▫ JIVE, SURFnet, Torun, OSO ▫ (JBO shortly after the deliverable was completed) Torun and PSNC not part of this workpackage/project ▫ Contributed by hosting equipment and configuring 10G link Sunet graciously allowed use of a 10G port ▫ Connect OSO to NORDUnet NSI testbed Connection tests done using D6.06 interface ▫ Torun - JIVE: % loss (worst case) at 10Gb/s ▫ OSO – JIVE: 0.039% loss at 8Gb/s, high loss beyond 8Gb/s Slide: 12 NEXPReS P3 Review – Dwingeloo, NL - 19 September 2013 WP6 – High Bandwidth on Demand

D6.08: Demonstration of international BoD at 10Gb/s Slide: 13 NEXPReS P3 Review – Dwingeloo, NL - 19 September 2013 WP6 – High Bandwidth on Demand

D6.02: Operational use of BoD on at least one e-VLBI connection Task 1, Participants: JIVE, SURFnet, NORDUnet, OSO, CSIRO ▫ Additionally: UMAN (JBO), Torun, DANTE/GÉANT, PSNC First science observation on NSI was from JBO ( ) ▫ Outage on regular production e-VLBI link from JBO ▫ AutoBahn- SURFnet NSI link just operational ▫ AutoBahn-NSI Protocol Adapter ▫ Used for 4 separate observing runs Torun production data on NSI link during observation ( ) Real-time fringes from Australian telescopes ( ) Slide: 14 NEXPReS P3 Review – Dwingeloo, NL - 19 September 2013 WP6 – High Bandwidth on Demand

D6.02: Operational use of BoD on at least one e-VLBI connection Slide: 15 NEXPReS P3 Review – Dwingeloo, NL - 19 September 2013 WP6 – High Bandwidth on Demand

D6.02: Operational use of BoD on at least one e-VLBI connection Slide: 16 NEXPReS P3 Review – Dwingeloo, NL - 19 September 2013 WP6 – High Bandwidth on Demand NSI Traffic from JBO to JIVE during 3 e-VLBI observations

D6.02: Operational use of BoD on at least one e-VLBI connection Slide: 17 NEXPReS P3 Review – Dwingeloo, NL - 19 September 2013 WP6 – High Bandwidth on Demand Fringes on , with Tr data over NSI

D6.02: Operational use of BoD on at least one e-VLBI connection Slide: 18 NEXPReS P3 Review – Dwingeloo, NL - 19 September 2013 WP6 – High Bandwidth on Demand ATNF traffic on , via NSI (left) and 2 more telescopes routed (right)

D6.02: Operational use of BoD on at least one e-VLBI connection Slide: 19 NEXPReS P3 Review – Dwingeloo, NL - 19 September 2013 WP6 – High Bandwidth on Demand Publication ▫ Radio and X-ray observations of jet ejection in Cygnus-X2 ▫ R.E. Spencer e.a. ▫ Monthly Notices of the Royal Astronomical Society (letters) ▫ Publication date August 8 th, 2013 ▫ Probably first use of NSI for science observation Astronomers Telegram ▫ e-EVN detection of Aql X-1 in outburst ▫ AT#5158 ▫ Tudose e.a.

The NEXPReS NSI client Slide: 20 NEXPReS P3 Review – Dwingeloo, NL - 19 September 2013 WP6 – High Bandwidth on Demand Performs circuit reservation through NSI protocol ▫ Tested with OpenDRAC, OpenNSA, AutoBahn-PA ▫ Web-UI to schedule paths, and API hooks ▫ Open Sourced (GPL) and built from O.S. components  Linux, PHP, MySQL, Apache ▫ Path-finding, Aggregation

Summary Slide: 21 NEXPReS P3 Review – Dwingeloo, NL - 19 September 2013 WP6 – High Bandwidth on Demand Built a working NSI (client) implementation ▫ Created international paths through multiple NRENs Demonstrated the usability of NSI for radio astronomy ▫ Multi-domain international paths at 4Gb/s and 10Gb/s ▫ e-VLBI and LTA operations First end-user to adopt NSI ▫ Important role in shaping the service Used NSI provisioned paths for science data ▫ First use of NSI for a science observation

Questions/Comments Contact Information: ▫ Paul Boven ▫ Linux/Networking Expert ▫ JIVE ▫ ▫ Additional information available via NEXPReS is an Integrated Infrastructure Initiative (I3), funded under the European Union’s Seventh Framework Programme (FP7/ ) under grant agreement no RI Slide: 22 NEXPReS P3 Review – Dwingeloo, NL - 19 September 2013