GridPP Collaboration Meeting Nov 2001 R. Hughes-Jones Manchester Network Monitoring and GridPP Richard Hughes-Jones, University of Manchester 6 November 2001 u DataGrid WP7 uMB – NG uDataTAG uGridPP

GridPP Collaboration Meeting Nov 2001 R. Hughes-Jones Manchester DataGrid WP7 Networking u Active and proceeding well, Meetings:  Oxford DataGrid meeting Jul 01  CERN 18 Sep 01  Frascati DataGrid meeting Oct 01 uProvisioning, Reports on  DataGrid network requirements and current infrastructure  Use of IP ports for TestBed1 uMonitoring (Robin Tasker) uHigh Performance High Throughput (Richard Hughes-Jones) uQoS and Bandwidth Reservation (Tiziana Ferrari) uSecuity (Dave Kelsey)

GridPP Collaboration Meeting Nov 2001 R. Hughes-Jones Manchester Network Monitoring u Several tools in test – plugged into a coherent structure:  PingER, RIPE one way times, iperf, UDPmonRE, rTPL, GridFTP, and NWS prediction engine u continuous tests for last month to selected sites:  DL Man RL UCL CERN Lyon Bologna SARA NBI SLAC …  Discussions this week at WP7 in Amsterdam uThe aims of monitoring for the Grid:  to inform Grid applications, via the middleware, of the current status of the network – input for resource broker and scheduling  to identify fault conditions in the operation of the Grid  to understand the instantaneous, day-to-day, and month-by-month behaviour of the network – provide advice on configuration etc. uReport written on LDAP scheme for publishing the network information

GridPP Collaboration Meeting Nov 2001 R. Hughes-Jones Manchester Local Network Monitoring Store & Analysis of Data (Access) Access to current and historic data and metrics via the Web, i.e. WP7 NM Pages, access to metric forecasts Backend LDAP script to fetch metrics Monitor process to push metrics local LDAP Server Grid Application access via LDAP Schema to - monitoring metrics; - location of monitoring data. PingER (RIPE TTB) iperf rTPL NWS etc LDAP Schema Grid Apps GridFTP Network Monitoring Architecture Robin Tasker

GridPP Collaboration Meeting Nov 2001 R. Hughes-Jones Manchester How do the Grid apps access the metrics of network monitoring? What is the RTT viewed from UCL to RAL and QMW? Query an LDAP server that makes use of an LDAP Schema containing the ObjectClass RTT to find out. How?

GridPP Collaboration Meeting Nov 2001 R. Hughes-Jones Manchester service=netmon, dc=ucl, ou=UK, ou=DataGrid, o=Grid rou=ral objectclass=networkmonitorHost objectclass=networkmonitorRTT objectclass=networkmonitorThroughput objectclass=networkmonitorLoss rou=qmw objectclass=networkmonitorHost objectclass=networkmonitorRTT objectclass=networkmonitorThroughput objectclass=networkmonitorLoss and find the details from the LDAP Schema for publication of the RTT metric PingER RTT metric rTPL RTT metric

GridPP Collaboration Meeting Nov 2001 R. Hughes-Jones Manchester to allow a request to return a valid metric

GridPP Collaboration Meeting Nov 2001 R. Hughes-Jones Manchester Data: RIPE 1-way & TCP throughput RIPE 1-way time ms Sara  RAL 20 Oct 01 RIPE 1-way time ms RAL  Sara TCP Iperf + prediction Mbit/s UCL  Sara

GridPP Collaboration Meeting Nov 2001 R. Hughes-Jones Manchester Data: Ping & UDP throughput PingER rtt (ms) dl – cern 1000 byte packet Forecast From 20 Oct 01 UDPmon throughput Mbit/s man – cern 300 * 1400 byte frames

GridPP Collaboration Meeting Nov 2001 R. Hughes-Jones Manchester High Performance High Throughput uDocument produced outlining the tests to be made:  Understanding the end system HW,  best way to monitor traffic and protocol packets,  Type and effect of background traffic,  Throughput vs rtt, throughput vs window-size,  Throughput using multiple TCP streams, and effect on the Network  GridFTP at Gigabit,  Effect of different TCP stacks,  Use of non-TCP protocols, and effect on the Network  Show and tell demos uDiscussions this week at WP7 in Amsterdam uLinks to MB-NG, DataTAG, GGF/IETF

GridPP Collaboration Meeting Nov 2001 R. Hughes-Jones Manchester QoS and BW Reservation uProposed workplan presented at Oxford WP7 meeting  Identification of traffic classes and middleware components requiring QoS Discussion with other WorkPackages – definition of application requirements GridFTP  packet loss Interactive applications  packet loss, delay, jitter Piloting of IP Premium (GEANT and NRNs)  Study of traffic differentiation and traffic engineering techniques: Layer 2 MPLS VPNs (CISCO and Juniper) LAN & WAN QoS Traffic clasification, marking, policing, ccongestion control, queue scheduling, traffic aggregation  demonstration of QoS & Bandwith Reservation uDocument in production outlining the tests to be made

GridPP Collaboration Meeting Nov 2001 R. Hughes-Jones Manchester E-science core project MB - NG u Project to investigate and pilot:  end-to-end traffic engineering and management over multiple administrative domains – MPLS in core diffserv at the edges.  Managed bandwidth and Quality-of-Service provision. (Robin T)  High performance high bandwidth data transfers. (Richard HJ)  Demonstrate end-to-end network services to CERN using Dante EU-DataGrid and the US DataTAG. u Status: approved with requested funds start on 1 Dec 2001 u Partners:CISCO, CLRC, Manchester, UCL, UKERNA plus Lancaster and Southampton (IPv6) u A technical meeting held – draft spec. of the HW required u Would like to use real Grid traffic – maybe:  CDF UCL-RAL  BaBar Man-RAL

GridPP Collaboration Meeting Nov 2001 R. Hughes-Jones Manchester MB – NG SuperJANET Testbed MB - NG SuperJANET4 Production Network Leeds RAL / UKERNA RAL / UKERNA SJ4 Dev C-PoP Reading SJ4 Dev C-PoP Warrington Manc MCC ULCC UCL SJ4 Dev C-PoP London Gigabit Ethernet 2.5 Gbit POS 10 Gbit POS

GridPP Collaboration Meeting Nov 2001 R. Hughes-Jones Manchester The EU DataTAG project u EU Transatlantic Gigabit project. u Status: approved for 4 M ECU start on 1 Dec 2001 u Partners: CERN/PPARC/INFN/UvA. IN2P3 sub-contractor u The main foci are: u Grid Network Research including:  Provisioning (CERN)  Investigations of high performance data transport (PPARC)  End-to-end inter-domain QoS + BW / network resource reservation  Bulk data transfer and monitoring (UvA) u Interoperability between Grids in Europe and the US  PPDG, GriPhyN, DTF, iVDGL (USA) DataTAG

GridPP Collaboration Meeting Nov 2001 R. Hughes-Jones Manchester DataTAG project Abilene ESNET MREN STAR-TAP UK SuperJANET4 IT GARR-B IT GARR-B GEANT NewYork Olivier Martin NL SURFnet NL SURFnet 2.5 Gbit lambda between CERN and Starlight POS 2 nd half 2002 – WDM later STAR-LIGHT CERN

GridPP Collaboration Meeting Nov 2001 R. Hughes-Jones Manchester Single stream vs Multiple streams effect of a single packet loss (e.g. link error, buffer overflow) Time T Avg Gbps Avg Gbps 2T Avg. 7.5 Gbps Streams/Throughput T = 2.37 hours! (RTT=200msec, MSS=1500B) T T T Throughput Gbps DataTAG

GridPP Collaboration Meeting Nov 2001 R. Hughes-Jones Manchester GGF u Grid High-Performance Networking RG  Talk on Lambda Networking Research, Cees de Laat, UvA  BW reservation & Gigabit Tests ATLAS at Michigan, E. Myers  Charter fully discussed u Network monitoring WG  Much in common with WP7 two way exchange of techniques. u GridFTP  UK participation in protocols and α-testing with the Globus developers. uLDAP Schema for network status  Discussions with GLobus

GridPP Collaboration Meeting Nov 2001 R. Hughes-Jones Manchester Focus on The UK and GridPP uGridPP + DataGRID + DataTAG + MB-NG + GGF will collaborate closely. uGridPP has UK specific issues and includes experiments at:  BaBar with links to SLAC  CDF and D0 working at Fermi  UKQCD UKDMC (dark matter) MINOS uPPNCG is a natural forum fro UK GridPP network matters uRecent throughput problems, perceived as transatlantic, traced to on-campus bottlenecks. uThe PPNCG strongly encourage good liaison between the HEP teams and the campus networking groups. uCompiled a picture of the access BW to the HEP sites:

GridPP Collaboration Meeting Nov 2001 R. Hughes-Jones Manchester Manchester 1G 100M 1 G soon Liverpool 155M 100M 4*155M soon. To hep ? Lancaster 155M 100M move to c&nlman at 155Mbit Glasgow 1G 100M 30M? Edinburgh 1G 100M UCL 155M 1G 30M? RAL 622M 100M Gig on site soon Oxford 622M 100M Durham 155M ??100M Birmingham 622M ?? 100M IC 155M 34M then 1G to Hep QMW 155M ?? Cambridge 1G 16M? RHBNC 34M 155M soon ?? 100M Brunel 155M ?? Bristol 622M 100M Sheffield 155M ??100M Swansea 155M 100M Portsmouth 155M 100M Southampton M Sussex M DL 155M 100M Connectivity of UK Grid Sites. BW to Campus, BW to site, limit

GridPP Collaboration Meeting Nov 2001 R. Hughes-Jones Manchester Ptolemy simulation of the Grid (1) uPtolemy - a discrete event simulation tool from Berkley uSimulation based on flows from “DataGrid-7-D NetworkRequirements.doc” uPredics the flow between Institutes and across SuperJANET Paul Mealor

GridPP Collaboration Meeting Nov 2001 R. Hughes-Jones Manchester Ptolemy simulation of the Grid (2) SuperJANET London Man RAL CERN Glasgow & Edinburgh Lancaster Liverpool Bristol Birmingham (Imperial) Tier 3 Paul Mealor

GridPP Collaboration Meeting Nov 2001 R. Hughes-Jones Manchester Don’t Forget Involvement with: uUKQCD UKDMC (dark matter) MINOS uAstroGRID uAccessGRID u Grids for High Performance Computer Centres – Edinburgh Manchester u Lambda Switching Projects u …

GridPP Collaboration Meeting Nov 2001 R. Hughes-Jones Manchester European Access uPPNCG monitoring shows packet loss and increased rtt from the UK to Europe. uDue to packet loss at the TEN155- gw.ja.net  Start of problems 12 Oct  % loss seen by 31 Oct uThe 155 Mbit line to Dante running at ~130 Mbit uA reconfiguration Fri 2 nov helped. uTEN155 contact ends 1 Dec – replaced by Dante 2.5Gbit access link.