R. Hughes-Jones ESnet Meeting Kyoto July 2000 Networking for HEP in the UK uIntroduction to the PPNCG uNetwork Topologies uMonitoring Activities uPeering to the US and Canada uGrid Work uSuperJANET4

R. Hughes-Jones ESnet Meeting Kyoto July 2000 Introduction to the PPNCG uMembership includes HEP and Astronomy users –Ensure the community has the required networking facilities –Monitor end-to-end performance –Investigate new network applications / technologies –Provide advice on kit / facilities – URL icfamon.rl.ac.uk/ppncg/title.html uActs as an Interface between HEP and UKERNA –Collaboration : Multicast, H.323, QoS tests, SuperJANET4 uActive Network Monitoring –Uses the ICFA monitoring tools and the PPNCG traceping and ftp –Monitor MANs / SuperJANET & the networks to CERN, DESY, US –Report problems to UKERNA

R. Hughes-Jones ESnet Meeting Kyoto July 2000 SuperJANET Connections in the UK

R. Hughes-Jones ESnet Meeting Kyoto July 2000 u 4 * 155 Mbit links to SuperJANET u 2 * 155 Mbit transatlantic links u 3 rd link in use 18 Jul 00 u 4 th planned by End of 00 SuperJANET Connections in London

R. Hughes-Jones ESnet Meeting Kyoto July 2000 UK to Europe TEN-155 April 2000 Peering with CANARIE made in London, uses 10 Mbit of the Dante US line for all Europe

R. Hughes-Jones ESnet Meeting Kyoto July 2000 Europe and ESnet in the US

R. Hughes-Jones ESnet Meeting Kyoto July 2000 Monitoring: US Traffic UKERNA Traffic data Kbit/s. Blue Traffic from US; Maroon Traffic to US 10 Nov Jul minute averages Last 7 days 1 hour averages

R. Hughes-Jones ESnet Meeting Kyoto July 2000 Monitoring: US Traffic - Trends Traffic Kbit/s. Blue Traffic from US Maroon Traffic to US 10 Nov Jul minute averages UKERNA – US Traffic Daily totals Mbytes Weekend Xmas 99 From US To US Weekday

R. Hughes-Jones ESnet Meeting Kyoto July 2000 Monitoring: ping plots UK - US Ping average round trip time & Lost packet % for 100 byte packets icfamon.dl.ac.uk – ns2.slac.stanford.edu 13 Oct Jun 00

R. Hughes-Jones ESnet Meeting Kyoto July 2000 Monitoring: traceping UK - US Mar 99 John Macallister PPNCG Oxford

R. Hughes-Jones ESnet Meeting Kyoto July 2000 Monitoring: traceping UK - US Oct 99

R. Hughes-Jones ESnet Meeting Kyoto July 2000 Monitoring: traceping UK - US Jul 2000

R. Hughes-Jones ESnet Meeting Kyoto July 2000 Monitoring: ping plots UK - CERN & DESY Ping average round trip time & Lost packet % for 100 byte packets icfamon.dl.ac.uk – rsplus.cern.ch icfamon.dl.ac.uk – x4u2.desy.de 27 Jun 00

R. Hughes-Jones ESnet Meeting Kyoto July 2000 Peering with ESnet uUsed CAR and WRED to give priority to Esnet traffic into JANET. uRtt and packet loss for 100 byte packets. uTests DL to SLAC Start 21 Feb 00 CAR+WRED enabled Config changes to CAR and WRED Further config changes High Priority Normal Priority Robin Tasker PPNCG DL

R. Hughes-Jones ESnet Meeting Kyoto July 2000 Peering with ESnet and Abilene urtt and packet loss for 100 byte packets uPlot start 16 May 00 ESnet High Priority DL - SLAC Abilene High Priority DL - Stanford Further config changes Change in bandwidth restrictions from Abilene into JANET

R. Hughes-Jones ESnet Meeting Kyoto July 2000 The Grid uGovernment has discussed 165M pounds to develop Computing Grid Infrastructure. uAcross Research Councils Initiative – not just HEP u Setting up management structure to co- ordinate PPARC activities. uHave run Globus workshop so US developers could inform the community. uSeveral sites now working with Globus toolkit. uWeb site

R. Hughes-Jones ESnet Meeting Kyoto July 2000 The Grid uKeen Interest in the EU DataGrid (CERN) middleware proposal. uHEP experiments will need world Grid access. uGrid Networking interests include: –High throughput, reliable, very large data transfers –QoS issues – diffserv, RSVP and packet marking –Monitoring, Metrics, and prediction accuracy –Modelling uPhysics Applications

R. Hughes-Jones ESnet Meeting Kyoto July 2000 The Grid: PAW with Globus Toolkit Linux GASS Server Sun GASS Server SGI GASS Server Campus LAN Zebra HBOOK Toolkit PAW Next Steps: Working on “root” Brokers Data Location Security + Global farms BaBar Tau Analysis Andrew McNab Manchester

R. Hughes-Jones ESnet Meeting Kyoto July 2000 uATM MAN u7 routers ~0.8ms / router  Router+link 0.4  s/byte uDL-Liverpool ~10 ms rtt - agreement The Grid:Measurements on SuperJANET uSigma ~1.2 ms Latency Mancester - DL Richard Hughes-Jones PPNCG Manchester

R. Hughes-Jones ESnet Meeting Kyoto July 2000 The Grid: Latency on SuperJANET Pink: LAN Blue: MAN-SJ CORE Pink: Man-RAL MB Blue: Man-RAL  ~5  s nice exponential  ~ 2 ms  4.5 -> 6.7 ms

R. Hughes-Jones ESnet Meeting Kyoto July 2000 The Grid: Throughput on SuperJANET Manc – UCL 10 Mbit Manc – Glasgow Manc – RAL 24 Mbit link Manc – RAL 2 Mbit Managed BW

R. Hughes-Jones ESnet Meeting Kyoto July 2000 The Grid: Multi-stream ftp Oxford to SLAC Single stream 8 ftp streams ~ 0.8 single stream John Macallister PPNCG Oxford

R. Hughes-Jones ESnet Meeting Kyoto July 2000 The Grid: Multi-stream ftp SLAC to Oxford

R. Hughes-Jones ESnet Meeting Kyoto July 2000 The Grid: Multi-stream ftp SLAC to Oxford 25 min

R. Hughes-Jones ESnet Meeting Kyoto July 2000 SuperJANET4 uSuperJANET4 Topology based on Worldcom Trident Network uBackbone initially SDH based 2.5 Gbit (STM-16) uUpgrade to 10 Gbit in 2001, 20 Gbit in 2002 uMigration from SDH to DWDM uTechnology review in 2003

R. Hughes-Jones ESnet Meeting Kyoto July 2000 SuperJANET4: Backbone and Access links uWorldcom supply the transmission uUKERNA layer the IP –Core PoP IP router at Worldcom –Backbone Access Router at MANs uAccess Links: –Large MAN 2.5 Gbit -> Gbit –Medium MAN 622 Mbit -> 2.5 Gbit u4 node DWDM development net uDeployment: –Backbone delivery Oct 00 –Routers + acceptance Nov 00 –Manc-ULCC traffic end Dec 00 –All sites Mar 01

R. Hughes-Jones ESnet Meeting Kyoto July 2000 Conclusion & Status uNetwork Links to US and Europe are OK (at the moment !) uPeering with Abilene, ESnet and CANARIE OK, interesting effects with CAR – WRED ! uConsiderable UK interest in the Internet2 tests uGrid: active in several areas including networks uSuperJANET4 rollout is very promising