1. 27-May-2004 NeSC Edinburgh The Evolving Network Peter Clarke The evolving network Some Science drivers Issues and Technology today Future evolution Peter Clarke University College London clarke@hep.ucl.ac.uk

2. 27-May-2004 NeSC Edinburgh The Evolving Network Peter Clarke Radio Astronomy: Very Long Baseline Interferometry

3. 27-May-2004 NeSC Edinburgh The Evolving Network Peter Clarke Jodrell Bank UK Onsala Sweden Medicina Italy Torun Poland Effelsberg Germany Westerbork Netherlands JIVE TODAY TOMORROW

4. 27-May-2004 NeSC Edinburgh The Evolving Network Peter Clarke Particle : The Large Collider Particle Physics : The Large Hadron Collider The CERN Accelerator Complex Proton-Proton Collisions ~ 20 PetaBytes per year

5. 27-May-2004 NeSC Edinburgh The Evolving Network Peter Clarke Breast Screening Programmes Current system is “minimal” technologically (taken from e-DiaMoND Project)

6. 27-May-2004 NeSC Edinburgh The Evolving Network Peter Clarke NETWORK Future should be digitised and processed images Remote Radiographers ? Remote Patient information 2 nd opinion Requires ~ Gbit/s flows for remote access Will not be possible without scheduled guaranteed net-services (taken from e-DiaMoND Project)

7. 27-May-2004 NeSC Edinburgh The Evolving Network Peter Clarke Issues are: TCP – the internet workhorse Servers –Disk I/O –Network Cards –Architecture –OS Local network and firewall The mindset : im getting poor response, the network must be to blame – so I give up To 1 st order the wide area network is not the problem SuperJANET (10 Gbit/s SuperJANET (10 Gbit/s Regional Campus Client Server The “network” Typically 2.5 – 10 Gbit/s User gets 10 -100 Mbit/s Issues and technology today

8. 27-May-2004 NeSC Edinburgh The Evolving Network Peter Clarke Example technology issue (1) : TCP (Transport Control Protocol ) You use this every day for almost everything you do on the internet Never designed long distance high bandwidth networks – but amazing that it does so well !!! Rate Time Ordinary TCP cant survive packet loss Plot show response to 1 packet loss per million Rate Time “High Speed TCP” is designed for today's internet and responds sensibly to the same packet loss [S.Floyd http://www.icir.org/floyd/hstcp.html]http://www.icir.org/floyd/hstcp.html

9. 27-May-2004 NeSC Edinburgh The Evolving Network Peter Clarke “High performance ” servers easily achieve ~ 500 Mbits/s Example technology issue (2) : Disk Input/Output Great difference between low and high performance servers Care is needed also with interface to network “Standard” servers easily achieve ~ 100 Mbits/s I/O Rate Time

10. 27-May-2004 NeSC Edinburgh The Evolving Network Peter Clarke IP packets can be “marked” At each node (router) in chain, marked packets can given “business class” treatment Example technology issue (3) : Differentiated Services Sort Identify & Classify Dequeue Time Rate 2.5 Gbit/s background Priority flow

11. 27-May-2004 NeSC Edinburgh The Evolving Network Peter Clarke Rate Time 940 Mbit/s A 24 hour High Speed TCP test from Manchester to CCLRC-RAL Messages:  Getting 1 Gbit/s out of real networks is a known solution (actually, getting 5 Gbit/s out of network has been done)  Applications people and network people have to bring it together to “make it work for science”

12. 27-May-2004 NeSC Edinburgh The Evolving Network Peter Clarke Requirements # of users A -> Lightweight users, browsing, mailing B -> Business applications, multicast, streaming, VPN’s C -> Special scientific applications, computing, data grids C A B Picture from Cees DeLaat University of Amsterdam The Future Network ?

13. 27-May-2004 NeSC Edinburgh The Evolving Network Peter Clarke Requirements Total BW A -> Need full Internet routing, many to many B -> Need VPN services and some Internet routing, several to several C -> Doesn’t need internet routing, Need very fat pipes, limited sites, few to few C A B

14. 27-May-2004 NeSC Edinburgh The Evolving Network Peter Clarke … a possible Network of the Future…. Provides Normal best effort IP network where appropriate Extended “virtual LANs” where appropriate Switched lightpaths where appropriate “layer-2” split out of wavelength [e.g. Ethernet] Router Routed IP Network

15. 27-May-2004 NeSC Edinburgh The Evolving Network Peter Clarke NorthernLi ght CERN Czech Light SunLight Pacific NW GigaPOP MANLAN This new way of networking was the rationale for UKLIGHT - a National Facility for Advanced Optical Networking - UKLight

16. 27-May-2004 NeSC Edinburgh The Evolving Network Peter Clarke 10 Gbit/s SURFnet 10 Gbit/s SURFnet 10 Gbit/s IEEAF 10 Gbit/s Prague CzechLight Prague CzechLight 2.5 Gbit/s NSF 10 Gbit/s Stockholm NorthernLight Stockholm NorthernLight CA*net4 2.5 Gbit/s New York MANLAN New York MANLAN Tokyo WIDE Tokyo WIDE 10 Gbit/s IEEAF 10 Gbit/s 2.5 Gbit/s Tokyo APAN Tokyo APAN Amsterdam NetherLight Amsterdam NetherLight Geneva CERN Geneva CERN London UKLight London UKLight Chicago StarLight Chicago StarLight Source: Kees Neggers, SURFnet … in a bit more detail …

17. 27-May-2004 NeSC Edinburgh The Evolving Network Peter Clarke UKLIGHT is: A VISION –The UK was missing from an important the global stage –The UK needed to be there – and now it is SCIENCE AND NETWORKING ENABLEMENT –Driven by a cross disciplinary scientific case –Applications: HEP, Radio Astronomy, HPC, TeleMedicine… –Network R&D: to find new paradigms for the next generation network INFRASTRUCTURE SUPPORTED BY KEY BODIES –Core e-Science Programme –JISC-JCSR and JISC-JCN –Funded through HEFC SRIF A DRIVER for SuperJANET-5: –The Global optical network initiative has been a driver which has influenced the way the next generation networks will be built. –The aim is more flexible – more cost efficient provisioning to meet needs of diverse user requirements.

18. 27-May-2004 NeSC Edinburgh The Evolving Network Peter Clarke As a result of the initiative, UKERNA have pushed through a complementary initiative to provide a nationwide domestic R&D network in parallel with SupetJANET LeNSESWERN Kentish MAN NorMAN YHMAN EMMAN EastNet LMN South Wales MAN TVN MidMAN Northern Ireland NNW C&NL MAN GlasgowEdinburgh WarringtonLeeds Reading London Bristol Portsmouth EaStMAN UHI Network Clydenet AbMAN FaTMAN S T C T T T TT T S S S T T This is a UK first ! We have never had a pervasive R&D network before Potentially any institute can connect to the R&D network, and to access UKLIGHT through it London UKLight London UKLight

19. 27-May-2004 NeSC Edinburgh The Evolving Network Peter Clarke Early Adopter projects already knocking at the door –ESLEA : proof of benefit to: Radio Astronomy Particle physics through GridPP High performance computation through RealityGrid E-Health through e-DiaMoND –White rose Grid –High Performance Monitoring Project – …needs more…

20. 27-May-2004 NeSC Edinburgh The Evolving Network Peter Clarke Conclude with a success story in the field of Computational Science Reality Grid performs massive simulations of complex molecular dynamics ReG won Most innovative Data Intensive application award at SC2003 conference & recently a European ISC 2004 award A comprehensive interconnection of HPC machines in UK and USA Connected by a “pre-UKLIGHT” network

21. 27-May-2004 NeSC Edinburgh The Evolving Network Peter Clarke

22. 27-May-2004 NeSC Edinburgh The Evolving Network Peter Clarke The Interconnections Required for the “SC2003” challenge in Phoenix 2003 The US TeraGrid Infrastructure

23. 27-May-2004 NeSC Edinburgh The Evolving Network Peter Clarke ~1-10 Gbps Tier2 Center Online System CERN USA Centres France Center ITALY Center Institut e ~20 PBytes/year ~PByte/sec ~1-10 Gbps Tier2 Center Experiment CCLRC-RAL Centre GEANT Network SuperJANET ~1-10 Gbps

24. 27-May-2004 NeSC Edinburgh The Evolving Network Peter Clarke The MB–NG Testbed (Managed Bandwidth Next Generation project 1 Gigabit Ethernet 2.5 Gigabit SDH UCL Domain Cisco 7609 Routers RAL Domain Manchester Domain SuperJANET Development Network Cisco 12000 Carrier class Routers High performance servers RAL Domain

25. 27-May-2004 NeSC Edinburgh The Evolving Network Peter Clarke