Presented at the 4th DataGrid Conference The EU DataTAG Project Presented at the 4th DataGrid Conference 8th March 2002, PARIS Olivier H. Martin CERN - IT Division

The project European partners: INFN (IT), PPARC (UK), University of Amsterdam (NL) and CERN, as project coordinator. INRIA (FR) expected to join during 1H2002. ESA/ESRIN (IT) will provide Earth Observation demos together with NASA. Budget: 3.98 MEUR Start date: January, 1, 2002 Duration: 2 years (aligned on DataGrid) Funded manpower: ~ 15 persons/year 5/12/2019 The EU DataTAG Project

US Funding & collaborations US NSF support through the existing collaborative agreement with CERN (Eurolink award). US DoE support through the CERN-USA line consortium. Significant contributions to the DataTAG workplan have been made by Jason Leigh (EVL@University of Illinois), Joel Mambretti (Northwestern University), Brian Tierney (LBNL). Strong collaborations already in place with ANL, Caltech, FNAL, SLAC, University of Michigan, as well as Internet2 and ESnet. 5/12/2019 The EU DataTAG Project

In a nutshell Two main focus: Grid related network research (WP2, WP3) Interoperability between European and US Grids (WP4) 2.5 Gbps transatlantic lambda between CERN (Geneva) and StarLight (Chicago) around July 2002. Dedicated to research (no production traffic) In principle open to other EU Grid projects as well as ESA for demonstrations 5/12/2019 The EU DataTAG Project

Goals & outcomes End to end Gigabit Ethernet performance using innovative high performance transport protocols. Assess inter-domain QoS and bandwidth reservation techniques. Interoperability between some major GRID projects in Europe and North America DataGrid, possibly other EU funded Grid projects PPDG, GriPhyN, Teragrid, iVDGL (USA) 5/12/2019 The EU DataTAG Project

Major 2.5 Gbps circuits between Europe & USA DataTAG project NewYork Abilene UK SuperJANET4 IT GARR-B STAR-LIGHT ESNET GEANT CERN MREN NL SURFnet STAR-TAP Major 2.5 Gbps circuits between Europe & USA

Project positioning Why yet another 2.5 Gbps transatlantic circuit? Most existing or planned 2.5 Gbps transatlantic circuits are for production, which makes them basically not suitable for advanced networking experiments that require a great deal of operational flexibility in order to investigate new application driven network services, e.g.: deploying new equipment (routers, G-MPLS capable multiplexers), activating new functionality (QoS, MPLS, distributed VLAN) The only known exception to date is the Surfnet circuit between Amsterdam & Chicago (Starlight) Concerns: How far beyond Starlight can DataTAG extend? How fast will US research network infrastructure match that of Europe! 5/12/2019 The EU DataTAG Project

The STAR LIGHT Next generation STAR TAP with the following main distinguishing features: Neutral location (Northwestern University) 1/10 Gigabit Ethernet based Multiple local loop providers Optical switches for advanced experiments The STAR LIGHT will provide 2*622 Mbps ATM connection to the STAR TAP Started in July 2001 Also hosting other advanced networking projects in Chicago & State of Illinois N.B. Many European Internet Exchanges Points have already been deployed along the same lines. 5/12/2019 The EU DataTAG Project

Major Grid networking issues QoS (Quality of Service) still largely unresolved on a wide scale because of complexity of deployment TCP/IP performance over high bandwidth, long distance networks The loss of a single packet will affect a 10Gbps stream with 200ms RTT (round trip time) for 5 hours. During that time the average throughput will be 7.5 Gbps. On the 2.5Gbps DataTAG circuit with 100ms RTT, this translates to 38 minutes recovery time, during that time the average throughput will be 1.875Gbps. Line Error rates A 2.5 Gbps circuit can absorb 0.2 Million packets/second Bit error rates of 10E-9 means one packet loss every 250 mseconds Bit error rates of 10E-11 means one packet loss every 25 seconds End to end performance in the presence of firewalls There is a lack of products, can we rely on products becoming available or should a new architecture be evolved? Evolution of LAN infrastructure to 1Gbps/10Gbps Uniform end to end bandwidth 5/12/2019 The EU DataTAG Project

Single stream vs Multiple streams effect of a single packet loss (e. g Single stream vs Multiple streams effect of a single packet loss (e.g. link error, buffer overflow) Streams/Throughput 10 5 1 7.5 4.375 2 9.375 10 Avg. 7.5 Gbps Throughput Gbps 7 5 Avg. 6.25 Gbps Avg. 4.375 Gbps 5 2.5 Avg. 3.75 Gbps T = 2.37 hours! (RTT=200msec, MSS=1500B) T T T Time T 5/12/2019 The EU DataTAG Project

Workplan (1) WP1: Provisioning & Operations (P. Moroni/CERN) Will be done in cooperation with DANTE & National Research & Education Networks (NREN) Two main issues: Procurement (largely done already for what concerns the circuit, equipment still to be decided). Routing, how can the DataTAG partners access the DataTAG circuit across GEANT and their national network? Funded participants: CERN(1FTE), INFN (0.5FTE) WP5: Information dissemination and exploitation (CERN) Funded participants: CERN(0.5FTE) WP6: Project management (CERN) Funded participants: CERN(2FTE) 5/12/2019 The EU DataTAG Project

Workplan (2) WP2: High Performance Networking (Robin Tasker/PPARC) High performance Transport tcp/ip performance over large bandwidth*delay networks Alternative transport solutions using: Modified TCP/IP stack UDP based transport conceptually similar to rate based TCP End to end inter-domain QoS Advance network resource reservation Funded participants: PPARC (2FTE), INFN (2FTE), UvA (1FTE), CERN(1FTE) 5/12/2019 The EU DataTAG Project

Workplan (3) WP3: Bulk Data Transfer & Application performance monitoring (Cees deLaat/UvA) Performance validation End to end user performance Validation Monitoring Optimization Application performance Netlogger Funded participants: UvA (2FTE), CERN(0.6FTE) 5/12/2019 The EU DataTAG Project

WP4 Workplan (Antonia Ghiselli & Cristina Vistoli / INFN) Main Subject: Interoperability between EU and US Grids services from DataGrid, GriPhyN, PPDG and in collaboration with iVDGL, for the HEP applications. Objectives: Produce an assessment of interoperability solutions Provide test environment to LHC Applications to extend existing use-cases to test interoperability of the grid components Provide input to a common Grid LHC architecture Plan EU-US Integrated grid deployment Funded participants: INFN (6FTE), PPARC (1FTE), UvA (1FTE) 5/12/2019 The EU DataTAG Project

WP4 Tasks Assuming the same grid basic services (gram,gsi,gris) between the differen grid projects, the main issues are: 4.1 resource discovery, coord. C.Vistoli 4.2 security/authorization, coord. R.Cecchini 4.3 interoperability of collective services between EU-US grid domains, coord. F.Donno 4.4 test applications, contact people from each application : Atlas / L.Perini, CMS / C.Grandi, Alice / P.Cerello 5/12/2019 The EU DataTAG Project

DataTAG/WP4 framework and relationships Grid projects: DataGrid PPDG Griphyn LCG Globus Condor ….. input feedback ….. Grid Interoperability Activities: DataTAG/WP4 iVDGL HICB/HIJTB GGF Integration stardardization Proposals ….. Applications: LHC experiments CDF Babar ESA 5/12/2019 The EU DataTAG Project

WP4.1 - Resource Discovery Objectives Enabling an interoperable system that allows for the discovery and access of the Grid services available at participant sites of all Grid domains, in particular between EU and US Grids. Compatibility of the Resource Discovery System with the existent components/services of the available GRID systems. 5/12/2019 The EU DataTAG Project

Task 4.1 Time Plan Reference agreement document on resource discovery schema by 31st of May 2002 “INTERGRID VO” MDS test by 31st of July 2002 Evaluation of the interoperability of multiple Resource Discovery Systems (FTree, MDS, etc…) by 30th of September 2002 Network Element by 31st of December 2002 Impact of the new Web Services Technology by 31st of June 2003 Identify missing components. Final deployment. by 31st of December 2003 5/12/2019 The EU DataTAG Project

WP4.2 - Objectives Identify Authentication, Authorization and Accounting (AAA) mechanisms allowing interoperability between grids Compatibility of the AAA mechanisms with the existing components/services of the available GRID systems. 5/12/2019 The EU DataTAG Project

Task 4.2 Time Plan Reference document Deployment Issues Minimum requirements for DataTAG CA’s; Analysis of available authorization tools and policy languages and their suitability (in cooperation with the DataGrid Authorization WG); Mapping of the policies of the VO domains; Information exchange protocol between the authorization systems; Feasibility study of an accounting system (in cooperation with the DataGrid WP1); First draft: 31 July 2002 Final version: 30 April 2003 Deployment First: 30 September 2002 Final: 31 December 2003 5/12/2019 The EU DataTAG Project

WP4.3 / WP4.4 - Objectives Identify grid elements in EU and US grid projects, Identify common components in the testbeds used by the HEP experiments for semi-production activities in EU and US and classify them in an architectural framework. Plan and Setup “InterGrid VO” environment with common EU-US services. Deployment of an EU-US VO domain in collaboration with iVDGL. 5/12/2019 The EU DataTAG Project

Task 4.3/4.4 Time Plan The time plan will follow the schedule of each experiment Study of exp. Layout and Classification – first result by 31st of June 2002 First deployment (already started) by 31st of September 2002 First report of integration and interoperability issues by 30th of December 2002 First working version of a VO EU-US domain by 31st of June 2003 Complete deployment. by 31st of December 2003 5/12/2019 The EU DataTAG Project