1. Presented at the 4th DataGrid Conference
The EU DataTAG Project
Presented at the 4th DataGrid Conference
8th March 2002, PARIS
Olivier H. Martin
CERN - IT Division

2. The project
European partners: INFN (IT), PPARC (UK), University of Amsterdam (NL) and CERN, as project coordinator.
INRIA (FR) expected to join during 1H2002.
ESA/ESRIN (IT) will provide Earth Observation demos together with NASA.
Budget: 3.98 MEUR
Start date: January, 1, 2002
Duration: 2 years (aligned on DataGrid)
Funded manpower: ~ 15 persons/year
5/12/2019
The EU DataTAG Project

3. US Funding & collaborations
US NSF support through the existing collaborative agreement with CERN (Eurolink award).
US DoE support through the CERN-USA line consortium.
Significant contributions to the DataTAG workplan have been made by Jason Leigh of Illinois), Joel Mambretti (Northwestern University), Brian Tierney (LBNL).
Strong collaborations already in place with ANL, Caltech, FNAL, SLAC, University of Michigan, as well as Internet2 and ESnet.
5/12/2019
The EU DataTAG Project

4. In a nutshell Two main focus:
Grid related network research (WP2, WP3)
Interoperability between European and US Grids (WP4)
2.5 Gbps transatlantic lambda between CERN (Geneva) and StarLight (Chicago) around July 2002.
Dedicated to research (no production traffic)
In principle open to other EU Grid projects as well as ESA for demonstrations
5/12/2019
The EU DataTAG Project

5. Goals & outcomes
End to end Gigabit Ethernet performance using innovative high performance transport protocols.
Assess inter-domain QoS and bandwidth reservation techniques.
Interoperability between some major GRID projects in Europe and North America
DataGrid, possibly other EU funded Grid projects
PPDG, GriPhyN, Teragrid, iVDGL (USA)
5/12/2019
The EU DataTAG Project

6. Major 2.5 Gbps circuits between Europe & USA
DataTAG project
NewYork
Abilene UK
SuperJANET4 IT
GARR-B
STAR-LIGHT
ESNET
GEANT
CERN
MREN NL
SURFnet
STAR-TAP
Major 2.5 Gbps circuits between Europe & USA

7. Project positioning Why yet another 2.5 Gbps transatlantic circuit?
Most existing or planned 2.5 Gbps transatlantic circuits are for production, which makes them basically not suitable for advanced networking experiments that require a great deal of operational flexibility in order to investigate new application driven network services, e.g.:
deploying new equipment (routers, G-MPLS capable multiplexers),
activating new functionality (QoS, MPLS, distributed VLAN)
The only known exception to date is the Surfnet circuit between Amsterdam & Chicago (Starlight)
Concerns:
How far beyond Starlight can DataTAG extend?
How fast will US research network infrastructure match that of Europe!
5/12/2019
The EU DataTAG Project

8. The STAR LIGHT
Next generation STAR TAP with the following main distinguishing features:
Neutral location (Northwestern University)
1/10 Gigabit Ethernet based
Multiple local loop providers
Optical switches for advanced experiments
The STAR LIGHT will provide 2*622 Mbps ATM connection to the STAR TAP
Started in July 2001
Also hosting other advanced networking projects in Chicago & State of Illinois
N.B. Many European Internet Exchanges Points have already been deployed along the same lines.
5/12/2019
The EU DataTAG Project

9. Major Grid networking issues
QoS (Quality of Service)
still largely unresolved on a wide scale because of complexity of deployment
TCP/IP performance over high bandwidth, long distance networks
The loss of a single packet will affect a 10Gbps stream with 200ms RTT (round trip time) for 5 hours. During that time the average throughput will be 7.5 Gbps.
On the 2.5Gbps DataTAG circuit with 100ms RTT, this translates to 38 minutes recovery time, during that time the average throughput will be 1.875Gbps.
Line Error rates
A 2.5 Gbps circuit can absorb 0.2 Million packets/second
Bit error rates of 10E-9 means one packet loss every 250 mseconds
Bit error rates of 10E-11 means one packet loss every 25 seconds
End to end performance in the presence of firewalls
There is a lack of products, can we rely on products becoming available or should a new architecture be evolved?
Evolution of LAN infrastructure to 1Gbps/10Gbps
Uniform end to end bandwidth
5/12/2019
The EU DataTAG Project

10. Single stream vs Multiple streams effect of a single packet loss (e. g
Single stream vs Multiple streams effect of a single packet loss (e.g. link error, buffer overflow)
Streams/Throughput 10 5 10
Avg. 7.5 Gbps
Throughput Gbps
7 5
Avg Gbps
Avg Gbps 5
2.5
Avg Gbps
T = 2.37 hours!
(RTT=200msec, MSS=1500B) T T T
Time T
5/12/2019
The EU DataTAG Project

11. Workplan (1) WP1: Provisioning & Operations (P. Moroni/CERN)
Will be done in cooperation with DANTE & National Research & Education Networks (NREN)
Two main issues:
Procurement (largely done already for what concerns the circuit, equipment still to be decided).
Routing, how can the DataTAG partners access the DataTAG circuit across GEANT and their national network?
Funded participants: CERN(1FTE), INFN (0.5FTE)
WP5: Information dissemination and exploitation (CERN)
Funded participants: CERN(0.5FTE)
WP6: Project management (CERN)
Funded participants: CERN(2FTE)
5/12/2019
The EU DataTAG Project

12. Workplan (2) WP2: High Performance Networking (Robin Tasker/PPARC)
High performance Transport
tcp/ip performance over large bandwidth*delay networks
Alternative transport solutions using:
Modified TCP/IP stack
UDP based transport conceptually similar to rate based TCP
End to end inter-domain QoS
Advance network resource reservation
Funded participants: PPARC (2FTE), INFN (2FTE), UvA (1FTE), CERN(1FTE)
5/12/2019
The EU DataTAG Project

13. Workplan (3)
WP3: Bulk Data Transfer & Application performance monitoring (Cees deLaat/UvA)
Performance validation
End to end user performance
Validation
Monitoring
Optimization
Application performance
Netlogger
Funded participants: UvA (2FTE), CERN(0.6FTE)
5/12/2019
The EU DataTAG Project

14. WP4 Workplan (Antonia Ghiselli & Cristina Vistoli / INFN)
Main Subject:
Interoperability between EU and US Grids services from DataGrid, GriPhyN, PPDG and in collaboration with iVDGL, for the HEP applications.
Objectives:
Produce an assessment of interoperability solutions
Provide test environment to LHC Applications to extend existing use-cases to test interoperability of the grid components
Provide input to a common Grid LHC architecture
Plan EU-US Integrated grid deployment
Funded participants: INFN (6FTE), PPARC (1FTE), UvA (1FTE)
5/12/2019
The EU DataTAG Project

15. WP4 Tasks Assuming the same grid basic services (gram,gsi,gris)
between the differen grid projects, the main issues are:
4.1 resource discovery, coord. C.Vistoli
4.2 security/authorization, coord. R.Cecchini
4.3 interoperability of collective services between EU-US grid domains, coord. F.Donno
4.4 test applications, contact people from each application :
Atlas / L.Perini, CMS / C.Grandi,
Alice / P.Cerello
5/12/2019
The EU DataTAG Project

16. DataTAG/WP4 framework and relationships
Grid projects:
DataGrid
PPDG
Griphyn
LCG
Globus
Condor
…..
input
feedback
…..
Grid
Interoperability
Activities:
DataTAG/WP4
iVDGL
HICB/HIJTB
GGF
Integration
stardardization
Proposals
…..
Applications:
LHC experiments
CDF
Babar
ESA
5/12/2019
The EU DataTAG Project

17. WP4.1 - Resource Discovery Objectives
Enabling an interoperable system that allows for the discovery and access of the Grid services available at participant sites of all Grid domains, in particular between EU and US Grids.
Compatibility of the Resource Discovery System with the existent components/services of the available GRID systems.
5/12/2019
The EU DataTAG Project

18. Task 4.1 Time Plan
Reference agreement document on resource discovery schema
by 31st of May 2002
“INTERGRID VO” MDS test
by 31st of July 2002
Evaluation of the interoperability of multiple Resource Discovery Systems (FTree, MDS, etc…) by 30th of September 2002
Network Element
by 31st of December 2002
Impact of the new Web Services Technology
by 31st of June 2003
Identify missing components.
Final deployment.
by 31st of December 2003
5/12/2019
The EU DataTAG Project

19. WP4.2 - Objectives
Identify Authentication, Authorization and Accounting (AAA) mechanisms allowing interoperability between grids
Compatibility of the AAA mechanisms with the existing components/services of the available GRID systems.
5/12/2019
The EU DataTAG Project

20. Task 4.2 Time Plan Reference document Deployment Issues
Minimum requirements for DataTAG CA’s;
Analysis of available authorization tools and policy languages and their suitability (in cooperation with the DataGrid Authorization WG);
Mapping of the policies of the VO domains;
Information exchange protocol between the authorization systems;
Feasibility study of an accounting system (in cooperation with the DataGrid WP1);
First draft: 31 July 2002
Final version: 30 April 2003
Deployment
First: 30 September 2002
Final: 31 December 2003
5/12/2019
The EU DataTAG Project

21. WP4.3 / WP4.4 - Objectives
Identify grid elements in EU and US grid projects, Identify common components in the testbeds used by the HEP experiments for semi-production activities in EU and US and classify them in an architectural framework.
Plan and Setup “InterGrid VO” environment with common EU-US services.
Deployment of an EU-US VO domain in collaboration with iVDGL.
5/12/2019
The EU DataTAG Project

22. Task 4.3/4.4 Time Plan
The time plan will follow the schedule of each experiment
Study of exp. Layout and Classification – first result
by 31st of June 2002
First deployment (already started)
by 31st of September 2002
First report of integration and interoperability issues
by 30th of December 2002
First working version of a VO EU-US domain
by 31st of June 2003
Complete deployment.
by 31st of December 2003
5/12/2019
The EU DataTAG Project