1. 5th EU DataGrid Conference
The DataTAG Project
5th EU DataGrid Conference
Pilicsaba, Hungary
Olivier H. Martin

2. The project CERN is the project coordinator
Contacts: Olivier Martin
European partners: INFN (IT), PPARC (UK), University of Amsterdam (NL) and, since July 2002, INRIA (FR)
Budget: 3.98 MEUR
Start date: January, 1, 2002
Duration: 2 years (aligned on DataGrid)
Funded manpower: ~ 15 people/year
12/3/2018
The DataTAG Project

3. Goals
End to end Gigabit Ethernet performance using innovative high performance transport protocols.
Assess & experiment inter-domain QoS and bandwidth reservation techniques.
Interoperability between major GRID projects middleware/testbeds in Europe and North America.
DataGrid, possibly other EU funded Grid projects
PPDG, GriPhyN, iVDGL, Teragrid (USA)
LCG
12/3/2018
The DataTAG Project

4. In a nutshell Two main focus:
Grid related network research (WP2, WP3):
2.5 Gbps transatlantic lambda between CERN (Geneva) and StarLight (Chicago) (WP1)
Dedicated to research (no production traffic)
Very unique multi-vendor testbed with layer 2 and layer 3 capabilities
in effect, a distributed transatlantic Internet Exchange Point.
Open to other European Grid projects for demonstrations
Interoperability between European and US Grids (WP4)
Middleware integration and coexistency - Applications
GLUE integration/standardization
GLUE testbed and demo
12/3/2018
The DataTAG Project

5. The 2.5 Gbps transatlantic circuit
Why yet another 2.5 Gbps transatlantic circuit?
Most existing or planned 2.5 Gbps transatlantic circuits are for production, i.e. not suitable for advanced networking experiments requiring operational flexibility, e.g.:
deploying new equipment (routers, G-MPLS capable multiplexers),
activating new functionality (QoS, MPLS, distributed VLAN)
The only known exception to date is the Surfnet circuit between Amsterdam & Chicago (Starlight)
12/3/2018
The DataTAG Project

6. Major 2.5 Gbps circuits between Europe & USA
DataTAG connectivity
NewYork
Abilene UK
SuperJANET4 IT
GARR-B
Canarie
3*2.5G
STAR-LIGHT
ESNET
GEANT
CERN
MREN NL
SURFnet FR
INRIA
VTHD/
ATRIUM
Major 2.5 Gbps circuits between Europe & USA

7. What we have achieved The 2.5Gbps transatlantic circuit
Operational since August 20 (delivered by Deutsche Telekom/T-Systems )
Routing plan developed (access across GEANT)
As expected, the full DataTAG testbed could not be readily deployed because of late ordering but also delivery delays, therefore the circuit will initially be connected to Cisco 7600 routers
Full testbed to be deployed by the end of October
Six high performance PCs will be deployed on each side of the high performance circuit in the coming week(s). The full layer2/layer3 testbed should be ready by the end of October
12/3/2018
The DataTAG Project

8. DataTAG/WP4 framework and relationships
HEP applications,
Other experiments
Integration
GriPhyN
PPDG
iVDGL
HICB/HIJTB
Interoperability
standardization
GLUE
12/3/2018
The DataTAG Project

9. Status of GLUE activities in DataTAG
Resource Discovery and GLUE schema
Authorization services from VO LDAP to VOMS
Common software deployment procedures
IST2002 and SC2002 joint EU-US demos
Interoperability : between Grid domains for core grid services,
coexistence of optimization/collective services
Data Movement and Description
Job Submission Services
12/3/2018
The DataTAG Project

10. Resource Discovery and GLUE schema
Computing Resources Structure Description
Entry point into queueing system
Container grouping subcluster or nodes
Homogeneous collection of nodes
Physical computing nodes
12/3/2018
The DataTAG Project

11. DataTAG iVDGL GIIS giis.ivdgl.org GIIS edt004.cnaf.infn.it
mds-vo-name=glue
Gatekeeper: Padova-site
GIIS edt004.cnaf.infn.it
Mds-vo-name=‘Datatag’
LSF
Resource Broker
Gatekeeper: US-CMS
GIIS giis.ivdgl.org
mds-vo-name=ivdgl-glue
Gatekeeper grid006f.cnaf.infn.it
Condor
Gatekeeper edt004.cnaf.infn.it
Gatekeeper: US-ATLAS
WN1 edt001.cnaf.infn.it WN2 edt002.cnaf.infn.it
Computing Element-1
PBS
Computing Element -2
Fork/pbs
Gatekeeper
LSF
hamachi.cs.uchicago.edu
dc-user.isi.edu
rod.mcs.anl.gov
Job manager: Fork
DataTAG
iVDGL
12/3/2018
The DataTAG Project

12. Common software deployment procedures
12/3/2018
The DataTAG Project

13. IST2002 and SC2002 joint EU-US
demos
12/3/2018
The DataTAG Project

14. Conclusions Personnel recruited 21FTE.
Network testbed in place by October 2002
Active collaboration with GEANT
Active collaboration with US/iVDGL for Grid Integration
First version of GLUE schema for resource discovery in place
Working on common authorization solutions
First evaluation of software deployment tools
First interoperability tests on heterogeneous transatlantic testbeds
Demos organization
Questions to EDT manager:
12/3/2018
The DataTAG Project