The DataTAG Project 25 March, Brussels FP6 Information Day Peter Clarke, University College London.

Slides:



Advertisements
Similar presentations
Electronic Visualization Laboratory University of Illinois at Chicago EVL Optical Networking Research Oliver Yu Electronic Visualization Laboratory University.
Advertisements

CERN STAR TAP June 2001 Status of the EU DataGrid Project Fabrizio Gagliardi CERN EU-DataGrid Project Leader June 2001
University of Illinois at Chicago Annual Update Thomas A. DeFanti Principal Investigator, STAR TAP Director, Electronic Visualization Laboratory.
EU DataGrid progress Fabrizio Gagliardi EDG Project Leader
An open source approach for grids Bob Jones CERN EU DataGrid Project Deputy Project Leader EU EGEE Designated Technical Director
S.L.LloydATSE e-Science Visit April 2004Slide 1 GridPP – A UK Computing Grid for Particle Physics GridPP 19 UK Universities, CCLRC (RAL & Daresbury) and.
24-May-01D.P.Kelsey, GridPP WG E: Security1 GridPP Work Group E Security Development David Kelsey CLRC/RAL, UK
Tony Doyle - University of Glasgow GridPP EDG - UK Contributions Architecture Testbed-1 Network Monitoring Certificates & Security Storage Element R-GMA.
5-Dec-02D.P.Kelsey, GridPP Security1 GridPP Security UK Security Workshop 5-6 Dec 2002, NeSC David Kelsey CLRC/RAL, UK
Particle physics – the computing challenge CERN Large Hadron Collider –2007 –the worlds most powerful particle accelerator –10 petabytes (10 million billion.
Tony Doyle GridPP2 Proposal, BT Meeting, Imperial, 23 July 2003.
Andrew McNab - Manchester HEP - 22 April 2002 EU DataGrid Testbed EU DataGrid Software releases Testbed 1 Job Lifecycle Authorisation at your site More.
ICFA SCIC Meeting CERN Dec 01 R. Hughes-Jones Manchester Network Connectivity and Projects – a Perspective from the UK Richard Hughes-Jones PPNCG SuperJANET4.
Andrew McNab - Manchester HEP - 2 May 2002 Testbed and Authorisation EU DataGrid Testbed 1 Job Lifecycle Software releases Authorisation at your site Grid/Web.
EGEE statement EU and EU member states major investment in Grid Technology Several good prototype results Next Step: –Leverage current and planned national.
CGW03, Crakow, 28 October 2003 DataTAG Project Update CGW’2003 workshop, Crakow (Poland) October 28, 2003 Olivier Martin, CERN, Switzerland.
The DutchGrid Platform Collaboration of projects from –Computer Science, HEP and service providers Participating and supported projects –Virtual Laboratory.
A conceptual model of grid resources and services Authors: Sergio Andreozzi Massimo Sgaravatto Cristina Vistoli Presenter: Sergio Andreozzi INFN-CNAF Bologna.
GridPP meeting Feb 03 R. Hughes-Jones Manchester WP7 Networking Richard Hughes-Jones.
CAIDA Bandwidth Estimation Meeting San Diego June 2002 R. Hughes-Jones Manchester 1 EU DataGrid - Network Monitoring Richard Hughes-Jones, University of.
The LHC Computing Grid Project Tomi Kauppi Timo Larjo.
DataTAG Project IST Copenhagen, 4/6 Nov Slides collected by: Cristina Vistoli INFN-CNAF.
Optical Networking Status of Discussion in the UK Richard Hughes-Jones The University of Manchester Particle Physics Network Coordination Group TERENA.
LCG Milestones for Deployment, Fabric, & Grid Technology Ian Bird LCG Deployment Area Manager PEB 3-Dec-2002.
LCG and HEPiX Ian Bird LCG Project - CERN HEPiX - FNAL 25-Oct-2002.
Grid Workload Management & Condor Massimo Sgaravatto INFN Padova.
Jarek Nabrzyski, Ariel Oleksiak Comparison of Grid Middleware in European Grid Projects Jarek Nabrzyski, Ariel Oleksiak Poznań Supercomputing and Networking.
Data Grid projects in HENP R. Pordes, Fermilab Many HENP projects are working on the infrastructure for global distributed simulated data production, data.
MAIN TECHNICAL CHARACTERISTICS Next generation optical transport networks with 40Gbps capabilities are expected to be based on the ITU’s.
DataTAG Research and Technological Development for a Transatlantic Grid Abstract Several major international Grid development projects are underway at.
GriPhyN EAC Meeting (Jan. 7, 2002)Carl Kesselman1 University of Southern California GriPhyN External Advisory Committee Meeting Gainesville,
23 January 2003Paolo Moroni (Slide 1) SWITCH-cc meeting DataTAG overview.
GridPP Collaboration Meeting Nov 2001 R. Hughes-Jones Manchester Network Monitoring and GridPP Richard Hughes-Jones, University of Manchester 6 November.
GNEW’2004 – 15/03/2004 DataTAG project Status & Perspectives Olivier MARTIN - CERN GNEW’2004 workshop 15 March 2004, CERN, Geneva.
GridPP Presentation to AstroGrid 13 December 2001 Steve Lloyd Queen Mary University of London.
DataGrid is a project funded by the European Commission under contract IST rd EU Review – 19-20/02/2004 DataGrid Project Status Fabrizio Gagliardi.
INFSO-RI Enabling Grids for E-sciencE OSG-LCG Interoperability Activity Author: Laurence Field (CERN)
Tiziana FerrariThe DataTAG Projct, Roma Nov DataTAG Project.
DataTAG Research and Technological Development for a Transatlantic Grid Abstract The main idea behind the DataTAG project was to strengthen the collaboration.
29/1/2002A.Ghiselli, INFN-CNAF1 DataTAG / WP4 meeting Cern, 29 January 2002 Agenda  start at  Project introduction, Olivier Martin  WP4 introduction,
Open Science Grid & its Security Technical Group ESCC22 Jul 2004 Bob Cowles
1CHEP2000 February 2000F. Gagliardi EU HEP GRID Project Fabrizio Gagliardi
30 June Wide Area Networking Performance Challenges Olivier Martin, CERN UK DTI visit.
18/09/2002Presentation to Spirent1 Presentation to Spirent 18/09/2002.
CERN The GridSTART EU accompany measure Fabrizio Gagliardi CERN
LHC Computing, SPC-FC-CC-C; H F Hoffmann1 CERN/2379/Rev: Proposal for building the LHC computing environment at CERN (Phase 1) Goals of Phase.
Javier Orellana JRA4 Coordinator Face to Face Partners Meeting University College London 11 December 2003 EGEE is proposed as a project funded by the European.
The EU DataTAG Project Richard Hughes-Jones Based on Olivier H. Martin GGF3 Frascati, Italy Oct 2001.
EGEE is a project funded by the European Union under contract IST JRA4 Overview Javier Orellana JRA4 Coordinator EGEE Kick Off Meeting SA2.
DataTAG overview. 3 February 2003Paolo Moroni (Slide 2) APM meeting - Barcelona Summary  Why DataTAG?  DataTAG project  Test-bed extensions  General.
Javier Orellana EGEE-JRA4 Coordinator CERN March 2004 EGEE is proposed as a project funded by the European Union under contract IST Network.
Grid Computing at NIKHEF Shipping High-Energy Physics data, be it simulated or measured, required strong national and trans-Atlantic.
Bob Jones EGEE Technical Director
TESTBED (Technical)
Grid related projects CERN openlab LCG EDG F.Fluckiger
Networking for grid Network capacity Network throughput
CERN-USA connectivity update DataTAG project
A conceptual model of grid resources and services
CEOS workshop on Grid computing Slides mainly from Olivier Martin
The DataTAG Project Olivier H. Martin CERN - IT Division
DataTAG Project update
TCP Performance over a 2.5 Gbit/s Transatlantic Circuit
Presented at the GGF3 conference 8th October Frascati, Italy
The EU DataTAG Project Olivier H. Martin CERN - IT Division
5th EU DataGrid Conference
Presentation at University of Twente, The Netherlands
The DataTAG Project UCSD/La Jolla, USA Olivier H. Martin / CERN
Internet2 Spring Member meeting
Presented at the 4th DataGrid Conference
LHC Computing, RRB; H F Hoffmann
Presentation transcript:

The DataTAG Project 25 March, Brussels FP6 Information Day Peter Clarke, University College London

DataTAG - EU FP6 Information Day - Brussels 25 March 2003 (2) DataTAG Mission EU US Grid network research EU US Grid network research High Performance Transport protocols Inter-domain QoS Advance bandwidth reservation EU US Grid Interoperability EU US Grid Interoperability Sister project to DataGRID Sister project to DataGRID T rans A tlantic G rid

DataTAG - EU FP6 Information Day - Brussels 25 March 2003 (3) Collaborations Collaborations Collaboration with Networks Collaboration with Networks DANTE and National Research Networks (NRN) GARR (IT), MB-NG (UK), Surfnet (NL), VTHD (FR) Internet2/Abilene, Starlight, TeraGrid, ESnet, Canarie Collaboration with projects in Europe Collaboration with projects in Europe DataGrid/CrossGrid Gridstart National Grid projects (e.g. IT) LHC Computing Grid (LCG) Collaboration with projects in the US Collaboration with projects in the US Globus iVDGL GriPhyN PPDG

DataTAG - EU FP6 Information Day - Brussels 25 March 2003 (4) EU collaborators Brunel University Brunel University CERN CERN CLRC CLRC DANTE DANTE INRIA NIKHEF PPARC UvA University of Manchester UCL

DataTAG - EU FP6 Information Day - Brussels 25 March 2003 (5) US collaborators ANL ANL Caltech Caltech Fermilab Fermilab University of Chicago University of Chicago FSU FSU Indiana Indiana Wisconsin Wisconsin Globus Globus Northwestern University UIC University of Michigan SLAC Starlight

DataTAG - EU FP6 Information Day - Brussels 25 March 2003 (6) Cooperating Networks Funding agencies

DataTAG - EU FP6 Information Day - Brussels 25 March 2003 (7) NL SURFnet CERN UK SuperJANET4 Abilene ESNET MREN IT GARR-B GEANT NewYork STAR-TAP STAR-LIGHT Network Research Testbed FR INRIA ATRIUM /VTHD 3*2.5G 2.5G --> 10G 10G

DataTAG - EU FP6 Information Day - Brussels 25 March 2003 (8) Phase I (iGRID2002)

DataTAG - EU FP6 Information Day - Brussels 25 March On February 27-28, a Terabyte of data was transferred by S. Ravot of Caltech between the Level3 PoP in Sunnyvale near SLAC and CERN through the TeraGrid router at StarLight from memory to memory as a single TCP/IP stream with 9KB Jumbo frames at a rate of 2.38 Gbps for 3700 seconds. This beat the former record by a factor of approximately 2.5, and used the US-CERN link at 96% efficiency. This is equivalent to: Transferring a full CD in 2.3 seconds (i.e CDs/hour) Transferring 200 full length DVD movies in one hour (i.e. 1 DVD in 18 seconds) Intel 10GigE Data Transfer Trial European Commission

DataTAG - EU FP6 Information Day - Brussels 25 March 2003 (10) Objectives Enable Middleware interoperability between European and US Grid domains Enable Middleware interoperability between European and US Grid domains Demonstrate Large Hadron Collider (LHC) Applications running on heterogeneous Grid Demonstrate Large Hadron Collider (LHC) Applications running on heterogeneous Grid EU US Grid Interoperability Issues Resource Discovery Resource Discovery Authentication & Authorisation Authentication & Authorisation Job scheduling Job scheduling Data Management Data Management

DataTAG - EU FP6 Information Day - Brussels 25 March 2003 (11) Results Common Resource Information Publication Common Resource Information Publication DataGrid Resource Broker and common Information system integration DataGrid Resource Broker and common Information system integration Implementation in standard Globus release To be included in next DataGrid Release Already included in US VDT release and CERN LCG-0 release Input to GGF and CIM

DataTAG - EU FP6 Information Day - Brussels 25 March 2003 (12) Results Common Virtual Organization Authorization system (VOMS) Common Virtual Organization Authorization system (VOMS) jointly developed by DataTAG/DataGRID Mapping between PKI-based Grid security and Kerberos-based mechanism at the local site. Mapping between PKI-based Grid security and Kerberos-based mechanism at the local site. New Grid monitoring system New Grid monitoring system

DataTAG - EU FP6 Information Day - Brussels 25 March 2003 (13) Dissemination Web site Web site Presentations Presentations GGF, DataGrid, Internet2, AcrossGrid, Nordunet, INFN- Grid, Gridstart, HNF Europe, IST2002, SC2002, etc Demos Demos iGRID2002, IST2002, SC2002 High Performance TCP workshop High Performance TCP workshop Feb-02Apr-02May-02Jul-02Sep-02Oct-02Dec-02Jan-03Mar-03 Month Hits 40000/month

DataTAG - EU FP6 Information Day - Brussels 25 March 2003 (14) Conclusions Successfull first year Successfull first year Comprehensive Transatlantic testbed built Comprehensive Transatlantic testbed built Many advances in very high rate data transport Many advances in very high rate data transport Demonstration of applications running across heterogeneous Grid domains Demonstration of applications running across heterogeneous Grid domains