05/23/2002Flavia Donno, INFN-Pisa1 DataTAG experiment grid integration plan Flavia Donno, INFN-Pisa DataTAG/iVDGL joint meeting, May 2002

05/23/2002Flavia Donno, INFN-Pisa2 Outline  Goals  People and HW resources  Working plan with experiments (ATLAS, CDF, CMS, ALICE, D0)

05/23/2002Flavia Donno, INFN-Pisa3 Goals Goals:  Interoperability between EU and US Grids services from DataGrid, GriPhyN, PPDG and in collaboration with iVDGL, DataGrid, GriPhyN, PPDG and in collaboration with iVDGL, for the HEP applications. for the HEP applications.Steps:  Produce an assessment of interoperability solutions  Provide test environment to LHC Applications to extend existing use-cases to test interoperability of the grid existing use-cases to test interoperability of the grid components components  Provide input to a common Grid LHC architecture  Plan EU-US Integrated grid deployment

05/23/2002Flavia Donno, INFN-Pisa4 General Plan Plan:   Evaluation of existing packaging and deployment tools. Collection of a set of requirements (VDT/PACMAN, EDG/LCFG, etc…) – first draft. DataTAG software distribution.   Evaluation/Deployment of existing services for job scheduling, submission and monitoring (DAGMAN, Condor-G, EDG/RB). Collection of requirements. First draft.   Evaluation/Deployment of existing DataManagement Tools (Globus/GridFTP, EDG/Replica Manager, MAGDA, SAM, etc). Collection of requirements. First draft.   Classifications of available services and identification of common requirements. The evaluations will be done in the context of the VO infrastructure provided by EDT-WP4 and in particular with the VO services for Authentication, and Authorization and the agreed common schema for Resource Specification/Discovery.

05/23/2002Flavia Donno, INFN-Pisa5 People and HW resources PEOPLE: DataTAG/WP4.3-4 people : INFN (7fte), PPARC (1fte) Coordinator:Flavia Donno- INFN Milano:David Rebatto- Luca Vaccarossa- INFN Padova:F. Fanzago- S. Fantinel- N. Smirnov- INFN CNAF :Cristina Vistoli- Vincenzo Ciaschini- Antonia Ghiselli- PPARC :Simone Ludwig- Human resources come also from partecipating experiments. Contact points established with experiments. Contact points established with iVDGL. HW Resources: Alice in progress (Italy, NiKhef, OCS, BNL) Atlas test layout in Milan, Argonne CDF test layout in Trieste, Bologna, FNAL CMS test layout in Italy, Ecole politecnique, Russia, … DataTAG test layout at CNAF for common services.

05/23/2002Flavia Donno, INFN-Pisa6 Working plan with experiments  Plans established with CMS and CDF.  Short term plan for ATLAS. A more detailed plan needs to be agreed for future activities. Check with the US counterpart.  First meeting with Alice May 2 nd Preliminary plan for Job submission and Data Catalogues.  D0 and Virgo/Ligo still to be defined. For now mainly EDG tools are used (EDG v1.1.1, v1.1.2 and v1.1.4): machine configuration, WP6 distribution, VO management, grid-mapfile, Information Service, EDG middleware software (Globus Beta2.1,Condor-G 6.3.1, classads 0.9, GDMP2.1 and 3.0)

05/23/2002Flavia Donno, INFN-Pisa7 Working plan with experiments - ALICE  Alice (P. Cerello): Goals:  A. Complete the PPR (Physics Performance Report) by the end of this year exploiting the use of GRID tools on test layouts spanning in both EU and US. Officially, for the PPR Alice will use AliEn. Alice would like to try to use AliEn managed resources and EDG resources with a minimal version of AliEn so that steps not possible with EDG can be executed by AliEn in a second time.  B. I nterface AliEn with EDG/RB if possible so that the RB will act like an “AliEn client” or with iVDGL/Condor-G.  C. I nterface or merge AliEn and EDG/RC data catalogues.  D. E xploit EDG/Spitfire and build with it a prototype of a “Grid” distributed data metadata catalogue to explore the problems related to this argument.

05/23/2002Flavia Donno, INFN-Pisa8 Working plan with experiments - ALICE Plan: A. 1 Define a DataTAG/iVDGL test layout for Alice. Define the hardware to be used by May 31st A. 1 Define a DataTAG/iVDGL test layout for Alice. Define the hardware to be used by May 31st B.1 DataTAG people help setup the Alice test layout. First attempts for interfacing Alien and the EDG/RB. Interface to iVDGL/Condor-G will come as a second step. B.2 Alien installation on Alice test layout. Coordination with Pedrag Buncic at CERN. Try to reach some results by September 2002 ? C.1 Interface of the AliEn and EDG catalogues A more detailed plan can be written down once we have more clear ideas on how to proceed and after talking to Pedrag and Fons. D.1 Domenico Vicinanza and Daniele Mura will try to install and configure Spitfire on machines at Cagliari with the help of the spitfire support team in EDG and of DataTAG people.

05/23/2002Flavia Donno, INFN-Pisa9 Working plan with experiments - ATLAS  Atlas (L. Perini): Goals:  A. As a first step, Atlas is trying to use the EDG solution on its test layout for the Data Challenge 1 (DC1) which should start by the 15 th of June.  B. Atlas will need to distribute the EDG software to the American collaborators with VDT distribution tools.  C. The only development Atlas is carrying on is the integration of MAGDA (the Atlas data manager) and EDG/GDMP.  D. Further developments are ongoing in the areas of: Metadata catalogue for the data (they have one developed by Grenoble). Metadata catalogue for the data (they have one developed by Grenoble). Griphyn and Virtual Data Language (GRAPPA). Griphyn and Virtual Data Language (GRAPPA). “Gridified” Online notebook by Indiana University. Virtual Data (MOP per le produzioni di Atlas)

05/23/2002Flavia Donno, INFN-Pisa10 Working plan with experiments - ATLAS Plan: A. 1 DataTAG will help setup a test layout for MAGDA/GDMP integration. B.1 DataTAG will try to produce a distribution of EDG/release 1.2 via Pacman by the 15 th of June. C.1 Work is in progress with EDG and DataTAG people to realize the integration of GDMP and MAGDA. A first integration will just try to syncronize the MAGDA and GDMP internal catalogues for file mirroring. This should be achieved by the end of May.

05/23/2002Flavia Donno, INFN-Pisa11 Working plan with experiments - CDF  CDF (S. Belforte, A. Sidoti, R. St. Denis): Goals:  A. CDF starts using European DataGRID toolkit for interoperability across European institution/laboratories, in conjunction with software configured as SAM stations to deal with data handling and distribution.  B. Make it easier to connect from EU countries to FNAL  C. Share resources to provide common framework  D. Open the way to exploit coming high speed European networks to build a common (disk resident) data set with faster access than FNAL main repository

05/23/2002Flavia Donno, INFN-Pisa12 Working plan with experiments - CDF Plan: A/B/C Create a DataTag testbed using EDG tools to allow CDF people to test job submission and scheduling tools. CDF VO in place, DOE CA accepted. Install EDG UI at FNAL. Testbed open for CDF tests. (30 Apr 2002) – DataTAG + CDF people Study the SAM environment and exploit the possibility of integrating SAM in CDF/DataTAG EDG testbed (31 st Jul 2002) – DataTAG + CDF SAM support. Study the SAM environment and exploit the possibility of integrating SAM in CDF/DataTAG EDG testbed (31 st Jul 2002) – DataTAG + CDF SAM support. Test Glue MDS schema and check if it is enough to describe SAM resources. – DataTAG + CDF SAM support. Test Glue MDS schema and check if it is enough to describe SAM resources. – DataTAG + CDF SAM support. Test current EDG/JDL and study possible extensions for SAM. – DataTAG + CDF SAM support. Test current EDG/JDL and study possible extensions for SAM. – DataTAG + CDF SAM support. Work on-going with the SAM development/support team at FNAL to converge on a plan.

05/23/2002Flavia Donno, INFN-Pisa13 Working plan with experiments - CMS  CMS (C. Grandi, P. Capiluppi): Goals:  A. Have a complete production chain driven by IMPALA/BOSS on EDG User Interface that uses the EDG Resource Broker to submit jobs to the DataGrid testbed by June CMS week. First evaluation of EDG job scheduling and submission services. (10 Jun 2002).  B. Open DataTag testbed to US CMS partners and study interoperability issues (CA's, II, RB, etc...). This implies the study of the packaging tools used in EDG and iVGDL. First set or requirements. (31 Jul 2002)  C. Install US grid software on DataTag resources. Study the possibility of submitting jobs from EDG testbeds to iVDGL test layouts – Compatibility of common resources schemas. First evaluation of iVDGL job scheduling, submission and monitoring services (31 Jul 2002)  D. Request for some million events similar (all chain in a single job). Tony Wildish proposed to try to produce them using the grid test layout.

05/23/2002Flavia Donno, INFN-Pisa14 Working plan with experiments - CMS Plan: A Use DataTag testbed as development environment to define CE, SE, WN. Installation kits and UI configuration with IMPALA/BOSS to submit Pythia and cmsim jobs (30 Apr 2002) - CMS people. Test Replica Catalogue registration and file replication (7 may 02) - CMS + DataTAG people Test Replica Catalogue registration and file replication (7 may 02) - CMS + DataTAG people Use DataTag testbed to develop what needed to submit ORCA jobs. (10 Jun 02) - CMS people Use DataTag testbed to develop what needed to submit ORCA jobs. (10 Jun 02) - CMS people B Develop DataGrid software packaging and distribution independent on LCFG. First report (30 Apr 02) - DataTag people Setup CMS VO and open it to iVGDL (30 Apr 02) - DataTag people Setup CMS VO and open it to iVGDL (30 Apr 02) - DataTag people Define commonly recognized CA's for US (31 May 02) - DataTag people Define commonly recognized CA's for US (31 May 02) - DataTag people EDG release deployment on some US sites (31 May 02) – DataTag people EDG release deployment on some US sites (31 May 02) – DataTag people Test worldwide production with EDG software (31 Jul 02) - CMS + DataTAG people Test worldwide production with EDG software (31 Jul 02) - CMS + DataTAG people

05/23/2002Flavia Donno, INFN-Pisa15 Working plan with experiments - CMS Plan: CInstall US grid software on DataTag resources (it depends on B.1 -> B.3)(31 May 02) - DataTag people DStart MB production with EDG software in EU only (17 Jun 02) - CMS people (it depends on A) Start MB production with EDG software worldwide (31 Jul 02) - CMS people (it depends on B) Start MB production with US software (31 Jul 02) - EU CMS people driven by CMS-US people (it depends on C)

05/23/2002Flavia Donno, INFN-Pisa16 Organization and Conclusions  Job organization internally in DataTAG.  Establish commonalities among test layouts.  Establish a working plan with iVDGL.  Interoperability tests with US.  SC2002 demo ?