Status of AliEn2 Services ALICE offline week Latchezar Betev Geneva, June 01, 2005.

Slides:



Advertisements
Similar presentations
During the last three years, ALICE has used AliEn continuously. All the activities needed by the experiment (Monte Carlo productions, raw data registration,
Advertisements

LCG Tiziana Ferrari - SC3: INFN installation status report 1 Service Challenge Phase 3: Status report Tiziana Ferrari on behalf of the INFN SC team INFN.
Status GridKa & ALICE T2 in Germany Kilian Schwarz GSI Darmstadt.
ATLAS Tier-3 in Geneva Szymon Gadomski, Uni GE at CSCS, November 2009 S. Gadomski, ”ATLAS T3 in Geneva", CSCS meeting, Nov 091 the Geneva ATLAS Tier-3.
GSIAF "CAF" experience at GSI Kilian Schwarz. GSIAF Present status Present status installation and configuration installation and configuration usage.
1 Status of the ALICE CERN Analysis Facility Marco MEONI – CERN/ALICE Jan Fiete GROSSE-OETRINGHAUS - CERN /ALICE CHEP Prague.
Large scale data flow in local and GRID environment V.Kolosov, I.Korolko, S.Makarychev ITEP Moscow.
Patricia Méndez Lorenzo (IT/GS) ALICE Offline Week (18th March 2009)
Production Activities and Requirements by ALICE Patricia Méndez Lorenzo (on behalf of the ALICE Collaboration) Service Challenge Technical Meeting CERN,
AliEn uses bbFTP for the file transfers. Every FTD runs a server, and all the others FTD can connect and authenticate to it using certificates. bbFTP implements.
Andrew McNab - Manchester HEP - 5 July 2001 WP6/Testbed Status Status by partner –CNRS, Czech R., INFN, NIKHEF, NorduGrid, LIP, Russia, UK Security Integration.
11 December 2000 Paolo Capiluppi - DataGrid Testbed Workshop CMS Applications Requirements DataGrid Testbed Workshop Milano, 11 December 2000 Paolo Capiluppi,
CERN – Alice Offline – Thu, 03 Feb 2005 – Marco MEONI - 1/18 Monitoring of a distributed computing system: the AliEn Grid Alice Offline weekly meeting.
Sejong STATUS Chang Yeong CHOI CERN, ALICE LHC Computing Grid Tier-2 Workshop in Asia, 1 th December 2006.
Panda Grid Status Kilian Schwarz, GSI on behalf of PANDA GRID Group (slides to a large extend from Radoslaw Karabowicz)
PROOF Cluster Management in ALICE Jan Fiete Grosse-Oetringhaus, CERN PH/ALICE CAF / PROOF Workshop,
Site operations Outline Central services VoBox services Monitoring Storage and networking 4/8/20142ALICE-USA Review - Site Operations.
PDC’06 – production status and issues Latchezar Betev TF meeting – May 04, 2006.
The ALICE Distributed Computing Federico Carminati ALICE workshop, Sibiu, Romania, 20/08/2008.
Status of PDC’07 and user analysis issues (from admin point of view) L. Betev August 28, 2007.
Overview of ALICE monitoring Catalin Cirstoiu, Pablo Saiz, Latchezar Betev 23/03/2007 System Analysis Working Group.
Experiment Support CERN IT Department CH-1211 Geneva 23 Switzerland t DBES A. Abramyan, S. Bagansco, S. Banerjee, L. Betev, F. Carminati,
Experiment Support CERN IT Department CH-1211 Geneva 23 Switzerland t DBES A. Abramyan, S. Bagansco, S. Banerjee, L. Betev, F. Carminati,
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE Site Architecture Resource Center Deployment Considerations MIMOS EGEE Tutorial.
Xrootd Monitoring and Control Harsh Arora CERN. Setting Up Service  Monalisa Service  Monalisa Repository  Test Xrootd Server  ApMon Module.
The CMS Top 5 Issues/Concerns wrt. WLCG services WLCG-MB April 3, 2007 Matthias Kasemann CERN/DESY.
Testing and integrating the WLCG/EGEE middleware in the LHC computing Simone Campana, Alessandro Di Girolamo, Elisa Lanciotti, Nicolò Magini, Patricia.
Tier3 monitoring. Initial issues. Danila Oleynik. Artem Petrosyan. JINR.
Phase 2 of the Physics Data Challenge ‘04 Latchezar Betev ALICE Offline week Geneva, September 15, 2004.
JAliEn Java AliEn middleware A. Grigoras, C. Grigoras, M. Pedreira P Saiz, S. Schreiner ALICE Offline Week – June 2013.
AliEn central services Costin Grigoras. Hardware overview  27 machines  Mix of SLC4, SLC5, Ubuntu 8.04, 8.10, 9.04  100 cores  20 KVA UPSs  2 * 1Gbps.
+ AliEn site services and monitoring Miguel Martinez Pedreira.
Materials for Report about Computing Jiří Chudoba x.y.2006 Institute of Physics, Prague.
Production Activities and Results by ALICE Patricia Méndez Lorenzo (on behalf of the ALICE Collaboration) Service Challenge Technical Meeting CERN, 15.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks The LCG interface Stefano BAGNASCO INFN Torino.
Experiment Support CERN IT Department CH-1211 Geneva 23 Switzerland t DBES L. Betev, A. Grigoras, C. Grigoras, P. Saiz, S. Schreiner AliEn.
03/09/2007http://pcalimonitor.cern.ch/1 Monitoring in ALICE Costin Grigoras 03/09/2007 WLCG Meeting, CHEP.
ALICE experiences with CASTOR2 Latchezar Betev ALICE.
Service Challenge Report Federico Carminati GDB – January 11, 2006.
Data transfers and storage Kilian Schwarz GSI. GSI – current storage capacities vobox LCG RB/CE GSI batchfarm: ALICE cluster (67 nodes/480 cores for batch.
INRNE's participation in LCG Elena Puncheva Preslav Konstantinov IT Department.
PDC’06 - status of deployment and production Latchezar Betev TF meeting – April 27, 2006.
Experiment Support CERN IT Department CH-1211 Geneva 23 Switzerland t DBES The AliEn File Catalogue Jamboree on Evolution of WLCG Data &
Meeting with University of Malta| CERN, May 18, 2015 | Predrag Buncic ALICE Computing in Run 2+ P. Buncic 1.
GRID interoperability and operation challenges under real load for the ALICE experiment F. Carminati, L. Betev, P. Saiz, F. Furano, P. Méndez Lorenzo,
Phase 2 of the Physics Data Challenge ‘04 Peter Hristov For the ALICE DC team Russia-CERN Joint Group on Computing CERN, September 20, 2004.
ALICE Physics Data Challenge ’05 and LCG Service Challenge 3 Latchezar Betev / ALICE Geneva, 6 April 2005 LCG Storage Management Workshop.
ALICE computing Focus on STEP09 and analysis activities ALICE computing Focus on STEP09 and analysis activities Latchezar Betev Réunion LCG-France, LAPP.
The ALICE Production Patricia Méndez Lorenzo (CERN, IT/PSS) On behalf of the ALICE Offline Project LCG-France Workshop Clermont, 14th March 2007.
Pledged and delivered resources to ALICE Grid computing in Germany Kilian Schwarz GSI Darmstadt ALICE Offline Week.
Storage discovery in AliEn
Experiment Support CERN IT Department CH-1211 Geneva 23 Switzerland t DBES A. Abramyan, S. Bagnasco, L. Betev, D. Goyal, A. Grigoras, C.
Availability of ALICE Grid resources in Germany Kilian Schwarz GSI Darmstadt ALICE Offline Week.
Kilian Schwarz ALICE Computing Meeting GSI, October 7, 2009
Jean-Philippe Baud, IT-GD, CERN November 2007
ARDA-ALICE activity in 2005 and tasks in 2006
ALICE and LCG Stefano Bagnasco I.N.F.N. Torino
The EDG Testbed Deployment Details
INFN-GRID Workshop Bari, October, 26, 2004
GSIAF & Anar Manafov, Victor Penso, Carsten Preuss, and Kilian Schwarz, GSI Darmstadt, ALICE Offline week, v. 0.8.
ALICE Physics Data Challenge 3
RDIG for ALICE today and in future
MC data production, reconstruction and analysis - lessons from PDC’04
Storage elements discovery
Installation and Commissioning of ALICE VO-BOXES and AliEn Services
Simulation use cases for T2 in ALICE
ALICE – FAIR Offline Meeting KVI (Groningen), 3-4 May 2010
LCG middleware and LHC experiments ARDA project
LHC Data Analysis using a worldwide computing grid
The LHCb Computing Data Challenge DC06
Presentation transcript:

Status of AliEn2 Services ALICE offline week Latchezar Betev Geneva, June 01, 2005

2 AliEn site services 01 June 2005 Outline  Services  Installation  ALICE Grid for PDC’05

3 AliEn site services 01 June 2005 AliEn2 services Local scheduler ALICE VO – central services Central Task Queue Job submission File Catalogue Configuration Accounting User authentication Computing Element Workload management Job Monitoring Storage Element(s) DB Data Transfer Storage Element Cluster Monitor AliEn Site services Disk and MSS Existing site components ALICE VO – Site services integration

4 AliEn site services 01 June 2005 AliEn2 services (2)  PackMan – application software delivery (ROOT, AliRoot, …):  Central and site service VO User  User/global application software management

5 AliEn site services 01 June 2005 AliEn services (3)  PackMan:  Managed package dependencies:  AliRoot 4.02.Rev.01 depends on ROOT – will trigger installation of ROOT  Automatic installation through declarations  xrootd – data transfer protocol:  Performing file transport system, descendant of rootd (but now completely reworked), xrootd client is ROOT/posix compliant  Load-balancing, scalability, speed  Replaces AliEn aiod as file transfer mechanism  More information at  MonALISA – monitoring:  Central repository, site agents  ApMon clients, embedded in the job wrapper:  Communication through UDP

6 AliEn site services 01 June 2005 AliEn Services (4)  Many new repository features  Interactive map with a lot of ‘at-glance’ information  Site agents repository – data filtering and averaging  A de-facto standard for Grid3 (US)

7 AliEn site services 01 June 2005 AliEn installation  New intuitive interactive alien-installer:

8 AliEn site services 01 June 2005 AliEn installation (2)  Very robust – carries all dependencies, able to install itself  Services of AliEn are partitioned by location  Supports software updates

9 AliEn site services 01 June 2005 AliEn installation (3)  When everything works the installation is extremely easy and straightforward  After installation: additional tuning of site parameters:  Storage, local scheduler, network ports, etc…

10 AliEn site services 01 June 2005 HP ProLiant DL580 AliEn central services HP ProLiant DL360 AliEn to CASTOR (MSS) interface HP ProLiant DL380 gShell API service Disk SE log files storage 1TB SATA Disk server AliEn services at CERN

11 AliEn site services 01 June 2005 AliEn services at CERN(2)  Central AliEn services – support by offline, running on our resources  IT support:  Storage capacities: 3 CASTOR disk stagers (50 TB)  CE, PackMan, SE load balancer for xrootd: lxgate06  Data transport slave servers: castorgrid01 to castorgrid08  Lxbatch capacity – 150 shares (approx 200 jobs)

12 AliEn site services 01 June 2005 AliEn services at computing centres  Identical as last year:  User account on a head node (or dedicated host) – this model is now being adopted by the other LHC experiments  Support by local expert is very important  Currently installed sites: Patricia Lorenzo (IT) Chang Choi Claudiu Schiaua (Bucharest) Jan Fiete (Muenster) Kilian Schwarz (Karlsruhe)

13 AliEn site services 01 June 2005 ALICE Grid for PDC’05  Comoputing centres (ALICE resources): 30  CERN  France: Lyon, Clermont-Ferrand, Nantes  Germany: GridKa, GSI, IKP Muenster  Italy: CNAF, Catania, Bari, Torino, Padova  UK: RAL  Holland: NIKHEF  Nordic facility: NDGF  US: OSC, NERSC, Houston  South Africa: Cape Town  Russia: IHEP, ITEP, KI, JINR, SPbSU, SINP  Romania: NIPNE  India: VECC  Slovakia: IEP  Czech Republic: Prague  South Korea: Sejong

14 AliEn site services 01 June 2005 ALICE Grid for PDC’05  30 Centres  Wealth of resources (2005): ~1700 CPUs, 250 TB disk (not counting CERN)  All these have to be ‘glued’ together by the Grid middleware  In 2004 we managed to run on 17 sites with AliEn (+LCG resources through interface)  This year we should do better  In 2006, the amount of available resources will double, as well as the volume of the computing exercise (PDC’06)

15 AliEn site services 01 June 2005 Current status and problems  Installation of sites ongoing:  With the help from the site experts  Also building up local expert group - to be able to support the running of the ALICE Grid in a 24/7 regime  List of problems:  The AliEn2 software is new (with respect to AliEn):  There are problems which only appear when the software is tested in a real environment and with complex tasks  We need time to learn how to operate it in a ‘production’ mode  The initial setup procedure is relatively slow:  We have done it before  We do need to push through this phase to be able to do the production and analysis of the ALICE data  The functionality expectations are very high

16 AliEn site services 01 June 2005 Development team  Experts, who provide all our Grid software and support for its functioning:  AliEn: Predrag Buncic, Pablo Saiz  ARDA: Andreas Peters, Derek Feichtinger, Catalin Cirstoiu, Slavomir Biegluk