CE extensions requirements for the Information System Pre-GDB 11 th July 2012 Maria Alandes Pradillo CERN IT Department, Grid Technology Group With contributions.

Slides:



Advertisements
Similar presentations
HTCondor and the European Grid Andrew Lahiff STFC Rutherford Appleton Laboratory European HTCondor Site Admins Meeting 2014.
Advertisements

LCG-France Project Status Fabio Hernandez Frédérique Chollet Fairouz Malek Réunion Sites LCG-France Annecy, May
Accounting Update Dave Kant Grid Deployment Board Nov 2007.
INFSO-RI Enabling Grids for E-sciencE XACML and G-PBox update MWSG 14-15/09/2005 Presenter: Vincenzo Ciaschini.
Pilots 2.0: DIRAC pilots for all the skies Federico Stagni, A.McNab, C.Luzzi, A.Tsaregorodtsev On behalf of the DIRAC consortium and the LHCb collaboration.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks gLite Release Process Maria Alandes Pradillo.
Storage Accounting John Gordon, STFC GDB June 2012.
1 Evolution of OSG to support virtualization and multi-core applications (Perspective of a Condor Guy) Dan Bradley University of Wisconsin Workshop on.
CERN IT Department CH-1211 Geneva 23 Switzerland t Storageware Flavia Donno CERN WLCG Collaboration Workshop CERN, November 2008.
WNoDeS – Worker Nodes on Demand Service on EMI2 WNoDeS – Worker Nodes on Demand Service on EMI2 Local batch jobs can be run on both real and virtual execution.
LCG Introduction John Gordon, STFC GDB September 9th 2009.
EMI is partially funded by the European Commission under Grant Agreement RI Argus Policies Tutorial Valery Tschopp - SWITCH EGI TF Prague.
Towards a Global Service Registry for the World-Wide LHC Computing Grid Maria ALANDES, Laurence FIELD, Alessandro DI GIROLAMO CERN IT Department CHEP 2013.
Certification and test activity IT ROC/CIC Deployment Team LCG WorkShop on Operations, CERN 2-4 Nov
Pilot Jobs John Gordon Management Board 23/10/2007.
Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Usage of virtualization in gLite certification Andreas Unterkircher.
INFSO-RI Enabling Grids for E-sciencE OSG-LCG Interoperability Activity Author: Laurence Field (CERN)
Report on Installed Resource Capacity Flavia Donno CERN/IT-GS WLCG GDB, CERN 10 December 2008.
Information System Status and Evolution Maria Alandes Pradillo, CERN CERN IT Department, Grid Technology Group GDB 13 th June 2012.
CREAM: ALICE Experience WLCG GDB Meeting, CERN 11th November 2009 Stefano Bagnasco (INFN-Torino), Jean-Michel Barbet (Subatech), Latchezar Betev (ALICE),
WLCG Middleware Support II Markus Schulz CERN-IT-GT May 2011.
EMI INFSO-RI Argus Policies in Action Valery Tschopp (SWITCH) on behalf of the Argus PT.
INFSO-RI Enabling Grids for E-sciencE ARDA Experiment Dashboard Ricardo Rocha (ARDA – CERN) on behalf of the Dashboard Team.
CREAM Installation&Configuration Sara Bertocco INFN Padova 11 th International GridKa School 2013 – Big Data, Clouds and Grids.
EMI INFSO-RI EMIR integration in BDII Maria Alandes Pradillo (CERN) Information System Product Team.
WLCG Software Lifecycle First ideas for a post EMI approach 0.
LCG Report from GDB John Gordon, STFC-RAL MB meeting February24 th, 2009.
Last update 31/01/ :41 LCG 1 Maria Dimou Procedures for introducing new Virtual Organisations to EGEE NA4 Open Meeting Catania.
EGEE-II INFSO-RI Enabling Grids for E-sciencE YAIM Overview MiMOS Grid tutorial HungChe, ASGC OPS Team.
LCG Introduction John Gordon, STFC GDB July8th 2009.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Middleware Update Maria Alandes Pradillo.
WLCG Information System Use Cases Review WLCG Operations Coordination Meeting 18 th June 2015 Maria Alandes IT/SDC.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks gLite configuration (plans) Robert Harakaly.
Next Steps after WLCG workshop Information System Task Force 11 th February
Definitions Information System Task Force 8 th January
INRNE's participation in LCG Elena Puncheva Preslav Konstantinov IT Department.
The GridPP DIRAC project DIRAC for non-LHC communities.
WLCG Operations Coordination report Maria Alandes, Andrea Sciabà IT-SDC On behalf of the WLCG Operations Coordination team GDB 9 th April 2014.
Co-ordination & Harmonisation of Advanced e-Infrastructures for Research and Education Data Sharing Research Infrastructures Grant Agreement n
EMI is partially funded by the European Commission under Grant Agreement RI Argus Policies Tutorial Valery Tschopp (SWITCH) – Argus Product Team.
Probes Requirement Review OTAG-08 03/05/ Requirements that can be directly passed to EMI ● Changes to the MPI test (NGI_IT)
WLCG Operations Coordination news and meeting restructuring Maria Alandes Pradillo Josep Flix Alessandra Forti Andrea Sciabà WLCG operations coordination.
EGEE is a project funded by the European Union under contract IST Aims and organization of the Biomedical VO Yannick Legré CNRS/IN2P3 NA4/SA1.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Job Management Claudio Grandi.
LCG Introduction John Gordon, STFC-RAL GDB November 7th, 2007.
INFSO-RI Enabling Grids for E-sciencE Padova site report Massimo Sgaravatto On behalf of the JRA1 IT-CZ Padova group.
Accounting Update John Gordon. Outline Multicore CPU Accounting Developments Cloud Accounting Storage Accounting Miscellaneous.
CMS Multicore jobs at RAL Andrew Lahiff, RAL WLCG Multicore TF Meeting 1 st July 2014.
Maria Alandes Pradillo, CERN Training on GLUE 2 information validation EGI Technical Forum September 2013.
Quattor installation and use feedback from CNAF/T1 LCG Operation Workshop 25 may 2005 Andrea Chierici – INFN CNAF
The Grid Information System Maria Alandes Pradillo IT-SDC White Area Lecture, 4th June 2014.
Operations Coordination Team Maria Girone, CERN IT-ES GDB, 11 July 2012.
CREAM Status and plans Massimo Sgaravatto – INFN Padova
Grid Engine batch system integration in the EMI era
Grid Technology CERN IT Department CH-1211 Geneva 23 Switzerland t DBCF GT Middleware Update GDB, 9 th February 2011 Slides by Maria Alandes.
Argus EMI Authorization Integration
Title of the Poster Supervised By: Prof.*********
Sviluppi in ambito WLCG Highlights
Andreas Unterkircher CERN Grid Deployment
Farida Naz Andrea Sciabà
Workload Management System
GDB 8th March 2006 Flavia Donno IT/GD, CERN
Distributed Job Submission in a Dynamic Virtual Environment
CREAM Status and Plans Massimo Sgaravatto – INFN Padova
Global Banning List and Authorization Service
lcg-infosites documentation (v2.1, LCG2.3.1) 10/03/05
The CREAM CE: When can the LCG-CE be replaced?
EMI 1 (Kebnekaise) Updates
SAM Alarm Triggering and Masking
Presentation transcript:

CE extensions requirements for the Information System Pre-GDB 11 th July 2012 Maria Alandes Pradillo CERN IT Department, Grid Technology Group With contributions from Stephen Burke and Laurence Field

WM TEG Use Cases Site Support for: – whole nodes – generic multi-core jobs – Both – none of these Maximum number of cores supported in the site Maximum amount of RAM that can be requested for multi-core jobs Distinction between I/O-bound and CPU-bound jobs supported in the site pre-GDB workshop on CE Extensions2

Information System Requirements What does it mean whole nodes? – What do you expect from IS? Publication of a functionality? Publication of a value? In general, for all use cases, we would like to understand what you want to see in the IS. pre-GDB workshop on CE Extensions WM TEG Use CaseIS Requirement Whole nodes? Generic multi-core jobs? Max number of cores per job? Max RAM for multi-core jobs? 3

Glue 1.3 Mechanisms GlueCECapability attribute Currently used for glexec and cpu scaling value YAIM Example: – CE_CAPABILITY="CPUScalingReferenceSI00=100 Share=dteam:20 Share=atlas:10 glexec wholenode“ This mechanism is not so good for numbers – The string needs to be parsed! – See June 2010 presentation on Job Matching – CPU Power Requirements 1&materialId=slides&confId=72057 pre-GDB workshop on CE Extensions4

Glue 2.0 Mechanisms Some extra attributes are added explicitly – ComputingShare (if parameters different per VO): MaxMultiSlotWallTime MaxTotalCPUTime MaxSlotsPerJob – ComputingManager (if global properties of the batch system): TotalLogicalCPUs TotalSlots LogicalCPUDistribution – ExecutionEnvironment (related to the WN hardware): LogicalCPUs CPUMultiplicity GLUE2EntityOtherInfo exists for all Glue 2.0 objects pre-GDB workshop on CE Extensions5

Manual or Automatic? Manual definition by sys admins – Clear documentation to make sure all attributes mean the same for all sys admins – YAIM variables are re-used for both Glue 2.0 and Glue 1.3 Automatically collected from batch system – Could the batch system provide the information? – Time to code new scripts, release them and deploy them! – Maintenance and support effort pre-GDB workshop on CE Extensions6

Deployment Glue 2.0: – EMI 2 version of CREAM is fully Glue 2.0 compliant It will take time to deploy this version – Agreement on the OtherInfo/Capability attributes Glue 1.3: – Agreement on GlueCECapability attribute Deployment of new attributes in either case What is the expected deadline? – LHC LS? pre-GDB workshop on CE Extensions7