LNL M.Biasotto, Bologna, 20 novembre 2000 1 Providing the Grid Information Service with information of local farms Massimo Biasotto – INFN LNL Massimo.

Slides:



Advertisements
Similar presentations
WP1 Grid Workload Management Massimo Sgaravatto INFN Padova
Advertisements

Installation and evaluation of the Globus toolkit WP 1 INFN-GRID Workload management WP 1 DATAGRID WP 2.1 INFN-GRID Massimo Sgaravatto INFN Padova.
INFN & Globus activities Massimo Sgaravatto INFN Padova.
Grid Workload Management (WP 1) Report to INFN-GRID TB Massimo Sgaravatto INFN Padova.
WP 1 (Globus) Status Report Massimo Sgaravatto INFN Padova for the INFN Globus group
LNL M.Biasotto, Roma, 22 novembre Some notes on WP6 INFN Testbed.
Legacy code support for commercial production Grids G.Terstyanszky, T. Kiss, T. Delaitre, S. Winter School of Informatics, University.
Work Package 1 Installation and Evaluation of the Globus Toolkit Massimo Sgaravatto INFN Padova.
LNL CMS M.Biasotto, Bologna, 29 aprile LNL Analysis Farm Massimo Biasotto - LNL.
Evaluation of the Globus Toolkit: Status Roberto Cucchi – INFN Cnaf Antonia Ghiselli – INFN Cnaf Giuseppe Lo Biondo – INFN Milano Francesco Prelz – INFN.
4/2/2002HEP Globus Testing Request - Jae Yu x Participating in Globus Test-bed Activity for DØGrid UTA HEP group is playing a leading role in establishing.
Condor and GridShell How to Execute 1 Million Jobs on the Teragrid Jeffrey P. Gardner - PSC Edward Walker - TACC Miron Livney - U. Wisconsin Todd Tannenbaum.
WP 1 Grid Workload Management Massimo Sgaravatto INFN Padova.
Dr. David Wallom Use of Condor in our Campus Grid and the University September 2004.
CMS HLT production using Grid tools Flavia Donno (INFN Pisa) Claudio Grandi (INFN Bologna) Ivano Lippi (INFN Padova) Francesco Prelz (INFN Milano) Andrea.
GRID workload management system and CMS fall production Massimo Sgaravatto INFN Padova.
Status of Globus activities within INFN Massimo Sgaravatto INFN Padova for the INFN Globus group
Workload Management Workpackage Massimo Sgaravatto INFN Padova.
Globus activities within INFN Massimo Sgaravatto INFN Padova for the INFN Globus group
INFN-GRID Globus evaluation Massimo Sgaravatto INFN Padova for the INFN Globus group
GRID Workload Management System Massimo Sgaravatto INFN Padova.
Globus activities within INFN Massimo Sgaravatto INFN Padova for the INFN Globus group
Workload Management Massimo Sgaravatto INFN Padova.
First steps implementing a High Throughput workload management system Massimo Sgaravatto INFN Padova
Status of Globus activities within INFN (update) Massimo Sgaravatto INFN Padova for the INFN Globus group
First ideas for a Resource Management Architecture for Productions Massimo Sgaravatto INFN Padova.
Evaluation of the Globus GRAM Service Massimo Sgaravatto INFN Padova.
INFN-GRID Globus evaluation (WP 1) Massimo Sgaravatto INFN Padova for the INFN Globus group
Workload Management WP Status and next steps Massimo Sgaravatto INFN Padova.
GRID The GRID distribution toolkit at INFN Flavia Donno (INFN Pisa) Andrea Sciaba` (INFN Pisa) Zhen Xie (INFN Pisa) presented by Massimo Sgaravatto (INFN.
A. Cavalli - F. Semeria INFN Experience With Globus GIS 1 A. Cavalli - F. Semeria INFN First INFN Grid Workshop Catania, 9-11 April 2001 INFN Experience.
1 BIG FARMS AND THE GRID Job Submission and Monitoring issues ATF Meeting, 20/06/03 Sergio Andreozzi.
Grid Workload Management & Condor Massimo Sgaravatto INFN Padova.
DataGrid WP1 Massimo Sgaravatto INFN Padova. WP1 (Grid Workload Management) Objective of the first DataGrid workpackage is (according to the project "Technical.
CSF4 Meta-Scheduler Name: Zhaohui Ding, Xiaohui Wei
Grid Workload Management Massimo Sgaravatto INFN Padova.
Research Computing Environment at the University of Alberta Diego Novillo Research Computing Support Group University of Alberta April 1999.
Stuart Wakefield Imperial College London Evolution of BOSS, a tool for job submission and tracking W. Bacchi, G. Codispoti, C. Grandi, INFN Bologna D.
Giuseppe Codispoti INFN - Bologna Egee User ForumMarch 2th BOSS: the CMS interface for job summission, monitoring and bookkeeping W. Bacchi, P.
Report from USA Massimo Sgaravatto INFN Padova. Introduction Workload management system for productions Monte Carlo productions, data reconstructions.
July 11-15, 2005Lecture3: Grid Job Management1 Grid Compute Resources and Job Management.
Globus Toolkit Massimo Sgaravatto INFN Padova. Massimo Sgaravatto Introduction Grid Services: LHC regional centres need distributed computing Analyze.
Resource Management Task Report Thomas Röblitz 19th June 2002.
Proposal for a IS schema Massimo Sgaravatto INFN Padova.
Portal Update Plan Ashok Adiga (512)
EGEE is a project funded by the European Union under contract INFSO-RI Practical approaches to Grid workload management in the EGEE project Massimo.
Pilot Factory using Schedd Glidein Barnett Chiu BNL
Report on the INFN-GRID Globus evaluation Massimo Sgaravatto INFN Padova for the INFN Globus group
GRID The GRID distribution toolkit at INFN Flavia Donno (INFN Pisa) Andrea Sciaba` (INFN Pisa) Zhen Xie (INFN Pisa) presented by Massimo Sgaravatto (INFN.
Condor on WAN D. Bortolotti - INFN Bologna T. Ferrari - INFN Cnaf A.Ghiselli - INFN Cnaf P.Mazzanti - INFN Bologna F. Prelz - INFN Milano F.Semeria - INFN.
Summary from WP 1 Parallel Section Massimo Sgaravatto INFN Padova.
Grid Compute Resources and Job Management. 2 Grid middleware - “glues” all pieces together Offers services that couple users with remote resources through.
GIIS Implementation and Requirements F. Semeria INFN European Datagrid Conference Amsterdam, 7 March 2001.
JSS Job Submission Service Massimo Sgaravatto INFN Padova.
STAR Scheduling status Gabriele Carcassi 9 September 2002.
4/9/ 2000 I Datagrid Workshop- Marseille C.Vistoli Wide Area Workload Management Work Package DATAGRID project Parallel session report Cristina Vistoli.
Status of Globus activities Massimo Sgaravatto INFN Padova for the INFN Globus group
Grid Workload Management (WP 1) Massimo Sgaravatto INFN Padova.
INFN “Grid Information Service” evaluation Giuseppe Lo Biondo - INFN Sez. Di Milano Giulietta Vita Finzi - INFN CNAF Padova June
EGEE 3 rd conference - Athens – 20/04/2005 CREAM JDL vs JSDL Massimo Sgaravatto INFN - Padova.
WP1 Status and plans Francesco Prelz, Massimo Sgaravatto 4 th EDG Project Conference Paris, March 6 th, 2002.
STAR Scheduler Gabriele Carcassi STAR Collaboration.
CSF. © Platform Computing Inc CSF – Community Scheduler Framework Not a Platform product Contributed enhancement to The Globus Toolkit Standards.
First evaluation of the Globus GRAM service Massimo Sgaravatto INFN Padova.
A System for Monitoring and Management of Computational Grids Warren Smith Computer Sciences Corporation NASA Ames Research Center.
CSF4 Meta-Scheduler Zhaohui Ding College of Computer Science & Technology Jilin University.
Workload Management Workpackage
First proposal for a modification of the GIS schema
Accounting Information: MPI
GRID Workload Management System for CMS fall production
Presentation transcript:

LNL M.Biasotto, Bologna, 20 novembre Providing the Grid Information Service with information of local farms Massimo Biasotto – INFN LNL Massimo Sgaravatto – INFN Padova

LNL M.Biasotto, Bologna, 20 novembre Overview  Overview of information published in GIS by default  Analysis of useful information provided by local resource management systems (LSF and Condor)  First proposal of a new schema  Conclusions and future work

LNL M.Biasotto, Bologna, 20 novembre Default schema: GlobusServiceJobManager

LNL M.Biasotto, Bologna, 20 novembre Default schema: GlobusQueue  Many useless fields (always set to 0)  totalnodes and freenodes not correct for LSF

LNL M.Biasotto, Bologna, 20 novembre Default schema: GlobusQueueEntry  start time and schedspecific always set to NULL

LNL M.Biasotto, Bologna, 20 novembre Info provided by local RMS  Both LSF and Condor offer commands to get exhaustive information on the status of the farm  LSF main commands: –bhosts, lshosts, lsload: hosts info –bqueues: queues info –bjobs: jobs info  Condor main commands: –condor_status: hosts info –condor_q: jobs info

LNL M.Biasotto, Bologna, 20 novembre Proposed schema  Farm represented by a set of queues  Each queue is a set of “homogeneous” resources  LSF: supports queues  Condor: single queue (set of hosts in Condor pool sharing same architecture and O.S.) Service (JobManager) Queue QueueEntry (JobId)

LNL M.Biasotto, Bologna, 20 novembre Proposed schema: Service  Info on Architecture and OpSys moved to Queue object

LNL M.Biasotto, Bologna, 20 novembre Proposed schema: Queue  TotalCpus and FreeCpus correctly defined  Info on Cpu power not available in LSF  Publish info on users?  Publish info on scheduling policies?

LNL M.Biasotto, Bologna, 20 novembre Proposed schema: QueueEntry  Info on CpuTime not available in Condor

LNL M.Biasotto, Bologna, 20 novembre Implementing the new schema  Two options available: –modify LDAP objects in current default schema –create new LDAP objects  Second approach is preferable: –doesn’t require changes to Globus source code –more flexible for future extensions  First version of scripts to compute LSF TotalCpus and FreeCpus: –more testing needed –send them to globus-discuss mailing list?

LNL M.Biasotto, Bologna, 20 novembre Future work  Current proposal based only on LSF and Condor: take into account other Resource Management Systems (PBS)  Implementation of the new schema  Future use will provide suggestions for changes and extensions to this preliminary schema