WP1 Grid Workload Management Massimo Sgaravatto INFN Padova

Slides:



Advertisements
Similar presentations
Installation and evaluation of the Globus toolkit WP 1 INFN-GRID Workload management WP 1 DATAGRID WP 2.1 INFN-GRID Massimo Sgaravatto INFN Padova.
Advertisements

INFN & Globus activities Massimo Sgaravatto INFN Padova.
Grid Workload Management (WP 1) Report to INFN-GRID TB Massimo Sgaravatto INFN Padova.
WP 1 (Globus) Status Report Massimo Sgaravatto INFN Padova for the INFN Globus group
Workload Management David Colling Imperial College London.
WP 1 Members of Wp1: INFN Cesnet DATAMAT PPARC. WP 1 What does WP1 do? Broker Submission mechanism JDL/JCL and other UIs Logging computational economics.
Andrew McNab - Manchester HEP - 22 April 2002 EU DataGrid Testbed EU DataGrid Software releases Testbed 1 Job Lifecycle Authorisation at your site More.
Andrew McNab - Manchester HEP - 2 May 2002 Testbed and Authorisation EU DataGrid Testbed 1 Job Lifecycle Software releases Authorisation at your site Grid/Web.
Work Package 1 Installation and Evaluation of the Globus Toolkit Massimo Sgaravatto INFN Padova.
EU 2nd Year Review – Jan – Title – n° 1 WP1 Speaker name (Speaker function and WP ) Presentation address e.g.
Workload management Owen Maroney, Imperial College London (with a little help from David Colling)
FP7-INFRA Enabling Grids for E-sciencE EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia Sep. 19, 2008.
Preparation of D1.7 Massimo Sgaravatto INFN Padova.
Alessandro Italiano INFN – CNAF 26/09/2003 1/5 Status of the INFN - EDG testbeds Alessandro Italiano 7th DataGrid Conference.
Evaluation of the Globus Toolkit: Status Roberto Cucchi – INFN Cnaf Antonia Ghiselli – INFN Cnaf Giuseppe Lo Biondo – INFN Milano Francesco Prelz – INFN.
Job Submission The European DataGrid Project Team
WP 1 Grid Workload Management Massimo Sgaravatto INFN Padova.
CMS HLT production using Grid tools Flavia Donno (INFN Pisa) Claudio Grandi (INFN Bologna) Ivano Lippi (INFN Padova) Francesco Prelz (INFN Milano) Andrea.
The DataGrid Project NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002
EU-GRID Work Program Massimo Sgaravatto – INFN Padova Cristina Vistoli – INFN Cnaf as INFN members of the EU-GRID technical team.
Status of Globus activities within INFN Massimo Sgaravatto INFN Padova for the INFN Globus group
Workload Management Workpackage Massimo Sgaravatto INFN Padova.
DataGrid Kimmo Soikkeli Ilkka Sormunen. What is DataGrid? DataGrid is a project that aims to enable access to geographically distributed computing power.
GRID Workload Management System Massimo Sgaravatto INFN Padova.
Globus activities within INFN Massimo Sgaravatto INFN Padova for the INFN Globus group
Workload Management Massimo Sgaravatto INFN Padova.
First steps implementing a High Throughput workload management system Massimo Sgaravatto INFN Padova
Status of Globus activities within INFN (update) Massimo Sgaravatto INFN Padova for the INFN Globus group
First ideas for a Resource Management Architecture for Productions Massimo Sgaravatto INFN Padova.
Evaluation of the Globus GRAM Service Massimo Sgaravatto INFN Padova.
INFN Testbed status report L. Gaido WP6 meeting CERN - October 30th, 2002.
The EDG Testbed Deployment Details The European DataGrid Project
EDG - WP1 (Grid Work Scheduling) Status and plans Massimo Sgaravatto - INFN Padova Francesco Prelz – INFN Milano.
“Grey areas” of the new architecture Massimo Sgaravatto INFN Padova.
INFN-GRID Globus evaluation (WP 1) Massimo Sgaravatto INFN Padova for the INFN Globus group
5 November 2001F Harris GridPP Edinburgh 1 WP8 status for validating Testbed1 and middleware F Harris(LHCb/Oxford)
Workload Management WP Status and next steps Massimo Sgaravatto INFN Padova.
Grid Workload Management & Condor Massimo Sgaravatto INFN Padova.
DataGrid Applications Federico Carminati WP6 WorkShop December 11, 2000.
DataGrid is a project funded by the European Union CHEP 2003 – March 2003 – M. Sgaravatto – n° 1 The EU DataGrid Workload Management System: towards.
M. Sgaravatto – n° 1 The EDG Workload Management System: release 2 Massimo Sgaravatto INFN Padova - DataGrid WP1
DataGrid WP1 Massimo Sgaravatto INFN Padova. WP1 (Grid Workload Management) Objective of the first DataGrid workpackage is (according to the project "Technical.
11 December 2000 Paolo Capiluppi - DataGrid Testbed Workshop CMS Applications Requirements DataGrid Testbed Workshop Milano, 11 December 2000 Paolo Capiluppi,
Grid Workload Management Massimo Sgaravatto INFN Padova.
- Distributed Analysis (07may02 - USA Grid SW BNL) Distributed Processing Craig E. Tull HCG/NERSC/LBNL (US) ATLAS Grid Software.
The ALICE short-term use case DataGrid WP6 Meeting Milano, 11 Dec 2000Piergiorgio Cerello 1 Physics Performance Report (PPR) production starting in Feb2001.
Report from USA Massimo Sgaravatto INFN Padova. Introduction Workload management system for productions Monte Carlo productions, data reconstructions.
Globus Toolkit Massimo Sgaravatto INFN Padova. Massimo Sgaravatto Introduction Grid Services: LHC regional centres need distributed computing Analyze.
DATAGRID Testbed Work Package (report) F.Etienne, A.Ghiselli CNRS/IN2P3 – Marseille, INFN-CNAF Bologna DATAGRID Conference, 7-9 March 2001 Amsterdam.
DataGRID PTB, Geneve, 10 April 2002 Testbed Software Test Plan Status Laurent Bobelin on behalf of Test Group.
Proposal for a IS schema Massimo Sgaravatto INFN Padova.
High-Performance Computing Lab Overview: Job Submission in EDG & Globus November 2002 Wei Xing.
Condor on WAN D. Bortolotti - INFN Bologna T. Ferrari - INFN Cnaf A.Ghiselli - INFN Cnaf P.Mazzanti - INFN Bologna F. Prelz - INFN Milano F.Semeria - INFN.
6 march Building the INFN Grid Proposal outline a.ghiselli,l.luminari,m.sgaravatto,c.vistoli INFN Grid meeting, milano.
Summary from WP 1 Parallel Section Massimo Sgaravatto INFN Padova.
Report from DataGrid Technical Board Massimo Sgaravatto INFN Padova.
EDG - WP1 (Grid Work Scheduling) Status and plans Massimo Sgaravatto INFN Padova.
4/9/ 2000 I Datagrid Workshop- Marseille C.Vistoli Wide Area Workload Management Work Package DATAGRID project Parallel session report Cristina Vistoli.
Status of Globus activities Massimo Sgaravatto INFN Padova for the INFN Globus group
Grid Workload Management (WP 1) Massimo Sgaravatto INFN Padova.
The DataGrid Project NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002
WP1 Status and plans Francesco Prelz, Massimo Sgaravatto 4 th EDG Project Conference Paris, March 6 th, 2002.
Bob Jones – Project Architecture - 1 March n° 1 Project Architecture, Middleware and Delivery Schedule Bob Jones Technical Coordinator, WP12, CERN.
Workload Management Workpackage
Regional Operations Centres Core infrastructure Centres
ALICE Physics Data Challenge 3
Introduction to Grid Technology
Testbed Software Test Plan Status
Wide Area Workload Management Work Package DATAGRID project
I Datagrid Workshop- Marseille C.Vistoli
Presentation transcript:

WP1 Grid Workload Management Massimo Sgaravatto INFN Padova

Activities 2001 Driven by deliverables D1.1 Report on current technology Survey on existing Grid tools and frameworks C. Anglano (TO), T. Ferrari, F. Giacomini (CNAF), F. Prelz (MI), M. Sgaravatto (PD) D1.2: Definition of architecture Internal WP1 architecture document F. Giacomini (CNAF) main author Participation to ATF to define the global EDG architecture D1.3: Initial Workload Management System (1 st release) Code released to EDG-Integration Team

1 st Release (what and who) UI (User Interface) - DATAMAT Command line for job management operations Job Description Language (JDL) to specify job characteristics and requirements RB (Resource Broker) – Catania Responsible to choose the best resources where to submit jobs based on the constraint specified in the JDL and characteristics and status of resources (published in the Grid Information Service and Replica Catalog)

1 st Release (what and who) JSS (Job Submission Service) – Padova Responsible for job management operations II (Information Index) – Milano First filter to the Grid Information Service LB (Logging & Bookkeeping) – CESNET State machine view of each job WP1 – WP2 interfaces - CNAF, PISA Packaging - CNAF, PISA Coordination (internal and with the other WPs) - F. Prelz, M. Sgaravatto

Other 2001 activities Grid Accounting – Torino Economy based model Implementation of a first prototype on- going Advance reservation and co-allocation - CNAF Globus GARA evaluation

Planning for 2002 Bug fixes, improvement of functionalities RB – Catania JSS – Padova II – Milano Support for interactive jobs RB – Catania JSS - Padova Grid accounting - Torino Implementation of a prototype system and integration with the workload management system

Planning for 2002 Analysis of new and smarter scheduling strategies – Catania Integration of network information in the matchmaking process within RB – CNAF, Catania, Torino Advance reservation and co-allocation - CNAF Triggering of data transfers – Catania, Torino Add the ability to evaluate network throughput and decide on the convenience of transferring data to provide better scheduling options (this may involve some form of network bandwidth reservation)

Planning for 2002 Support for partitionable jobs Padova Job dependencies CNAF WP1 – WP2 interfaces Pisa Packaging of WP1 software, Participation to EDG-IT CNAF, Pisa

Resources for year 2002 Travel Travel in Italy: 104 K 8 WP1 2-day meetings (Milano) CT (2 people), CNAF (3 people), PD (4 people), PI (2 people), TO (4 people) Integration activities (3 weeks) CT (1 people), MI (1 people), CNAF (2 people), PD (1 people), PI (2 people), TO (2 people) TB INFN-GRID and coordination activities (20 days) MI (1 people), PD (1 people) Conferences and workshops (5 days) MI (1 people), PD (1 people), PI (1 people), TO (2 people)

Resources for year 2002 Travel abroad: 153 K 3 EDG workshops (Paris, Edinburgh, ??) CT (2 people), CNAF (3 people), MI (2 people), PD (4 people), PI (2 people), TO (4 people) GGF4 - Toronto (4 days) CT (1 people), CNAF (1 people), MI (1 people), PD (1 people), TO (1 people) GGF6 - USA (4 days) CT (1 people), CNAF (1 people), MI (1 people), PD (1 people), TO (1 people) SC2002 – USA (1 week) MI (1 people), PD (1 people) 7 PTB – CERN MI (1 people), PD (1 people) Coordination – CERN MI (1 people, 20 days), PD (1 people, 15 days) Collaboration with Globus and GGF developers on Information Services MI (1 people, 2 weeks) Collaboration with Globus and GGF developers on Scheduling CT (1 people, 2 weeks) Collaboration with Condor developers PD (1 people, 2 weeks), CNAF (1 people, 2 weeks) Releases - CERN CT (1 people, 5 weeks), PI (1 people, 5 weeks), CNAF (1 people, 7 weeks)