Olof Bärring – WP4 summary- 6/3/2002 - n° 1 Partner Logo WP4 report Status, issues and plans

Slides:



Advertisements
Similar presentations
TeraGrid Deployment Test of Grid Software JP Navarro TeraGrid Software Integration University of Chicago OGF 21 October 19, 2007.
Advertisements

GridPP7 – June 30 – July 2, 2003 – Fabric monitoring– n° 1 Fabric monitoring for LCG-1 in the CERN Computer Center Jan van Eldik CERN-IT/FIO/SM 7 th GridPP.
Fabric and Storage Management GridPP Fabric and Storage Management GridPP 24/24 May 2001.
Andrew McNab - Manchester HEP - 24 May 2001 WorkGroup H: Software Support Both middleware and application support Installation tools and expertise Communication.
Andrew McNab - Manchester HEP - 22 April 2002 EU DataGrid Testbed EU DataGrid Software releases Testbed 1 Job Lifecycle Authorisation at your site More.
Andrew McNab - Manchester HEP - 2 May 2002 Testbed and Authorisation EU DataGrid Testbed 1 Job Lifecycle Software releases Authorisation at your site Grid/Web.
19/06/2002WP4 Workshop - CERN WP4 - Monitoring Progress report
DataGrid is a project funded by the European Union CHEP 2003 – March 2003 – Towards automation of computing fabrics... – n° 1 Towards automation.
German Cancio – WP4 developments Partner Logo WP4-install plans WP6 meeting, Paris project conference
1 OBJECTIVES To generate a web-based system enables to assemble model configurations. to submit these configurations on different.
DataGrid is a project funded by the European Union 22 September 2003 – n° 1 EDG WP4 Fabric Management: Fabric Monitoring and Fault Tolerance
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
Cracow Grid Workshop, November 5-6, 2001 Towards the CrossGrid Architecture Marian Bubak, Marek Garbacz, Maciej Malawski, and Katarzyna Zając.
ASIS et le projet EU DataGrid (EDG) Germán Cancio IT/FIO.
27-29 September 2002CrossGrid Workshop LINZ1 USE CASES (Task 3.5 Test and Integration) Santiago González de la Hoz CrossGrid Workshop at Linz,
GridPP9 – 5 February 2004 – Data Management DataGrid is a project funded by the European Union GridPP is funded by PPARC WP2+5: Data and Storage Management.
WP4-install task report WP4 workshop Barcelona project conference 5/03 German Cancio.
Software Engineering 2003 Jyrki Nummenmaa 1 CASE Tools CASE = Computer-Aided Software Engineering A set of tools to (optimally) assist in each.
7/2/2003Supervision & Monitoring section1 Supervision & Monitoring Organization and work plan Olof Bärring.
Scalable Systems Software Center Resource Management and Accounting Working Group Face-to-Face Meeting June 13-14, 2002.
EDG WP4: installation task LSCCW/HEPiX hands-on, NIKHEF 5/03 German Cancio CERN IT/FIO
Crossgrid kick-off meeting, Cracow, March 2002 Santiago González de la Hoz, IFIC1 Task 3.5 Test and Integration (
QCDGrid Progress James Perry, Andrew Jackson, Stephen Booth, Lorna Smith EPCC, The University Of Edinburgh.
Grid Workload Management & Condor Massimo Sgaravatto INFN Padova.
Partner Logo DataGRID WP4 - Fabric Management Status HEPiX 2002, Catania / IT, , Jan Iven Role and.
GRID IIII D UK Particle Physics GridPP Collaboration meeting - R.P.Middleton (RAL/PPD) 23-25th May Grid Monitoring Services Robin Middleton RAL/PPD24-May-01.
Olof Bärring – WP4 summary- 4/9/ n° 1 Partner Logo WP4 report Plans for testbed 2
Security Area in GridPP2 4 Mar 2004 Security Area in GridPP2 “Proforma-2 posts” overview Deliverables – Local Access – Local Usage.
11 December 2000 Paolo Capiluppi - DataGrid Testbed Workshop CMS Applications Requirements DataGrid Testbed Workshop Milano, 11 December 2000 Paolo Capiluppi,
May PEM status report. O.Bärring 1 PEM status report Large-Scale Cluster Computing Workshop FNAL, May Olof Bärring, CERN.
Partner Logo German Cancio – WP4-install LCFG HOW-TO - n° 1 LCFGng configuration examples Updated 10/2002
LHCb planning for DataGRID testbed0 Eric van Herwijnen Thursday, 10 may 2001.
1 The new Fabric Management Tools in Production at CERN Thorsten Kleinwort for CERN IT/FIO HEPiX Autumn 2003 Triumf Vancouver Monday, October 20, 2003.
First attempt for validating/testing Testbed 1 Globus and middleware services WP6 Meeting, December 2001 Flavia Donno, Marco Serra for IT and WPs.
German Cancio – WP4 developments Partner Logo System Management: Node Configuration & Software Package Management
Deployment work at CERN: installation and configuration tasks WP4 workshop Barcelona project conference 5/03 German Cancio CERN IT/FIO.
20-May-2003HEPiX Amsterdam EDG Fabric Management on Solaris G. Cancio Melia, L. Cons, Ph. Defert, I. Reguero, J. Pelegrin, P. Poznanski, C. Ungil Presented.
German Cancio/ WP4 -1 WP4 comments for the TestBed German Cancio / WP4
Budapest, September 5th, 2002 DataGrid Accounting System DGAS Current status & plans Stefano Barale INFN Budapest, September.
G. Cancio, L. Cons, Ph. Defert - n°1 October 2002 Software Packages Management System for the EU DataGrid G. Cancio Melia, L. Cons, Ph. Defert. CERN/IT.
DataGRID WPMM, Geneve, 17th June 2002 Testbed Software Test Group work status for 1.2 release Andrea Formica on behalf of Test Group.
Maite Barroso – WP4 Barcelona – 13/05/ n° 1 -WP4 Barcelona- Closure Maite Barroso 13/05/2003
Lemon Monitoring Miroslav Siket, German Cancio, David Front, Maciej Stepniewski CERN-IT/FIO-FS LCG Operations Workshop Bologna, May 2005.
LCG EGEE is a project funded by the European Union under contract IST LCG PEB, 7 th June 2004 Prototype Middleware Status Update Frédéric Hemmer.
Installing, running, and maintaining large Linux Clusters at CERN Thorsten Kleinwort CERN-IT/FIO CHEP
May http://cern.ch/hep-proj-grid-fabric1 EU DataGrid WP4 Large-Scale Cluster Computing Workshop FNAL, May Olof Bärring, CERN.
DataGRID PTB, Geneve, 10 April 2002 Testbed Software Test Plan Status Laurent Bobelin on behalf of Test Group.
Olof Bärring – WP4 summary- 4/9/ n° 1 Partner Logo WP4 report Plans for testbed 2 [Including slides prepared by Lex Holt.]
German Cancio – WP4 developments Partner Logo WP4 / ATF ATF meeting, 9/4/2002
DGC Paris WP2 Summary of Discussions and Plans Peter Z. Kunszt And the WP2 team.
EU 2nd Year Review – Feb – WP4 demo – n° 1 WP4 demonstration Fabric Monitoring and Fault Tolerance Sylvain Chapeland Lord Hess.
Workforce Scheduling Release 5.0 for Windows Implementation Overview OWS Development Team.
Olof Bärring – EDG WP4 status&plans- 22/10/ n° 1 Partner Logo EDG WP4 (fabric mgmt): status&plans Large Cluster.
German Cancio – WP4 developments Partner Logo WP4-install progress CERN, 19/6/2002 for WP4-install.
Maite Barroso - 10/05/01 - n° 1 WP4 PM9 Deliverable Presentation: Interim Installation System Configuration Management Prototype
David Adams ATLAS ATLAS Distributed Analysis (ADA) David Adams BNL December 5, 2003 ATLAS software workshop CERN.
DataGrid is a project funded by the European Commission under contract IST EDG Baseline API Document Document build description and current.
Quattor tutorial Introduction German Cancio, Rafael Garcia, Cal Loomis.
Bob Jones – Project Architecture - 1 March n° 1 Project Architecture, Middleware and Delivery Schedule Bob Jones Technical Coordinator, WP12, CERN.
Maite Barroso – WP4 Workshop – 10/12/ n° 1 -WP4 Workshop- Update on Status of Fabric Global Schema Maite Barroso 10/12/2002
Partner Logo Olof Bärring, WP4 workshop 10/12/ n° 1 (My) Vision of where we are going WP4 workshop, 10/12/2002 Olof Bärring.
Monitoring and Information Services Core Infrastructure (MIS-CI) Service Description Mark L. Green OSG Integration Workshop at UC Feb 15-17, 2005.
14 June 2001LHCb workshop at Bologna1 LHCb and Datagrid - Status and Planning F Harris(Oxford)
J Jensen / WP5 /RAL UCL 4/5 March 2004 GridPP / DataGrid wrap-up Mass Storage Management J Jensen
WP4 meeting Heidelberg - Sept 26, 2003 Jan van Eldik - CERN IT/FIO
Monitoring and Fault Tolerance
WP4 Fabric Management 3rd EU Review Maite Barroso - CERN
WP4-install status update
Fabric and Storage Management
Towards automation of computing fabrics using tools from the fabric management workpackage of the EU DataGrid project Maite Barroso Lopez (WP4)
Presentation transcript:

Olof Bärring – WP4 summary- 6/3/ n° 1 Partner Logo WP4 report Status, issues and plans

Olof Bärring – WP4 summary- 6/3/ n° 2 Summary u Highlights from WP4 meeting 5/3/2002 u Update of release plan u Issues

Olof Bärring – WP4 summary- 6/3/ n° 3 Highlights from WP4 meeting 5/3/2002 u Presentations from three WP4 tasks n Configuration management task (Piotr Poznański) s Configuration High Level Definition (HLD) language s Current status and plans n Monitoring task (Sylvain Chapeland) s Status s interface definitions n Installation task (German Cancio) s Outcome from the WP4 installation workshop, February s Modified release plan u Release 1.1 integration (Maite Barroso) u Release 1.2 integration (Maite Barroso) u WP4 Architecture discussion and input to ATF meeting (German Cancio)

Olof Bärring – WP4 summary- 6/3/ n° 4 Configuration task (Piotr) u High Level Definition language n Language to describe, structure, and manipulate configuration of systems n This is what eventually will replace the LCFG templates (*.h files) n Status: s Language defined in an advanced proposal s Core part of the compiler implemented and working s Full compiler will be ready for end of April u Configuration data base (CDB) n The place where all configuration profiles, both high level and low (node) level, are stored n Expect a real data base for the longer term but…. s Not sure if there is enough available effort to deliver this for release 2  s Maybe just a CVS repository to guarantee the version control of the configuration templates u GUI in mind but not for release 2

Olof Bärring – WP4 summary- 6/3/ n° 5 Monitoring task (Sylvain) u A first fabric monitoring prototype was delivered for release 1.1 n The software was successfully integrated but not deployed to not disturb too much the preparation for the EU Review Demo n The deployed prototype only supports primitive interfaces s Sensor interface to the local monitoring agent is based on a ASCII protocol over UNIX pipes s Repository interface is not at all want we want n Implementation will change up to release 2 s Public and internal interfaces have been defined and will be deployed s A new reliable transport will replace the current UDP implementation s SNMP support s Monitoring repository: flat files  real database s Alarm display

Olof Bärring – WP4 summary- 6/3/ n° 6 Installation task (German) u In December 2001: the precise scope for the WP4 installation task cause “hot” discussions between three partners u A workshop was scheduled to resolve this issue n Input: list of about 50 issues with the interim installation system (LCFG) n Output: an agreed scope and objective up to release 2 and beyond u LCFG will be the basis for further developments u New development plan has two threads n R&D n Production (for production testbed)

Olof Bärring – WP4 summary- 6/3/ n° 7 Installation task (German) u R&D thread (don’t expect production quality for release 2): n Use standard tools where possible, e.g. Anaconda/KickStart for base installation. Automatic generation of KickStart files from WP4 configuration mgmt system n Service management: NetBSD, SysV; relationship with software distribution. Currently there is a split of software distribution and service management. Will write a document how this could be automated. n Integration with the CCM (Configuration Cache Manager) and the Node View Access API (NVA-API) from the configuration task

Olof Bärring – WP4 summary- 6/3/ n° 8 Installation task (German) u Production thread: n LCFG “light” (R1.2) n New LCFG release (R1.3) n Intrusion level library (R1.3) n Integration with the WP4 monitoring system (R1.3, alpha version exists) n Integration with the High Level Definition language (R1.4) u Precise delivery from both threads will be presented in a revised WP4 release plan, which will be delivered in the coming weeks

Olof Bärring – WP4 summary- 6/3/ n° 9 Update to the release plan u New plan from the installation task u Fault tolerance subsystem public interfaces R1.1  R1.3 u Stand alone WP4 gatekeeper R1.1  R1.2 u HLD definition for the configuration of the monitoring system R1.2  R1.3

Olof Bärring – WP4 summary- 6/3/ n° 10 Issues/discussion u WP4 configuration task efforts n Edinburgh University unfortunately had to reduce their contribution to the configuration task n However: PPARC provides new efforts (0.5FTE) from Liverpool u Ease to use of WP4 tools n Deployment of LCFG in an existing environment. “LCFG light” will help but WP4 will only provide best effort support. What’s the meaning of “testbed”? Is the place to fully deploy datagrid m/w or cherry-picking for forming a “grid site”? n Graphical publication of monitoring data (netsaint, PVSS, …) u Accounting: what’s the precise objective for DataGrid u Information publication: R-GMA when/where/how? u RH7.2: deployment and certification (both m/w and application) u Communication between WP4 components n Standardize on common RPC (SOAP, web services)