EGEE-II INFSO-RI-031688 Enabling Grids for E-sciencE www.eu-egee.org EGEE and gLite are registered trademarks SA3 partner collaboration tasks & process.

Slides:



Advertisements
Similar presentations
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks SA3 Partner Update: FOM Dennis van Dok Jan.
Advertisements

27-29 September 2002CrossGrid Workshop LINZ1 USE CASES (Task 3.5 Test and Integration) Santiago González de la Hoz CrossGrid Workshop at Linz,
Accounting Update Dave Kant Grid Deployment Board Nov 2007.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Supporting MPI applications on the EGEE Grid.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks gLite Release Process Maria Alandes Pradillo.
EMI SA2: Quality Assurance (EMI-SA2 Work Package) Alberto Aimar (CERN) WP Leader.
INFSO-RI Enabling Grids for E-sciencE SA1: Cookbook (DSA1.7) Ian Bird CERN 18 January 2006.
EGEE is a project funded by the European Union under contract IST Testing processes Leanne Guy Testing activity manager JRA1 All hands meeting,
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks C. Loomis (CNRS/LAL) M.-E. Bégin (SixSq.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks gLite IPv6 compliance project tests Further.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks PPS All sites Meeting: Introduction & Agenda.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Extensions to the ETICS Build System Client.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks GRNET SA3 Progress Report Ioannis Liabotis.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Oliver Keeble SA3 Activity Leader CERN EGEE-III.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Middleware Deployment and Support in EGEE.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks The Bazaar Vision Ideas of RC/VO coordination,
INFSO-RI Enabling Grids for E-sciencE SA1 and gLite: Test, Certification and Pre-production Nick Thackray SA1, CERN.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Next steps with EGEE EGEE training community.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Multi-level monitoring - an overview James.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks gLite Build Programme and Multi-Platform.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks CERN status report SA3 All Hands Meeting.
Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Usage of virtualization in gLite certification Andreas Unterkircher.
EGEE’06 Conference Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Testing gLite middleware: overview & status Andreas.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks IPv6 test methodology Mathieu Goutelle (CNRS.
INFSO-RI Enabling Grids for E-sciencE EGEE SA1 in EGEE-II – Overview Ian Bird IT Department CERN, Switzerland EGEE.
EGEE-III INFSO-RI Enabling Grids for E-sciencE Antonio Retico CERN, Geneva 19 Jan 2009 PPS in EGEEIII: Some Points.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks The GILDA t-Infrastructure Roberto Barbera.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE Site Architecture Resource Center Deployment Considerations MIMOS EGEE Tutorial.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks DSA1.4 – Objectives and Status Ioannis Liabotis.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks The future of the gLite release process Oliver.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Progress on first user scenarios Stephen.
Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Tools and techniques for managing virtual machine images Andreas.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Task tracking SA3 All Hands Meeting Prague.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks GLite testing status and future Gianni Pucciani.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Batch System Integration Update Jan Just.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Robin McConnell NA3 Activity Manager 28.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Update Authorization Service Christoph Witzig,
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Communication tools between Grid Virtual.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Progress report from University of Cyprus.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Grid Monitoring Tools E. Imamagic, SRCE CE.
EGEE-III INFSO-RI Enabling Grids for E-sciencE SA3 All Hands Meeting 'Cluster of Competence' Experience SA3 INFN Cyprus May 7th-8th.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Middleware Update Maria Alandes Pradillo.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks NA3 Activity – Training and Induction Robin.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Developing YAIM modules for Sun Grid Engine.
INFSO-RI Enabling Grids for E-sciencE gLite Certification and Deployment Process Markus Schulz, SA1, CERN EGEE 1 st EU Review 9-11/02/2005.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks gLite configuration (plans) Robert Harakaly.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Patch Preparation SA3 All Hands Meeting.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks MSA3.4.1 “The process document” Oliver Keeble.
INFSO-RI Enabling Grids for E-sciencE gLite Test and Certification Effort Nick Thackray CERN.
EGEE-II INFSO-RI Enabling Grids for E-sciencE SA3 Report Markus Schulz EGEE-II SA3 Activity Leader IT Department,
EGEE-II TCD 22 nd -25 th May 2007 Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Experiences with a distributed.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Status and outlook for testing in the LCG.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Imperial College SA3 Status David Colling.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Implementing product teams Oliver Keeble.
EGEE-III INFSO-RI Enabling Grids for E-sciencE JRA1 and SA3 All Hands Meeting December 2009, CERN, Geneva Product Teams –
INFSO-RI Enabling Grids for E-sciencE Software Process Author: Laurence Field (CERN) Presented by David Smith JRA1 All Hands meeting,
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks NA5: Policy and International Cooperation.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks ROC model assessment AP ROC ShuTing Liao.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGEE-II All Activity Meeting, Sofia
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks CYFRONET site report Marcin Radecki CYFRONET.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Towards an Information System Product Team.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks GOCDB4 Gilles Mathieu, RAL-STFC, UK An introduction.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks CREAM: current status and next steps EGEE-JRA1.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Argus gLite Authorization Service Workplan.
EGEE-II INFSO-RI Enabling Grids for E-sciencE SA3 Report Markus Schulz For EGEE-II SA3 IT Department, CERN Final EU.
Andreas Unterkircher CERN Grid Deployment
Partner Status HPCL-University of Cyprus
Testing for patch certification
Future Test Activities SA3 All Hands Meeting Dublin
Presentation transcript:

EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks SA3 partner collaboration tasks & process SA3 All Hands Meeting Dublin Andreas Unterkircher CERN Grid Deployment

Enabling Grids for E-sciencE Andreas Unterkircher Content 1.SA3 partner roles 2.SA3 collaboration process EGEE’07 2

Enabling Grids for E-sciencE Andreas Unterkircher Partner’s work areas YAIM certification Patch certification Contribution to the testbed Batch system support Test writing Testing Contribution to releases Porting (multi platform support) EGEE’07 3

Enabling Grids for E-sciencE Andreas Unterkircher YAIM certification Every partner can and (should) participate –updating services using a new version of YAIM This is very time critical (latency) –Must be done within a week because it blocks further steps Only documented testing is acceptable –Tests reports are the tangible results of this activity Information on YAIM (including instructions for certification): – EGEE’07 4

Enabling Grids for E-sciencE Andreas Unterkircher Patch certification Partner has/acquires expertise for certain service types and certifies patches concerning these services –Over time partners will broaden their “field of vision” Tracked in Savannah Response time: 1-3 weeks –depending on urgency of the patch Best being done on local machines using the certification testbed as an “environment” –Using virtual machine images might help Patch certification checklist available – EGEE’07 5

Enabling Grids for E-sciencE Andreas Unterkircher Batch system support Provide instructions on installation Provide rpms for jobmanagers and information system Test the batch system within gLite (accounting). Provide YAIM module for gLite specific configuration Information available – EGEE’07 6

Enabling Grids for E-sciencE Andreas Unterkircher Contribution to testbed Partner sets up a site (at least a CE and a WN) Site is being added to the certification testbed and regular tests are run We have to make sure we cover different deployment scenarios –Otherwise it is only a mirror of the central testbed ….. Test results available – EGEE’07 7

Enabling Grids for E-sciencE Andreas Unterkircher Test writing Test writing guidelines – elineshttps://twiki.cern.ch/twiki/bin/view/LCG/LCGgliteTestWritingGuid elines Tests are stored in CVS List of available tests – Here the focus is to get “deeper” tests –More complex use cases reflecting better use by VOs –More “stability” tests  Wrong input, operations on non existing entities  Checking return values and comparing them with actions Regression tests EGEE’07 8

Enabling Grids for E-sciencE Andreas Unterkircher Contribution to release Preparation for the release of a new service Define and test meta-rpm –Pre, pre deployment tests Write YAIM configuration –More and more moving to developers Write tests Verify documentation, complete documentation Test the service Release tracker: – EGEE’07 9

Enabling Grids for E-sciencE Andreas Unterkircher Testing The test results must be visible. Partners must provide a test report (TWiki page etc.). Otherwise testing is useless. Test results entry page – EGEE’07 10

Enabling Grids for E-sciencE Andreas Unterkircher Collaboration process EGEE’07 11 Assigning of individual tasks in Savannah Certification of patches in Savannah Daily SA3 progress page gives overview of tasks being done per partner Interaction with a subset of SA3 on very specific issues. Weekly SA3 phone conference (minutes are available) Monthly SA3 all hands meeting 4 times a year

Enabling Grids for E-sciencE Andreas Unterkircher Task tracking in Savannah EGEE’07 12

Enabling Grids for E-sciencE Andreas Unterkircher SA3 progress page EGEE’07 13

Enabling Grids for E-sciencE Andreas Unterkircher Meeting page EGEE’07 14

Enabling Grids for E-sciencE Andreas Unterkircher Experiences 1 Introduction of the task tracking system (beginning of 2007) significantly improved the output produced by the partners. Several partners participate in YAIM certification. This has been very useful. Patch certification by partners started (slowly). –12 patches certified, 1 in certification by TCD –5 patches certified, 2 in certiification: GRNET –4 patches certified: INFN –3 patches certified, 1 in certification: PIC –2 patches certified, 2 in certification: UCY –1 patch certified, 1 in certification: CISC –1 patch certified: IMPERIAL –1 patch in certification: CESGA Progress in supporting different batch systems. –Excellent progress: SGE (CESGA), Torque (GRNET), Condor (PIC) –No progress: LSF (we need to find a partner) Some new tests made it into SAM. –LB (UKHB), BLAH (INFN), AMGA (UCY), SRM2.2 (CERN), LFC API (CERN) EGEE’07 15

Enabling Grids for E-sciencE Andreas Unterkircher Experiences 2 Since Aug (when the first patch was certified by a partner) around 370 patches were treated, only 36 (~10%) were treated by partners. Delivering of tasks in time frequently is not achieved. –E.g.: RGMA security report by PSNC was 2 months late. Work done by partners sometimes is not visible. –No trace in task. –No webpage available. –E.g.: Imperial’s WMS test page contains only one entry which is 4 months old. Some people are only assigned to SA3 with a fraction of their work time. Steep learning curve for partners. EGEE’07 16

Enabling Grids for E-sciencE Andreas Unterkircher Improvements for next phase More detailed tracking of the tasks with weekly updates required. Timelines will be checked more rigorously. The outcome of any task must be visible (webpage, report, comments in task). Otherwise the task is considered as not delivered. Every partner selects one person that does the reporting and acts as the main contact. EGEE’07 17