DataGrid Quality Assurance

Slides:



Advertisements
Similar presentations
Tony Doyle GridPP2 Proposal, BT Meeting, Imperial, 23 July 2003.
Advertisements

Andrew McNab - Manchester HEP - 22 April 2002 EU DataGrid Testbed EU DataGrid Software releases Testbed 1 Job Lifecycle Authorisation at your site More.
Introduction to Maven 2.0 An open source build tool for Enterprise Java projects Mahen Goonewardene.
Andrew McNab - Manchester HEP - 2 May 2002 Testbed and Authorisation EU DataGrid Testbed 1 Job Lifecycle Software releases Authorisation at your site Grid/Web.
Project Management Summary Castor Development Team Castor Readiness Review – June 2006 German Cancio, Giuseppe Lo Presti, Sebastien Ponce CERN / IT.
Enabling Access to Sound Archives through Integration, Enrichment and Retrieval WP1. Project Management.
Configuration Management Managing Change. Points to Ponder Which is more important?  stability  progress Why is change potentially dangerous?
Cracow Grid Workshop, November 5-6, 2001 Towards the CrossGrid Architecture Marian Bubak, Marek Garbacz, Maciej Malawski, and Katarzyna Zając.
27-29 September 2002CrossGrid Workshop LINZ1 USE CASES (Task 3.5 Test and Integration) Santiago González de la Hoz CrossGrid Workshop at Linz,
Task 3.5 Tests and Integration ( Wp3 kick-off meeting, Poznan, 29 th -30 th January 2002 Santiago González de la.
Automated Tests in NICOS Nightly Control System Alexander Undrus Brookhaven National Laboratory, Upton, NY Software testing is a difficult, time-consuming.
EC Review – 01/03/2002 – G. Zaquine – Quality Assurance – WP12 – CS-SI – n° 1 DataGrid Quality Assurance Gabriel Zaquine Quality Engineer - WP12 – CS-SI.
DataGrid is a project funded by the European Commission under contract IST rd EU Review – 19-20/02/2004 DataGrid Quality Assurance On behalf.
Software Configuration Management
Configuration Management Process and Environment MACS Review 1 February 5th, 2010 Roland Moser PR a-RMO, February 5 th, 2010 R. Moser 1 R. Gutleber.
Integration of DataGrid Software for Testbed 1 Goal: combine the DataGrid middleware and the Globus core services. Phases: Preparation for Integration.
S L H C – P P Management Tools Kick-off Meeting April 8 th, 2008 Mar CAPEANS CERN This project has received funding from the European.
EMI SA2: Quality Assurance (EMI-SA2 Work Package) Alberto Aimar (CERN) WP Leader.
EMI INFSO-RI EMI SA2 Report Quality Assurance Alberto Aimar (CERN) SA2 WP Leader.
EMI SA2: Quality Assurance (EMI-SA2 Work Package) Alberto Aimar (CERN) WP Leader.
EMI INFSO-RI SA2 - Quality Assurance Alberto Aimar (CERN) SA2 Leader EMI First EC Review 22 June 2011, Brussels.
Crossgrid kick-off meeting, Cracow, March 2002 Santiago González de la Hoz, IFIC1 Task 3.5 Test and Integration (
A DΙgital Library Infrastructure on Grid EΝabled Technology ETICS Usage in DILIGENT Pedro Andrade
Software Quality Assurance
SA1/SA2 meeting 28 November The status of EGEE project and next steps Bob Jones EGEE Technical Director EGEE is proposed as.
Gabriel Zaquine- Quality Group- 02/10/ n° 1 Quality Group activities QAG website:
DataGRID WPMM, Geneve, 17th June 2002 Testbed Software Test Group work status for 1.2 release Andrea Formica on behalf of Test Group.
JRA Execution Plan 13 January JRA1 Execution Plan Frédéric Hemmer EGEE Middleware Manager EGEE is proposed as a project funded by the European.
Preparation for Integration Organized access to the code WP6 infrastructure (MDS-2, RC, …) Input from WPs on requirements,... Acquire experience with Globus.
DataGRID PTB, Geneve, 10 April 2002 Testbed Software Test Plan Status Laurent Bobelin on behalf of Test Group.
EGEE-III INFSO-RI Enabling Grids for E-sciencE Presentation of templates and supporting documents Anna Cook EGEE-II / EGEE II Transition.
Confidential Continuous Integration Framework (CIF) 5/18/2004.
Management Tools K. Pommès. Management Tools - The Project Planning Design Purchasing Production Installation To follow the project through its phases.
JRA2: Quality Assurance Overview EGEE is proposed as a project funded by the European Union under contract IST JRA.
Software Release Procedure Session MANAGEMENT and FUTURE directions Form ongoing ‘empowered’ Technical Discussion Group (TDG) Any future project definitions(resources.
G.Govi CERN/IT-DB 1 September 26, 2003 POOL Integration, Testing and Release Procedure Integration  Packages structure  External dependencies  Configuration.
EMI INFSO-RI Software Quality Assurance in EMI Maria Alandes Pradillo (CERN) SA2.2 Task Leader.
EMI INFSO-RI EMI Quality Assurance Tools Lorenzo Dini (CERN) SA2.4 Task Leader.
Software Deployment & Release 26/03/2015 1EN-ICE.
T Iteration Demo Tikkaajat [PP] Iteration
D4Science and ETICS Building and Testing gCube and gCore Pedro Andrade CERN EGEE’08 Conference 25 September 2008 Istanbul (Turkey)
INFSO-RI Enabling Grids for E-sciencE Quality Assurance Gabriel Zaquine - JRA2 Activity Manager - CS SI EGEE Final EU Review
ATS code development workflow Group Name: TST WG Source: Mahdi Ben Alaya, TST WG vice chair, SENSINOV, Miguel.
ATS code development workflow Group Name: TST WG Source: Mahdi Ben Alaya, TST WG vice chair, SENSINOV, Meeting Date: TST #21 Document.
Summary of the EDG review Some info for the next future of the WP1 software Massimo Sgaravatto INFN Padova.
Induction: What is EGEE? –April 26-28, EGEE organisation and procedures John Murison, EGEE Training Team EGEE is funded by the European Union.
JRA1 Meeting – 09/02/ Software Configuration Management and Integration EGEE is proposed as a project funded by the European Union under contract.
EMI INFSO-RI SA2: Quality Assurance Status Report Alberto Aimar(SA2) SA2 Leader EMI First EC Review 22 June 2011, Brussels.
1 EGI-InSPIRE Project Management Catherine Gater CAO, EGI.eu EGI-InSPIRE EGI-InSPIRE RI www.egi.eu.
Maite Barroso – WP4 Workshop – 10/12/ n° 1 -WP4 Workshop- Developers’ Guide Maite Barroso 10/12/2002
Comments on SPI. General remarks Essentially all goals set out in the RTAG report have been achieved. However, the roles defined (Section 9) have not.
Testing and Release Procedures/Tools Cristina Aiftimiei (INFN-CNAF) Mario David (LIP)
Software Configuration Management (SCM)
Proposal Publications Policy Proposal
EGEE is a project funded by the European Union
Gavin McCance University of Glasgow GridPP2 Workshop, UCL
Software Configuration Management
EO Applications Parallel Session
EMI Project Processes and Tools
Ian Bird GDB Meeting CERN 9 September 2003
SPI Software Process & Infrastructure
StratusLab Project Status
Testbed Software Test Plan Status
Leanne Guy EGEE JRA1 Test Team Manager
Leigh Grundhoefer Indiana University
Ian Bird LCG Project - CERN HEPiX - FNAL 25-Oct-2002
Simplified Development Toolkit
ESS.VIP VALIDATION An ESS.VIP project for mutual benefits
Software Configuration Management
Presentation transcript:

DataGrid Quality Assurance Gabriel Zaquine Quality Engineer - WP12 – CS-SI Gabriel.Zaquine@cern.ch

Outline Quality objectives Quality deliverables & related deliverables Main Process description Project monitoring and reporting Document management and deliverables review procedure Software release procedure Configuration management, code repository, autobuild and bug tracking management Standards and tools Plan for the next year Summary Questions

Quality objectives (1/2) Merge Scientists from research environment with conventional industrial Quality Assurance activity. Provide Quality assurance taking in to account the main DataGrid project characteristics: Large software development (about 200 persons working on the project) Long life cycle development (36 months) Distributed development of software (21 partners) Large scale integration (several Testbed sites) Software portability (Linux, Solaris, …), ….

Quality objectives (2/2) Overall quality plan: Year 1 - Focus on: Quality of the deliverables Project monitoring and reporting Software infrastructure Year 2 - Focus on: Quality of the software production User support Software distribution and Testbed infrastructure Year 3 - Focus on: Global Quality of Services provided.

Quality deliverables & related deliverables Quality Plan (D12.1) Quality organisation - Project organisation - Risk management Document management - Document templates Software quality Assurance - Methods and tools used Configuration Management - Code repository, autobuild and bug tracking management Software Release Policy and Software release Plan (D12.3) Policy for iterative software releases including milestones, time-scales and supporting techniques and tools to be employed. Naming conventions (D12.2) Naming conventions, project directories organisation and comments conventions, that should be applied to all DataGrid middleware packages. The use of these conventions is strongly encouraged for Java, C++ and C. Configuration management and Build conventions (D6.2) Conventions for CVS module structure, naming and tagging, as well as package organization.

Main Process Description

Project Monitoring and reporting (1/3) Main project monitoring mechanisms: WP Managers weekly meeting (Weekly phone conference calls) Project Technical Board meeting ( every 2 months) Project Management Board meeting (every quarter) Quarterly and Annual Reports Agenda Achievements Status of milestones Deviations Issues, Risks Meetings/Conferences/Papers/Dissemination Resources

Project Monitoring and reporting (2/3) Quarterly/Annual reports & Cost Claims process Cost Claims (every year) Partners Quarter Consumed effort Q1, Q2, … WPs Validation and Generates Quarterly Report Generates WP annual Report Validation Project Office WP1 to 12 Prepares the Project Quarterly Report Global Prepares the Project Annual Report Validation PTB, PMB Validation Validation Validation EU

Project Monitoring and reporting (3/3) DataGrid website: Project management and technical part

Document Management EDMS: Cern Document Management Tool Document identification conventions Document Templates Deliverables review procedure Standardised document production tools: Word, Latex, pdf Standardised document management tool: EDMS

Deliverables Review Procedure Document Workflow followed within EDMS In Work Reviewed within the WP. Last version deadline is three weeks before the PTB. For each deliverable the PTB chairman appoints a moderator. The moderator finds three appropriate reviewers.Others WP Managers can send their comments to the moderator. Under Review Last version deadline is one week before the PTB. Under PTB Reviewed by PTB members and the internal independent reviewer. Approval Endorsed by PTB. Under PMB Approval PMB members have one week to send their comments. Endorsed by PMB. Under EU Approval EU Approved 01/03/2002

Software Release Procedure Plan Release feedback Coordination meeting Gather feedback on previous release Review plan for next release WP meeting WPs elaborate their specific work-plans for the next release. Software Release work-plan coordination Establishment of an overall plan for the next release. Sw development Performed by WPs in dispersed institutes and run unit tests Software integration Performed by WP6 on frozen sw Integration tests run Acceptance tests Performed by the validation team. Roll-out Present sw to application groups Deploy on testbed Coord. meeting WP meetings themed tech. meets Release Plan++ Component 1 . Component n WP1 WP3 WP7 Globus . . EDG release testbed 1: Dec 11 2001 ~100 participants Distributed EDG release Roll-out. meeting

Configuration Management, code repository, autobuild and bug tracking management Central repository DataGrid code is managed within a central repository. This repository consist of a CVS server for source code and a package repository to distribute the packaged code. The repository is hosted by WP6. Autobuild system Performs nightly rebuilds of the DataGrid code (based on build conventions D6.2) Reports on results on a web page API documentation is generated from source code and published on the website An autocheck procedure will perform basic functionality tests Bug reporting and tracking Centralised via Bugzilla

Standards and tools Documentation production: Ms Office, Latex, pdf Documentation Management: EDMS Code Management: CVS Build tools: autoconf, automake, ant Bug tracking: Bugzilla Auto-documentation tools: Javadoc, Doxygen Coding rules checking tool: Code Checker Testing: junit, cppunit

Plan for the next year Year 2: Focus on Quality of the software production, user support, software distribution and Testbed infrastructure Improve and extend the infrastructure and toolset to facilitated software development, integration and distribution: Automatic build, autocheck, result notification, test plan. Empower Iteam to control quality of contributed software and documentation. Refine requirements priorities and coverage tests plan.

Summary From the quality point of view, For the fist year, the quality focus was on: Quality of the deliverables Project monitoring and reporting Software infrastructure The second year will further incorporate the benefit of successive software releases as defined in the Software Release Policy document.