SEAL Project Status SC2 Meeting 16th April 2003 P. Mato / CERN.

Slides:



Advertisements
Similar presentations
Iterative development and The Unified process
Advertisements

Release & Deployment ITIL Version 3
SPI Software Process & Infrastructure GRIDPP Collaboration Meeting - 3 June 2004 Jakub MOSCICKI
SEAL V1 Status 12 February 2003 P. Mato / CERN Shared Environment for Applications at LHC.
M. Gallas IT-API LCG SPI project: testing1 Software Testing Infrastructure status LCG Software Process & Infrastructure (CERN, 10/23/02)
Introduction to RUP Spring Sharif Univ. of Tech.2 Outlines What is RUP? RUP Phases –Inception –Elaboration –Construction –Transition.
SPI Software Process & Infrastructure EGEE France - 11 June 2004 Yannick Patois
TILC09, April 2009, Tsukuba P. Mato /CERN.  Former LHCb core software coordination ◦ Architect of the GAUDI framework  Applications Area manager.
M Gallas CERN EP-SFT LCG-SPI: SW-Testing1 LCG-SPI: SW-Testing LCG Applications Area GridPP 7 th Collaboration Meeting LCG/SPI LCG.
GLAST Science Support CenterAugust 9, 2004 Implementation of the Standard Analysis Environment (SAE) James Peachey (HEASARC/GLAST SSC—GSFC/L3)
K. Harrison CERN, 20th April 2004 AJDL interface and LCG submission - Overview of AJDL - Using AJDL from Python - LCG submission.
A. Aimar - EP/SFT LCG - Software Process & Infrastructure1 Software Process panel SPI GRIDPP 7 th Collaboration Meeting 30 June – 2 July 2003 A.Aimar -
SEAL Project Status and Plans LHCC Comprehensive Review of LCG-AA November 2003 P. Mato / CERN.
LC Software Workshop, May 2009, CERN P. Mato /CERN.
The LCG SPI project in LCG Phase II CHEP’06, Mumbai, India Feb. 14, 2006 Andreas Pfeiffer -- for the SPI team
DOSAR Workshop, Sao Paulo, Brazil, September 16-17, 2005 LCG Tier 2 and DOSAR Pat Skubic OU.
LCG Applications Area – Overview, Planning, Resources Torre Wenaus, BNL/CERN LCG Applications Area Manager LHCC Comprehensive Review.
SEAL: Core Libraries and Services Project CERN/IT After-C5 Meeting 6 June 2003 P. Mato / CERN.
ROOT Application Area Internal Review September 2006.
EGEE is a project funded by the European Union under contract IST JRA1-SA1 requirement gathering Maite Barroso JRA1 Integration and Testing.
LCG-SPI: SW-Testing LCG AppArea internal review (20/10/03)
SEAL Project Overview Lorenzo Moneta/ CERN-EP on behalf of the SEAL team ACAT03 IX International Workshop on Advanced Computing and Analysis Techniques.
20/09/2006LCG AA 2006 Review1 Committee feedback to SPI.
LCG Generator Meeting, December 11 th 2003 Introduction to the LCG Generator Monthly Meeting.
SEAL: Common Core Libraries and Services for LHC Applications CHEP’03, March 24-28, 2003 La Jolla, California J. Generowicz/CERN, M. Marino/LBNL, P. Mato/CERN,
SEAL Core Libraries and Services CLHEP Workshop 28 January 2003 P. Mato / CERN Shared Environment for Applications at LHC.
SEAL Project Core Libraries and Services 18 December 2002 P. Mato / CERN Shared Environment for Applications at LHC.
GDB Meeting - 10 June 2003 ATLAS Offline Software David R. Quarrie Lawrence Berkeley National Laboratory
LCG Applications Area Overview Applications Area Internal Review 30 March – 1 April 2005 Pere Mato/CERN.
EGEE MiddlewareLCG Internal review18 November EGEE Middleware Activities Overview Frédéric Hemmer EGEE Middleware Manager EGEE is proposed as.
15 December 2015M. Lamanna “The ARDA project”1 The ARDA Project (meeting with the LCG referees) Massimo Lamanna CERN.
David Quarrie: ATLAS LCG Apps Area Feedback LCG Applications Area Internal Review – 30 March - 1 April ATLAS LCG Applications Area Feedback David.
SEAL Framework & Services LCG AA Internal Review 20 October, 2003 Radovan Chytracek / CERN on behalf of SEAL team.
The LHC Computing Grid Project (LCG) and ROOT Torre Wenaus, BNL/CERN LCG Applications Area Manager John Harvey, CERN EP/SFT Group Leader
Feedback from LHC Experiments on using CLHEP Lorenzo Moneta CLHEP workshop 28 January 2003.
Servicing HEP experiments with a complete set of ready integrated and configured common software components Stefan Roiser 1, Ana Gaspar 1, Yves Perrin.
SEAL and PI Project Status LHCC Comprehensive Review of LCG November 2004 P. Mato / CERN.
Software Engineering Overview DTI International Technology Service-Global Watch Mission “Mission to CERN in Distributed IT Applications” June 2004.
G.Govi CERN/IT-DB 1 September 26, 2003 POOL Integration, Testing and Release Procedure Integration  Packages structure  External dependencies  Configuration.
SEAL Project Overview LCG-AA Internal Review October 2003 P. Mato / CERN.
23/2/2000Status of GAUDI 1 P. Mato / CERN Computing meeting, LHCb Week 23 February 2000.
A. Aimar - EP/SFT LCG - Software Process & Infrastructure1 SPI Software Process & Infrastructure for LCG Project Overview LCG Application Area Internal.
K. Harrison CERN, 3rd March 2004 GANGA CONTRIBUTIONS TO ADA RELEASE IN MAY - Outline of Ganga project - Python support for AJDL - LCG analysis service.
LCG – AA review 1 Simulation LCG/AA review Sept 2006.
- LCG Blueprint (19dec02 - Caltech Pasadena, CA) LCG BluePrint: PI and SEAL Craig E. Tull Trillium Analysis Environment for the.
12 March, 2002 LCG Applications Area - Introduction slide 1 LCG Applications Session LCG Launch Workshop March 12, 2002 John Harvey, CERN LHCb Computing.
D. Duellmann - IT/DB LCG - POOL Project1 The LCG Dictionary and POOL Dirk Duellmann.
The SEAL Component Model Radovan Chytracek CERN IT/DB, LCG AA On behalf of LCG/SEAL team This work received support from Particle Physics and Astronomy.
1 Comments to SPI. 2 General remarks Impressed by progress since last review Widespread adoption by experiments and projects Savannah, ExtSoft Build system.
A. Aimar - EP/SFT LCG - Software Process & Infrastructure1 SPI Infrastructure for LCG Software Projects Status and work plan for H July 2003 A.Aimar.
LCG Applications Area Internal Review Response (preliminary and brief version) (main points are on last slide) Torre Wenaus, BNL/CERN LCG Applications.
News from EP SFT John Harvey FOCUS Meeting – October 3 rd 2003.
Follow-up to SFT Review (2009/2010) Priorities and Organization for 2011 and 2012.
Project Work Plan SEAL: Core Libraries and Services 7 January 2003 P. Mato / CERN Shared Environment for Applications at LHC.
Status of SEAL LCG Applications Area Meeting 22 July 2003 P. Mato / CERN Contents Overview Work Packages Status Summary.
SPI Software Process & Infrastructure Project Plan 2004 H1 LCG-PEB Meeting - 06 April 2004 Alberto AIMAR
JRA1 Meeting – 09/02/ Software Configuration Management and Integration EGEE is proposed as a project funded by the European Union under contract.
12 March, 2002 LCG Applications Area - Introduction slide 1 LCG Applications Session LCG Launch Workshop March 12, 2002 John Harvey, CERN LHCb Computing.
Applications Area Preparation of Phase II Planning Pere Mato 22 on March 2005.
Comments on SPI. General remarks Essentially all goals set out in the RTAG report have been achieved. However, the roles defined (Section 9) have not.
SPI Report for the LHCC Comprehensive Review Stefan Roiser for the SPI project.
SEAL: Common Core Libraries and Services for LHC Applications
SEAL Project Overview Lorenzo Moneta/ CERN-EP ACAT03
SEAL Project Status LCG Applications Area Internal Review
LCG Applications Area Milestones
SPI Software Process & Infrastructure
Dirk Düllmann CERN Openlab storage workshop 17th March 2003
User Feedback from SEAL
Simulation Framework Subproject cern
SEAL Project Core Libraries and Services
Presentation transcript:

SEAL Project Status SC2 Meeting 16th April 2003 P. Mato / CERN

16 April 2004SEAL Project StatusP. Mato/CERN2 Contents  Project Overview  Current Status  Work Plan  Resources  Summary

16 April 2004SEAL Project StatusP. Mato/CERN3 SEAL Overview  Goals –Provide the software infrastructure, basic frameworks, libraries and tools that are common among the LHC experiments –Select, integrate, develop and support foundation and utility class libraries –Develop a coherent set of basic framework services to facilitate the integration of LCG and non - LCG software  Scope –Foundation Class Libraries »Basic types (STL, Boost, CLHEP, …), utility libraries, system isolation libraries, domain specific foundation libraries –Mathematical Libraries –Basic Framework Services »Component model, reflection, plugin management, scripting services

16 April 2004SEAL Project StatusP. Mato/CERN4 SEAL Work Packages FoundationFoundation and Utility Libraries and Plug-in Manager MathLibsMath Libraries Support and Coordination DictionaryLCG Object Dictionary FrameworkComponent Model and Basic Framework services ScriptingScripting Services DocumentationEducation and Documentation

16 April 2004SEAL Project StatusP. Mato/CERN5 Scripting Dictionary Foundation MathLibs SealUtil Framework Packages and Dependencies (v1.3.4) rootboostzlibpcreuuidpythongccxml SealBase SealKernel SealServices PluginManager Reflection ReflectionBuilder SealZip SealIOTools SealSTL SealCLHEP SealROOT clhep PyLCGDict PyROOT Minuit PyBus

16 April 2004SEAL Project StatusP. Mato/CERN6 Release Road Map ReleaseDateStatusDescription (goals) V /02/03internal  Establish dependency between POOL and SEAL  Dictionary generation from header files V /03/03public  Essential functionality sufficient for the other existing LCG projects (POOL)  Foundation library, system abstraction, etc.  Plugin management V /05/03internal  Improve functionality required by POOL  Basic framework base classes V /07/03public  Essential functionality sufficient to be adopted by experiments  Collection of basic framework services  Scripting support V /09/03public  Corrections and improvements of Framework V /10/03public  Support for ICC and VC++ compilers V /11/03public  Improvements in Plugin Manager  Consolidation Dictionary and Minuit V /03/04public  Bug fixes V /04/04in preparation  Streamline external dependencies  Dictionary service  GSL test suit

16 April 2004SEAL Project StatusP. Mato/CERN7 SEAL Products and their Usage ATLASAliceCMSLHCbNon LHC Foundation SealBase+Util SealZip SealIOTools PluginManager Framework Component Model Basic Services Dictionary Reflection Lcgdict tool Specific Dictionaries Scripting PyROOT PyLCGDict PyBus MathLibsMinuit In use directlyIn use indirectlyPlanned use

16 April 2004SEAL Project StatusP. Mato/CERN8 Summary Status  SEAL is out since end March –Should be sufficient for the scheduled experiment data challenges  Supported Platforms –RH73 gcc3.2, Windows vc++7.1 –icc 8.0 is basically ready waiting for external packages for icc 8.0  SEAL has delivered a number components that constitutes the basic foundation and utility libraries and object dictionary –The main “client” has been POOL –Currently being integrated into experiments’ frameworks  Scripting based on Python –Boost.Python and PyLCGDict recommended to provide Python bindings

16 April 2004SEAL Project StatusP. Mato/CERN9 SEAL 2004 Work Plan  Draft document has been discussed with Experiments and in the Architects Forum, PEB –  This Work Plan is based on –Needs of the LHC experiments in the domain of core software foundation and basic services –The Blueprint RTAG recommendations –Recommendations of the LCG-AA Internal Review –Wishes from the line management to define a more coherent collaboration model with the ROOT project –Input from the different SEAL work packages

16 April 2004SEAL Project StatusP. Mato/CERN10 AA Review Recommendations  Foundation Libraries recommendations –Setup tutorials, user-guides and help developers  in the Plan –Remove unnecessary dependencies in external packages  in the Plan –Convergence between the SEAL and ROOT plug-in manager  not in the Plan  Math libraries recommendations –Concerns about the future of Minuit, GSL and CLHEP –Careful testing to guarantee reliable physics results  in the Plan –Provision of a coherent set of libraries including dictionaries  in the Plan  Dictionary recommendations –Concerns about the size of dictionaries  already done –Encourage unifying the dictionary with ROOT/CINT  in the Plan  Framework recommendations –Discussion with the experiments to evaluate interest in framework  in the Plan  Scripting recommendations: –Evaluate the interest in the interoperability between Boost and Swig before any work is committed  already done –Continue with the PyLCGDict automatic binding  in the Plan –Seek feedback from the experiment physics community in usability of python in interactive analysis  in the Plan

16 April 2004SEAL Project StatusP. Mato/CERN11 LCG/ROOT Collaboration Model  Clear recommendation from internal AA review and line management to define a more coherent collaboration model  Evolve the current user-provider relationship to a more coherent one  The goal is to establish a more peer-to-peer relationship –In some cases LCG uses ROOT (e.g. POOL, PyROOT, etc.) –In other cases ROOT uses LCG (e.g. New Dictionary, etc.)  Two areas have been identified as initial attempts for common LCG/ROOT developments –Dictionary –Mathematical Libraries

16 April 2004SEAL Project StatusP. Mato/CERN12 Dictionary Plans  The final GOAL is to have a “single” object dictionary shared between ROOT and LCG  Development done in collaboration with ROOT team –Iterate the current proposal until an agreement is reached  The steps are: –New Reflection API to overcome current limitations –Provide reference implementation of the agreed API as baseline. –Adapt code generation tools (gcc_xml based) to produce new dictionary descriptions. –Adapt existing ROOT meta-classes (TClass, TMethod,…) to the new common reflection API. –Develop an implementation using available CINT data structures with the goal to eliminate the need of having the LCG CINT gateway (POOL).

16 April 2004SEAL Project StatusP. Mato/CERN13 MathLibs Plans  The purpose is to provide a coherent Mathematical Library to the end-users –Coordinate the activities with ROOT, bringing the needs of LCG and ROOT together, trying to avoid maintenance and support of various mathematical libraries providing similar functionality –The goal is to share a common mathematical library between ROOT and the rest of LCG activities and experiments. ROOT should be able to build layered functionality based on this common library  A major requirement is to use the same basic Mathematical Library in all environments –Directly in C++ within the experiment reconstruction or simulation programs –During the analysis phase from an interactive environment, using either Python or ROOT/CINT

16 April 2004SEAL Project StatusP. Mato/CERN14 MathLibs: Work Items  MathLib Web Site –Inventory of most common Mathematical functions and algorithms used by the HEP community –High quality user documentation should be provided as Web pages describing the palette of functions and algorithms (FAQ, recommendations, references) –A cross reference table with links to and from CERNLIB list of routines  Evaluation of GSL –It is expected that the majority of needed mathematical functions is provided by GSL –To be re-assured of the quality of the library, we need to study its functionality, numerical stability, performance, accuracy, etc –The result of these studies will be a validation and a test suite complementing the one supplied with the GSL distribution

16 April 2004SEAL Project StatusP. Mato/CERN15 MathLibs: Work Items (continued)  C++ MathLib –Development of a common Mathematical Library –Provide a thin wrapper layer in C++ for the set of chosen functions and algorithms (GSL, CERNLIB, ROOT, CLHEP, etc.) –Develop a higher layer of C++ classes describing mathematical properties of functions and related algorithms, such as derivatives, integrals, function operation and compositions, etc… –Produce dictionaries using the LCG dictionary and CINT for allow interaction from Python and ROOT/CINT –Study possible solutions and establish a plan for new developments of a C++ linear algebra library

16 April 2004SEAL Project StatusP. Mato/CERN16 MathLib C++

16 April 2004SEAL Project StatusP. Mato/CERN17 MathLibs: Work Items (continued)  CLHEP –Continue to provide support for CLHEP (installation, consultancy, etc.) –Collect requirements from experiments and discuss them with CLHEP editors –Enhance and update existing tests and produce a validation and test suite  Fitting and Minimization –Complete the current development of the Minuit C++ library with full functionality (Simplex, Scan, Contours, etc…) –Produce complete Minuit documentation –Prototype of fitting and minimization framework using existing code –Integrate prototype in existing analysis tools and experiment frameworks

16 April 2004SEAL Project StatusP. Mato/CERN18 Required resources Foundation Lassi Tuura, Lorenzo Moneta, Massimo Marino, Radovan Chytracek MathLibs Lorenzo Moneta, Matthias Winkler, Marte Hatlo Dictionary Stefan Roiser, Pere Mato Framework Radovan Chytracek, Lassi Tuura, Pere Mato, Massimo Marino Scripting Jacek Generowicz, Pere Mato, Wim Lavrijsen, Massimo Marino Grid Documentation Jacek Generowicz Available people (~6 FTE) New resources could be made available (from CMS, LHCb, etc.) for the development of the new MathLib C++

16 April 2004SEAL Project StatusP. Mato/CERN19 Summary  Delivered a number of components that constitutes the basic foundation and utility libraries and object dictionary  Most of the delivered components are already in use or being tested and planned to be in use by LHC experiments  2004 Work Plan Document available at  The proposed Work Plan implements most of the internal review recommendations –Help experiments and end-users to integrate SEAL functionality –Develop a new collaboration model with ROOT project –Get feedback from the experiment physics community in usability of Python in interactive analysis