A. Gheata, ALICE offline week March 09 Status of the analysis framework.

Slides:



Advertisements
Similar presentations
5/2/  Online  Offline 5/2/20072  Online  Raw data : within the DAQ monitoring framework  Reconstructed data : with the HLT monitoring framework.
Advertisements

The LEGO Train Framework
CSE 4939 Alex Riordan Brian Pruitt-Goddard Remote Unit Testing.
open access portal Mihaela Gheata ALICE offline week 19 Nov 2014.
Trains status&tests M. Gheata. Train types run centrally FILTERING – Default trains for p-p and Pb-Pb, data and MC (4) Special configuration need to be.
ALICE Operations short summary and directions in 2012 Grid Deployment Board March 21, 2011.
ALICE Operations short summary LHCC Referees meeting June 12, 2012.
ALICE Operations short summary and directions in 2012 WLCG workshop May 19-20, 2012.
Staging to CAF + User groups + fairshare Jan Fiete Grosse-Oetringhaus, CERN PH/ALICE Offline week,
The ALICE Analysis Framework A.Gheata for ALICE Offline Collaboration 11/3/2008 ACAT'081A.Gheata – ALICE Analysis Framework.
Workload Management WP Status and next steps Massimo Sgaravatto INFN Padova.
1 / 22 AliRoot and AliEn Build Integration and Testing System.
QUALITY ASSURANCE PRACTICES. Quality Plan Prepared and approved at the beginning of project Soft filing system approach followed. Filing location – –
Analysis infrastructure/framework A collection of questions, observations, suggestions concerning analysis infrastructure and framework Compiled by Marco.
Status of JCORRAN analysis train R.Diaz D.Kim 1. Analysis Module “AliJCORRANTask” 2 Name : AliJCORRANTask 1. Inherited from AliAnalysisTaskSE Inputs :
INFSO-RI Enabling Grids for E-sciencE SCDB C. Loomis / Michel Jouvin (LAL-Orsay) Quattor Tutorial LCG T2 Workshop June 16, 2006.
DPDs and Trigger Plans for Derived Physics Data Follow up and trigger specific issues Ricardo Gonçalo and Fabrizio Salvatore RHUL.
DQM status report Y. Foka (GSI) Offline week from pp to PbPb.
Infrastructure for QA and automatic trending F. Bellini, M. Germain ALICE Offline Week, 19 th November 2014.
EGEE is a project funded by the European Union under contract IST Tools survey status, first experiences with the prototype Diana Bosio EGEE.
PWG3 Analysis: status, experience, requests Andrea Dainese on behalf of PWG3 ALICE Offline Week, CERN, Andrea Dainese 1.
Andrei Gheata, Mihaela Gheata, Andreas Morsch ALICE offline week, 5-9 July 2010.
Analysis trains – Status & experience from operation Mihaela Gheata.
5/2/  Online  Offline 5/2/20072  Online  Raw data : within the DAQ monitoring framework  Reconstructed data : with the HLT monitoring framework.
Planning and status of the Full Dress Rehearsal Latchezar Betev ALICE Offline week, Oct.12, 2007.
ALICE analysis framework References for Analysis Tools used to the ALICE simulated data.
1 Andrea Sciabà CERN Critical Services and Monitoring - CMS Andrea Sciabà WLCG Service Reliability Workshop 26 – 30 November, 2007.
AliRoot survey P.Hristov 11/06/2013. Offline framework  AliRoot in development since 1998  Directly based on ROOT  Used since the detector TDR’s for.
CERN – Alice Offline – Thu, 20 Mar 2008 – Marco MEONI - 1 Status of Cosmic Reconstruction Offline weekly meeting.
PROOF and ALICE Analysis Facilities Arsen Hayrapetyan Yerevan Physics Institute, CERN.
1 Outline: Update on muon/dimuon AOD production (R. Arnaldi/E. Scomparin) Other ongoing activities: MUON correction framework (X. Lopez) MUON productions.
PWG-CF Jan Fiete Grosse-Oetringhaus Analysis Session Offline Week March 2012.
Separate distribution of the analysis code (and more) P. Hristov 19/03/2014.
Experiment Support CERN IT Department CH-1211 Geneva 23 Switzerland t DBES Andrea Sciabà Hammercloud and Nagios Dan Van Der Ster Nicolò Magini.
LCG AA Meeting 31 October 2007 The new dynamically and extensively customizable ROOT browser Bertrand Bellenot.
Slide 1 Running NEMO at ECMWF Slide 1 NEMO under Perforce at ECMWF Kristian S. Mogensen Last revised:
AliRoot survey: Analysis P.Hristov 11/06/2013. Are you involved in analysis activities?(85.1% Yes, 14.9% No) 2 Involved since 4.5±2.4 years Dedicated.
Gustavo Conesa ALICE offline week Gamma and Jet correlations analysis framework Short description, Status, HOW TO use and TO DO list 1/9.
1 Offline Week, October 28 th 2009 PWG3-Muon: Analysis Status From ESD to AOD:  inclusion of MC branch in the AOD  standard AOD creation for PDC09 files.
S.Linev: Go4 - J.Adamczewski, H.G.Essel, S.Linev ROOT 2005 New development in Go4.
Data processing Offline review Feb 2, Productions, tools and results Three basic types of processing RAW MC Trains/AODs I will go through these.
M. Gheata ALICE offline week, October Current train wagons GroupAOD producersWork on ESD input Work on AOD input PWG PWG31 (vertexing)2 (+
PWG3 Analysis: status, experience, requests Andrea Dainese on behalf of PWG3 ALICE Offline Week, CERN, Andrea Dainese 1.
PWG3 analysis (barrel)
Physics selection: online changes & QA M Floris, JF Grosse-Oetringhaus Weekly offline meeting 30/01/
Predrag Buncic (CERN/PH-SFT) Software Packaging: Can Virtualization help?
Analysis train M.Gheata ALICE offline week, 17 March '09.
M. Gheata ALICE offline week, 24 June  A new analysis train macro was designed for production  /ANALYSIS/macros/AnalysisTrainNew.C /ANALYSIS/macros/AnalysisTrainNew.C.
V5-01-Release & v5-02-Release Peter Hristov 20/02/2012.
Offline Weekly Meeting, 24th April 2009 C. Cheshkov & C. Zampolli.
AliRoot Classes for access to Calibration and Alignment objects Magali Gruwé CERN PH/AIP ALICE Offline Meeting February 17 th 2005 To be presented to detector.
Analysis framework plans A.Gheata Offline week 13 July 2011.
Some topics for discussion 31/03/2016 P. Hristov 1.
CCR e INFN-GRID Workshop, Palau, Andrea Dainese 1 L’analisi per l’esperimento ALICE Andrea Dainese INFN Padova Una persona attiva come utente.
AAF tips and tricks Arsen Hayrapetyan Yerevan Physics Institute, Armenia.
ANALYSIS TRAIN ON THE GRID Mihaela Gheata. AOD production train ◦ AOD production will be organized in a ‘train’ of tasks ◦ To maximize efficiency of full.
V4-18-Release P. Hristov 21/06/2010.
Jan Fiete Grosse-Oetringhaus
Data Formats and Impact on Federated Access
Analysis trains – Status & experience from operation
PWG2 Analysis status Adam Kisiel, CERN for the PWG2 group.
Latest WMS news and more
ALICE analysis preservation
v4-18-Release: really the last revision!
Analysis Trains - Reloaded
Savannah to Jira Migration
Storage elements discovery
Analysis framework - status
Building and Testing using Condor
Framework for the acceptance and efficiency corrections
Presentation transcript:

A. Gheata, ALICE offline week March 09 Status of the analysis framework

Framework classes - status No new important developments Few minor fixes Some additions to facilitate analysis in organized mode (access to containers) Possibility to use PAR files with the AliEn plugin After a long period of bug fixing (mainly in other parts of AliRoot) people literally jumped on the new production Quite random access mode Revealed some of the limitations of the systems

Framework classes – new features Ongoing work: Special container class for AOD. User tasks will be able to specify requested and published branches AOD + AOD friends produced in the same session Adjustable timeout when input files not available Logging of processed vs. requested files

Getting data type and common containers const char *AliVEventHandler::GetDataType() Returns “ESD” or “AOD”. To be used by task configuration macros (see talk of Mihaela) AliAnalysisManager::GetCommonInputContainer() Analysis task configuration macros should be separated from steering macros. They will create their own output data containers but just connect to existing common ones

Ongoing work towards organized analysis Problems: Analysis tasks develop fast, available latest release of AliRoot becomes old fast People forced to use PAR archives in grid -> jobs failing on regular basis. CAF is used to get fast feedback from a production, still some issues with the new proof version Analysis macros in SVN not synchronized with task code Hard to maintain a train macro with tasks compiled, configured and run in all possible ways

To do's - centrally Provide a 'make analysis' target that compiles base libraries used for analysis + PWG code Deploy regularly the modifications in the analysis code to be available with the latest release So people can rely on existing libraries to run their code Provide a train macro that connects the available wagons from PWG and runs regularly over the full available data Both in CAF for a fast sample and in GRID Provide a template for the macros that should attach users cars in the train (see next talk)

To do's : PWG groups Follow the provided templates and implements a macro per analysis task This macro will contain the desired task configuration and will attach the task to an existing analysis manager Preferably all macros kept in one directory in each PWGn Maintain the configuration macros in sync with the code If possible, provide a minimum set of QA histograms (max 4) to give a fast picture if the analysis succeeded

Conclusions A common effort is needed for setting up a uniform analysis task configuration approach To be able to efficiently process new data just after it becomes available We will discuss individually with all groups if needed to make this new setup work correctly in all modes Work already started with PWG2 and PWG4 The framework is quite stable now but do not hesitate to mention new requirements