Off-line weekly meeting

Slides:



Advertisements
Similar presentations
DataTAG WP4 Meeting CNAF Jan 14, 2003 Interfacing AliEn and EDG 1/13 Stefano Bagnasco, INFN Torino Interfacing AliEn to EDG Stefano Bagnasco, INFN Torino.
Advertisements

© 2008 EBSCO Information Services SUSHI, COUNTER and ERM Systems An Update on Usage Standards Ressources électroniques dans les bibliothèques électroniques.
1 CHEP 2000, Roberto Barbera Tests of data management services in EDG 1.2 ALICE Off-line Week,
Calendar Browser is a groupware used for booking all kinds of resources within an organization. Calendar Browser is installed on a file server and in a.
Batch Production and Monte Carlo + CDB work status Janusz Martyniak, Imperial College London MICE CM37 Analysis, Software and Reconstruction.
Name Services Jessie Crane CPSC 550. History ARPAnet – experimental computer network (late 1960s) hosts.txt – a file that contained all the information.
Sara SartoliAkbar Siami Namin NSF-SFS workshop July 14-18, 2014.
FileSecure Implementation Training Patch Management Version 1.1.
V Avon High School Tech Crew Agenda Old Business –Delete Files New Business –Week 10 Topics: Coming up: –Yearbook Picture: Feb 7 12:20PM.
DONE-10: Adminserver Survival Tips Brian Bowman Product Manager, Data Management Group.
1M. Ellis - MICE Video Conference - 15th March 2007 Software Report  New G4MICE Users  TOF Simulation and Digitisation  SciFi Reconstruction  Tracker.
Let’s Make An Form! Bonney Armstrong GD 444 Westwood College February 9, 2005.
Alice off-line meeting Alberto Colla Cern, October 3, 2005 AliEn How-To Alice off-line meeting Cern, October 3, 2005 Alberto Colla (Alice off-line Calibration.
Guidelines for Homework 6. Getting Started Homework 6 requires that you complete Homework 5. –All of HW5 must run on the GridFarm. –HW6 may run elsewhere.
The gLite API – PART I Giuseppe LA ROCCA INFN Catania ACGRID-II School 2-14 November 2009 Kuala Lumpur - Malaysia.
Update on Database Issues Peter Chochula DCS Workshop, June 21, 2004 Colmar.
Wahid, Sam, Alastair. Now installed on production storage Edinburgh: srm.glite.ecdf.ed.ac.uk  Local and global redir work (port open) e.g. root://srm.glite.ecdf.ed.ac.uk//atlas/dq2/mc12_8TeV/NTUP_SMWZ/e1242_a159_a165_r3549_p1067/mc1.
A portal interface to my Grid workflow technology Stefan Rennick Egglestone University of Nottingham
Configuration Database David Forrest 15th January 2009 CM23, HIT, Harbin.
ALICE Condition DataBase Magali Gruwé CERN PH/AIP Alice Offline week May 31 st 2005.
Andrei Gheata, Mihaela Gheata, Andreas Morsch ALICE offline week, 5-9 July 2010.
Peter Chochula ALICE Offline Week, October 04,2005 External access to the ALICE DCS archives.
L0 DAQ S.Brisbane. ECS DAQ Basics The ECS is the top level under which sits the DCS and DAQ DCS must be in READY state before trying to use the DAQ system.
4 Oct 2005 / Offline week Shuttle program for gathering conditions data from external DB Boyko Yordanov 4 October 2005 ALICE Offline week.
G.Govi CERN/IT-DB 1 September 26, 2003 POOL Integration, Testing and Release Procedure Integration  Packages structure  External dependencies  Configuration.
Database authentication in CORAL and COOL Database authentication in CORAL and COOL Giacomo Govi Giacomo Govi CERN IT/PSS CERN IT/PSS On behalf of the.
JAliEn Java AliEn middleware A. Grigoras, C. Grigoras, M. Pedreira P Saiz, S. Schreiner ALICE Offline Week – June 2013.
+ AliEn site services and monitoring Miguel Martinez Pedreira.
Alberto Colla - CERN ALICE off-line week 1 Alberto Colla ALICE off-line week Cern, May 31, 2005 Table of contents: ● Summary of requirements ● Description.
Summary of User Requirements for Calibration and Alignment Database Magali Gruwé CERN PH/AIP ALICE Offline Week Alignment and Calibration Workshop February.
Program Libraries 1. What is a program library? A library is a collection of implementations of behavior, written in terms of a language, that has a well-defined.
Oracle Business Intelligence Foundation – Testing and Deploying OBI Repository.
Grid Deployment Board 5 December 2007 GSSD Status Report Flavia Donno CERN/IT-GD.
Site Authorization Service Local Resource Authorization Service (VOX Project) Vijay Sekhri Tanya Levshina Fermilab.
The Grid Storage System Deployment Working Group 6 th February 2007 Flavia Donno IT/GD, CERN.
Database Issues Peter Chochula 7 th DCS Workshop, June 16, 2003.
AliRoot Classes for access to Calibration and Alignment objects Magali Gruwé CERN PH/AIP ALICE Offline Meeting February 17 th 2005 To be presented to detector.
With OpenCDISC Validator 1. What is 2 OpenCDISC Validator Open source project Freely Available Commercial-quality Facilitate compliance with CDISC standards.
SAM Status Update Piotr Nyczyk LCG Management Board CERN, 5 June 2007.
THREATS, VULNERABILITIES IN ANDROID OS BY DNYANADA PRAMOD ARJUNWADKAR AJINKYA THORVE Guided by, Prof. Shambhu Upadhyay.
CACI Proprietary Information | Date 1 PD² v4.2 Increment 2 SR13 and FPDS Engine v3.5 Database Upgrade Name: Semarria Rosemond Title: Systems Analyst, Lead.
AAF tips and tricks Arsen Hayrapetyan Yerevan Physics Institute, Armenia.
Open Science Grid Configuring RSV OSG Resource & Service Validation Thomas Wang Grid Operations Center (OSG-GOC) Indiana University.
HOW TO DESKTOP USE by Mario C. Ponciano – a.k.a: Razec DBJMIN MULTI-DB Client (easy-to-use) (Step-by-Step) Jun/ v0.1.
L1Calo DBs: Status and Plans ● Overview of L1Calo databases ● Present status ● Plans Murrough Landon 20 November 2006.
1 Remote Installation Service Windows 2003 Server Prof. Abdul Hameed.
CS1010: Intro Workshop.
How to Contribute to System Testing and Extract Results
Database Replication and Monitoring
The New APEL Client Will Rogers, STFC.
z/Ware 2.0 Technical Overview
Demystifying SELinux: WTF is it saying?
News on the CDB Framework
The new AliRoot DB access classes
Savannah to Jira Migration
Online Software Status
NIGHTLY BUILD SCRIPT FOR THE LEVEL-1 TRIGGER ONLINE SOFTWARE
Quality Control in the dCache team.
Subversion.
Simulation use cases for T2 in ALICE
Maintaining software solutions
Analysis framework - status
Software Version System Part1: Subversion at CERN
Module 01 ETICS Overview ETICS Online Tutorials
Managing a Distributed Environment
Credential Management in HTCondor
Best Practices in Higher Education Student Data Warehousing Forum
Offline framework for conditions data
ASP.NET Core Middleware Fundamentals
Presentation transcript:

Off-line weekly meeting Progress with the DB access classes Summary: Changes/upgrades of the classes hunts for memory leaks correction of a few bugs first experience with Grid services Weekly meeting Alberto Colla Alberto Colla Off-line weekly meeting Cern, June 30, 2005

Off-line weekly meeting Reference documents Draft note on the condition DB access, distributed to the Off-line mailing list Talks by M. Gruwe and A. Colla at the last Alice off-line week (May 31th) Alberto Colla Off-line weekly meeting

Off-line weekly meeting DB access classes schema AliRunData DB object AliObjectMetaData AliRunDataStorage AliRunDataFile AliRunDataOganizedFile AliRunDataAlien Local file Local file in a defined folder structure AliEn file AliRunLoader (AliSelectionMetaData) User code GetRunObject Get/Put GetEntry/PutEntry Note: classes names are under discussion and are subject to change! Alberto Colla Off-line weekly meeting

Off-line weekly meeting Review of the DB access classes Following the many feedbacks received after the distribution of the note, we have reviewed the DB access classes Changes have applied on: the names of the DB classes their behaviour Alberto Colla Off-line weekly meeting

Off-line weekly meeting Renaming of the DB access classes First of all, we were asked to change the AliRunData prefix into AliCDB. Therefore: AliRunData  AliCDBEntry AliRunDataStorage  AliCDBStorage AliRunDataFile  AliCDBDump AliRunDataOrganizedFile  AliCDBLocal AliRunDataAlien  AliCDBGrid Alberto Colla Off-line weekly meeting

Off-line weekly meeting DB access classes schema (New) AliCDBEntry DB object AliObjectMetaData AliCDBStorage AliCDBDump AliCDBLocal AliCDBGrid Dump file Local file in a defined folder structure AliEn file AliRunLoader (AliSelectionMetaData) User code GetRunObject Get/Put GetEntry/PutEntry Alberto Colla Off-line weekly meeting

Off-line weekly meeting Changes in the classes’ behaviour In case of presence of more than 1 object valid for a given run and with the same version, f.e.: /DBFolder/ObjName/Run1-10_v0.root /DBFolder/ObjName/Run1-15_v0.root (Note: this can only happen if the file name is changed by hand!)  Before: warning message, the first object found was returned  Now: error message, no objects returned! In case the specified version of the object to be retrieved does not exist  Before: warning message, the closest preceding version was returned  Now: error message, no objects returned! Alberto Colla Off-line weekly meeting

Off-line weekly meeting Changes in the classes’ behaviour (2) During the storage of an object with the AliCDBLocal class the run validity and version of the object’s metadata is not reset (as it was before). If the file name is changed by hand so that the run validity and/or version do not match those in the object’s metadata a warning message is issued during retrieval. Alberto Colla Off-line weekly meeting

Off-line weekly meeting Hunt for memory leaks With the help of Paul Nilsson and of his SPD calibration objects I have checked the code against possible memory leaks during storage and retrieval of a large number of objects memory leaks in the DB access classes’ code were found and corrected a few bugs in the code were found in parallel and corrected After the corrections we have re-checked the code by storing and getting back thousands of SPD calibration objects, with no appreciable memory leaks Note: a SPD calibration object is a “AliITSBadChannelsSPD” container which contains a (TObj)Array of TObjArrays (one for each SPD module), in which the coordinates of the noisy channels of every SPD module are stored. Alberto Colla Off-line weekly meeting

Off-line weekly meeting Next release of the DB access classes Upgraded DB access classes have been sent to Peter in order to be included in the next release of AliRoot Alberto Colla Off-line weekly meeting

Off-line weekly meeting First experience with Grid services Reference documents: Talks by L. Betev and A. Peters at the last Alice off-line meeting (June 01st and 02nd) Alberto Colla Off-line weekly meeting

Off-line weekly meeting Installation of gShell and AliEn client CERN desktop (AFS): no need to install AliEn client, install gShell V1.0.3 After installation: laptop (no AFS): installation of AliEn client  I tried it, but I could not connect due to problems with my certificate transferral. Will check together with Latchezar… Alberto Colla Off-line weekly meeting

Off-line weekly meeting Installation of Root 5.0 + AliEn support AliEn support configuration requires loading of gShell environment, so that $GSHELL_ROOT is defined # cd $ROOTSYS # ./configure –enable-alien --with-alien-incdir=$GSHELL_ROOT/include --with-alien-libdir=$GSHELL_ROOT/lib/ # make Alberto Colla Off-line weekly meeting

Off-line weekly meeting Connecting to Grid from Root Alberto Colla Off-line weekly meeting

“alien://aliendb4.cern.ch:9000”, “colla” Connecting to Grid from Root (2) url user “alien://aliendb4.cern.ch:9000”, “colla” grid host port When TGrid::Connect is called: the library $ROOTSYS/lib/libRAliEn.so is loaded via TPluginManager class The constructor of TAlien class is invoked Inside TAlien constructor the “new” class $GSHELL_ROOT/include/gliteUI.h is instantiated ($GSHELL_ROOT must be defined!) GLiteUI::Connect(fHost, fPort, fUser) is called Alberto Colla Off-line weekly meeting

Off-line weekly meeting Copying files to Grid to copy a local file to Grid (and vice versa): # cp file:<localPath>/filename filename@ALICE::CERN::Server Grid storage elements at Cern: ALICE::CERN::Server ALICE::CERN::se01 ALICE::CERN::Castor ALICE::CERN::SOFTWARE list of files from Grid: ls file: or ls alien: will redirect to local or Grid paths respectively.  Unfortunately things stop working last week, after a new development of the interface (A. Peters told me). Experts are working... Alberto Colla Off-line weekly meeting

Off-line weekly meeting Next steps As soon as AliEn services are fully operational again: Begin implementation of the DB access classes to Grid (AliCDBGrid) Begin the implementation of the access classes “manager” (in order to handle the storage and retrieval from different sources)  A summer student, Boyko Yordanov, just joined the group and will work on the access classes interface. Thanks and welcome! Alberto Colla Off-line weekly meeting