Presentation is loading. Please wait.

Presentation is loading. Please wait.

Production client status

Similar presentations


Presentation on theme: "Production client status"— Presentation transcript:

1 Production client status
Job submission Production client Production worker scripts Status Andrei Tsaregorodtsev, CPPM, Marseille

2 Job submission schema Castor Storage CERN Job scripts Production
Data Production DB Bookkeeping DB Job scripts Production service <XML-RPC> Monitoring service Production center <XML-RPC> Castor Bookkeeping service Production client <XML-RPC> Bookkeeping XML files <BBFTP> Storage <BBFTP>

3 Client operations Check the availability of the CPU resources (queue);
Check …/job/ToDo directory for pending tasks: submit tasks formulated in the old production if any; Request job script(s) from the Production Server; Check for the necessary software, configuration files: install the lacking software if necessary; Submit the jobs obtained, report to the Production Server; Check …/bookkeeping/ToDo directory for bookkeeping update files: - update the bookkeeping database; - initiate bbftp transfer of data files to Castor; - accomplish the bookkeeping update if transfer successful

4 Job description (1) A *.csh file: Production and job identifiers
To be fixed ! setenv SUBMIT_DATE setenv SUBMIT_TIME 17:42 setenv PRODUCTION_IDENTIFIER setenv JOB_NAME # Parameters of step MinBias.Dec.2002 setenv MBIAS_QQ_USER_FILE None setenv MBIAS_EVTYPE 61 # ================================================================ # Parameters of step B2pipi.Dec.2002 setenv B2PIPI_QQ_USER_FILE B2pipi.dec setenv B2PIPI_EVTYPE Signal part description Signal part description

5 Applications and other packages versions
Job description (2) Applications and other packages versions # Parameters of work flow B2pipi.Dec.2002 setenv SIMULATION_APP SICBMC setenv SIMULATION_VSN v254r2 setenv RECONSTRUCTION_APP Brunel setenv RECONSTRUCTION_VSN v13r1 setenv DBASE_PKG dbase setenv DBASE_VSN v248r4 setenv XMLDDDB_PKG XmlDDDB setenv XMLDDDB_VSN v8r1 setenv QQ_USER_FILE ${MBIAS_QQ_USER_FILE},${B2PIPI_QQ_USER_FILE} setenv mcevtype ${MBIAS_EVTYPE},${B2PIPI_EVTYPE} setenv SPILLOVER on setenv mcmonihisto on # ( optional ) statistics, 500 by default setenv mcstat 500 # ( optional ) output file size, 1000 and 1000 by default setenv mcsize setenv dstsize 1000 # ================================================================ A list of different signal datasets to be produced with the same spill-over events Spill-over flag Monitoring histo flag Optional parameters

6 Production worker scripts
The job scripts are interpreted on a worker node by a set of production scripts: getting input data; invoking executables for each step; saving output datasets and log files; checking the log files; preparing bookkeeping update scripts; reporting job status to PVSS and “new” monitoring services; The current production scripts are used with the Production Client: Should we retain compatibility with the whole current production procedure or just the bookkeeping part ?

7 Client status Implemented in Python;
Code is functional, some parts to be added: Logging; Simple local production manager tool Tests are being done: New job script format; Compatibility with the old production schema; Proper packaging is to be done; Easy installation (rpm like) is to be done;


Download ppt "Production client status"

Similar presentations


Ads by Google