6th Feb 2003SCT DAQ analysis development 1 SCT analysis framework Work by:Alan Barr, Matt Palmer, Dave Robinson Almost all slides originally produced by.

Slides:



Advertisements
Similar presentations
GNAM and OHP: Monitoring Tools for the ATLAS Experiment at LHC GNAM and OHP: Monitoring Tools for the ATLAS Experiment at LHC M. Della Pietra, P. Adragna,
Advertisements

Web Applications Development Using Coldbox Platform Eddie Johnston.
June 19, 2002 A Software Skeleton for the Full Front-End Crate Test at BNL Goal: to provide a working data acquisition (DAQ) system for the coming full.
Blueprint RTAGs1 Coherent Software Framework a Proposal LCG meeting CERN- 11 June Ren é Brun ftp://root.cern.ch/root/blueprint.ppt.
© 2007 IBM Corporation IBM Emerging Technologies Enabling an Accessible Web 2.0 Becky Gibson Web Accessibility Architect.
Browsers and Servers CGI Processing Model ( Common Gateway Interface ) © Norman White, 2013.
April 2006Jean-Sébastien GraulichSlide 1 DAQ Status o Goal for BTF o Status o First results o To be done.
Barrel Module Database - Status Status of upload utilities Review of uploading SCTDAQ info Flagging Hybrid re-work Module Quality uploads Module Signoff.
Usage of the Python Programming Language in the CMS Experiment Rick Wilkinson (Caltech), Benedikt Hegner (CERN) On behalf of CMS Offline & Computing 1.
Overview We succeeded in using Slice Test DAQ code to take test beam data, combining chamber and trigger trackfinder data through an XDAQ Event Builder.
GLAST LAT ProjectNovember 18, 2004 I&T Two Tower IRR 1 GLAST Large Area Telescope: Integration and Test One and Two Tower Integration Readiness Review.
CFT Offline Monitoring Michael Friedman. Contents Procedure  About the executable  Notes on how to run Results  What output there is and how to access.
Data Acquisition Software Integration and ADC Characterisation Jack Hobbs 4 th August
Introducing Axis2 Eran Chinthaka. Agenda  Introduction and Motivation  The “big picture”  Key Features of Axis2 High Performance XML Processing Model.
Java Analysis Studio Status Update 12 May 2000 Altas Software Week Tony Johnson
Don Quijote Data Management for the ATLAS Automatic Production System Miguel Branco – CERN ATC
JAS3 + AIDA LC Simulations Workshop SLAC 19 th May 2003.
Nightly Releases and Testing Alexander Undrus Atlas SW week, May
Integration Broker at Cornell Kevin Leonard CIT/Integration and Delivery May 9, 2002.
David Adams ATLAS ATLAS Distributed Analysis David Adams BNL March 18, 2004 ATLAS Software Workshop Grid session.
Magnetic Field Measurement System as Part of a Software Family Jerzy M. Nogiec Joe DiMarco Fermilab.
Lecture 19 Web Application Frameworks Boriana Koleva Room: C54
Views The architecture was specifically changed to accommodate multiple views. The used of the QStackedWidget makes it easy to switch between the different.
Database Status and Progress Dave Robinson, SCT Week, September 2003 Overview New Developments - Metrology & Datasheet uploads/reporting - Module Quality.
UWG 2013 Meeting PO.DAAC Web Services Demo. What are PO.DAAC Web Services?
QCDGrid Progress James Perry, Andrew Jackson, Stephen Booth, Lorna Smith EPCC, The University Of Edinburgh.
Greg Sullivan University of Maryland Data Filtering and Software IceCube Collaboration Meeting Monday, March 21, 2005.
Ch 1. A Python Q&A Session Spring Why do people use Python? Software quality Developer productivity Program portability Support libraries Component.
Updating JUPITER framework using XML interface Kobe University Susumu Kishimoto.
Bookkeeping Tutorial. Bookkeeping & Monitoring Tutorial2 Bookkeeping content  Contains records of all “jobs” and all “files” that are created by production.
ALICE, ATLAS, CMS & LHCb joint workshop on
Framework for MDO Studies Amitay Isaacs Center for Aerospace System Design and Engineering IIT Bombay.
CMS pixel data quality monitoring Petra Merkel, Purdue University For the CMS Pixel DQM Group Vertex 2008, Sweden.
SiTRA test beams at CERN: infrastructure developments and results Annual EUDET meeting NIKHEF Alexandre CHARPY.
Multistep Runs with ROD Crate DAQ Murrough Landon, QMUL Outline: Overview Implementation Comparison with existing setup Readout Status ModuleServices API.
Update on IS performance issues Classes for storing and retrieving scan data from IS GUI updates –Scripting support –Histogramming Overview.
H.G.Essel: Go4 - J. Adamczewski, M. Al-Turany, D. Bertini, H.G.Essel, S.Linev CHEP 2003 GSI Online Offline Object Oriented Go4.
Paul Scherrer Institut 5232 Villigen PSI CHEP 2006 in Mumbay / / Matthias Schneebeli ROME CHEP 2006 Presented by Matthias Schneebeli a universally.
H.G.Essel: Go4 - J. Adamczewski, M. Al-Turany, D. Bertini, H.G.Essel, S.Linev ROOT 2002 GSI Online Offline Object Oriented Go4.
Ch 1. A Python Q&A Session. Why do people use Python? Software Quality Developer productivity Program portability Support Libraries Component integration.
© FPT SOFTWARE – TRAINING MATERIAL – Internal use 04e-BM/NS/HDCV/FSOFT v2/3 JSP Application Models.
Copyright © 2009 Pearson Education, Inc. Publishing as Pearson Addison-Wesley Chapter 4: Events Programming with Alice and Java First Edition by John Lewis.
Faculty Advisor – Dr. Suraj Kothari Client – Jon Mathews Team Members – Chaz Beck Marcus Rosenow Shaun Brockhoff Jason Lackore.
PPDG February 2002 Iosif Legrand Monitoring systems requirements, Prototype tools and integration with other services Iosif Legrand California Institute.
Bookkeeping Tutorial. 2 Bookkeeping content  Contains records of all “jobs” and all “files” that are produced by production jobs  Job:  In fact technically.
How to combine IRIS products Available APIs Examples of integrations Ole Andersen Senior Strategic Account Manager.
Online Monitoring System at KLOE Alessandra Doria INFN - Napoli for the KLOE collaboration CHEP 2000 Padova, 7-11 February 2000 NAPOLI.
Status & development of the software for CALICE-DAQ Tao Wu On behalf of UK Collaboration.
Peter W. PhillipsATLAS SCT Week, CERN, September/October 2002 Electrical Tests of SCT modules using RODs Peter W Phillips Rutherford Appleton Laboratory.
TDAQ Experience in the BNL Liquid Argon Calorimeter Test Facility Denis Oliveira Damazio (BNL), George Redlinger (BNL).
Quality assurance for TPC. Quality assurance ● Process: ● Detect the problems ● Define, what is the problem ● What do we expect? ● Defined in the TDR.
David Adams ATLAS ATLAS Distributed Analysis (ADA) David Adams BNL December 5, 2003 ATLAS software workshop CERN.
1 G4UIRoot Isidro González ALICE ROOT /10/2002.
Event Management. EMU Graham Heyes April Overview Background Requirements Solution Status.
Validation db status and plans (what happened since the Collaboration meeting) Hans Wenzel 10th Physics Lists and Validation Tools working group meeting.
David Adams ATLAS ADA: ATLAS Distributed Analysis David Adams BNL December 15, 2003 PPDG Collaboration Meeting LBL.
Ganga/Dirac Data Management meeting October 2003 Gennady Kuznetsov Production Manager Tools and Ganga (New Architecture)
Simulation Production System Science Advisory Committee Meeting UW-Madison March 1 st -2 nd 2007 Juan Carlos Díaz Vélez.
TRTViewer: the ATLAS TRT detector monitoring and diagnostics tool 4 th Workshop on Advanced Transition Radiation Detectors for Accelerator and Space Applications.
POOL Based CMS Framework Bill Tanenbaum US-CMS/Fermilab 04/June/2003.
7/8/2016 OAF Jean-Jacques Gras Stephen Jackson Blazej Kolad 1.
Go4 v2.2 Status & Overview CHEP 2003
Simulation Production System
CMS High Level Trigger Configuration Management
DAQ for ATLAS SCT macro-assembly
Copyright © 2011 Pearson Education, Inc. Publishing as Pearson Addison-Wesley Chapter 2 Database System Concepts and Architecture.
Star Online System Claude A. Pruneau, Mei-li Chen, Adam Kisiel, and Jeff Porter CHEP 2000, Padova, Italy.
WPS - your story so far Seems incredible complicated, already
Status and plans for bookkeeping system and production tools
Some thoughts on scripting languages
Presentation transcript:

6th Feb 2003SCT DAQ analysis development 1 SCT analysis framework Work by:Alan Barr, Matt Palmer, Dave Robinson Almost all slides originally produced by MP and DR!

SCT DAQ analysis development2 6th Feb 2003 User Interface IPC IS Fitting Service SCT API Java GUI scripting histograms (JAS) Information Service Working model for macro-assembly Analysis Service IS RODModule IS? Data Archival (or interactive ROOT) Using OH alone is too restrictive. Instead save/retrieve objects into IS, containing data and histograms etc.

SCT DAQ analysis development3 6th Feb 2003 User Interface IS Fitting Service SCT API Java GUI scripting histograms (JAS) Information Service Development at Cambridge Analysis Service IS RODModule Data Archival (or interactive ROOT) SCTDAQ Data IPC Uses SCTDAQ data from module production testing at Cambridge Cambridge Non-Cambridge

SCT DAQ analysis development4 6th Feb 2003 Information Service Objects RawRODData... 1 per module per scan 2 x 2D histo (scan data for each link) n x 1D histos (trigger histo, hardware flags etc) Scan type and parameters Module Configuration FittedRODData per module per scan RawRODData object name Fit Data RODAnalysis per module, and per analysis (eg 3ptGain, Noise etc) FittedRODData object names RawRODData object names Analysis Results and Histograms Easily modifiable in the short term

SCT DAQ analysis development5 6th Feb 2003 Dynamic status finding Scan object can search IS (and disk) to find data and dynamically determine its status. Higher level Test object contains links to one or more Scans, as well as analysis procedures. Callback functions alert services of new data.

SCT DAQ analysis development6 6th Feb 2003 Subscribes to the Information Service, responding to new raw data. Takes 1D event trigger and 2D ROD output histograms from RawRODData Outputs FittedRODData objects, containing strip, chip and link fits. These are republished to IS. Will soon add summary information histograms. Fitting Service IS

SCT DAQ analysis development7 6th Feb 2003 The Fitter Waits for new RawRODData on IS. Finds the ScanType, and hence choses an appropriate FitType (Gauss, Erf, etc.). Creates a new FittedRODData class, and a bunch of FitObjects. Finds the initial parameters in the same manner as SCTDAQ. Perfoms each of the fits, (channel, chip, link as appropriate), and publishes the results (including the FitStatus) to IS.

SCT DAQ analysis development8 6th Feb 2003 GUI + Scripting Scripting provided by IBM’s Bean Scripting Framework  Provides general interface to many scripting engines. Scripting engines are robust – two currently tested  BeanShell – Java syntax  JavaScript – same engine as in Mozilla  Many others possible – Python, Perl, etc  No dictionary generation required – direct access to all Java objects  Access can be controlled. Console requires some work to get to same functionality as CINT.  E.g. Tab completion – easy (ish) for Java objects, harder for local vars.  Robust handling of all keyboard input.

SCT DAQ analysis development9 6th Feb 2003 GUI Snapshots

SCT DAQ analysis development10 6th Feb 2003 Persistency Requirements:  Browsable  Searchable  Analysed by both man and machine.  Robust against changes in data types and structure Options:  ROOT tree or directory (initial system) Object-structured or flat? POOL?  IS-style XML  MySQL (or similar) database Not yet well defined!

SCT DAQ analysis development11 6th Feb 2003 Software documentation

SCT DAQ analysis development12 6th Feb 2003 The Future Short term  Define persistency mechanism  Integrate analysis work with real API  Initial measurements from analysis tool Medium term (~weeks)  Extend analysis tool to other tests with the aim of doing full characterisation.  Design a smart performance monitor.