Software Summary Database Data Flow G4MICE Status & Plans Detector Reconstruction 1M.Ellis - CM24 - 3rd June 2009.

Slides:



Advertisements
Similar presentations
1Malcolm Ellis - Tracker Meeting - 18th May 2006 Reconstruction Plans  Staged process of building up Reconstruction over the rest of this year  Will.
Advertisements

MAUS Update Adam Dobbs, MICE Project Board, 16 th April 2015.
Grid and CDB Janusz Martyniak, Imperial College London MICE CM37 Analysis, Software and Reconstruction.
Batch Production and Monte Carlo + CDB work status Janusz Martyniak, Imperial College London MICE CM37 Analysis, Software and Reconstruction.
Tracker Software 1M.Ellis - CM23 - Harbin - 15th January 2009  Four key areas that currently need some work: u Digitisation u Decoding files u Unpacking.
Data Quality Assurance Linda R. Coney UCR CM26 Mar 25, 2010.
1Malcolm Ellis - Video Conference - 7th December 2006 Data Challenge Report  Disclaimer  Data Challenge definition(s)  Software status u G4MICE u GRID.
1 Configuration Database David Forrest University of Glasgow MICO Meeting 13/10/2008
Online Reconstruction Update Linda R. Coney UCR Mar 25, 2010.
1 Configuration Database Review David Forrest University of Glasgow RAL :: 1 st June 2009.
Computing Panel Discussion Continued Marco Apollonio, Linda Coney, Mike Courthold, Malcolm Ellis, Jean-Sebastien Graulich, Pierrick Hanlet, Henry Nebrensky.
Online Reconstruction Update Linda R. Coney UCR Dec 17, 2009.
Linda R. Coney – 24th April 2009 Online Reconstruction & a little about Online Monitoring Linda R. Coney 18 August, 2009.
1 Analysis code for KEK Test-Beam M. Ellis Daresbury Tracker Meeting 30 th August 2005.
Software Parallel Intro 1M.Ellis - CM23 - Harbin - 15th January 2009  Focus this CM continues to be on needs for analysis of data and use of G4MICE online.
1Malcolm Ellis - Software Meeting - 31st May 2006 Data Challenge Requirements  First list of requirements, based on Yagmur’s document: u
1 G4MICE Analysis of KEK Test Beam Aron Fish Malcolm Ellis CM15 10th June 2006.
1 G4MICE TOF Reconstruction & KEK Test Beam Analysis Update Aron Fish Tracker Phone Conference May 25, 2006.
Software Development, Programming, Testing & Implementation.
CM26 March 2010Jean-Sebastien GraulichSlide 1 Online Summary o The heplnw17 case o DAQ o CAM o Online Reconstruction o Data Base o Data Storage Jean-Sebastien.
Software Summary 1M.Ellis - CM23 - Harbin - 16th January 2009  Four very good presentations that produced a lot of useful discussion: u Online Reconstruction.
1M. Ellis - MICE Video Conference - 15th March 2007 Software Report  New G4MICE Users  TOF Simulation and Digitisation  SciFi Reconstruction  Tracker.
1M. Ellis - MICE CM th June 2007 Software Status Malcolm Ellis – MICE CM18 – 16 th June 2007.
HPS Online Software Discussion Jeremy McCormick, SLAC Status and Plans.
Software & Computing 1M.Ellis - CM th July 2010  Announcement  Software u Current Status u Open Issues u Roles u Next Steps  Computing u Status.
Offline Software Summary 1M.Ellis - CM25 - 6th November 2009  Release Schedule  Simulation and Analysis Update  Detector software: u CKOV u EMR u KL.
1Malcolm Ellis - CM th October 2006 Status of Data Challenge  Don’t Shoot the Messenger!  Data Challenge – explanation  Software Tools u Design.
Configuration Database MICE Collaboration Meeting 28, Sofia David Forrest University of Glasgow Antony Wilson Science and Technology Facilities Council.
1 Persistency – Update and Plans Malcolm Ellis Software Phone Meeting 25 th August 2005.
ATLAS and GridPP GridPP Collaboration Meeting, Edinburgh, 5 th November 2001 RWL Jones, Lancaster University.
Configuration Database Antony Wilson MICE CM February 2011 RAL 1.
LAV Software Status Emanuele Leonardi – Tommaso Spadaro Photon Veto WG meeting – 2015/03/24.
Software Status  Last Software Workshop u Held at Fermilab just before Christmas. u Completed reconstruction testing: s MICE trackers and KEK tracker.
1M. Ellis - MICE VC - 1st November 2007 Cosmic Ray Test Preparations  The cosmic ray test was initially planned to be held in R12, but this proved to.
1 Software for the KEK test Malcolm Ellis 13 th April 2005.
G4MICE Status and Plans 1M.Ellis - CM24 - RAL - 31st May 2009  Firstly, a correction to the agenda:  I failed to spot a mistake in the agenda that I.
Configuration Database David Forrest 15th January 2009 CM23, HIT, Harbin.
Online Reconstruction 1M.Ellis - CM th October 2008.
1 KEK test-beam software progress Malcolm Ellis MICE Video Conference 4 th May 2005.
MICE CM January 2009Jean-Sébastien GraulichSlide 1 Detector DAQ Issues o Achievements Since CM23 o Detector DAQ o Trigger o Online Software o Front End.
1M. Ellis - NFMCC - 31st January 2007 MICE Analysis.
Linda R. Coney – 5 November 2009 Online Reconstruction Linda R. Coney 5 November 2009.
MICE CM28 Oct 2010Jean-Sebastien GraulichSlide 1 Detector DAQ o Achievements Since CM27 o DAQ Upgrade o CAM/DAQ integration o Online Software o Trigger.
M. Ellis - MICE Video Conference - 30th August Software Report Recent progress:Recent progress: –Start of code to read DATE format (two parts) One.
This presentation shall describe; Work over the last 3 months Ongoing work Plans for the future CM 32.
G4MICE’s DataQualityCheck application G4MICE’s DataQualityCheck application: Preliminary thoughts Mark Rayner 23 rd February 2010.
Database David Forrest. What database? DBMS: PostgreSQL. Run on dedicated Database server at RAL Need to store information on conditions of detector as.
MICE CM39 St Catherine’s, Oxford, 26 June 2014 Paul Soler Instrumentation Global Commissioning Plan.
Tracker Cosmic Ray Test 2011 Linda R. Coney UC Riverside CM 29 - February 16, 2011.
Detector Summary Tracker. Well, as far as the tracker hardware is concerned, we are done. – Need to do the system test to make sure nothing has degraded.
1 Software Workshop Report Malcolm Ellis MICE Video Conference Wednesday 9 th November 2005.
Software Overview 1M. Ellis - CM21 - 7th June 2008  Simulation Status  Reconstruction Status  Unpacking Library  Tracker Data Format  Real Data (DATE)
1 Tracker Software Status M. Ellis MICE Collaboration Meeting 27 th June 2005.
1 Configuration Database David Forrest University of Glasgow RAL :: 31 May 2009.
Database Issues Peter Chochula 7 th DCS Workshop, June 16, 2003.
MICE Tracker Software A. Dobbs CM32 9 th Feb 2012.
Configuration Database David Forrest University of Glasgow.
Coney - CM36 - June Online Overview L. Coney – UCR MICE CM36 – June 2013.
MAUS Status A. Dobbs CM43 29 th October Contents MAUS Overview Infrastructure Geometry and CDB Detector Updates CKOV EMR KL TOF Tracker Global Tracking.
H2LC The Hitchhiker's guide to LSA Core Rule #1 Don’t panic.
MAUS Status and Plans Chris Rogers, ASTeC, Rutherford Appleton Laboratory.
Online – Data Storage and Processing
How to Contribute to System Testing and Extract Results
Offline Software A. Dobbs CM43 30th October 2015.
Database High-Level Overview
MICE Collaboration Meeting Saturday 22nd October 2005 Malcolm Ellis
Models vs Representations
Chris Rogers, ASTeC, Rutherford Appleton Laboratory
Chris Rogers, ASTeC, Rutherford Appleton Laboratory
Offline framework for conditions data
Presentation transcript:

Software Summary Database Data Flow G4MICE Status & Plans Detector Reconstruction 1M.Ellis - CM24 - 3rd June 2009

Database  Storage of the geometry is progressing well.  Numerous geometries have been stored to the DB and then retrieved.  Work is moving to calibrations and then cabling information now.  API exists now at RAL.  Discussion during the session concluded that the best solution is for the API to be on the MICE network (in the control room) and a process can run on heplnw17 to forward requests from outside of the lab.  This way a network failure will not prevent data taking. 2M.Ellis - CM24 - 3rd June 2009

API  Communication with the API is through the use of XML files.  G4MICE already has an application that takes the geometry and generates an XML file.  The API converts this to SQL (which decouples G4MICE, the DAQ, and other users from any changes to the DB including the technology in use).  Will soon write code to read an XML file into G4MICE to use a geometry retrieved from the DB.  Queries to the DB will be possible through a web interface and through a GUI in the control room. 3M.Ellis - CM24 - 3rd June 2009

Data Flow  Long discussion during the plenary presentation yesterday.  Key points: u Henry’s talk u MICE Notes 247 and 253: 4M.Ellis - CM24 - 3rd June 2009

We Need to Turn this: 5M.Ellis - CM24 - 3rd June 2009

Into This: 6M.Ellis - CM24 - 3rd June 2009

“Known Unknowns”  Meta-data: u First list of potential search terms. u What technology/DB to use?  LFC namespace: u Proposed at last CM. u Need to agree (or disagree!) to it now so that we can start registering data to the GRID.  MICE Data: u Volume u Lifetime u Access control  Proposed to arrange a 1 day workshop for interested / key people to settle these points. 7M.Ellis - CM24 - 3rd June 2009

G4MICE Status & Plans  G4MICE was released on the weekend.  It is the first release with the new compiler and external libraries: u gcc u GEANT4 9.1.p01 u CLHEP u ROOT u GSL 1.12 u Unpacking 2.0 u RecPack  It compiles without warnings on 32 bit and 64 bit machines and this will be enforced for all future releases. 8M.Ellis - CM24 - 3rd June 2009

Tests  We currently have: u Unit Tests: 81 u System Tests: 55 u Integration Tests: 0 (several written, but none yet added to testing script).  In total, the testing is currently checking over 13,000 simulated, digitised, reconstructed values or other output from various parts of G4MICE.  Still need Unit Tests for the RealData domain. Will work on these over the summer.  Need to add System/Integration tests for the common use cases.  Please let me know how YOU use G4MICE so I can add some tests to ensure that what you do continues to work the way you need it to. 9M.Ellis - CM24 - 3rd June 2009

Detector Reconstruction  Tracker reconstruction has been improved as a result of Aron’s analysis of the KEK data and the ongoing cosmic ray tests in lab 7.  Two areas to be improved before the next production release: u Remove hard coded tracker number in SciFiDigit class. u Fix automatic choice of PR algorithm based on the magnetic field in each tracker.  TOF reconstruction is well advanced (see reports on work by Mark, Yordan and Vassil).  CKOV reconstruction is also coming along nicely (David Adey and Vassil). 10M.Ellis - CM24 - 3rd June 2009

Next Steps  Add tests for the FileSplitter and FileMerger Applications.  Ensure all Recon Unit tests are working correctly and increase the scope to cover cosmic ray as well as MICE physics cases.  Generate release with all of the above for installation on the GRID.  In parallel with the above: u Produce a 64-bit version of the compiler and external libraries for installation on 64 bit machines. u Produce a Mac version of G4MICE (growing demand). 11M.Ellis - CM24 - 3rd June 2009

Concerns  As mentioned at a past VC, I am still concerned about the lack of direction given to those working on the code for the PID detectors.  Both Mark and Yordan have been working on the TOF, and I fear this has resulted in wasted/duplicated effort.  There would appear to be a similar potential in the CKOV with Vassil and David.  I would hate to think that important tasks (e.g. implementing the actual MICE hall geometry in the software) is suffering due to lack of mouse-power while effective mice are duplicating the work of others. 12M.Ellis - CM24 - 3rd June 2009

Activities that need an Owner  There are a number of key areas for which someone needs to take “ownership”: u MICE hall geometry (I am starting on this with Ash Jamdagni and the help of people at RAL, but this will not move very quickly). u Production – this was discussed during Henry’s talk yesterday, someone (or a group) needs to take charge of the eventual offline reconstruction of our data (we already have lots to practice on!). u PID related software – unlike the tracker group, there still does not appear to be any clear leadership for the other detectors (with the possible exception of the EMR). 13M.Ellis - CM24 - 3rd June 2009

Any Volunteers? 14M.Ellis - CM24 - 3rd June 2009