1M. Ellis - MICE CM18 - 16th June 2007 Software Status Malcolm Ellis – MICE CM18 – 16 th June 2007.

Slides:



Advertisements
Similar presentations
1 Simulation Status/Plans Malcolm Ellis Sci Fi Tracker Meeting Imperial College, 10 th September 2004.
Advertisements

1Malcolm Ellis - Tracker Meeting - 18th May 2006 Reconstruction Plans  Staged process of building up Reconstruction over the rest of this year  Will.
MAUS Update Adam Dobbs, MICE Project Board, 16 th April 2015.
Software Summary Database Data Flow G4MICE Status & Plans Detector Reconstruction 1M.Ellis - CM24 - 3rd June 2009.
1 Scintillating Fibre Tracker Simulation Malcolm Ellis Imperial College London Tuesday 9 th March 2004.
First Results from Tracker 1  Cryostat Commissioning  AFE/VLSB Firmware and Readout  Cosmic Ray Setup  Tracker Readout  Software  Trigger Timing.
1 Sci Fi Simulation and Reconstruction Status M.Ellis/C.Rogers Wednesday 31 st March 2004.
Tracker Software 1M.Ellis - CM23 - Harbin - 15th January 2009  Four key areas that currently need some work: u Digitisation u Decoding files u Unpacking.
1 Scintillating Fibre Cosmic Ray Test Results Malcolm Ellis Imperial College London Monday 29 th March 2004.
Status of the MICE SciFi Simulation Edward McKigney Imperial College London.
1 VLPC system and Cosmic Ray test results M. Ellis Daresbury Tracker Meeting 30 th August 2005.
1Malcolm Ellis - Video Conference - 7th December 2006 Data Challenge Report  Disclaimer  Data Challenge definition(s)  Software status u G4MICE u GRID.
Sci Fi Simulation Status Malcolm Ellis MICE Meeting Osaka, 2 nd August 2004.
Online Reconstruction Update Linda R. Coney UCR Mar 25, 2010.
1 Online data quality and monitoring M. Ellis Daresbury DAQ Meeting 31 st August 2005.
Online Reconstruction Update Linda R. Coney UCR Dec 17, 2009.
March 31, Status of the TOF, Ckov and Virtual Detector Packages in G4Mice Steve Kahn Brookhaven National Laboratory Mice Collaboration Meeting March.
Linda R. Coney – 24th April 2009 Online Reconstruction & a little about Online Monitoring Linda R. Coney 18 August, 2009.
1 Analysis code for KEK Test-Beam M. Ellis Daresbury Tracker Meeting 30 th August 2005.
Software Parallel Intro 1M.Ellis - CM23 - Harbin - 15th January 2009  Focus this CM continues to be on needs for analysis of data and use of G4MICE online.
1Malcolm Ellis - Software Meeting - 31st May 2006 Data Challenge Requirements  First list of requirements, based on Yagmur’s document: u
1 G4MICE Analysis of KEK Test Beam Aron Fish Malcolm Ellis CM15 10th June 2006.
6 th April 2005 Malcolm Ellis, Imperial College London 1 Sci Fi Status & KEK Test.
1 G4MICE Malcolm Ellis SciFi Tracker Meeting, KEK Thursday 31st March 2005.
1Malcolm Ellis - Tracker Meeting - 6th November 2006 Tracker Software  Offline u Modeling u GRID u Tests u Decoding u Kalman fit u Reconstruction & “data.
1 G4MICE TOF Reconstruction & KEK Test Beam Analysis Update Aron Fish Tracker Phone Conference May 25, 2006.
Software Summary 1M.Ellis - CM23 - Harbin - 16th January 2009  Four very good presentations that produced a lot of useful discussion: u Online Reconstruction.
1M. Ellis - MICE Video Conference - 15th March 2007 Software Report  New G4MICE Users  TOF Simulation and Digitisation  SciFi Reconstruction  Tracker.
1 MICE Tracker Update M. Ellis UKNFIC Meeting 25 th August 2005.
1 G4MICE Design Iteration Malcolm Ellis MICE Video Conference 21 st April 2004.
Offline Software Summary 1M.Ellis - CM25 - 6th November 2009  Release Schedule  Simulation and Analysis Update  Detector software: u CKOV u EMR u KL.
1 Recon tests, Sci Fi status and Sci Fi design iteration Malcolm Ellis MICE Software Phone Meeting Wednesday 28 th April 2004.
1Malcolm Ellis - CM th October 2006 Status of Data Challenge  Don’t Shoot the Messenger!  Data Challenge – explanation  Software Tools u Design.
1 SciFi Results and Comparison Malcolm Ellis, for the MICE Scintillating Fibre Group Abingdon, 31 st October 2003.
1 Persistency – Update and Plans Malcolm Ellis Software Phone Meeting 25 th August 2005.
Sci-Fi Tracker: Progress Report Malcolm Ellis, MICE Video Conference Wednesday 6 th October 2004.
Software Status  Last Software Workshop u Held at Fermilab just before Christmas. u Completed reconstruction testing: s MICE trackers and KEK tracker.
1 Software for the KEK test Malcolm Ellis 13 th April 2005.
G4MICE Status and Plans 1M.Ellis - CM24 - RAL - 31st May 2009  Firstly, a correction to the agenda:  I failed to spot a mistake in the agenda that I.
Online Reconstruction 1M.Ellis - CM th October 2008.
1 KEK test-beam software progress Malcolm Ellis MICE Video Conference 4 th May 2005.
1M. Ellis - NFMCC - 31st January 2007 MICE Analysis.
1 A first look at the KEK tracker data with G4MICE Malcolm Ellis 2 nd December 2005.
Linda R. Coney – 5 November 2009 Online Reconstruction Linda R. Coney 5 November 2009.
M. Ellis - MICE Collaboration Meeting - Thursday 28th October Sci-Fi Tracker Performance Software Status –RF background simulation –Beam simulation.
1Malcolm Ellis - Software Meeting - 12th July 2006 Data Challenge Tasks  A set of web pages has been started to follow our progress and document the work:
M. Ellis - MICE Video Conference - 30th August Software Report Recent progress:Recent progress: –Start of code to read DATE format (two parts) One.
26 Oct 2010PC Physics Requirements of Software from Chris R ~19 Oct. My.
Database David Forrest. What database? DBMS: PostgreSQL. Run on dedicated Database server at RAL Need to store information on conditions of detector as.
MICE CM39 St Catherine’s, Oxford, 26 June 2014 Paul Soler Instrumentation Global Commissioning Plan.
Detector Summary Tracker. Well, as far as the tracker hardware is concerned, we are done. – Need to do the system test to make sure nothing has degraded.
1 Light Yield results from the KEK tracker test using G4MICE M. Ellis Tracker Phone Meeting 25 th January 2006.
1 Software Workshop Report Malcolm Ellis MICE Video Conference Wednesday 9 th November 2005.
Software Overview 1M. Ellis - CM21 - 7th June 2008  Simulation Status  Reconstruction Status  Unpacking Library  Tracker Data Format  Real Data (DATE)
1 Tracker Software Status M. Ellis MICE Collaboration Meeting 27 th June 2005.
1 Configuration Database David Forrest University of Glasgow RAL :: 31 May 2009.
1M. Ellis - MICE Tracker PC - 1st October 2007 Station QA Analysis (G4MICE)  Looking at the same data as Hideyuki, but using G4MICE.  Have not yet had.
MICE Tracker Software A. Dobbs CM32 9 th Feb 2012.
M. Ellis - MICE Collaboration Meeting - Wednesday 27th October Sci-Fi Tracker Performance Software Status –RF background simulation –Beam simulation.
Monte Carlo simulation of the particle identification (PID) system of the Muon Ionization Cooling Experiment (MICE) Mice is mainly an accelerator physics.
MAUS Status A. Dobbs CM43 29 th October Contents MAUS Overview Infrastructure Geometry and CDB Detector Updates CKOV EMR KL TOF Tracker Global Tracking.
Online – Data Storage and Processing
Requirements for the Software Group (and agreed actions)
MICE Computing and Software
Offline Software A. Dobbs CM43 30th October 2015.
Tracker Specific Software
MICE Collaboration Meeting Saturday 22nd October 2005 Malcolm Ellis
Chris Rogers, ASTeC, Rutherford Appleton Laboratory
Global PID MICE CM43 29/10/15 Celeste Pidcott University of Warwick
Tracker Software Status
Presentation transcript:

1M. Ellis - MICE CM th June 2007 Software Status Malcolm Ellis – MICE CM18 – 16 th June 2007

2M. Ellis - MICE CM th June 2007 Question from Alain’s Talk: “Goals of meeting -- status of software and analysis: are we ready to receive data? My pet questions: -- can we get “online” results ? How reliable can they be? “  Executive Summary of Answer: u No  “Yes Minister” Answer: u Yes and No

3M. Ellis - MICE CM th June 2007 Outline  Recent Progress and Current Status u Decoding (SciFi – Aron) u Simulation (CKOV – Yordan & Hideyuki) u Event Display (Michael) u Reconstruction (SciFi – Aron and Tamas) u Optics/Analysis (Chris) u G4MICE G4MANX u Tests  Urgent/Important work needed u GRID u PID Detector Code u Online Monitoring u Data Base  Short and Medium term plans u Complete reconstruction release u Focus on online/data taking needs u Software Workshops  Data Taking & Online Analysis – a preview  Conclusions

4M. Ellis - MICE CM th June 2007 Recent Progress  Similar report to past CMs: u Continue to make progress in all areas of interest. u Continue to be limited by very small number of effective FTEs.  Good news: u Several new people are making an increasing contribution: s Tamas Sashalmi (IC) s Yordan Karadzhov (Sofia) s Michael Wojcik (IIT) s Ben Freemire (IIT)  Bad news: u Still very few people in MICE who can use the software to perform routine simple tasks (e.g. produce a histogram in order to do a Monte Carlo study or calibrate a detector element). u While simple computing tasks are being done by developers, development of code is held up (and vice versa).

5M. Ellis - MICE CM th June 2007 SciFi Decoding  Ongoing saga that has been recently resolved for the current iteration of readout electronics and waveguides.  Aron has produced a number of decoding files for the various tests made of Station 5 and with assistance from Michael Wojcik has verified that it is correct.  N.B. u We also have decoding code and files for the KEK test beam for the TOF system used there but have no input from the other detector groups as to how their detectors will be read out, cabled, etc and hence no work has been done on the “decoding” of the other detectors!

6M. Ellis - MICE CM th June 2007 Simulation  CKOV and TOF Simulations have been improved by Yordan (continuing work started by Hideyuki).  The CKOV detector geometry looks reasonable and emphasis is now moving towards implementing a reasonable model of the transport and collection of the Cherenkov light by the PMTs.  Aim to simulate the test beam data that was used for selection of the aerogel in order to validate this aspect of the simulation.  TOF simulation already existed but has been improved by Yordan.  He has also checked and fixed the digitisation and reconstruction.  So once we can unpack the TOF data fully, it can be reconstructed.

7M. Ellis - MICE CM th June 2007 Event Display  HepRep based event display described in past CM talks.  Slowly adding information to the output, now focusing on reconstructed information (hits, clusters, slabs, points, tracks, etc).  Michael recently added visualisation of SciFiDoubletClusters (i.e. a fibre or pair of fibres in one plane of a SciFi tracking station).  Next step will be to visualise reconstructed tracks and fix known issue with visualisation of simulated particles.

8M. Ellis - MICE CM th June 2007 Station 5 Cosmic Ray Events

9M. Ellis - MICE CM th June 2007 SciFi Reconstruction  Migrated to new version of RecPack Kalman fitting package (used to use old version used in HARP, now changed to redesigned package that is undergoing development and which is supported).  Pattern Recognition written by Aron (described at last CM) provides a seed to the Kalman Fit.  One known problem (incorrect determination of the process noise Q matrix for the correct treatment of MCS) otherwise, new version works well.  Release of new track reconstruction was made at the end of the software workshop that finished on Tuesday. This is being used by Tamas to verify the baseline station spacing now.  Once MCS problem is fixed, will add field map use and will then be able to do global matching and return to work on PID.

10M. Ellis - MICE CM th June 2007 Track Fit

11M. Ellis - MICE CM th June 2007 Optics/Analysis/General Black Magic  Tests for BeamTools u Solenoid, Dipole, RFMap, PillBox, SolenoidMap  Simulation integration tests u Field placement, engineering model, phasing u Not yet automated  Partial implementation of sector dipoles for MANX  Beam generation algorithms u Amplitude momentum correlation, momentum dependent beta, fully automated linear matching  Optics upgrades u Second order transport u Third order transport (ongoing)

12M. Ellis - MICE CM th June 2007 G4MICE -> G4MANX  As described at past meetings, it is possible to describe quite complex geometries in G4MICE now without writing a single line of C++ code.  This has allowed some colleagues from the MANX experiment to develop a “configuration” which contains two standard MICE trackers but places the helical cooling channel and matching sections in the middle.  This is currently being used by them to understand and fix some problems in the matching section and prepare results for a proposal that is due soon.

13M. Ellis - MICE CM th June 2007 G4MANX

14M. Ellis - MICE CM th June 2007 Tests  MICETESTS area continues to grow and become a part of the MICE software team’s culture.  The SciFi Recon tests (space point, PR and Kalman fit) were a crucial part of the preparation of the latest release and will continue to serve to monitor future releases to ensure that the performance is not degraded.  Recent additions include a more detailed check of the material properties used throughout G4MICE (so allow us to see if there are any changes in properties when we change G4, for example).  Currently in the process of adding a geometry checker that validates all MICE models and ensures that there are no problems (e.g. a tracker station sticking outside of the solenoid volume).

15M. Ellis - MICE CM th June 2007 Urgent/Important Work  Efforts on the simulation and reconstruction are beginning to ramp down (at least for now).  With only a few important tasks left (and apparently little serious desire by the collaboration to use the tools...) the focus will now shift to the needs for data taking and analysis.

16M. Ellis - MICE CM th June 2007 GRID  Very little progress since last CM basically due to other calls on my time.  Lack of computing support at RAL for MICE continues to concern me (and I’m not just referring to the lack of network access during CMs!).  CSF at RAL still does not recognise the MICE VO (despite a request placed in February), nor do any of the RAL GRID machines support the MICE VO.  The list of institutes that support the MICE VO has not changed since CM17 (Sofia, QMUL, RHUL, Brunel and ScotGRID).  I’ve requested that Sheffield and Imperial provide resources for the MICE VO, but have not succeeded yet.

17M. Ellis - MICE CM th June 2007 PID Detector & Monitoring Code  Simulations of the PID detectors are making progress, however there has been no effort on the code required for decoding and analysing real data.  We also have no scheme for accessing or analysing the data that will presumably be recorded as part of the controls and monitoring system (see slides on DataBase later)  An opportunity to start this work was not taken up when the Frascati test beam data was analysed.  Assuming the code to unpack the data format produced by DATE exists (and it will), we still need code and data files for things such as: u Cabling (i.e. what electronic channel is connected to what physical part of a detector). u Calibration (e.g. pedestals, gains, t0s, etc). u Clusterisation, etc if required (e.g. flash ADC vs ADC + TDC).

18M. Ellis - MICE CM th June 2007 Online Monitoring  Recently had the opportunity to get help on the online monitoring from Akram Khan (Brunel).  He requested a ROOT file containing samples of the kind of histograms we might use for monitoring and offered to produce a GUI interface.  I was unable to do this for him (too busy with tracker hardware and other software tasks) and until recently was unable to find anyone else (other software people already overloaded and no-one else can do something like this).  Paul Kyberd has since taken up the challenge and during the collaboration meeting has produced a simulation and written a G4MICE application to produce a set of histograms for Akram.  I use this example to illustrate the problem that I fear we will soon face to a much greater extent.  Paul will soon circulate a questionnaire to the collaboration to try to work out in detail the parameters and plots that are needed.

19M. Ellis - MICE CM th June 2007 Data Base  Requested requirements from the experiment during/after CM17.  Received responses from: u Tracker group u CKOV (Lucien) u Target (Paul) u Analysis (John)  Decision has been taken to use PostgreSQL.  This decision will be documented as time allows.  Does this need to be checked/agreed on by CB, TB, EB, etc?

20M. Ellis - MICE CM th June 2007 Short and Medium Term Plans  Complete remaining simulation and reconstruction code development and testing (mostly tweaking a few details, ensuring adequate test coverage and double checking results of tests).  Write unpacking code to read the files produced by DATE.  Generate a reasonable set of monitoring histograms.  Start implementation of online DB.  Support detector commissioning.  Continue attempts to train new users of G4MICE.

21M. Ellis - MICE CM th June 2007 Software Workshops  Next workshop: 15 th – 17 th August at Fermilab.  Followed by:3 rd – 5 th October at RAL.  Current plans are not finalised for the next few, but looking at the following: u November(Brunel or RAL) u December(Fermilab) u January (RAL) u February(with CM20)  Increase in frequency is for two reasons: u Higher average productivity of the small software group when we can work together in a focused manner. u Continue to use workshops to train new users in the use of G4MICE. Hopefully as data appears more people will develop an interest in producing plots and doing an analysis of some description.

22M. Ellis - MICE CM th June 2007 Tracker in G4MICE  G4MICE has been used to analyse over 10 million events of tracker related data (test beam, cosmic ray, radioactive source and LED pulser).  Applications have been generated that perform tasks such as: u Histogramming physical quantities. u Reconstructing and visualising points and tracks in the prototype tracking stations u Performing fits for calibration. u Determining light yield, looking for dead channels, etc.  (Note this does not include the various Monte Carlo studies that have been performed or are ongoing).  While tasks such as emittance calculation have so far only been performed on simulated data, a reconstructed track produced by G4MICE can be used for emittance calculation in the same manner whether it was derived from simulated or real hits.

23M. Ellis - MICE CM th June 2007 Data Taking & Online Analysis  In order to (finally) answer Alain’s question, the next few slides will describe how the present state of the software could be used to analyse the MICE data.  Almost all of the tools required for an analysis of the MICE tracker(s) already exists in G4MICE. The rest of the experiment is not in such a healthy state.  Data is produced by the DAQ (DATE).  Code in the RealData area is used to generate VlpcHits.  Code in the Reconstruction area makes SciFiDigits from the VlpcHits. Does not exist now, but will do so soon (VLSB readout code -> DATE) Code already exists, just need new cabling file for final tracker √ Does not exist now, but will be written in parallel with DAQ debugging

24M. Ellis - MICE CM th June 2007 Data Taking & Analysis Example  Code in the Reconstruction area makes SciFiDoubletClusters  Code in the Reconstruction area makes SciFiSpacePoints  Code in the Reconstruction area makes SciFiKalTracks  User code extrapolates reconstructed tracks to required surfaces (e.g. TOF planes)  User code generates histograms of desired values  Calculate emittance of beam, SPE distributions, etc Code already exists, just need calibration files √ Code already exists, nominal geometry already known √ Code already exists, nothing further required √ Code already exists, can be used as an example for whatever is required √ Last 2 are not necessarily the job of a G4MICE developer!

25M. Ellis - MICE CM th June 2007 Examples

26M. Ellis - MICE CM th June 2007 Examples 2

27M. Ellis - MICE CM th June 2007 Examples 3

28M. Ellis - MICE CM th June 2007 Examples 4

29M. Ellis - MICE CM th June 2007 Conclusions  We continue to see a slow but steady increase in the number of people AND FTE available to G4MICE development.  We still lag behind where I would have liked to have been in terms of general MICE users of the software.  Focus is now turning towards the online needs for detector and beam line commissioning and analysis in the coming year.  We will be able to reconstruct the tracker when it is commissioned.  I’m hopeful that the TOF and CKOV will also be available, but that is not obvious at the moment.  I continue to encourage everyone to attend a workshop to learn how to use G4MICE (you don’t need to know C++, GEANT4, etc in order to make histograms).  I am also happy to travel (within other work constraints) to hold workshops, software tutorials, etc if invited, so let me know if you would like to organise something.