Presentation is loading. Please wait.

Presentation is loading. Please wait.

New zero suppression in simulation: current status David Adams BNL November 30, 2015 DUNE DAQ Updated: 13:20 EST.

Published byEleanor Berry Modified over 8 years ago

Similar presentations

Presentation on theme: "New zero suppression in simulation: current status David Adams BNL November 30, 2015 DUNE DAQ Updated: 13:20 EST."— Presentation transcript:

1 New zero suppression in simulation: current status David Adams BNL November 30, 2015 DUNE DAQ Updated: 13:20 EST

2 Introduction I have been working on zero suppression (ZS) Have simulation of the ZS planned for 35-ton running o See description of this and current simulation default at https://cdcvs.fnal.gov/redmine/projects/35ton/wiki/Data_compression_and_zero_suppression Working on new DetSim module that can use the new ZS sim o Will allow user to plug in different services for ZS – And for multi-channel ZS and compression o Also developing modules to reproduce current behavior For more info, see my talk at last meeting of this group o https://indico.fnal.gov/conferenceDisplay.py?confId=10857 https://indico.fnal.gov/conferenceDisplay.py?confId=10857 This talk is continuation of my last talk to the 35t sim/reco group https://indico.fnal.gov/conferenceDisplay.py?confId=10876 Much of it is duplicated here plus add plots for induction and higher noise with smaller signal D. Adams, BNL ZS simulation status DUNE DAQ November 30, 20152

3 New software New ZS and compression code is in the dunezs package https://github.com/dladams/dunezs Has three ZS services: legacy, 35t sim, no ZS One compression service: sets ADC to zero for suppressed channels Detsim module that uses above ZS and compression through service interfaces Need art_extensions (not art-extensions) to build this o https://github.com/dladams/art_extensions https://github.com/dladams/art_extensions Dunezs also has the param files to generate the samples used in the plots shown here o See test/SimWireDune/XXX.fcl – mu35told – Old simulation – mu35tnew – New simulation with new ZS – mu35tnzs – New simulation w/o ZS – mu35tnhinew – New simulation with high noise and corresponding ZS – mu35tnhinzs – New simulation with high noise and w/o ZS D. Adams, BNL ZS simulation status DUNE DAQ November 30, 20153

4 Legacy ZS I created a service to do “legacy” ZS https://github.com/dladams/dunezs/blob/master/DZSService/ZeroSuppress35tLegacyService.h I.e. to reproduce the ZS in the current version of dunetpc o That used for past (and upcoming) MCC Keep +/-TickRange ticks around any tick with |ADC| > AdcThreshold I reported slight discrepancies between new and old code last week I added option to not suppress a range < MinTickGap o This fixed some of the discrepancy But there are still differences o In a few cases I keep a tick that is suppressed by the old code o Often/always following double peak and range of constant ADC o Jonathon thinks this is likely a defect in the old code o Discrepancy is in 15/29M (0.00005%) of bins o Difference is in either ZS or compression code No plan to resolve remaining discrepancy D. Adams, BNL ZS simulation status DUNE DAQ November 30, 20154

5 New noise model Two weeks ago I showed the then-current noise model Significant correlations between neighboring ticks o I.e. low frequency (compared to 2MHz) noise RMS was 3.2 ADC counts Shortly after the meeting a new default was defined Higher frequency RMS = 2.5 ADC counts Parameters are in the next slide Last I heard, this is what we intend to use for the upcoming MCC o May also produce a 35t sample with twice the amplitude o I.e. RMS=5, close to present observation in 35t o Results for both low and high noise in this talk I used this to tune zero suppression and produce results shown here D. Adams, BNL ZS simulation status DUNE DAQ November 30, 20155

6 DetSim producer parameters daq: { CollectionCalibPed: 500 CollectionCalibPedRMS: 0.01 CollectionPed: 500 CollectionPedRMS: 0.01 CompressionType: "ZeroSuppression" DriftEModuleLabel: "largeant" FractHorizGapUCollect: 0.1 FractHorizGapUMiss: 0.8 FractHorizGapVCollect: 0.1 FractHorizGapVMiss: 0.8 FractHorizGapZMiss: 0.8 FractUUCollect: 0.5 FractUUMiss: 0.2 FractUVCollect: 0.1 FractUVMiss: 0.2 FractVUCollect: 0.5 FractVUMiss: 0.2 FractVVCollect: 0.1 FractVVMiss: 0.2 FractVertGapUCollect: 0.1 FractVertGapUMiss: 0.8 FractVertGapVCollect: 0.1 FractVertGapVMiss: 0.8 FractVertGapZMiss: 0.8 FractZUMiss: 0.2 FractZVMiss: 0.2 InductionCalibPed: 1800 InductionCalibPedRMS: 0.01 InductionPed: 1800 InductionPedRMS: 0.01 LowCutoffU: 7.5 LowCutoffV: 7.5 LowCutoffZ: 7.5 NearestNeighbor: 25 NeighboringChannels: 3 NoiseArrayPoints: 1000 NoiseFactU: 0.05 NoiseFactV: 0.05 NoiseFactZ: 0.05 NoiseModel: 1 NoiseWidthU: 2000 NoiseWidthV: 2000 NoiseWidthZ: 2000 PedestalOn: "false" SaveEmptyChannel: "true" SimCombs: "false" SimStuckBits: "false" StuckBitsOverflowProbHistoName: "pCorrFracOverflowVsInputLsbCell" StuckBitsProbabilitiesFname: "ADCStuckCodeProbabilities35t/output_produceDcScanSummar yPlots_20150827_coldTest_0p1to1p4_step0p0010.root" StuckBitsUnderflowProbHistoName: "pCorrFracUnderflowVsInputLsbCell" ZeroThreshold: 5 module_type: "SimWireDUNE” } D. Adams, BNL ZS simulation status DUNE DAQ November 30, 20156 ZS parameters taken from service

7 New noise Histograms show noise Top is noise histogram from DetSim module Bottom is part of ADC spectrum from one wire Comment Signal is evident on wire o Muon is horizontal, parallel to APA near center of TPC Noise has more higher frequency than earlier D. Adams, BNL ZS simulation status DUNE DAQ November 30, 20157

8 New zero suppression The new zero suppression is sim of that planned for online Description is at https://cdcvs.fnal.gov/redmine/projects/35ton/wiki/Data_compressio n_and_zero_suppression#35-ton-ZS-algorithm https://cdcvs.fnal.gov/redmine/projects/35ton/wiki/Data_compressio n_and_zero_suppression#35-ton-ZS-algorithm Has many parameters o Chosen values are listed below Main features Thresholds applied on RS (running sum) rather than individual ticks o RS is over NS ticks – Ticks with ADC <= TS are included with value zero – Stuck bit ticks are not included in sum or tick count – Threshold applied on RS = sum/(# included ticks) |RS| > TL defines the start of a block to be retained Preceding NL ticks are kept Ticks after start are retained through end of dead region plus NT ticks o Dead region is ND ticks with |RS| <= TD D. Adams, BNL ZS simulation status DUNE DAQ November 30, 20158

9 Zero suppression parameters The table below gives the parameter values used here D. Adams, BNL ZS simulation status DUNE DAQ November 30, 20159 NameValueMeaning NS5# of ticks in RS TS3Threshold for RS TL7Threshold to flag start of signal NL15# ticks retained before start of signal ND5# ticks to define dead region TD3-5Threshold for dead region NT3# ticks retained after dead region

10 Running sum: signed or unsigned I have assumed here that the RS (running sum) is a signed sum I.e. signed ADC for each tick is included in sum However, JJ informed me his initial design sums the absolute value of the ADC count for each tick o Motivation was to include contributions from both positive and negative lobes of the induction signal I think we will do better summing signed ADC counts Use a window whose width only covers one lobe Allow positive or negative sum to trigger collection o I.e. apply threshold to absolute value of signed sum o So we get two tries for induction signals This way the positive and negative noise ticks cancel See plot on following page I understand that JJ agrees and will change online algorithm. OK? Combine lobes to improve performance for induction Might later examine applying threshold to difference of RS’s offset expected distance between these D. Adams, BNL ZS simulation status DUNE DAQ November 30, 201510

11 Induction signal with high noise level D. Adams, BNL ZS simulation status DUNE DAQ November 30, 201511 TS = 6 TL = 10 NS = 5 35t induction signal for muon far from APA

12 Choosing the signal threshold (TL) I looked at one MC sample Single muons with p = 4 GeV (MIP) One APA plane shown here Results Following plots show the raw signals, RS and |RS| Suppress everything except around |RS| > TL TL = 7 keeps all signals and no BG See later discussion for high noise model D. Adams, BNL ZS simulation status DUNE DAQ November 30, 201512

13 Raw signal w/o ZS D. Adams, BNL ZS simulation status DUNE DAQ November 30, 201513

14 Running sum D. Adams, BNL ZS simulation status DUNE DAQ November 30, 201514 RS

15 |Running sum| D. Adams, BNL ZS simulation status DUNE DAQ November 30, 201515 RS

16 Defining dead region Dead region is specified by ND and TD Tick is dead if ND preceding channels have |RS| <= TD Following pages show plots of dead ticks o In practice, live (not dead) channels are plotted as black – White regions are dead o Live fraction away from the signal is shown with each plot o Results shown varying TD from 3 to 5 Results Region around signal is always live Retained dead region and tail look dead: mix of small negative and positive signals Live fraction is small in all cases D. Adams, BNL ZS simulation status DUNE DAQ November 30, 201516

17 Raw signal w/o ZS D. Adams, BNL ZS simulation status DUNE DAQ November 30, 201517

18 Live regions: TD = 3 D. Adams, BNL ZS simulation status DUNE DAQ November 30, 201518 1.8%

19 Live regions: TD = 3.5 D. Adams, BNL ZS simulation status DUNE DAQ November 30, 201519 0.8%

20 Live regions: TD = 4 D. Adams, BNL ZS simulation status DUNE DAQ November 30, 201520 0.2%

21 Live regions: TD = 5 D. Adams, BNL ZS simulation status DUNE DAQ November 30, 201521 0.04%

22 Zero suppression Following page shows application of 35t ZS I.e. the new simulation of the online algorithm Parameters are those listed earlier (and on the plot) Result The ZS is very effective: retains all signal and suppresses all BG About 40 ticks are retained in each channel Assuming 1 muon/4000 ticks (see my Nov 4 plots), this means we keep 1% of ticks. Caveats o Actual noise may be much worse o And vertical muons may deposit more energy o And induction planes have wider signals But we might be able to meet goal of 5% retention (X20 suppression) D. Adams, BNL ZS simulation status DUNE DAQ November 30, 201522

23 Collection signal w/o ZS D. Adams, BNL ZS simulation status DUNE DAQ November 30, 201523

24 Collection signal after ZS D. Adams, BNL ZS simulation status DUNE DAQ November 30, 201524 NS: 5 NL: 15 ND: 5 NT: 3 TS: 3 TL: 7 TD: 5

25 Collection signal after ZS (zoomed) D. Adams, BNL ZS simulation status DUNE DAQ November 30, 201525 NS: 5 NL: 15 ND: 5 NT: 3 TS: 3 TL: 7 TD: 5

26 Induction signal w/o ZS D. Adams, BNL ZS simulation status DUNE DAQ November 30, 201526

27 Induction signal after ZS D. Adams, BNL ZS simulation status DUNE DAQ November 30, 201527 NS: 5 NL: 15 ND: 5 NT: 3 TS: 3 TL: 7 TD: 5

28 Induction signal after ZS (zoomed) D. Adams, BNL ZS simulation status DUNE DAQ November 30, 201528 NS: 5 NL: 15 ND: 5 NT: 3 TS: 3 TL: 7 TD: 5

29 High noise Higher noise level has also been examined By doubling the noise amplitudes (NoiseFacXXX: 0.05 -> 0.10) And also look at muons far (215 cm) from the APA o Where the signal is weakest o Previous results were at the center of the TPC First tried doubling all the thresholds But observed some signals were lost o Typically one channel per APA plane D. Adams, BNL ZS simulation status DUNE DAQ November 30, 201529 NS: 5 NL: 15 ND: 5 NT: 3 TS: 6 TL: 10 TD: 10 So I lowered the signal threshold TL: 7  14  10 Scanning 5 events by eye, this looks pretty good Except a couple induction planes trigger on the negative signal o And so lose early part of signal

30 High-noise collection signal w/o ZS D. Adams, BNL ZS simulation status DUNE DAQ November 30, 201530

31 High-noise collection signal after ZS D. Adams, BNL ZS simulation status DUNE DAQ November 30, 201531 NS: 5 NL: 15 ND: 5 NT: 3 TS: 6 TL: 10 TD: 10

32 High-noise collection signal after ZS (zoomed) D. Adams, BNL ZS simulation status DUNE DAQ November 30, 201532 NS: 5 NL: 15 ND: 5 NT: 3 TS: 6 TL: 10 TD: 10

33 High-noise induction signal w/o ZS D. Adams, BNL ZS simulation status DUNE DAQ November 30, 201533

34 High-noise induction signal after ZS D. Adams, BNL ZS simulation status DUNE DAQ November 30, 201534 NS: 5 NL: 15 ND: 5 NT: 3 TS: 6 TL: 10 TD: 10

35 High-noise induction signal after ZS (zoomed) D. Adams, BNL ZS simulation status DUNE DAQ November 30, 201535 NS: 5 NL: 15 ND: 5 NT: 3 TS: 6 TL: 10 TD: 10

36 Leading edge boundary Dead zone appears effective Trailing boundary of signals is quiet: nice mix of positive and negative small signals Leading edge not quite as nice Some regions where the boundary is all positive o Radiation in direction of APA or just noise? o May want to have more signals on the leading side Should we also use dead zone to also define leading boundary? o JJ is looking at this D. Adams, BNL ZS simulation status DUNE DAQ November 30, 201536

37 Summary/conclusions I continue to develop ZS (and compression) code Changes at present in dunezs Plan to move some/all to dunetpc Interfaces for ZS and compression and SimWire module for these Implementations of legacy and 35t ZS Implementation of replacement and Huffman (TBA) compression All are implemented as art services Legacy ZS compared with old version Small discrepancy remains New noise parameterization has been introduced By Jonathon Proposed to use that for upcoming MCC. And maybe 2X that for high-noise 35t. 35t ZS Simulation code in place Results of first study reported o Single beam-directed mu at center of TPC, low noise o ZS is very effective (no BG, high signal efficiency) o Parameter set proposed Also took look at high noise and weaker signal with different ZS params Idea for improving algorithm: add dead zone on leading side I use sum over signed ADC. Is this what we want? D. Adams, BNL ZS simulation status DUNE DAQ November 30, 201537

Download ppt "New zero suppression in simulation: current status David Adams BNL November 30, 2015 DUNE DAQ Updated: 13:20 EST."

Similar presentations

Grey Level Enhancement Contrast stretching Linear mapping Non-linear mapping Efficient implementation of mapping algorithms Design of classes to support.

Grey Level Enhancement Contrast stretching Linear mapping Non-linear mapping Efficient implementation of mapping algorithms Design of classes to support.
Copyright 2010-2011 Kenneth M. Chipps Ph.D. www.chipps.com How to Use a Spectrum Analyzer Wi-Spy Version Last Update 2011.09.30 1.3.0 1.

Copyright Kenneth M. Chipps Ph.D. How to Use a Spectrum Analyzer Wi-Spy Version Last Update
Analysis of chip with 100 events, July 2001 Variation in pixel to pixel average ADC values (fixed pattern noise) Pixel ADC value event to event repeatability.

Analysis of chip with 100 events, July 2001 Variation in pixel to pixel average ADC values (fixed pattern noise) Pixel ADC value event to event repeatability.
Adding electronic noise and pedestals to the CALICE simulation LCWS 19 – 23 rd April 20041 Catherine Fry (working with D Bowerman) Imperial College London.

Adding electronic noise and pedestals to the CALICE simulation LCWS 19 – 23 rd April Catherine Fry (working with D Bowerman) Imperial College London.
LHC Collimation Working Group – 19 December 2011 Modeling and Simulation of Beam Losses during Collimator Alignment (Preliminary Work) G. Valentino With.

LHC Collimation Working Group – 19 December 2011 Modeling and Simulation of Beam Losses during Collimator Alignment (Preliminary Work) G. Valentino With.
1 Scintillating Fibre Cosmic Ray Test Results Malcolm Ellis Imperial College London Monday 29 th March 2004.

1 Scintillating Fibre Cosmic Ray Test Results Malcolm Ellis Imperial College London Monday 29 th March 2004.
CC analysis progress This talk: –A first attempt at calculating CC energy sensitivity using the Far Mock data MC files with full reconstruction. –Quite.

CC analysis progress This talk: –A first attempt at calculating CC energy sensitivity using the Far Mock data MC files with full reconstruction. –Quite.
Multimedia Data Introduction to Image Processing Dr Mike Spann Electronic, Electrical and Computer.

Multimedia Data Introduction to Image Processing Dr Mike Spann Electronic, Electrical and Computer.
Veto Wall Test Hyupwoo Lee MINERvA/Jupiter Group Meeting Oct, 3, 2007.

Veto Wall Test Hyupwoo Lee MINERvA/Jupiter Group Meeting Oct, 3, 2007.
1Calice-UK Cambridge 9/9/05D.R. Ward David Ward Compare Feb’05 DESY data with Geant4 and Geant3 Monte Carlos. Work in progress – no definitive conclusions.

1Calice-UK Cambridge 9/9/05D.R. Ward David Ward Compare Feb’05 DESY data with Geant4 and Geant3 Monte Carlos. Work in progress – no definitive conclusions.
SpillServer and FD neutrino events As part of my CC analysis studies, I have been attempting to isolate beam neutrino candidates in the FD using both scanning.

SpillServer and FD neutrino events As part of my CC analysis studies, I have been attempting to isolate beam neutrino candidates in the FD using both scanning.
Status of  b Scan Jianchun Wang Syracuse University Representing L b scanners CLEO Meeting 05/11/02.

Status of  b Scan Jianchun Wang Syracuse University Representing L b scanners CLEO Meeting 05/11/02.
A.Chekhtman1 GLAST LAT ProjectInstrument Analysis meeting, June, 24, 2005 CAL retriggering study with SLAC data. Alexandre Chekhtman NRL/GMU Gamma-ray.

A.Chekhtman1 GLAST LAT ProjectInstrument Analysis meeting, June, 24, 2005 CAL retriggering study with SLAC data. Alexandre Chekhtman NRL/GMU Gamma-ray.
Octal ASD Certification Tests at Michigan J. Chapman, Tiesheng Dai, & Tuan Bui August 30, 2002 - CERN.

Octal ASD Certification Tests at Michigan J. Chapman, Tiesheng Dai, & Tuan Bui August 30, CERN.
1 Calice Analysis Meeting 13/02/07David Ward Just a collection of thoughts to guide us in planning electron analysis In order to end up with a coherent.

1 Calice Analysis Meeting 13/02/07David Ward Just a collection of thoughts to guide us in planning electron analysis In order to end up with a coherent.
An offline look at TIF data David Stuart UC Santa Barbara May 2, 2007.

An offline look at TIF data David Stuart UC Santa Barbara May 2, 2007.
Database Applications – Microsoft Access Lesson 9 Designing Special Queries.

Database Applications – Microsoft Access Lesson 9 Designing Special Queries.
1 Alessandra Casale Università degli Studi di Genova INFN Sezione Genova FT-Cal Prototype Simulations.

1 Alessandra Casale Università degli Studi di Genova INFN Sezione Genova FT-Cal Prototype Simulations.
Multimedia Data Introduction to Image Processing Dr Sandra I. Woolley Electronic, Electrical.

Multimedia Data Introduction to Image Processing Dr Sandra I. Woolley Electronic, Electrical.
#3191, 14 Oct 2012 Cabling installed to allow fast BPM electronics on injector BPMs System is flexible enough to allow different INJ-BPMs to be used (not.

#3191, 14 Oct 2012 Cabling installed to allow fast BPM electronics on injector BPMs System is flexible enough to allow different INJ-BPMs to be used (not.

Similar presentations

Ads by Google