“Technical run experience” Gianluca Lamanna (CERN) TDAQ meeting 11.12.2012.

Slides:



Advertisements
Similar presentations
Clara Gaspar on behalf of the LHCb Collaboration, “Physics at the LHC and Beyond”, Quy Nhon, Vietnam, August 2014 Challenges and lessons learnt LHCb Operations.
Advertisements

LAV trigger primitives Francesco Gonnella Photon-Veto Working Group CERN – 09/12/2014.
LKr readout: present and future R. Fantechi 30/8/2012.
Status of the digital readout electronics Mauro Raggi and F. Gonnella LNF Photon Veto WG CERN 13/12/2011.
INTRODUCE OF SINAP TIMING SYSTEM
+ discussion in Software WG: Monte Carlo production on the Grid + discussion in TDAQ WG: Dedicated server for online services + experts meeting (Thusday.
Clara Gaspar, October 2011 The LHCb Experiment Control System: On the path to full automation.
R. Fantechi. DAQ tools My feelings Not dealing with readout stuff No TEL62, no CREAMS, etc But the auxiliary software needed to run the experiment After.
“L1 farm: some naïve consideration” Gianluca Lamanna (CERN) & Riccardo Fantechi (CERN/Pisa)
Status of NA62 straw electronics and services Peter LICHARD, Johan Morant, Vito PALLADINO.
SPSC Questions to the 2014 NA62 Status Report 1 Beam: which is the beam structure expected in October? Which is the intensity you can reasonably expect?
Local Trigger Unit (LTU) status T. Blažek, V. Černý, M. Kovaľ, R. Lietava Comenius University, Bratislava M. Krivda University of Birmingham 30/08/2012.
DEBUGGING. BUG A software bug is an error, flaw, failure, or fault in a computer program or system that causes it to produce an incorrect or unexpected.
“TDAQ for 2012 runs” Gianluca Lamanna (CERN) Annual review meeting
R. Fantechi. TDAQ commissioning Status report on Infrastructure at the experiment PC farm Run control Network …
4 th Workshop on ALICE Installation and Commissioning January 16 th & 17 th, CERN Muon Tracking (MUON_TRK, MCH, MTRK) Conclusion of the first ALICE COSMIC.
TALK, LKr readout and the rest… R. Fantechi, G. Lamanna 15/12/2010.
Overview, remarks, lamentations, hope and despair M. Sozzi TDAQ WG meeting CERN - 4 June 2013 Introduction, news and appetizer.
NA62 TDAQ WG Meeting News and usual stuff M. Sozzi CERN – 29/5/2009.
ALICE Pixel Operational Experience R. Santoro On behalf of the ITS collaboration in the ALICE experiment at LHC.
Installation status Control Room PC farm room DetectorsEB Infrastructure 918 ECN3.
1 Calorimeters LED control LHCb CALO meeting Anatoli Konoplyannikov /ITEP/ Status of the calorimeters LV power supply and ECS control Status of.
RunControl status update Nicolas Lurkin School of Physics and Astronomy, University of Birmingham NA62 TDAQ Meeting – CERN, 14/10/2015.
“Planning for Dry Run: material for discussion” Gianluca Lamanna (CERN) TDAQ meeting
R. Fantechi. TDAQ commissioning Coordination activity started on January Several items to be attacked already in January Regular meetings: 15/1, 29/1,
TEL62 AND TDCB UPDATE JACOPO PINZINO ROBERTO PIANDANI CERN ON BEHALF OF PISA GROUP 14/10/2015.
Preparation for production phase Web – New web with HV pigtail qualified (?) – Installed on 2 views in Technical run Very little effect on noise; detector.
R. Fantechi. Shutdown work Refurbishment of transceiver power supplies Work almost finished in Orsay Small crisis 20 days ago due to late delivery of.
SRB data transmission Vito Palladino CERN 2 June 2014.
Talk board status R. Fantechi, D. Gigi, G.Lamanna TDAQ meeting, Mainz
Status of the NA62 network R. Fantechi 23/5/2012.
FW and HW Status TDAQ WG 10/6/2015. Hardware MPOD: ◦ HV was NOT floating   Sensibility of current limit to external devices  Particularly for chamber.
TDAQ news and miscellaneous reports M. Sozzi NA62 TDAQ WG meeting CERN – 13/7/2011.
Straw readout status Status and plans in Prague compared with situation now Choke and error Conclusions and plans.
TDAQ Working group meeting Mainz – 8/9/2011 Where do we stand? Where do we go?
TELL1 readout in RICH test: status report Gianluca Lamanna on behalf of TDAQ Pisa Group (B.Angelucci, C.Avanzini, G.Collazuol, S.Galeotti, G.L., G.Magazzu’,
10/09/10FV 1 News and observations from Brussels' meeting.
The NA62RunControl: Status update Nicolas Lurkin School of Physics and Astronomy, University of Birmingham NA62 TDAQ Meeting – CERN, 10/06/2015.
“TALK board status” R.Fantechi, G.Lamanna & D.Gigi (CERN)
Status of LAV electronics commissioning Mauro Raggi, Francesco Gonnella Laboratori Nazionali di Frascati 1 Mauro Raggi - Laboratori Nazionali di Frascati4.
R. Fantechi 2/09/2014. Milestone table (7/2014) Week 23/6: L0TP/Torino test at least 2 primitive sources, writing to LTU, choke/error test Week.
Software and TDAQ Peter Lichard, Vito Palladino NA62 Collaboration Meeting, Sept Ferrara.
LAV electronics status report Mauro Raggi and Francesco Gonnella TDAQ meeting NA62 Collboration Meeting 1-5 September 2014 Ferrara.
Sumary of the LKr WG R. Fantechi 31/8/2012. SLM readout restart First goal – Test the same configuration as in 2010 (rack TS) – All old power supplies.
“The Dry Run” Gianluca Lamanna (CERN) TDAQ - NA62 Siena Meeting
“CHEF board” Gianluca Lamanna & Riccardo Fantechi (CERN) TDAQ meeting
Straw Working group Ferrara 4/9/2014. Outline Status and Plans Installation of Chambers 1-3 Chamber 4 Vacuum test SRB Readout, monitoring and software.
Summary of IAPP scientific activities into 4 years P. Giannetti INFN of Pisa.
RICH Readout Plans F. Bucci, M. Piccini on behalf of the RICH WG.
Gianluca Lamanna TDAQ WG meeting. CHOD crossing point two slabs The CHOD offline time resolution can be obtained online exploiting hit position.
K + → p + nn The NA62 liquid krypton electromagnetic calorimeter Level 0 trigger V. Bonaiuto (a), A. Fucci (b), G. Paoluzzi (b), A. Salamon (b), G. Salina.
THIS MORNING (Start an) informal discussion to -Clearly identify all open issues, categorize them and build an action plan -Possibly identify (new) contributing.
Straw readout status Run 2016 Cover FW SRB FW.
Gu Minhao, DAQ group Experimental Center of IHEP February 2011
STATUS OF KLOE F. Bossi KLOE GM, ROMA Nov. 13/14.
Status of NA62 straw readout
LKr status R. Fantechi.
Online Monitoring : Detector and Performance check
Level-zero trigger status
LAV front-end and readout status
Michal Koval (CERN) Straw WG Meeting
Francois and Lau EATM 17 July 2012
Enrico Gamberini for the GTK WG TDAQ WG Meeting June 01, 2016
Shift instructions August 16, 2017 Antoni Aduszkiewicz
Controlling a large CPU farm using industrial tools
R. Piandani2 , F. Spinella2, M.Sozzi1 , S. Venditti 3
Cabling Lengths and Timing
M. Sozzi NA62 TDAQ WG meeting CERN – 20/10/2010
Run experience Cover FW SRB FW DAQ and monitoring
Trigger system Marián Krivda (University of Birmingham)
Presentation transcript:

“Technical run experience” Gianluca Lamanna (CERN) TDAQ meeting

Summary (1) October 29 The technical run started in October 29 Excellent participation from all the collaboration Good support from (almost) all the sub- detectors and sub-systems experts Several stops and delays due to “external” problems: magnets, main PS power supply, doors and ….water

ECN3

Summary (2) Two parts: Test beam Technical run Test beam: data collected in “standalone” Several software used (Karim’s, Lav’s, Chanti’s): reading of the input buffers (the first 2000 words) Mainly muon runs Technical run: data collected with the full system. Several runs collected with different: Beam conditions (pencil, “real” (low and high intensity, muons) Triggers (Q1*MUV3, Q1*NHOD, Q1*MUV2, Q1, Q1*MUV2*!NHOD) Detectors included (CHANTI yes/no, detectors excluded for temporary failure,…) Random triggers (with and without beam)

Summary (3) k The runbook information will be completed with the information from the run control Partial list of runs (with stable conditions) compiled by Giuseppe

Success or failure? Installation of a complex system Readout boards Trigger distribution Network PCFARM, Run Control, CDR Detectors, HV, DCS,… Commissioning building of several pieces Beam commissioning Control room ancillary systems Collected more than 150 GB of data Reinforcement of the collaboration But the main success is in …

Success or failure? …all the mistakes we have made! Each bugs, malfunction, instability, crazy behavior, etc. we observed, will help to build a “perfect” system more than the data collected!

KeywordsTALK TEL62 DIM NETWORK RunControl OnlineMonitor CLOCK PCFARM ELOG CDR TRIGGER DCS

TALK (a.k.a. L0TP) No major issue Well known limitations maximum number of NIM trigger sources (4) maximum latency, … Limitations due to the firmware: limited (and hard coded) number of trigger configurations impossibility to downscaling single triggers mixture of trigger possible but not tested missed automatic logging of L0TP configuration Main problem: apparently the trigger offset depends on the firmware Lab investigation (not so easy)

Clock & Alignment Issue with the phase of the SOB to the LKr Trigger offset alignment in two steps: Coarse: looking directly the data in the output buffers Fine: automatic scan Trigger scan repeated before any trigger change chod lav3 cedar

Clock & Alignment Very important: Is it the SOB jitter low “enough”? (Vlado’s question) Try to look in to the data: accuracy limited by the detector time resolution Design a way to test the electronics in a controlled situation (in the lab and in the cavern) Choke&Error test not completed

TEL62 Theoretical limitation to 200 kHz (in the present design) never reached due to firmware bugs The most tricky (in the DDR part) was very difficult to be discovered in lab test Other bugs in the SL fixed but not tested No evidence of hardware design problems (within the tests done) Strategy to allow extensive tests in the lab (in TR like conditions) Marco’s talk

DIM Several problems due to DIM stability Loss of connection with CCPC Rare loss of connection with L0TP Something to investigate in the PCFARM Some problem due to the network infrastructure Fix or change the system Extensive tests needed, redesign of the DIM service DNS (lkrpn2) PCFARM MERGER RunControl TEL62 SLM L0TP

Network Prompt help from the IT division main structure, multicast, … Still not everything perfect adding a new boards require some job The network bandwidth has not been tested The network structure for the trigger primitives transmission has not been tested

Run Control Big improvements during the run Several problems pointed out during the data taking has been fixed in the last version (not tested) Most of the problems during the runs (stops, errors, black magic with the farm…) are related to DIM Nicolas’ talk

PCFARM & CDR The PCFARM worked well during the run: Only one PC tested Not rate test performed Still missing L1&L2 Problems with DIM interface (to be fixed) Still licenses missed (we have only two) The CDR worked well GPN data transfer 10 Gb fibers installation to be completed and tested

Online monitor The technical run gives a big boost to the reconstruction software and the online monitor Still some detector needs improvement Several “temporary”, ”last minute”, ”incompleted” solutions to be reviseted The general structure is working: first step for the event display

DCS A lot of job to improve the reliability of the DCS during the whole TR Several problems remain on the stability of the OPC server Still problems of reliability DCS for LAVFEE was not working until the second half of the TR Still the MUV2 control isn’t ready

Elog & Twiki Two power full tools not completelly exploited: Experience to improve the elog interface (additional categories, electronics shift list, …) Not all the information has been placed on Twiki

Trigger primitives A preliminary trigger primitives test has been done (Dec. 1) A bug in some configuration scripts prevents to completed the test The most critical parts has been tested (primitives generation and primitives transmission) The network for the primitives transmission hasn’t been tested

Next steps Design the strategies to test the system without beam (electronics pulsers, leds, etc.) Build the hardware needed Complete the remaining firmware Build the missed hardware (Straw tel62 interface, final L0TP, …) New Dry Run(s) ! (one long or two short? next summer?)