Quench Detection System R. Denz TE-MPE-EP on behalf of the QPS team.

Slides:



Advertisements
Similar presentations
6 th April 2010 MP3 weekly summary – issues and follow-up 0v1 M. Zerlauth for the MP3-CCC shift crew.
Advertisements

LHC UPS Systems and Configurations: Changes during the LS1 V. Chareyre / EN-EL LHC Beam Operation Committee 11 February 2014 EDMS No /02/2014.
Oliver Bitterling  Introduction to the QPS  Radiation damage in electronic systems  Construction of radiation tolerant systems  Radiation test and.
Technical review on UPS power distribution of the LHC Beam Dumping System (LBDS) Anastasia PATSOULI TE-ABT-EC Proposals for LBDS Powering Improvement 1.
TE-MPE –TM, 16/05/2013, Mateusz Bednarek, TE/MPE-EE ELQA testing during and beyond LS1.
LHC Beam Screen Heaters: System overview, consolidation needs and project planning 4 February TE-CRG/JCC (Beam Screen Heater Review) 1.
TE-MPE-EP, RD, 26-Jul Quench Heater Supervision for MB Status of System Integration R. Denz TE-MPE Technical Meeting July 26 th Acknowledgements:
Acknowledgments: O.Aberle – F.Bertinelli – J.C.Billy - O.Capatina - J.Casas - L.Ceccone - S.Claudet J.Coupard - K.Dahlerup - R.Denz - K.Foraz - J.J.Gras.
TE-MPE-EP, VF, 11-Oct-2012 Update on the DQLPU type A design and general progress. TE-MPE Technical Meeting.
LHC ARC Commissioning report during LS1 Agenda: VRGPE documentation (former VRJGE) Active Penning modification By-Pass Valves modification LHC ARC commissioning.
A. Siemko and N. Catalan Lasheras Insulation vacuum and beam vacuum overpressure release – V. Parma Bus bar joints stability and protection – A. Verweij.
TE-MPE-EP, RD, 06-Dec QPS Data Transmission after LS1 R. Denz, TE-MPE-EP TIMBER PM WinCC OA Tsunami warning:
Chamonix Risks due to UPS malfunctioning Impact on the Superconducting Circuit Protection System Hugues Thiesen Acknowledgments:K. Dahlerup-Petersen,
How can we reduce the “no beam„ time? Walter Venturini Delsolaro D. Arnoult, S. Claudet, G. Cumer, K. Dahlerup Petersen, R. Denz, F. Duval, V. Montabonnet,
TE-MPE-CP, RD, 23-Nov Summary of Radiation Induced QPS Events in LHC 2010 R. Denz TE-MPE-CP.
1 Second LHC Splice Review Copper Stabilizer Continuity Measurement possible QC tool for consolidated splices H. Thiesen 28 November 2011 K. Brodzinski,
Changes in QPS R. Denz, TE-MPE-EP MPP workshop Acknowledgements: K. Dahlerup-Petersen, V. Froidbise, S. Georgakakis, B. Magnin, C. Martin, J.
TE/MPE/EE J. Mourao T/MPE/EE 1 November 2012 LHC Machine Local protection Redundant Power supply (DQLPUR) & interface Module (DQLIM) progress status.
TE-MPE-EP, RD, 30-Nov DQLPR - are there any R2E issues? R. Denz, TE-MPE-EP.
TE-MPE LS1 review 02/06/2015, Mateusz Bednarek, TE/MPE-EE ELQA during LS1 – the “unexpected” activities New developments Exceptional NCs Other tests.
Training LHC Powering R. Denz Quench Protection System R. Denz AT-MEL.
TE-MPE-CP, RD, 09-June Enhanced Diagnostics & Supervision for Quench Heater Circuits R. Denz TE-MPE-CP.
AT-MEL-PM, R. Denz, CERN, CH-1211 Geneva 23 1 QPS system and its risks  Principal risks  General remarks  Quench heater circuits  Quench detection.
K.Hanke – PS/SPS Days – 19/01/06 K.Hanke - PS/SPS Days 19/01/06 Recommissioning Linac2/PSB/ISOLDE from CCC  remote operation from CCC  upgrades & changes.
AT-MEI-PE, RD, LIUWG 31-JUL R. Denz AT-MEI-PE LHC Luminosity Upgrade Protection of the Inner Triplet, D1, Correctors and Superconducting Links/Leads.
TE-MPE-EP, RD, 26-Aug Workshop on QPS Software Layer Hardware / Agents R. Denz, TE-MPE-EP.
QPS R2E Status R2E Internal Meeting, October 24 th 2013Discussion 1 LS1 developments Digital Quench Protection insertion region magnets Delivery/installation.
TE-MPE-CP, RD, 06-Oct Radiation Induced Faults in QPS Systems during LHC run 2011 R. Denz TE-MPE Technical Meeting October 6 th.
TE-MPE-EP New DQLPU type A Production of 1300 new protection units TE-MPE-EP, VF, 23-Nov-2012.
TE/MPE activities currently planed for YETS Reiner Denz, Knud Dalherup-Petersen, Markus Zerlauth & Bruno Puccio YETS coordination meeting.
BCWG - 16/11/20102 Content WHY do we need a HW Commissioning campaign? WHAT are we going to do? HOW are we going to do it? ElQA QPS Powering Tests Planning.
NQPS commissioning …a long way to go. Topics nQPS component overview Enhancements in Firmware Commissioning diagram Detailed task list Summary.
LMC Update - R2E Failures December 5 th 2012 (R2E) Mitigation Project: LMC Update December 5 th 2012 R2E SEE Update M. Brugger on behalf.
R2E Availability October 15 th 2014 Experience from Past LHC and Injector Operation and scaling to the future G. Spiezia.
MP3 List of main Issues during March 2010 MP3 - Team.
1 15 April 2010: Post Mortem Analysis by M.Zerlauth Automated analysis of Powering Events – Progress update.
TE-MPE-CP, RD, LHC Performance Workshop - Chamonix Feb R. Denz TE-MPE-CP on behalf of the QPS team QPS Upgrade and Re-commissioning.
1 J. Mourao (TE/MPE/CP) Enhanced DQHDS functionality  Status for 2011  Increase Magnet diagnostic capabilities  Our proposals.
New projects, priorities and main objectives for /12/15 TE-MPE Annual Meeting1.
LHC Machine Status Report Mike Lamont for the LHC team Acknowledgements: Mirko Pojer, Matteo Solfaroli, Katy Foraz et al.
Conclusions on UPS powering test and procedure I. Romera Acknowledgements: V. Chareyre, M. Zerlauth 86 th MPP meeting –
QPS high level controls LabView tools, an overview.
Machine Protection Review, R. Denz, 11-APR Introduction to Magnet Powering and Protection R. Denz, AT-MEL-PM.
TE-MPE, MPE Workshop 2010, G.D’Angelo, 14-Dec TE-MPE on-call service for the LHC Giorgio D’Angelo on behalf of TE-MPE On call team, with inputs.
MPE Workshop for LS1 Summary of Global Activities Thanks to Speakers Arjan Verweij Hugues Thiesen Zinur Charifoulline Kajetan Fuchsberger.
MPP Workshop Status of Powering Interlocks I. Romera on behalf of MPE-MS MPP Workshop, 12 June 2015, I. Romera (TE-MPE)1.
TE-MPE-CP, RD, 12-Dec QPS - analysis of main problems, areas to target, possible improvements R. Denz, TE-MPE-CP Evian 2011.
Thursday 27 th October 00:57 fill 2257 dumped during squeeze (RQTF.A67B1) 03:52 stable beams fill #2258 4:33 Dumped, problem of LBDS dilution kicker power.
CERN TE-MPE-EP, RD, 09-April Quench Protection Systems (QPS) for the LHC R. Denz, TE-MPE-EP Acknowledgements: K. Dahlerup-Petersen, A. Siemko, J.
TE-MPE-CP, RD, 28-Sep Problems with QPS DAQ Systems During LHC Operation, 1 st Results from 2010 CNRAD Tests R. Denz TE-MPE-CP.
MPE Workshop 14/12/2010 Post Mortem Project Status and Plans Arkadiusz Gorzawski (on behalf of the PMA team)
February 4 th, Quality assurance plan: production, installation and commissioning N.Vauthier TE-CRG Technical Review on Beam Screen Heater Electronics.
Update on the automation of quench heater analysis Zinour Charifoulline 18/06/2015TE/MPE-PE, ZCh1 Automation team: Odd Oyvind Andreassen, Jean-Christophe.
MPE LS1 workshop Summary Session 4 – Quench Detection R. Denz, D. E. Rasmussen.
Hardware Commissioning Review, R. Denz, 12-May Superconducting circuits: what remains to be done during hardware commissioning R. Denz AT-MEL-PM.
Main MPE Activities during YETS/EYETS/LS2 and the Provision of Resources Andrzej Siemko Andrzej Siemko TE-MPE1.
Injectors BLM system: PS Ring installation at EYETS
RELIABILITY OF 600 A ENERGY EXTRACTION SYSTEMS
Ideas and design concepts, and challenges
LV Safe Powering from UPS to Clients
Powering the LHC Magnets
MPE main activities planned for LS2
the CERN Electrical network protection system
Powering from short circuit tests up to nominal
Re-Commissioning (IST) of Electrical Systems: QPS, EE & PIC
Detailed global view on protection and detection of the circuits
Quench detection electronics for the HL-LHC magnet circuits of the LHC
Collimator Control (SEUs & R2E Outlook)
Review of hardware commissioning
R. Denz, TE-MPE-EP Acknowledgements: J. Steckert
Presentation transcript:

Quench Detection System R. Denz TE-MPE-EP on behalf of the QPS team

Upgrade of the LHC quench detection system (QDS) during LS1 Yellow racks & R2E QDS system dependability during LHC operation in 2015 Overall system performance Upgrades performed in 2015 Experience during the ion run Preparation for 2016 operation Firmware upgrade for nQPS DAQ systems Deployment of radiation tolerant QDS for 600 A circuits Includes RU.L4 and RU.R4 Expected system performance in 2016 Outline 2

QDS upgrade during LS1 3 QPS system dependability Overhaul of MB protection systems (“Yellow racks”) Revision of safety critical firmware Automatic system configuration and verification R2E framework: Relocation of equipment (Inner Triplet protection) Deployment of radiation tolerant electronics (IPQ, IPD) Enhancement of supervision & diagnostic capabilities Enhanced quench heater circuit supervision Earth voltage feelers QPS fieldbus upgrade CSCM for all sectors (objective added in 2014)

The new systems record simultaneously the discharge voltage and current at sampling rates up to 192 kHz and 16 Bit resolution Discharge current is measured with the help of dedicated precision measurement transformers. Special mode to detect blown internal fuse of the quench heater power supply indicating a potential heater isolation fault. Successful detection of a damaged heater strip in A26R8. The heater strip has been isolated and replaced by a low field heater. The new systems are so far only available for MB magnets. In the midterm, it is foreseen deploying these type of systems for all magnets protected by quench heaters. Enhanced quench heater circuit supervision for main dipole magnets 4 Quench heater resistance recorded during discharge revealing a damaged heater strip in MB A26R8.

Data provided by Zinur Charifoulline: About quench heater circuit usage... Statistics for LHC main dipoles, Expected to be less in 2016 No firing campaign scheduled for 2016

Remote control options Remote power cycle of detection crates Re-start of stalled communication busses Automatic re-start of stalled field-bus couplers 11 interventions requiring access in 2012, fully transparent in 2015 Update of QPS superv ision FESA2  FESA3 Configuration management QPS field-bus upgrade  higher data transmission rates Revision of LOGGING data retrieval Analog data recorded without dead-bands Installation of earth voltage feelers for the main circuits Improved availability & maintainability 6 MPE stand-by service statistics for QDS+DAQ interventions In % of all interventions were requiring access to the LHC compared to 41% in 2012!

System immunity to ionizing radiation (R2E) 7  Relocation of QPS equipment previously installed in UJ14, UJ16, UJ56 Inner triplet protection  Deployment of radiation tolerant electronics for quench detection systems for IPQ and IPD protection  Ghosts from the past... Deployment of radiation tolerant electronics for quench detection systems for 600 A protection Upgrade started - to be completed during YETS

QDS system dependability in 2015 Challenging year after major system upgrades during LS1 Significant (not foreseen) effort to overcome post LS1 teething problems affecting overall system availability (96.79%) 8 Very (=100%) reliable operation and effective protection of superconducting circuits Detection of 40 main dipole quenches during proton run 2015 Safe detection of MB training quench at nominal current. Note: A QPS = (T OPERATION - T FAULT(AFT) )/T OPERATION Smooth ~96% mBS crisis

Necessary due to problems with the radiation tolerance of the hybrid circuit boards installed for the CSCM test in 2014 Exchange of 1248 QPS circuits boards (6.1 % of total installed quantity) Test of 2496 hardwired interlocks (18.5 % of all QPS interlocks) Verification of 4992 analog signals Electrical test of the LHC main dipole circuits Powering test of the LHC main dipole circuits Successfully completed within one week Very challenging, demanding and hopefully exceptional exercise DQQBS back-grade during TS#2 9 Many thanks for all the essential support provided by internal and external teams!

Significant improvement of system availability QDS system dependability after TS#2 10 QTYSEPOCTNOVDECTOTAL QDS QDSIPQDT nQPS QDSRB QDSRQ QDSRBQ Σ DUMPS13115 (3 x SEU) No faults in main magnet protection units!

R2E related problems Not yet hardened detection systems for 600 A nQPS triggers during ion run Special case of rack B10L2 (~40 Gy, 120 μSv/h surface activity), meanwhile re-located by one meter Mitigated and transparent faults (not affecting availability) Hardware failures Cables & connectors (mostly teething problems) Circuit board failures Protection crate hardware problems Data acquisition & transmission Stalled bus recovery etc.  further mitigation & consolidation currently ongoing (YETS 15/16) QDS main failure modes 11 Consolidation during YETS 15/16 Very rare (1/year), non safety critical events causing down time of a few hours. Example for a hardware fault: 1.Broken multilayer ceramic chip capacitor causes faulty input signal on a symmetric quench detection board type DQQDS. 2.Detection algorithm triggers correctly causing heater firing and beam dump. 3.Faulty board is replaced by standby service. 4.Allocated fault time is 7.2 h + penalties for pre-cycle... 5.There are 58 capacitors of the incriminated type (same value and rating) on each of the 1632 DQQDS boards currently installed in LHC. 6.1 out of caps failing in 2015  λ 2015 = 1.2 x h -1

Firmware upgrade for nQPS DAQ systems Sampling rate for earth voltage feelers increased to 10 Hz Better detection and recovery of local communication faults; transparent error handling Deployment of radiation tolerant QDS for 600 A circuits Mandatory for radiation exposed areas in point 1, 5 and 7 QDS preparation for 2016 operation 12 Completed last week! New detection systems are no longer requiring re-calibration cycles (resets)  we will try hard to upgrade as well RU.L4 and RU.R4...

Considering a successfully implementation of the ongoing upgrades: The same level of availability as in 2015 after TS#2 (~98%) should be feasible despite the increasing radiation load The required overall (QDS + HDS + EE) availability for smooth LHC operation is: A QPS ≥ 96% The system maintainability is expected to improve, mainly to the better handling of certain error types The complexity of the system remains a challenge Almost possibilities to stop LHC at any time... QDS performance in 2016 – an estimate 13