Wed 27/7 – Thu 28/7 09:00 LHC Controls problems

Slides:



Advertisements
Similar presentations
PROFIBUS controller problem (SEU) on cryo valve on DFBMH (600 A circuit RQ6.L7B1/2). Loss of cryo maintain ==> Beam dump. End of fill #1975 after ~2.5.
Advertisements

21/05/2012LHC 8:30 meeting Overview Week 20 Injectors, LHCb polarity, Beam-Beam Coordinators: Bernhard Holzer, Jan Uythoven.
LHC 8:30 meetingEBH 1  Cryogenics recovery in point 8  Meanwhile a couple of accesses:  MKI investigation on noise in IP2  Insulation Vacuum.
Summary of Week 30 G. Arduini, J. Wenninger Main aims: “Adiabatically” increase peak luminosity by emittance reduction Luminosity production.
Tuesday 17 th April 04:00 Prepare second fill for v/d Meer scans. 06:22 Stable beams, v/d Meer scans for Alice and LHCb. 13:20 End v/d Meer scans.Dump.
● Morning: Physics fill with 25 bunches: – 07:00: Injection; – 07:25: Start ramp; – 09:00: End of squeeze and stable beams; – Emittances:  x1 = 3.0 
Monday :00 Injection for physics fill # :00 Stable beams fill #1816, luminosity ~1.2x1033 cm-2s-1 11:08 Beams dumped. QPS trigger on detector.
09:25 Operator dump fill #2178, integrated lumi 107/108/18 nb-1. Trip of RQ4.R6 (fire heaters discharged) just after the beam dump but the QPS gave no.
08h15: Injection.  Correction injection oscillations.  Transfer line steering.  Losses at 30% of dump threshold, limited by SPS scraping. 12h35: Start.
04:01 Injection kicker timing problems B2  Injection pre-pulse shifted, causing BETS to inhibit beam injection. 144 bunches on TDI.  Run without ROF.A81B2.
Tuesday 24 th July - morning 10:15 Operator dump of fill 2873  Initial luminosity: 5.83e33 cm-2s-1  12 hours stable beams  151 pb-1 delivered  Initial.
07:00 Dump fil #2219, 123 pb -1 delivered. Trim TDI parking position to +/- 55 mm in the collimator BP trimmed the temperature kicker limit to 62 degrees.
:30 meetingEBH 1  No beam during the morning:  4:15 – 9: V distributor: Recovery after electrical interruption  access for TI services.
Wednesday :06 Dump fill 3533: interlock BPMS in IP6
Last 24 hours RQ4.L1 Lost going into collision Test ramp Storm
Luminosity lifetime – fill 2932
Monday :00 Stable beams 9_6_6_6 13:40 Access.
Wed :55 Fill 2653 stable beams 1.40e11 ppb, cm-2s-1peak lumi, 11.6 pb-1 total lumi delivered. 09:31 Dumped by collimator interlock:
LHC Status Wed Morning 13-April R. Assmann, B. Holzer et al
Monday fill with 1092 bunches (6 h stable beams)
Saturday 30th June - Sunday: Rocky !
Thursday 09:30 VdM scan for CMS, standard ADT gain.
LHC Morning Meeting - G. Arduini
Summary week 31 Week 31 G. Arduini & O. Brüning
Week 46 Week 46: Machine coordinators: Roger Bailey – Gianluigi Arduini Main aims of the week: Stable beams with ions Scheduled stop for ion source refill.
Fill 1410 revisited Peak luminosity 1.4e32 Beam current 2.68/2.65 e13
Tue :25 Beams dumped due to RF vacuum interlock
Saturday 12:00 Fill 1992 in stable beams.
Fri 29/7 – Sat 30/7 09:00 End of fill 1990, PC trip RCBXV3.R1 (likely SEU on QPS). Integrated Luminosity: 41 pb-1. Access for MKI2 main switch replacement.
Thu 19/5 06: :00 Investigations from vacuum and cryogenics
Summary of Week 16 G. Arduini, J. Wenninger
Note: squeeze in Atlas, CMS, LHCb and Alice on going
Friday Morning 3:44 – 15:04 stable beams Fill (dumped by operator)
LHC Operations overview Week 28 – Getting back
Sunday morning Recovering from 400 kV disturbance.
Chromaticity can make a difference…
04-05/08/2010 End of physics at ~11:00 after 18.5 hours ~120 nb-1.
Thu 15/9 – Fri 16/9 09:30 Controls network problem fixed The network problems have been fixed since 9:30am when the network switch for the Service IP57.
Friday Morning 7:30 injection for fill 2908
Friday AM Some oscillations of the cryo conditions in MSR8 perturbed the setup for injection. RF frequency interlock fixed – required a reset of RF controls.
Tuesday Access for RF & QPS (others in the shadow) until ~18:00.
Sunday/Monday & :30 Stable beams. Fill #1851.
Summary of week 19 Machine Coordinators: G. Arduini, M. Lamont Main aim: Luminosity production.
Monday – Morning Fill 3265 stable beams since 1:31
Aims for the week Recover from technical stop and precycle at 10A/s
Thursday morning 08:45 Stable beams fill 2855 for ATLAS/CMS VdMs.
Monday 14:00 beam dump Access:
Rocky last 24 hours Losses Q6.R5 Orbit SIS TCDQ OK! Power converters
MD#2 News & Plan Tue – Wed (19. – 20.6.)
Tue/Wed 12/ :00 Probe beam back again
Fill 1743 Peak luminosity ~6.7 e32 Integratated lumi ~20 pb-1
Monday morning 09:40 Dump fill 2838, integrated ~130 pb-1.
07/08/2010 Fill #1264 dump at 02:14:38.
Monday 11th June 08:10 Beam dumped in the ramp by OP. OFB did not start its function and kept the injection orbit. 08:50 Switch LHCb polarity to negative.
Thursday 22 September 2011.
Thu 04:00 Fill #2729 Stable Beams. Initial lumi 6.5e33 cm-2 s-1.
Summary Tuesday h23: Machine closed. Precycle started.
Thursday
Coordination: Eva Barbara Holzer, Mike Lamont
Monday 26th September 7:30 Beam dump, QSP on RQX.R1, lost cryo in ITR1, 91 pb-1. Cryo recovery, needed about 1.5 h. Setting of TI2 collimators to 5 sigma.
Thursday 20th July - morning
Monday 27th August & night
Wednesday 26 October 2011.
Wednesday 14:30 Fill 2011 dumped.
Wednesday morning / afternoon
Saturday Luminosity production 1380 bunches
Wed 12/10 09:30 – 10:30 Ramp down of ALICE solenoid to 50% nominal field on request of ALICE. Increase of the vacuum (e-cloud in this area that has not.
Saturday 26 November 2011.
Thursday 10:00 Fill 1986 in stable beams.
Tuesday
Presentation transcript:

Wed 27/7 – Thu 28/7 09:00 LHC Controls problems 11:00 Injection: vacuum rise in point 2 leading to beam dump. Possible outgassing at the ion pump switch on Re-steering and re-inject ==> Beam dump due to vacuum raise close to D1.R2 during the squeeze ==> Increased threshold for the corresponding vacuum gauge to allow outgassing 17:20: STABLE BEAMS #1985. Initial luminosity 1.76x1033 Initial luminosity 04:40: Electrical perturbation (argh!!!). Several FMCM trigger beam dump. End of fill #1985. ~50 pb-1 in 11.7 h 05:30: problem with the BLM sanity check 08:00: Filling

Controls problems (A. Bland) For many weeks the PS Operators complained that the PS Access video of the doors was "stuttering". This was traced to high network traffic on the IP57 network service of CS-CCR-TIMPS1 which receives the 19 MPEG2 video streams. Last week the decision was made to create a new network service (IP1) and to put CS-CCR-TIMPS1 and the 2 PS Access consoles on it. This was announced on Tuesday 26th of July in the FOM. Interventions on Access systems are normally done in operation and not during Technical Stops. The move of CS-CCR-TIMPS1 occurred at around 8:50am this morning. A few minutes later most network traffic in the CCC and the CCR was perturbed and the LHC Beam was lost around 9am. This phenomenon had already occurred in the May 10th Technical Stop during a reboot of CS-CCR-VIDEO1 which also receives many video streams. The IT/CS Router expert was able to recreate that scenario in the lab and sent a bug report to HP, the manufacturer of the Router. Today when I realized that the Router was overloaded I called the IT/CS Router expert who "blackholed" the CS-CCR-TIMPS1 IP address and the network recovered.

Vacuum spikes in R2 Possible explanation (V. Baglin) is the outgassing of an ion pump when the discharge is starting from time to time. Increase the interlock level on the nearby vacuum gauge temporarily to allow cleaning

STABLE BEAMS#1985 Emittance in collision from luminosity ~2 mm BB tune shift ~ -0.0065/IP

STABLE BEAMS#1985

STABLE BEAMS#1985 0.014 0.015

giulia papotti (BE/OP/LHC) Fill 1985 Cut a few minutes after going into collisions Both beams have very similar losses giulia papotti (BE/OP/LHC) IPs: 1 5 2 8 - 1 5 8 - 1 5 2 - 1 5 - 2 8 - 8 - 2

Tune shift

Plan Go for another physics fill

H-plane 0.31 (nominal) DA from simulations: xbb/IP= -6.5 10-3 Werner Herr & Dobrin Kaltchev 4/14 2/7 3/10 4/13 1/3 xbb/IP= -6.5 10-3 nominal tune Chamonix, January 2011 Oliver Brüning BE-ABP 12

H-plane 0.308 DA from simulations: xbb/IP= -6.5 10-3 nominal tune 4/14 Werner Herr & Dobrin Kaltchev 4/14 2/7 3/10 4/13 1/3 xbb/IP= -6.5 10-3 nominal tune Chamonix, January 2011 Oliver Brüning BE-ABP 13

H-plane 0.318 DA from simulations: xbb/IP= -6.5 10-3 nominal tune 4/14 Werner Herr & Dobrin Kaltchev 4/14 2/7 3/10 4/13 1/3 xbb/IP= -6.5 10-3 nominal tune Chamonix, January 2011 Oliver Brüning BE-ABP 14

Int. L (Average ATLAS/CMS) Fill overview Fill Termination Peak L (cm-2s-1) Length (h) Int. L (Average ATLAS/CMS) (pb-1) Dump cause 1975 STABLE 1.6E33 2.5 13 Cryo valve PROFIBUS (SEU?) 1976 ADJUST - BLM TCSG.L7 1977 SQUEEZE RF Module trip 1979 1.3E33 6 23 QPS RCO 1980 RAMP QPS RQTL7