1. 1.Shifter Intro 1. Introduction 2. Pit Area 8 – LHCb 3. Control Room 4. Cavern 5. Access to Cavern 6. Shift Organization 7. Safety 8. Calling Experts 9. Coordinators 10. Experts 11. Online computers 12. Shifter Duties 13. Shift Logbook 14. LHCb Status 15. LHC Status 16. LHC Logbook 17. Documentation 18. Conclusion R. Jacobsson 1. Introduction for LHCb Shifters 1

2. 1.Shifter Intro 1. Introduction 2. Pit Area 8 – LHCb 3. Control Room 4. Cavern 5. Access to Cavern 6. Shift Organization 7. Safety 8. Calling Experts 9. Coordinators 10. Experts 11. Online computers 12. Shifter Duties 13. Shift Logbook 14. LHCb Status 15. LHC Status 16. LHC Logbook 17. Documentation 18. Conclusion R. Jacobsson  The LHCb Shift Crew training consists of several courses 1.Introduction 2.Safety 3.Basic Concepts 4.Running LHCb 5.Data Manager 6.Shift Leader  Olivier Callot made first version of this training, this is a complete overhaul with everything updated  All of these courses are subject to changes System improvements and new procedures New tools and new problems  Course will be unsatisfactory: A lot of info but still not enough! Only theory  Hands on training with me or other shifters Keep yourself up-to-date/come to the pit a day or two before a shift period  This course is intended as introduction for new shifters Orientation Shifter formalities and practicalities Shifter responsibilities and task  Please comment on missing or unclear topics, errors. Don’t hesitate to ask questions  In general, contact the Run Chief or Run Coordinator if you are unhappy about something at the pit! 2

3. 1.Shifter Intro 1. Introduction 2. Pit Area 8 – LHCb 3. Control Room 4. Cavern 5. Access to Cavern 6. Shift Organization 7. Safety 8. Calling Experts 9. Coordinators 10. Experts 11. Online computers 12. Shifter Duties 13. Shift Logbook 14. LHCb Status 15. LHC Status 16. LHC Logbook 17. Documentation 18. Conclusion R. Jacobsson 3 3894 Gas building Meeting point Control room Conference room Parking

4. 1.Shifter Intro 1. Introduction 2. Pit Area 8 – LHCb 3. Control Room 4. Cavern 5. Access to Cavern 6. Shift Organization 7. Safety 8. Calling Experts 9. Coordinators 10. Experts 11. Online computers 12. Shifter Duties 13. Shift Logbook 14. LHCb Status 15. LHC Status 16. LHC Logbook 17. Documentation 18. Conclusion R. Jacobsson  The meeting point in case of emergencies (fire,...) is the building 2890 at the site’s entrance.  Shuttle Bus between CERN Main Entrance  Pit 8 https://lbtwiki.cern.ch/pub/Operation/WebHome/ShuttleServiceP8.pdf  By night and week-ends, the main gate is closed. You need to sweep your card twice if you enter by car, first at the main gate, then at the normal barrier.  Make sure you always bring your CERN Access Card!  There is a coffee, drink and food area inside building 2885 with vending machines, useful during long nights... These machines accept € and CHF. 4

5. 1.Shifter Intro 1. Introduction 2. Pit Area 8 – LHCb 3. Control Room 4. Cavern 5. Access to Cavern 6. Shift Organization 7. Safety 8. Calling Experts 9. Coordinators 10. Experts 11. Online computers 12. Shifter Duties 13. Shift Logbook 14. LHCb Status 15. LHC Status 16. LHC Logbook 17. Documentation 18. Conclusion R. Jacobsson  Experiment is entirely controlled and monitored from the surface  Experts may tend to take your place, resist except if you have asked them to fix something! 5 DM SL DAQ LHC HV/LV QC DSS CAS ST VELO OT PUS RICH CALO L0 MUON ONLINE Expert Computer Room Online Lab SysMan On Duty Resting Area

6. 1.Shifter Intro 1. Introduction 2. Pit Area 8 – LHCb 3. Control Room 4. Cavern 5. Access to Cavern 6. Shift Organization 7. Safety 8. Calling Experts 9. Coordinators 10. Experts 11. Online computers 12. Shifter Duties 13. Shift Logbook 14. LHCb Status 15. LHC Status 16. LHC Logbook 17. Documentation 18. Conclusion R. Jacobsson 6 LHC UXA UXB UXA-D UXA-B UXA-C UXA-A Cooling, ventilation and power supplies for on-detector electronics (Maraton) Gas distribution Three floors of barracks D1 holds the Event Filter Farm (EFF) D2 contains the main DAQ network and controls PC D3 contains the SD electronics, L0 trigger, TFC, and LHC interfaces

7. 1.Shifter Intro 1. Introduction 2. Pit Area 8 – LHCb 3. Control Room 4. Cavern 5. Access to Cavern 6. Shift Organization 7. Safety 8. Calling Experts 9. Coordinators 10. Experts 11. Online computers 12. Shifter Duties 13. Shift Logbook 14. LHCb Status 15. LHC Status 16. LHC Logbook 17. Documentation 18. Conclusion R. Jacobsson  During operation, access is only possible to UXA Electronics barracks, power supplies, cooling, ventilation  Access to the cavern is not needed to control the experiment There is currently no standard Pit Tour (VELO make their own tour) Exception: Assist expert during an intervention  However as shifter you must have the appropriate trainings and accesses  Course level 1,2,3, 4 and 4b  EDH access request form for "UX85: LHCB underground (LHCB_U)"  Radiation area qualification: Training, medical form  Iris scanned and CERN film badge, simple token is not sufficient (building 55)  This takes time... Take care of it NOW, to be ready!  Access to UXB requires Radiation Protection inspection Only for experts during “ACCESS” mode after formal request to Run Chief and agreed with LHC 7

8. 1.Shifter Intro 1. Introduction 2. Pit Area 8 – LHCb 3. Control Room 4. Cavern 5. Access to Cavern 6. Shift Organization 7. Safety 8. Calling Experts 9. Coordinators 10. Experts 11. Online computers 12. Shifter Duties 13. Shift Logbook 14. LHCb Status 15. LHC Status 16. LHC Logbook 17. Documentation 18. Conclusion R. Jacobsson  The main Shift Crew has two members Shift Leader (SL) Data Manager (DM) You are encouraged to sit by a few shifts to learn the ropes, and once you are experienced you might be joined by beginners  Shifts are organized by the Run Coordinator using the ShiftDB tool http://lbshiftdb.cern.ch/ for which you should all have a shift account http://lbshiftdb.cern.ch/ For any question/request always send mail to lhcb.shift.manager@cern.chlhcb.shift.manager@cern.ch Shifts are planned a month at a time, a month in advance You receive mail about updating your availability at the end of each month Once shifts are assigned, it is your responsibility to find a qualified replacement if needed  Shifts last 8 ½ hours, with 30 minutes overlap SL and DM should exchange information on the current situation and possible pending problems Arrive on time Shift hours : 6:30 – 15:00 = “morning” 14:30 – 23:00 = “afternoon” 22:30 – 7:00 = “night” 8 } Tough job, make sure you communicate with each other

9. 1.Shifter Intro 1. Introduction 2. Pit Area 8 – LHCb 3. Control Room 4. Cavern 5. Access to Cavern 6. Shift Organization 7. Safety 8. Calling Experts 9. Coordinators 10. Experts 11. Online computers 12. Shifter Duties 13. Shift Logbook 14. LHCb Status 15. LHC Status 16. LHC Logbook 17. Documentation 18. Conclusion R. Jacobsson SAFETY IS YOUR MAIN RESPONSIBILITY It should take precedence over any other duty, even data taking, not to mention offline analysis or watching TV !  Several problems may affect the safety of the detector and personnel : Gas leak. The main risk is cryogenic helium release… Fire in the barracks. Overheating in a rack. Water leak.  These are constantly monitored by dedicated systems, which may take automatic actions in case of a serious problem. A first detection generates a WARNING, which requires timely action by shift crew. This may often avoid a Level 3 ALARM, which triggers automatic actions, such as emergency cutting power and a call to the fire brigade. Warnings and Alarms are reported in the Control Room on the DSS station.  Next course dedicated to Safety 9

10. 1.Shifter Intro 1. Introduction 2. Pit Area 8 – LHCb 3. Control Room 4. Cavern 5. Access to Cavern 6. Shift Organization 7. Safety 8. Calling Experts 9. Coordinators 10. Experts 11. Online computers 12. Shifter Duties 13. Shift Logbook 14. LHCb Status 15. LHC Status 16. LHC Logbook 17. Documentation 18. Conclusion R. Jacobsson  Fire and Rescue: Dial 74444 from any phone  Shift Leader: Fixed phone 77874 and GSM (16 18 66) Always keep this phone on you when leaving control room Make sure it is on the charger otherwise  Data manager: Portable phone 77863  LHC “red phone”: Portable phone 77889 For communication with LHC, leave line open  Experts-On-Call (“Piquets”) and the way to contact them is written on the a dedicated support next to main console Internal CERN numbers: 7XXXX GSM phones: 16XXXX Home phone Geneva: Dial 0 + 022 + 7 digits Home phone France: 10 + 10 digits starting with 04 50 for nearby France Outside the local area: Shift Leader fixed phone is open to all Europe  Dial 10 + 10 digits for anywhere in France, 0 + 00 + country code +... for other countries  Not for private communications 10

11. 1.Shifter Intro 1. Introduction 2. Pit Area 8 – LHCb 3. Control Room 4. Cavern 5. Access to Cavern 6. Shift Organization 7. Safety 8. Calling Experts 9. Coordinators 10. Experts 11. Online computers 12. Shifter Duties 13. Shift Logbook 14. LHCb Status 15. LHC Status 16. LHC Logbook 17. Documentation 18. Conclusion R. Jacobsson When in doubt – call! “Better call once too much than once too few” Decision to call is taken by the Shift Leader  Sub-detector and System Experts-On-Call Available 24/7  Production Manager (Offline Control Room) Available 24/7  Run Chiefs Available 24/7 On duty for one or two weeks. Organizes daily running and chairs the daily Run Meeting. Follow up on problems, and coordinates experts in difficult decisions and should be contacted for important decisions.  Run Coordinator Assures the long-term running and planning, supports the Run Chiefs, trains the shifters, and follow-up on global issues. Stays in contact with LHC and part of LHCb Operation Group. Available 24/7  Group Leader in Matters of Safety (GLIMOS) Assures general safety and gives safety training Available 24/7  LHC Contact Person Assures the communication with LHC and attends the daily LHC “8.30 meeting”  LHC Programme Coordinator Coordinates the experiments physics goals 11

12. 1.Shifter Intro 1. Introduction 2. Pit Area 8 – LHCb 3. Control Room 4. Cavern 5. Access to Cavern 6. Shift Organization 7. Safety 8. Calling Experts 9. Coordinators 10. Experts 11. Online computers 12. Shifter Duties 13. Shift Logbook 14. LHCb Status 15. LHC Status 16. LHC Logbook 17. Documentation 18. Conclusion R. Jacobsson  Calling LHC “CERN Control Centre” 77600 or alternatively 77500 - Operators or Engineer In Charge (EIC) Make sure you are clear about who you are (Experiment and function) Make your point/question clearly and kindly! Lots of jargon – ask kindly for better explanation if you don’t understand!  Problems with gas, electricity, cooling Call CCC/TI (CERN Control Centre/Technical Infrastructure) 72201 12

13. 1.Shifter Intro 1. Introduction 2. Pit Area 8 – LHCb 3. Control Room 4. Cavern 5. Access to Cavern 6. Shift Organization 7. Safety 8. Calling Experts 9. Coordinators 10. Experts 11. Online computers 12. Shifter Duties 13. Shift Logbook 14. LHCb Status 15. LHC Status 16. LHC Logbook 17. Documentation 18. Conclusion R. Jacobsson  Printed automatically every morning at 6 AM, put next to SL console Data Manager should also look after the printer and outputs 13

14. 1.Shifter Intro 1. Introduction 2. Pit Area 8 – LHCb 3. Control Room 4. Cavern 5. Access to Cavern 6. Shift Organization 7. Safety 8. Calling Experts 9. Coordinators 10. Experts 11. Online computers 12. Shifter Duties 13. Shift Logbook 14. LHCb Status 15. LHC Status 16. LHC Logbook 17. Documentation 18. Conclusion R. Jacobsson 14 Up-to-date version posted next to SL Main Console

15. 1.Shifter Intro 1. Introduction 2. Pit Area 8 – LHCb 3. Control Room 4. Cavern 5. Access to Cavern 6. Shift Organization 7. Safety 8. Calling Experts 9. Coordinators 10. Experts 11. Online computers 12. Shifter Duties 13. Shift Logbook 14. LHCb Status 15. LHC Status 16. LHC Logbook 17. Documentation 18. Conclusion R. Jacobsson  Online Computer cluster both Windows and Linux  Online network is an isolated domain (LBDAQ.CERN.CH) Linux (lbgw) and Windows (lbts) gateways There are two wireless networks in the Control Room, one on the internal Online network, that your portable cannot access, and the general CERN one.  As shifters you should login as “lhcb_shift” Password is written on white board in the control room Do not change the settings of anything on this account! The Desktop has the minumum number of icons needed  Monitoring screens on the shelf require no login Common mouse and keyboard via switch for groups of screens In case of problems, switch off/on console next to screen while keyboard and mouse is active on screen  Controlling the experiment is mostly done via PVSS User Interfaces Be careful, windows and menus look very much alike! 15

16. 1.Shifter Intro 1. Introduction 2. Pit Area 8 – LHCb 3. Control Room 4. Cavern 5. Access to Cavern 6. Shift Organization 7. Safety 8. Calling Experts 9. Coordinators 10. Experts 11. Online computers 12. Shifter Duties 13. Shift Logbook 14. LHCb Status 15. LHC Status 16. LHC Logbook 17. Documentation 18. Conclusion R. Jacobsson  The Shift Leader is Shift Leader In Matter Of Safety (SLIMOS). This means (legally) that (s)he is responsible for following the official instructions in case of problems.  Reporting in LHCb Shift Logbook (lblogbook.cern.ch) is essential! Report not only problem, but whatever information you think may be useful to understand and solve the problem!  Read logbook frequently during your shift period  Try to attend the daily Run Meeting during your shift period During your shift the Shift Leader may attend if the situation allows  Data Manager is responsible while Shift Leader is absent Run Meeting is always on EVO Register to the lhcb-run-news mailing list  Main duty of the shift crew is to operate LHCb at optimum performance 1. Control all systems 2. Monitor all system and data quality 3. Respond to Alarms and Errors 4. Contact SD Coordinators 5. Fill in logbook 6. Help keep control room clean and organized… 7. Handle and control accesses during Technical Stops 16

17. 1.Shifter Intro 1. Introduction 2. Pit Area 8 – LHCb 3. Control Room 4. Cavern 5. Access to Cavern 6. Shift Organization 7. Safety 8. Calling Experts 9. Coordinators 10. Experts 11. Online computers 12. Shifter Duties 13. Shift Logbook 14. LHCb Status 15. LHC Status 16. LHC Logbook 17. Documentation 18. Conclusion R. Jacobsson  If you are not already a user  You need to register to the logbook system to be able to add information. Having a personal account allows having your name entered properly for each entry, so that one is sure to find the real author. 17

18. 1.Shifter Intro 1. Introduction 2. Pit Area 8 – LHCb 3. Control Room 4. Cavern 5. Access to Cavern 6. Shift Organization 7. Safety 8. Calling Experts 9. Coordinators 10. Experts 11. Online computers 12. Shifter Duties 13. Shift Logbook 14. LHCb Status 15. LHC Status 16. LHC Logbook 17. Documentation 18. Conclusion R. Jacobsson  The can be read and updated on the Web and simple entries can be made from a Web browser or the main control panel Many systems enter information automatically  Any expert/piquet call should be logged, together with the arrival and departure time of any piquet doing an intervention Make sure expert fill in information about his intervention 18

19. 1.Shifter Intro 1. Introduction 2. Pit Area 8 – LHCb 3. Control Room 4. Cavern 5. Access to Cavern 6. Shift Organization 7. Safety 8. Calling Experts 9. Coordinators 10. Experts 11. Online computers 12. Shifter Duties 13. Shift Logbook 14. LHCb Status 15. LHC Status 16. LHC Logbook 17. Documentation 18. Conclusion R. Jacobsson  http://frankm.web.cern.ch/frankm/test/Online/Stomp/web/ 19

20. 1.Shifter Intro 1. Introduction 2. Pit Area 8 – LHCb 3. Control Room 4. Cavern 5. Access to Cavern 6. Shift Organization 7. Safety 8. Calling Experts 9. Coordinators 10. Experts 11. Online computers 12. Shifter Duties 13. Shift Logbook 14. LHCb Status 15. LHC Status 16. LHC Logbook 17. Documentation 18. Conclusion R. Jacobsson  http://op-webtools.web.cern.ch/op-webtools/vistar/vistars.php?usr=LHC1 20

21. 1.Shifter Intro 1. Introduction 2. Pit Area 8 – LHCb 3. Control Room 4. Cavern 5. Access to Cavern 6. Shift Organization 7. Safety 8. Calling Experts 9. Coordinators 10. Experts 11. Online computers 12. Shifter Duties 13. Shift Logbook 14. LHCb Status 15. LHC Status 16. LHC Logbook 17. Documentation 18. Conclusion R. Jacobsson  https://ab-dep-op-elogbook.web.cern.ch/ab-dep-op-elogbook/elogbook/eLogbook.php https://ab-dep-op-elogbook.web.cern.ch/ab-dep-op-elogbook/elogbook/eLogbook.php Login with your NICE username/password when outside CERN Choose “LHC OP” logbook 21

22. 1.Shifter Intro 1. Introduction 2. Pit Area 8 – LHCb 3. Control Room 4. Cavern 5. Access to Cavern 6. Shift Organization 7. Safety 8. Calling Experts 9. Coordinators 10. Experts 11. Online computers 12. Shifter Duties 13. Shift Logbook 14. LHCb Status 15. LHC Status 16. LHC Logbook 17. Documentation 18. Conclusion R. Jacobsson  There will be documentation available some time… Probably in a few weeks/months. This unavoidably comes last…  There is a Twiki site http://twiki from inside the pit, http://lbtwiki.cern.ch from outside, with a sub-web ‘Operation’http://twiki http://lbtwiki.cern.ch Training slides Tool guides Instructions 22

23. 1.Shifter Intro 1. Introduction 2. Pit Area 8 – LHCb 3. Control Room 4. Cavern 5. Access to Cavern 6. Shift Organization 7. Safety 8. Calling Experts 9. Coordinators 10. Experts 11. Online computers 12. Shifter Duties 13. Shift Logbook 14. LHCb Status 15. LHC Status 16. LHC Logbook 17. Documentation 18. Conclusion R. Jacobsson  This completes the introduction to the LHCb shift operation. Your training will then continue with:  Safety followed by Basic Concepts Please give feed-back on the training, the documentation, the procedures, to the Run Chief and/or Run Coordinator. Improvements are always possible...... and are usually welcome ! 23