1. Keck AO Operations D. Le Mignant for the Keck AO team

2. Topics AO refresh AO operation at a glance About the operation tools Troubleshooting session

3. AO = Adaptive Optics Control loop for canceling out the optical aberrations introduced mostly by the atmosphere (WFS, WFC, TT, DM,etc). Tracking devices (ROT) and slewing devices (FSMs, FCS, FSS) Telescope guiding and focusing. Is this a transparent process?

4. ROT Pupil re-imaging Dichroic TT DM FSMs WFS

5. Optics Bench Devices obs eng. screen wfc eng. screen AOA camera Wavefront Controller AO supervisory control Telescope DCS IDL Java User Interface pro files slk autom. units cshow epics channels Software Architecture Epics kwd server

6. AO at a glance: what it could be…  Run nighttime script  Slew to reference star  Acquire star on WFS  Run auto AO setting script  Go to next object  Acquire star on WFS  Etc..  Run Halt AO script

7. What is it : 1. Nighttime script 2. Slew, acquire reference star 3. Check FSM POs and run auto AO setting 4. Coordinate rotator slew 5. Watch for problems 6. etc 1. Need to be simplified 2. Ok, watch PO and/or use pixel location 3. Reliable, yet not optimized for IF and survey mode 4. Automation needed 5. Auto-recovery and automation needed

8. What has been our strategy so far.. K2AO/K1AO need to be modified for dvlpt. Yet, we routinely operate them for science. After many years, OPS software still evolving.. New feedback from OAs Changes being implemented AO handover will provide a strict baseline for NGS AO operation Science version vs dvlpt version Reliable, high performance and easy-to-use

9. JAVA IDL

10. Optics Bench Devices obs eng. screen wfc eng. screen AOA camera Wavefront Controller AO supervisory control Telescope DCS IDL Java User Interface pro files slk autom. units cshow epics channels Epics kwd server

11. IDL widgets and scripts AO Acquisition widget:  Watchdog tasks  Rotator, FSMs fault  WFC crash  Set AO!  Scripts:  Auto AO setting  Set FSMs  Set AO parms  Record WFS backgrd  Iterate once and exit  Auto-recovery scripts  AO/DCS coms  FSMs, Rot fault  Update Cog

12. Java and other tools 1. Java screens 2. Some value displayed are - EPICS keyword server - automation units kwds 3. WFS config. / rot position call automation units

13. JAVA IDL

14. The most common problems (random order) WFC crash FSMs Fault Rotator Fault DCS/AO communication AO loops not closed GUIs not responsive Poor AO correction

15. Telescope nod with AO NIRC2: sends nod request to telescope waits for AO (wait4tt, wait4dm, wait4fcs) DCS/AO handshake : DCS request to AO : pause DCS : moves telescope request to AO : resume AO: Open AO loops (aoloop=open/restore) acknowledges AO: converts nod in FSM X, Y moves Send FSM moves Close AO loops (aoloop=restore) acknowledges AO In parallel to FSMs moves, WFS focus repositioned NIRC2: Resumes

16. Nodding using FSMs FSMs : 2 mirrors / 4 actuators + encoders Moves image on the WFS Maintains DM to lenslet pupil registration --> Any coordinated moves requires driving all 4 actuators Moves take <10sec Tight space See hardware

17. AO/DCS communication SC TT offloading Focus offloading FSM nod AO loops (aoloop kwd) DCS Telescope guiding Secondary focus adjustment

18. Restart AO/DCS communications Open all loops (TT, DM, TT and focus offloading) Set aoloop kwd to open Reset automation units to record WFS background Zero-out the DT control offset (used for DAR and KAT offload) Reload the last-used centroid origin file for the WFC Run DCS script to set AO TT offload as inputs for telescope guiding Close TT and focus offloading Does not close TT and DM loops

19. AO Loops Wavefront Controller Supervisory Controller DCS DM TTM WFS DM Loop TT Loop Telescope Pointing TTO Secondary Mirror Piston WFO

20. WFC crash (see web page) WFC running at 672Hz TT controller and DM controller, Fault likely comes from DM controller Fault detection not obvious Bad image quality! WFS intensity not updating, wyko frozen AO loops not responsive Once Fault detected, one needs to reboot WFC No Calibrations needed BUT need to run the nighttime script again and auto AO setting script We are working on Better fault detection Full auto-recovery script

21. Rotator operation Rotator is a tracking device with two modes (Position Angle, Vertical Angle) Position is fixed by the astronomer Rotator slew are cumbersome: AO loops open Star on-axis (within few arcsec) After rotator slew Close loops Wait for new reconstructor

22. Rotator fault OBS/DCS communication used to drive the rotator Fault modes: Invisible: rotator does not report any fault But acquisition does not work Visible: FACSUM reports FAULT Mechanical? OBS/DCS coms? See web page for troubleshooting