1. EPICS 2011 Spring Meeting, Hsinchu, June 13-17, 2011 Status of the TPS Control System Kuo-Tung Hsu On-behalf of the TPS Control Team NSRRC, Hsinchu, Taiwan June 13, 2011

2. 2 EPICS 2011 Spring Meeting, Hsinchu, June 13-17, 2011 Strategic for TPS Control System Development  TPS control system frameworks => EPICS toolkit. Most successful and largest collaboration for control system project  Development strategic for new EPICS site like TPS project Work first, then pursue work well Learning by doing Learn from EPICS community  Focus on hardware and software of data source layer at this moment. Standardization and minimized requires resources  Middle layer and presentation layer will be focus in next step.  Co-operative development to integrated EPICS and non-EPICS system Some subsystems controls have their special requirements and preferences It need time to clarify between EPIC (poem, computer form factor, …) and EPICS (Experimental Physics and Industrial Control System) for a new comer!  Goal: Meet system integration and commissioning and machine fine tune schedule in 2013~2014 and requirements for future development.

3. 3 EPICS 2011 Spring Meeting, Hsinchu, June 13-17, 2011 A Chivalrous Sword-Man Jia Dao (779-843 A.D.) Spend 10-year sharpening my sword, The frost-bright blade has never tested. Let me show it to you today Have you anything unjust to say? 劍客 賈島 (779-843 A.D.) 十年磨一劍，霜刃未曾試。 今日把示君，誰有不平事？ Essay by Peter Norvig: Teach Yourself Programming in Ten Years After the sword (skill) is sharpen - Hope we can contribute something to the EPICS community in future! Our Aspiration

4. 4 EPICS 2011 Spring Meeting, Hsinchu, June 13-17, 2011 Phase I: Minimized type of EPICS IOC Minimized type of platform, OS and software versions EPICS IOC Nodes cPCI IOCs~ 70 nodes Corrector PS control IOCs~ 120 nodes BPM IOCs~ 72 nodes Special IOCs~ 30 nodes Servers~ 20 nodes Control console~ 10 nodes Basic software for system integration, commissioning and operation Basic software development management … Phase II : Complex and sophisticated applications EPICS extension … 201020112012201320142015 Phase IPhase II Machine Commissioning and Tuning TPS Control System Development Phase

5. 5 EPICS 2011 Spring Meeting, Hsinchu, June 13-17, 2011 Consoles and Servers Standard cPCI EPICS IOCs - Intel CPU/Linux (fully preemptive kernel ) - High volume I/O - High speed serial connection (GbE, … etc.) Miscellaneous EPICS IOCs - Pentium/XScale/ARM/PPC Linux - Soft real-time system - RS-232/422/485 Devices - CCD camera server - PLC (safety type system) - Bunch-by-bunch feedback system interface - Special applications cPCI EPICS IOCs File and Name Server, Gateway, Archivers, Beam Physics Server (Modeling System), Display Managers, Database Server, Alarm Server, AP Server, Boot Server, Monitoring Services, Storage Server … etc. EPICS IOC (Input Output Controller) Signal Conditioning Miscellaneous EPICS IOCs Safety Type System Intranet Beamline Network, Network Attached EPICS Devices (e.g. EPICS Oscilloscope, … etc.) PLC-IOC Control Ethernet Private Ethernet Field Devices (Power Supply, Motion Controller, LXI Instruments, …etc.) Timing EPICS/OPI PC/Linux Router Control System Infrastructure

6. 6 EPICS 2011 Spring Meeting, Hsinchu, June 13-17, 2011 D-Tacq Intel IOP + ADC TEWS cPCI IP carrierADLINK 128 Bits DI/DI ADLINK cPCI CPU board CompactPCI IOC (Linux) BI, BO, AI, AO, Timing, Network attached devices I-Tech BPM IOC (Intel CPU, Linux) MRF cPCI Event System Modules D-Tacq Custom Designed Corrector Power Supply Controller IOC (~ 20 bit DAC) D-Tacq 18 bits DAC Power SuppliesEthernet/LXI devices Dimtel Bunch-by-Bunch Feedback and Diagnostic IOC Middle Layer IOC (JavaIOC ?) Applicaion Specific SoftIOC Special IOC YEC PLC IOC Hytec 18/20/24 bits DAC/ADC IP Modules Oscilloscopes MOXA Serial ServerMODBUS/TCP Devices ADLINK cPCI Crate 64 Nodes of cPCI Platforms in Test EPICS IOC Hardware Building Blocks

7. 7 EPICS 2011 Spring Meeting, Hsinchu, June 13-17, 2011 Control System Computer Room to CIAs Control and Timing fiber network Control fiber network To TLS Control System Computer Room Intra-CIA fiber link CIA #24 to Control System Computer Room and all CIAs Control, Timing and Intra-CIA Fiber Network

8. 8 EPICS 2011 Spring Meeting, Hsinchu, June 13-17, 2011 CIA Switch 24 sets Pulse magnet PS x 1 set TPS Control System Computer Room CIA24 Network Rack TPS Control Network Infrastructure –Baseline Design (ready in late 2012) ~ 32 SFP + 10 GbE dual speed ports E3143 (TLS Control System Computer Room) M230 (Laboratory) 10 Gigabit Fiber Links 1 Gigabit Fiber Link NSRRC Intranet Ethernet Switch Edge Switch 24 GbE + 4 SFP + 2 SFP + NTP server Ethernet Switch NSRRC Intranet

9. 9 EPICS 2011 Spring Meeting, Hsinchu, June 13-17, 2011 cPCI modules - CPU modules - 6 U cPCI EVG/EVR - 32/64/96 channel 16 bits AI 32/64 channel 24 bits AI (transient signal capture capability) - 32 channel, 18 bits AO - 128 bit DI, 128 bit DO - EVG, EVR in 6U cPCI form factor - IP carrier and IP modules 16 channel/24 bits ADC 16/8 channel 18/20 bits DAC - In house design modules Filedbus Ethernet (> 95%) Raw ASCII/LXI/VXI-11 /Modbus-TCP, …. RS-232/422-485 devices Serial device server => Ethernet … etc. Ethernet and LXI compliant devices Power supply Diagnostics Electronics instruments Environment monitoring (temperature, vibration, pressure, …) Motion control Ethernet based motion controller Fast waveform capture Oscilloscope and soft-IOC Camera GigE Vision Interlock PLC embedded EPICS IOC Ethernet/LXI Miscellaneous Interface … etc. EPICS Controls Hardware Standard

10. 10 EPICS 2011 Spring Meeting, Hsinchu, June 13-17, 2011 cPCI-EVRTG-300 (e-Gun Trigger) Fan-Out Concentrator Universal I/O TTL Interlock Input Module Universal I/O TTL Input UNIV-TTLIN Universal I/O TTL Output UNIV-TTL Universal I/O TTL Output Module w/ Delay Tuning Universal I/O NIM Output UNIV-NIM Universal I/O LVPECL Output Module Universal I/O LVPECL Output Module with Delay Tuning Universal I/O HFBR-1414 Output UNIV-HFBR-1414 Universal I/O HFBR-1528 Output UNIV-HFBR-1528 In-house made fanout Fanout module cPCI-EVG-300 cPCI-EVR-300 GUN-RC-203/300 Fibre + Transceiver Ru 87 Timing System Hardware

11. 11 EPICS 2011 Spring Meeting, Hsinchu, June 13-17, 2011 Storage ring dipole power supply, booster dipole power supply and quadrupole power supplies were awarded to the IE Power. Control interface is similar as CLS. Booster dipole power supply and quadrupole power supply will build in waveform generator and/or external reference input (cPCI EPICS IOC + IP Carrier Module + Hytec 18/20 bits DAC IP module). Storage ring quadrupole 、 sextupole power supplies and transport line dipole 、 quadrupoles power supply were contracted to Chroma ATE Inc. All power supply equip with Ethernet/LXI interface with NSRRC specify control functionality. Power Supply Control Interface

12. 12 EPICS 2011 Spring Meeting, Hsinchu, June 13-17, 2011 Interlock PLC IOC EPICS IOC ADLINK cPCI CPU ADLINK 128 Bits DI/DO TEWS TCP201 IP Carrier Hytec IP ADC 24 bits, 16 channels IP-ADC-8417 EVR (CPCI6U-EVR-300) Trigger Fanout Trigger Ramp Trigger TPS Control Network Hytec IP DAC 18 bits, 16 channels IP-DAC-8415 BR frev clock 3 Hz Power supplies trigger EPICS IOC ACQ164CPCI 24 bits ADC, 32 ch, GbE Sextupole SD, SF PS Ethernet Switch Ethernet Interface: On/Off control Status readback Interlock reset Two Options: Analogue Reference Input (Waveform) or Embedded Waveform Generator Booster Dipole, QF, Q1, Q2, QM PS (IE Power Inc.) Booster Main Power Supply Control Interface

13. 13 EPICS 2011 Spring Meeting, Hsinchu, June 13-17, 2011 TPS Control network Cell Power Supply Control cPCI IOC Ethernet Switch Quad (10), Sextupole (7) (Chroma ATE Inc.) x 24 EPICS Access (10 Hz rate) Orbit Feedback Setting (10 kHz rate) CPU Module ±10 Amp Power Supplies (ITRI) EVR (cPCI-EVR-300) Corrector Power Supply Controller (CPSC) SR Slow Correctors 168 (H) +168 (V) SR Fast Correctors 96 (H) + 96 (V) Skew Quadrupole 96 BR Correctors 60 (H) + 36 (V) EPICS IOC 20 bits DAC 24 bits ADC (D-Tacq) CLK/Trigger Dipole PS (IE Power) x 1 Power Supply Control in one Cell

14. 14 EPICS 2011 Spring Meeting, Hsinchu, June 13-17, 2011 + Slow Setting Buffer External Clock Input DO (LEMO connector, for timing measurement), Trigger out, Package received Write Registers 8 bit DO Setting Buffers Gigabit Ethernet Slow Trigger (on demand, may not necessary) Heartbeat Register Rx Fast Setting Ports (GbE, UDP/IP), Through Port Heartbeat Register AURORA 8 Ch, 20 bit DAC Single Board Computer (Linux, EPICS IOC) Status Registers 8 bit DI 24 ch, 16 bit ADC 8 ch, 24 bit ADC (10 kHz Sampling) Slow Access (~ 10 Hz) Control and Status Registers Ethernet Interface (Hardware UDP Stack) 96 pin DIN61412 Connectors x 2 +/- 15 V + 5 V 4 ways, 8 ch adder ~8 x 64 k x 32 bit Waveform Memory Sequencer 10 kHz clock Waveform Memory Free running Or Pre/Post Trigger 10 Hz rate data Trigger (3 Hz) Precise digital temperature sensors Individual Channel Enable/Disable? Control and Status Registers Slow Access (~ 10 Hz) Rx Tx Fast Setting Port, Through Port (AURORA) Tx SFP Port Up to 10 kHz (Fast Setting Clock) 10 kHz Clock Generator 10 kHz rate waveform Data Acquisition Trigger input Corrector Power Supply Controller (CPSC) SR corrector PS (fast + slow), skew quad, BR correctors

15. 15 EPICS 2011 Spring Meeting, Hsinchu, June 13-17, 2011 Orbit Feedback Environment within for one Cell To Cell N-1 Group 14*Magnet output repeater Add XBPM in IOFB or local feedback are feasible. To Cell N+1 I-Tech Solution Group 8*Magnet output CPSC for Skew quad 4 (or more) Cell’s Edge Switch CPSC for slow horizontal corrector 7 CPSC for slow vertical corrector 7 BPM Grouping Links (2.5~3.125 Gb/s) AURORA CPSC for fast horizontal and vertical corrector 4 + 4 TPS Control Network Fast Setting GbE link

16. 16 EPICS 2011 Spring Meeting, Hsinchu, June 13-17, 2011 Storage ring Front-end Beamline and Experimental Station Hardwired handshake Cell N+1 Vacuum Syustem cRIO PAC Beamline N-1 front-end cRIO PAC 1. Vacuum and front-end: Vacuum gauge reading IP current Valves information Various status (pressure 、 temp 、 flow rate 、 …) 2. Limited setting functionality CIA #N-1 EPICS IOC EPICS CA gateway Ethernet Accelerator Control System and Vacuum and Front-end PAC System Machine Protection System Cell N Vacuum System cRIO PAC Cell N-1 Vacuum System cRIO PAC Beamline N-1 Control System and Experimental Station Front-end Status Fanout EPICS CA Channel MODBUS/TCP Accelerator Control System Vacuum & Frontend Control System Beamline & End-Station

17. 17 EPICS 2011 Spring Meeting, Hsinchu, June 13-17, 2011 TPS Phase I ID Plans (10 IDs) IU22 3 M x 3 IU22 (1+1) x 2 EPU48 (1+1)x 1 (U50, EPU48 ?)x 1

18. 18 EPICS 2011 Spring Meeting, Hsinchu, June 13-17, 2011 TPS Control Ethernet Power Supplies 128 Bits DI/DIcPCI CPU board CompactPCI Insertion Devices IOC (Linux, EPICS) 200 update/sec IP DAC 16 channels, 18 bits IP ADC 16 channels, 24 bits Motor Drivers (Stepper (IU22) or Servo (EPU) Encoders (SSI, Incremental) Limit Switches Temperature RTD/TC Vacuum Ion-Pump, BA Gauge Global compensation UDP/IP (~ 200 update/sec) Local compensation EPICS OPI Beamline monochromator synchronization link ? Beamline control system Wiring Adapters MOXA RS- 232/422/485 Serial Device Servers RS-232/485 Based Devices Galil DM-404x Motion Controller Ethernet Switch EPICS Gateway ICPDAS RTD/TC (POE) Interlock Logic Insertion Devices Control Environment

19. 19 EPICS 2011 Spring Meeting, Hsinchu, June 13-17, 2011 Motion Controller EPICS IOC Status update every 5 msec EPICS CA access ~ 10 Hz rate Local Compensation Power Supplies Setting update every 5 msec Gap/Phase information broadcast every 5 msec Clients (Global orbit/tune/coupling correction,, …) Fast Setting Real-time Ethernet (up to 10 kHz rate) Soft real-time applications are supported (~ 5 msec) StreamDevice Quadrupole control ~ 10 update/sec (via standard EPICS channel) Correctors & skew quads ID Global Compensation Solution

20. 20 EPICS 2011 Spring Meeting, Hsinchu, June 13-17, 2011 EPICS IOC ADLINK cPCI CPU TEWS TCP201 IP Carrier EPICS Ethernet (3 Hz rate) Hytec IP ADC 24 bits, 16 channels IP-ADC-8417 Trigger 3 Hz @ TZERO Storage Ring DCCT EVR (cPCI-EVR-300) 10 kHz sampled data averaged into 3 Hz rate Lifetime calculation updated in 3 Hz rate I Tau I x Tau Accumulated I x Tau Transfer efficiency form booster synchrotron to storage ring Heartbeat Detector To Machine Protection System Beam Trip Detector Orbit Interlock Threshold Lock-in Amplifier Hytec IP ADC 24 bits, 16 channels IP-ADC-8417 2  A, 5 kHz Tone Loop Threshold Relay Stop Injection Trigger: Current achieve target value DCCT failed EPICS IOC failed BPM VLAN SUM signals from several BPM @ 10 Hz rate For Beam Current Safety Check 2  A Excitation OFF NPCT Power Loss DCCT OK DCCT Failed TPS Storage Ring DCCT IOC

21. 21 EPICS 2011 Spring Meeting, Hsinchu, June 13-17, 2011  Turnkey systems compliant with EPICS included: Linac (EPICS ready) RF transmitter … etc.  Turnkey EPICS devices included: BPM electronics, feedback processor, oscilloscope, …  Measures to minimize amount of workload for integration supports and maintenance Standard components should be chosen to get consistency of hardware EPICS development environment and documentation on the TPS application development process Turnkey System Interface

22. 22 EPICS 2011 Spring Meeting, Hsinchu, June 13-17, 2011 TPS Control Network Lianc Timing and IOC (Timing, LTB PS, LTB Diagnostics, Oscilloscopes, GigE Vision Camera,… etc.) EPICS OPI TPS Control Environment Modulator #1 Linac Control Ethernet Switch Modulator #3Gun Local Controller (PLC,..etc.) Local Control Panel Power Supply RF Vacuum Interlock …etc. Local Controller (PLC,..etc.) Local Control Panel Local Controller (PLC,..etc.) Local Control Panel Local Controller (PLC,..etc.) Local Control Panel Linac RF, Diagnostic, …etc Local Controller (PLC,..etc.) Timing Network Event Receiver EVR CPCI-EVR-300, cPCI-EVRTG-300 cPCI CPU board + + Linac Timing IOC (Linux) cPCI IOC Trig Signal Gun grid pulser, Klystron Current/ Voltage, RF, Faraday Cup, Current Transformer, … etc. RI’s EPICS Soft-IOC Gun Trigger Optical Fiber + LTB Devices RI’s Linac – EPICS Enable

23. 23 EPICS 2011 Spring Meeting, Hsinchu, June 13-17, 2011  Vacuum system and Beamline Front-end (responsive by Vacuum Group) Connect to cRIO based PAC System via MODBUS/TCP links  Diagnostics BPM electronics: Embedded EPICS Image: GigE Vision camera Miscellaneous controls: Motor, BI, BO, AI, AO, counter  RF (responsible by RF group) => Transmitter, LLRF, Cryogenic Electronics EPICS CA interface  Machine protection => Dedicated PLC system with fast link PLC Embeded EPICS IOC  Safety system (responsible by Radiation Safety Group) Ethernet to control system. Others Subsystem Interface

24. 24 EPICS 2011 Spring Meeting, Hsinchu, June 13-17, 2011  Feedback system interface Orbit control – embedded with power supply control Bunch-by-bunch feedback Tune feedback Filing pattern feedback  Environment monitoring: Vibration, Temperature, … Raw TCP LXI MODBUS/TCP  Post-mortem supports Many devices support this functionality Trigger by event system … Others Subsystem Interface – cont.

25. 25 EPICS 2011 Spring Meeting, Hsinchu, June 13-17, 2011 NPCT IOC (Beam current, Beam lifetime, …) Filling Pattern IOC (Bunch current, Bunch lifetime, …) Timing Master IOC EVGEVG Linac E V R Gun Timing, Linac Timing, Timing Diagnostic Injection Control IOC CA access Injection and Extraction Timing IOC EVREVR Booster Main PS Timing IOC EVREVR Gun E V R Uplink E V R Timing Fanout Two injection control options: Matlab scripts running on control console (3 Hz injection rate tested) EPICS record processing (in consider) Injection Control

26. 26 EPICS 2011 Spring Meeting, Hsinchu, June 13-17, 2011 Control system framework: EPICS toolkit Development focus on V3 V4 and extension are in study High level physics framework (responsible by Beam Dynamic Group) : Matlab/Accelerator Toolkit/Matlab Middle Layer Applications interface and Operation related applications: Define Implementation Many items are still in study RDB E-log Archiver and retriever Documentation … etc. Software Infrastructure

27. 27 EPICS 2011 Spring Meeting, Hsinchu, June 13-17, 2011  Basic EPICS environment  Subsystem control Device supports and device drivers User interface (control and status monitoring) Cold start, warm up, shutdown, operation check Save and restore  Subsystem application programs Gun processing Power supply performance check BPM system diagnostic EPICS IOCs house keeping Network monitoring … etc.  High level applications Beam diagnostic related …. Special operation applications EPICS IOC housekeeping Network traffic Magnet degaussing Sybsystem warm-up, processing Save/restore Lattice management Save, restore, … LTB, BTS, Booster Synchrotron, Storage Ring, …etc. Booster synchrotron: ramping waveform management Injection control Bucket addressing Injection Top-up injection Filling pattern control and feedback Multi-bunch Single bunch Multiple single bunch (Isolated bunch) Exotic filling pattern - Camshaft mode, Repeat Camshaft mode, …. Etc. Special operation applications – cont. Timing control Pulse magnets current waveform monitoring Alarm checking Archiver and browser Machine status web page Safety system status Beamline related applications Feed-forward table management Orbit feedback supports Machine status web page …. Commissioning and Operation Related Applications Check List (2012-2014) Intensity monitor Storage ring DCCT Current and lifetime stream data Booster synchrotron DCCT Current waveform LTB/BTS FCT Stream data Injection efficiency Filling pattern monitor Storage ring Bunch current (or charge) Bunch purity monitor for isolated bunch Booster synchrotron Bunch current BPM related Configuration tools LTB/BTS single pass BPM Booster BPM display Ramping orbit Storage ring BPM (A, B, C, D, X, Y, Q, SUM, I, Q) First tune data Turn-by-turn 10 kHz steam data 10 Hz stream data Orbit (in waveform – array format) Spectrum for turn-by-turn data Spectrum for 10 kHz data Spectrum for 10 Hz data Bunch-by-bunch data Bunch phase oscillation data Bunch oscillation data Tune Booster ramping tune Storage ring tune …. Real-time beam loss monitor Screen monitor Actuator control Image acquisition Image analysis Synchrotron radiation monitor Booster synchrotron Optical control Timing control Image acquisition Image analysis Storage ring Optics control Image acquisition Image analysis Bunch-by-bunch data Bunch phase oscillation data Bunch oscillation data Waveform data …. Plan based on priority and delivery schedule

28. 28 EPICS 2011 Spring Meeting, Hsinchu, June 13-17, 2011 TPS Synoptic Page TPS LTB GUI E-Gun Trigger Module Timing Master Prototype Test Screen Monitor Single PS GUI Developed Simple Applications

29. 29 EPICS 2011 Spring Meeting, Hsinchu, June 13-17, 2011 TPS Timing Modules Configuration Page Profile Analysis TPS Timing Summary Control Page Single Pass BPM Kicker Pulser Control FCT Waveform Developed Simple Applications – cont.

30. 30 EPICS 2011 Spring Meeting, Hsinchu, June 13-17, 2011  To enable early testing of applications through the control system, a virtual accelerator has been implemented to give simulation of the accelerators though the intended EPICS PV interface. Prototype was set up by the help from DLS.  Current version is on AT/MML environment. TPS Storage Ring (Lattice provided by BD Group) Virtual TPS Storage Ring (EPICS) Virtual Accelerator EPICS IOC

31. 31 EPICS 2011 Spring Meeting, Hsinchu, June 13-17, 2011  Major procurements are in proceed.  Plans for installation.  Learn how to deal with EPICS system development and management.  Infrastructure of the software system.  TODO list for the software components.  Familiar with subsystem for applications development.  Explore EPICS new developments: For middle layer applications For API interface and another applications  Solutions for archiver and retriever, RDB, E-Log, … etc.  Plan a realistic schedule and set priority. Current Efforts

32. 32 EPICS 2011 Spring Meeting, Hsinchu, June 13-17, 2011  Implementation of the TPS control system is under way.  Standard hardware are specified.  Standardization of software components and tools are the current focus.  High level applications and EPICS extensions will be the next focus issues.  Reinforce collaboration with EPICS community. Help from the EPICS community are essential! Summary

33. 33 EPICS 2011 Spring Meeting, Hsinchu, June 13-17, 2011

34. 34 EPICS 2011 Spring Meeting, Hsinchu, June 13-17, 2011 Announcement 1.Name list for Taipei visit is posted on the bulletin board. Please check its correctness! If you name is missing, please contact information desk. 2.NSRRC offer to buy insurance for your stay in Taiwan this week. If you are still interest and not provide your information, please contact information desk. 3.The 3rd floor meeting room is available for your lunch also. 4.Tour of TPS Linac and TLS – please gather on the front gate of this building at 13:00.