1. Wir schaffen Wissen – heute für morgen Paul Scherrer Institut Timo Korhonen Developments at PSI towards the SwissFEL (and others) EPICS Meeting,Taiwan 2011

2. EPICS Meeting, Hshinchu, Taiwan PSI has three accelerators in user operation – Swiss Light Source (EPICS) Plus ~20 beamlines (also EPICS) – HIPA – the High Intensity Proton Accelerator in-house control system software, migrating to EPICS – PROSCAN – dedicated for cancer therapy (EPICS) The SwissFEL is the next planned project of the PSI – We are not funded yet – decision will be done in about one year – We do have already a running test machine: 250 MeV injector – the first stage of the final machine – Funding decision in parliament later this year We are quite optimistic about this This would mean: – Start building construction in 2012 – Commissioning in 2016, operation in 2017 (first beamline) PSI Activities overview

3. EPICS Meeting, Hshinchu, Taiwan PSI has a “matrix” structure – Same units are involved in many activities – Controls group (or section) is responsible for all the above machines (and the SLS beamlines, too) Maintenance, development, upgrades This puts some constraints on us – It is not feasible to do everything from scratch even for a new project – No or very little dedicated (new) staff for new projects – Try to do development for new projects in a way that the results can be used in (upgrades of) older facilities – But: the SwissFEL is a good chance (excuse?) to develop new things! – And: Luckily we have the EPICS community! PSI Activities overview

4. EPICS Meeting, Hshinchu, Taiwan The SwissFEL Machine The accelerator: a “compact” X-ray FEL (many similarities with SACLA at Spring-8) - C-band RF - 100 Hz repetition rate - (plan) two bunches in each cycle, separate bunches with a fast kicker  - the machine will be underground, technical gallery right above (place constraints)

5. EPICS Meeting, Hshinchu, Taiwan The SwissFEL Machine Two beamline branches: Aramis: Hard X-ray SASE FEL. Wavelength tuning mainly by electron beam energy (2.2 – 5.8 GeV) with some tunability by the gap of the undulator modules. Athos: Soft X-ray SASE FEL with APPLE II type undulator modules. Wavelength tuning by undulator gap with two injection energies of the electron beam (2.1 and 3.4 GeV). D’Artagnan: FEL for wavelengths above Athos, seeded with an HHG source.

6. EPICS Meeting, Hshinchu, Taiwan SwissFEL Control System Where we do not need to start from scratch: –EPICS and general development infrastructure –Use the Micro-Research event system Of course, there are new wishes like: –Higher link speed so that we can directly run at our basic RF frequency (142.8 MHz) –Enhanced sequencer »To offload the master CPU –Many diagnostics systems have been developed (on VME) Beam position monitor electronics, for instance Where we need something new (details in next slides): –Application infrastructure –Fast I/O possibilities (on VME) –Distributed I/O (constraints of a linear machine and the space available in building.) –Huge amounts of data to be stored/archived –Lots of undulators to be controlled (synchronously) –Experience in handling a pulsed machine!

7. EPICS Meeting, Hshinchu, Taiwan SwissFEL Control System hardware platforms Control system backbone architecture: VME64x –A lot of existing infrastructure and investment in development –No obvious benefit of taking something else –New developments bring us a whole new spectrum of possibilities (next slides) –Fast interconnections with high-speed links built into infrastructure Slow I/O –PLC-type systems (like WAGO)‏ –Possibly with direct EPICS integration –Binary I/O, slow analog I/O, facility-type systems Small, embedded systems (on FPGAs) –For applications with a few I/O channels requiring high speed –For specialized functions, although those are not yet fully crystallized... –Maintenance (of firm- and software) is an unsolved issue Not only in this category – but especially burning here EtherCAT –Under development/consideration for undulator control, possibly also for machine protection and some RF systems

8. EPICS Meeting, Hshinchu, Taiwan SwissFEL Control System software Control system: EPICS-based –All PSI machines run EPICS – what else? –But this is not the whole story... Applications –Our high level application infrastructure is – hmm – colourful –Matlab has evolved into a de-facto standard tool for SwissFEL project other PSI users are following suit –But...do we want to have everything only in Matlab? No. –Joined the effort of BNL, SLAC and others to develop services based on PVAccess and the other components known as EPICS 4 Accelerator model services (MAD-X etc.) Component data (SwissFEL component data will be in databases that are supplied by controls – under discussion but likely) –Archiving is a big issue for SwissFEL Again, try to join the effort of SLAC and BNL In the meantime, keep the channel archiver (our workhorse) alive –Strengthening our activities in database area For configuration management For service infrastructure

9. EPICS Meeting, Hshinchu, Taiwan Our new development together with a local company, called IoxOS: IFC_1210 (www.ioxos.ch) –A combination of a big FPGA, a dual-core CPU and a high- bandwith PCI Express infrastructure –2 FMC slots for I/O, direct connection to FPGA –1 PMC and 2 XMC slots (not at the same time with FMC) –8 PCI Express (Gen2) lanes, 8 GTX transceivers to the crate rear through P0 (UHM) Allows a separate data plane besides VME bus (PCIe: 8-lane, 2x4-lanes,...) Works in the existing VME64x crates Lots of FPGA resources FPGA Network-on-a-chip firmware package (TOSCA-II) delivered by the company (with source code, but licensed)

10. EPICS Meeting, Hshinchu, Taiwan SwissFEL Control System Software plans for the IFC_1210 board –Run Linux with real-time extensions Xenomai is the current plan –www.xenomai.org Seems to fit nicely to what we would need –Different configurations: SMP with different task affinities AMP for running user applications on one core and EPICS on the other core e.g. devoting one core for user signal processing This is likely to be our next standard IOC platform (on VME) We can: –Distribute I/O over several hundreds of meters if needed It still looks like memory-mapped devices Do processing transparently on a remote server –Take advantage of the most recent technologies PCIe, FMC, multicore CPUs, SR/MR-IOV, Linux SMP/AMP... But do not need to develop everything from scratch! –It is still a lot of work...

11. EPICS Meeting, Hshinchu, Taiwan SwissFEL Control System Distributed and/or slow I/O with WAGO –Low-cost but flexible I/O platform PLC-like but different in many aspects Very attractive costs when having (relatively) few I/O points in distant locations –And compared to PLCs Many different functions available as modules –Analog and digital I/O –Motion control At the moment using this with ModbusTCP –Simplest CPU Possibility to run Linux on a more powerful CPU –WAGO is willing to help in this

12. EPICS Meeting, Hshinchu, Taiwan PSI internal coordination between VME and PLC teams Goal: Connect distributed input/outputs with low demands (speed, accuracy) to EPICS control system. Step 1:Establish communication between WAGO-I/O-SYSTEM 750 and EPICS.  ModbusTCP Driver, EPICS softIOC (central). Successfully in operation since March 2011. Step 2: softIOC running on WAGO-I/O-SYSTEM 750.  EPICS channels are local on the WAGO node. Step 3: softIOC running on WAGO-I/O-SYSTEM 750 and PLC-Task running on the same node.  PLC functionality (security, interlock) with EPICS channels. These steps do not exclude each other. They can exist “in parallel” in control system. WAGO-I/O-SYSTEM 750 and EPICS

13. EPICS Meeting, Hshinchu, Taiwan SwissFEL Power supplies The Second Generation PSI digital power supply controller 12 onboard ADC More PWM I/O & Digital Inputs More processing power Simultaneous control of 3 Power Supplies Display Ethernet Lower measurement delay Higher link bandwidth High-resolution ADC for demanding applications – Used already in SwissFEL test machine and PROSCAN – Will be used for SwissFEL (but was not explicitly developed for SwissFEL)

14. EPICS Meeting, Hshinchu, Taiwan Power supply controller Gen 2 functions

15. EPICS Meeting, Hshinchu, Taiwan Controls-Power Supply group joint effort: the PS “concentrator” -Virtex-4 FPGA with embedded PowerPCs Runs embedded Linux and EPICS locally –Was recently put into operation on the SwissFEL test injector Fast links (“RocketIO”)for fast orbit feedback connection Ethernet MACs on board 8 power supply connections: 4 links on-board, 4 more with an add-on board Could be built into the power supply controller racks –Then just needs an Ethernet connection

16. 10/11/10EPICS Spring Meeting, Taiwan, Acknowledgements My colleagues in controls and the whole Large Research Facilities Department and the rest of PSI.

17. EPICS Meeting, Hshinchu, Taiwan Test Machine: 250 MeV Injector