1. Status of MTCA Infrastructure
June 4-5, 2012
Chengcheng Xu for infrastructure team:
Sonya Hoobler, Kukhee Kim, Till Straumann, Ernest Williams, Jingchen Zhou

2. Outline Infrastructure Hardware Evaluation Infrastructure Software
MTCA Carrier Hub
CPU Module
EVR
mTCA Shelf
Power Module
Infrastructure Software
Operating System
Network/Computing Infrastructure
MTCA System Manager
Timing System Integration
Infrastructure Task Progress and Future Plans

3. Overall System
Cooling Module
Power Module
MCH
CPU
EVR

4. Dimension Definition

5. MTCA Carrier Hub Evaluation
NATEurope NAT-MCH
Compatibility mode makes system integration easier
Works with all AMC modules we evaluated with compatibility mode
No front panel RJ-45 serial port is inconvenient

6. MTCA Carrier Hub Evaluation
Vadatech UTC002
Currently manages the 6 and 12 slot shelves at SLAC
Strict MTCA specification implementation
Had compatibility issues, but it is now resolved
Front panel serial port, Ethernet ports
Very powerful hardware, will keep exploring the features it offers

7. NATEurope NAT-MCH

8. Vadatech UTC002

9. CPU Module Evaluation Currently using: ADLINK AMC1000
Used in all MTCA system, and works well.
Intel Core2 Duo 1GHz processor
Front panel serial port
No front panel Ethernet port is inconvenient
VGA port, not needed for SLAC environment
2/5 hardware failures
We are also evaluating other CPUs

10. CPU Module Evaluation Have ordered Kontron AM4020M
Intel i7 processor 2.6GHz
Dual Ethernet ports on the front panel
Front panel serial port
Also ordered Vadatech CPU AMC720, delayed due to silicon vendor delay

11. ADLINK AMC1000

12. Kontron AM4020M
Source:

13. EVR Evaluation MRF PMC based EVR with Vadatech AMC100 PMC Carrier
Currently used in all of our MTCA systems

14. MTCA Shelf Evaluation 6 slot shelf vendors 12 slot shelf vendors
Schroff
ELMA
12 slot shelf vendors
Performance Technology (Coming soon)
Vadatech (Later this year)

15. Six Slot MTCA Shelf Evaluation
Available from Schroff and ELMA
Designed for development; it is easy to use and helpful for development
Not designed for field use
Lack of redundancy
Power module is not compatible with MTCA.0 spec
Cooling module is not modular
Working with vendors to upgrade to MTCA.0 compatible for field use

16. Schroff 6 Slot Shelf

17. ELMA 6 Slot Shelf

18. 12 Slot MTCA Shelf Evaluation
Schroff
ELMA (Gen.1)
Slots for redundant
Power module
Cooling module
MCH
Marginal cooling design
Gen. 1 cooling module was non-intelligent
Gen. 2 less air flow at power module area
Problems are resolved by vendor
Slots for redundant
Power module
Cooling module
Initial cooling test is satisfactory
Had power management control issue

19. MTCA Shelf Future Work
Evaluating new ELMA 12 slot shelf (arriving soon)
New Schroff 5 fan cooling module, will evaluate when it comes out
Vadatech 12 slot shelf MTCA.4 under development, will evaluate when it comes out

20. μBlade AC Power Module Evaluation
μBlade PUMA 600W in Schroff 12 slot shelf
Over heats with Gen.1 cooling module
Stable in lab environment with Gen.2 cooling module
μBlade PUMA 600W in ELMA 12 slot shelf
Stable with ELMA 12 slot in lab environment
DESY reports too much RF noise
Company filed for bankruptcy
New sources are under development (Ray’s talk)

21. μBlade PUMA 600W Power Module

22. Power Module Power modules for 6 slot shelf (non-standard)
Schroff power module
ELMA power module

23. Infrastructure Software
Operating System
EPICS (R )
Network/Computing Infrastructure
MTCA System Manager
Timing System Integration

24. LinuxRT OS Assemble only what is needed for the system
Linux kernel (RT_PREEMPT patch is available)
μClibc: “small” footprint C-library
Busybox: provides most standard unix commands
iPXE: provide diskless boot (netboot)
Real-time bench mark
Max. interrupt delay time: ~44 μs
Avg. interrupt delay time: ~7.5 μs
Able to handle 360Hz (2.7ms cycle time)
Currently used in LI28-2 LLRF station
Developed by T. Straumann

25. Network/Computing Infrastructure
Develop and test network configuration:
DHCP
ntp
iPXE
TFTP
NFS
iocConsole
Develop by ICD Software, and SLAC Computer Center

26. MTCA System Manager Uses IPMI protocol over RMCP
Manager has ability to:
Monitor/control shelf power supply
Monitor/control shelf cooling module
Monitor shelf and module temperature
Monitor module online/offline status
Development in progress (S. Hoobler)

27. MTCA System Manager Future Work
Next version could include features like:
Faulty module automatic isolation
Module hotswap/power cycle

28. Timing System Integration
Currently using PMC carrier with EVR, using B Hill’s Linux driver with modification done by K. Kim
Current system is working but not ideal for the future
Needs to distribute full 14 trigger/timing across backplane
Develop EPICS driver/device support for AMC timing module

29. Infrastructure Hardware Future Plans
PMC EVR trigger fan out board: initial dev phase (J. Dusatko/C. Xu)
FPGA code for the AMC timing module: initial dev phase (J. Dusatko)
New hardware integration compatibility tests (C. Xu)

30. Software Infrastructure
Duration (days)
% Complete
Software Infrastructure
Requirements
Document 5
100%
Review 1
Design 15
20% 0%
Implementation / Prototype
LinuxRT Development
RTOS, toolchain, environment 10
Diskless boot loader 3
10%
EPICS Base Integration
Build/release EPICS base, drivers, modules (R )
Startup script 2
Documentation
EPICS Drivers/Device Support
Support OSI for LinuxRT
EVR (PMC Carrier) development
EVR (AMC) development
IPMI development (PS, Fan, Temp, on/off) 20
40%
Network and Computing Infrastructure
Network configuration and services for DHCP/PXE/TFPT 4
iocConsole (serial port) modification

31. Hardware Infrastructure
Duration (days)
% Complete
Hardware Infrastructure
PMC Carrier Trigger Fanout Board (inhouse) 10 0%
EVR (AMC) port Firmware from SLAC to Stockholm U. 40
Test and Integration
Roll out computing infrastructure to production 1
80%
Migrate LLRF 28-2 station IOC SW and demo 3
100%
IPMI 5
EVR (AMC)
PMC Carrier Trigger Fanout Board

32. Conclusion
MTCA.4 is a new specification and required extra work with vendors to achieve interoperability.
We have succeeded to make a working general purpose infrastructure
More effort is in progress to make our infrastructure into a fully featured and robust system

33. Thank You!