1. Enclosures & ComponentsBackplanesSystem PlatformsSwitches, Knobs & LEDsCabinets 1 MTCA Systems Technology Meeting 10.2.2009 CERN Genève

2. Enclosures & ComponentsBackplanesSystem PlatformsSwitches, Knobs & LEDsCabinets 2 - Presentation Hamburg, 2.2.2009 Friedrich Fix

3. Enclosures & ComponentsBackplanesSystem PlatformsSwitches, Knobs & LEDsCabinets 3

4. Enclosures & ComponentsBackplanesSystem PlatformsSwitches, Knobs & LEDsCabinets 4 History AMC Modules MCH Module Cooling Unit Power Supply Mechanic

5. Enclosures & ComponentsBackplanesSystem PlatformsSwitches, Knobs & LEDsCabinets 5 OLD FORM FACTORS NEW FORM FACTORS PICMG 2.0 CompactPCI PICMG 2.16 Packet Switching PICMG 3.0 AdvancedTCA PICMG 2.17 Star Fabric PICMG 2.20 Serial Mesh PICMG 2.18 Serial RapidIO PICMG μTCA PICMG EXP.0 CompactPCI Express PICMG 2.5x CompactTCA DATA RATE TIME 2001200220042005 2006 General information about µTCA History of PICMG specifications:

6. Enclosures & ComponentsBackplanesSystem PlatformsSwitches, Knobs & LEDsCabinets 6 PMC Mezzanines used on CPCI Boards Advanced Mezzanine Cards invented for AdvancedTCA History AMC Modules

7. Enclosures & ComponentsBackplanesSystem PlatformsSwitches, Knobs & LEDsCabinets 7 Carrier Versions for History AMC Modules

8. Enclosures & ComponentsBackplanesSystem PlatformsSwitches, Knobs & LEDsCabinets 8 AMC Site 1 AMC Site 2 AMC Site 3 AMC Site 4 ATCA* Carrier AMC.0 defines Modules & Carriers Integrated Module Management AMC module Single 73.4mm x 181.5mm MM C Component Side 1 Component Side 2 Module Face Plate Monitoring LEDs I/O connectors AMC Connector Attached to carrier Module Latch Mechanical closure Hot Swap switch Edge Connector History AMC Modules

9. Enclosures & ComponentsBackplanesSystem PlatformsSwitches, Knobs & LEDsCabinets 9 History AMC Modules

10. Enclosures & ComponentsBackplanesSystem PlatformsSwitches, Knobs & LEDsCabinets 10technology the basis for Carrier BladeAMC form factorsCarrier blades in ATCA chassis History AMC Modules

11. Enclosures & ComponentsBackplanesSystem PlatformsSwitches, Knobs & LEDsCabinets 11 technology Carrier BladeAMC form factorsCarrier blades in ATCA chassis History AMC Modules

12. Enclosures & ComponentsBackplanesSystem PlatformsSwitches, Knobs & LEDsCabinets 12 µTCA System concepts: MicroTCA Pico MicroTCA Cube MicroTCA Shelf General information about µTCA

13. Enclosures & ComponentsBackplanesSystem PlatformsSwitches, Knobs & LEDsCabinets 13 AdvancedMC form factors History AMC Modules technology PSUPSU MCHMCH PSUPSU MCHMCH

14. Enclosures & ComponentsBackplanesSystem PlatformsSwitches, Knobs & LEDsCabinets 14 AMC - Advanced Mezzanine Card PICMG® AMC.0 Specification PICMG® AMC.0 R2.0 RC1.1 6 Standard Sizes Attention: The nomenclature has changed History AMC Modules

15. Enclosures & ComponentsBackplanesSystem PlatformsSwitches, Knobs & LEDsCabinets 15 mezzanine modules for and  Function extension (add on) for AdvancedTCA  Function module for µTCA  Hot swap capability  EMC shielded  Power loss specified up to 80W/module  Serial interface  Software interface AMC is designed to take advantage of the strengths of the PICMG 3.0 ATCA specification and the Carrier grade needs for:  Reliability  Availability  Serviceability Carrier with AdvancedMC Modules History AMC Modules SUMMARY

16. Enclosures & ComponentsBackplanesSystem PlatformsSwitches, Knobs & LEDsCabinets 16 All kind of modules available on the market Advanced Mezzanine Cards CPU module Gb Ethernet modules S-ATA Harddisk modules VGA module GPS clock module WiMAX baseband card History AMC Modules

17. Enclosures & ComponentsBackplanesSystem PlatformsSwitches, Knobs & LEDsCabinets 17 Weitere AMC Module Interphase 3650 4-channel OC-3/STM-1 bzw. 1-channel OC-12/STM-4 Modul up to 3 Gigabit Ethernet Ports and AMC.1 und AMC.2 Interface, Mid Size, 450 MHz Wintegra™ WinPath™ 2, ATM AAL5 and Automatic Protection Switching support 3650 Surf SurfRider/AMC DSP Resource Board with 2, 4, 6 or 8 DSPs, Full Size, SurfDocker Module, up to 128MB DDR2 RAM TMS320 C64x, FPGA incl. PowerPC 405 Core, Video Transcoding, PICMG SFP I- TDM Protocol via GbE SurfRider/AMC Advanced Mezzanine Cards

18. Enclosures & ComponentsBackplanesSystem PlatformsSwitches, Knobs & LEDsCabinets 18 AdvancedMC Connector: card edge -> Press-fit, SMD, Compression mount Backplane Technology History AMC Modules

19. Enclosures & ComponentsBackplanesSystem PlatformsSwitches, Knobs & LEDsCabinets 19 MCH Modules

20. Enclosures & ComponentsBackplanesSystem PlatformsSwitches, Knobs & LEDsCabinets 20 μTCA system mangement and IPMI communication GUI NatHpiView

21. Enclosures & ComponentsBackplanesSystem PlatformsSwitches, Knobs & LEDsCabinets 21 μTCA: System Management >uTCA systems use IPMI as standard for hardware control and monitoring IPMI: Communication Mechanisms >IPMI messages define versatile and extentable communication mechanism for management tasks NAT MCH: Software Structure >NAT MCH‘s RMCP interface allow customer specific applications GUI: JAVA Application NatHpiView >GUI application provides comfortable interface for system management μTCA system mangement and IMPI communication summary

22. Enclosures & ComponentsBackplanesSystem PlatformsSwitches, Knobs & LEDsCabinets 22 As MicroTCA doesn´t use a Carrier board, the management, clock distribution and switching functionality must be realized onto another device -> the MicroTCA Carrier Hub (MCH) MicroTCA Carrier Hub - Block diagram  Switch functionality (common options, fat pipe)  Management Controller (Carrier management, optional: Shelf- and Systemmanagement)  Clock distribution / generation  JTAG slave / master MCH Modules

23. Enclosures & ComponentsBackplanesSystem PlatformsSwitches, Knobs & LEDsCabinets 23 The AdvancedMC Modules are defined in PICMG® AMC.0. defined in PICMG® MicroTCA.0. System components MCH Modules

24. Enclosures & ComponentsBackplanesSystem PlatformsSwitches, Knobs & LEDsCabinets 24 Basic communication, Ethernet (dual star mandatory) Storage devices, Dual Star, Star or direct connections between slots? Data transfer, different protocols, defined by use of MCH plug-on switch logic and AMC modules User defined, maybe 4th Clock (PCIe) on port 16? MCH Modules

25. Enclosures & ComponentsBackplanesSystem PlatformsSwitches, Knobs & LEDsCabinets 25 Functional blocks of μTCA management source: PICMG, μTCA spec System Manager … MCH Modules

26. Enclosures & ComponentsBackplanesSystem PlatformsSwitches, Knobs & LEDsCabinets 26 General μTCA management connections >management connection outside a μTCA shelf >system manager  shelf manager via ETH >shelf manager  carrier manager via ETH >management connections inside a μTCA shelf >AMCs  Carrier Manager (MCH) via IPMB-L >Carrier Manager  PMs + CUs + FRUs via IPMB-0 >MCMC (MCH)  Carrier Management FRU Information Device via I 2 C >MCMC (MCH)  redundant MCMC (MCH) via IPMB-L MCH Modules

27. Enclosures & ComponentsBackplanesSystem PlatformsSwitches, Knobs & LEDsCabinets 27 Functional Overview: MCH Modules

28. Enclosures & ComponentsBackplanesSystem PlatformsSwitches, Knobs & LEDsCabinets 28 Tongue layout: >connector 1: >Fabric A:AMC.x  data hub >IPMBx:I 2 C  management >connector 2: >Fabric B:AMC.x  data hub >CLKx:LVDS  clock distribution >connector 3: >Fabric D:AMC.x  data hub >Fabric E:AMC.x  data hub >connector 4: >Fabric F:AMC.x  data hub >Fabric G:AMC.x  data hub MCH Modules

29. Enclosures & ComponentsBackplanesSystem PlatformsSwitches, Knobs & LEDsCabinets 29 Core Edge Special MCH connector  Minimized insertion force  As single, double, tripple or quadruple connector available MCH Modules

30. Enclosures & ComponentsBackplanesSystem PlatformsSwitches, Knobs & LEDsCabinets 30 MCH tongue 1, Common options switch, management basic uplinks GbE Switch, Common options Port 0 & 1 MicroTCA Carrier Management Controller (MCMC), H8 controller Local CPU (optional), manages switching, security features Uplinks, GbE, serial interface MCH Modules

31. Enclosures & ComponentsBackplanesSystem PlatformsSwitches, Knobs & LEDsCabinets 31 Fabric Extension Header, connection to tongue 3 and 4 -> fat pipe switches, tongue 3 and 4 as hook up modules (PCIe switch, 10GbE switch, …), exchangeable MCH tongue 2, Clock module, Clock Alarm Module MCH Modules

32. Enclosures & ComponentsBackplanesSystem PlatformsSwitches, Knobs & LEDsCabinets 32 Non-redundant μTCA clock architecture:  all clocks as point-to-point connections between MCH and each AMC MCH Modules

33. Enclosures & ComponentsBackplanesSystem PlatformsSwitches, Knobs & LEDsCabinets 33 Redundant μTCA clock architecture:  CLK1 is a point-to-point connection between MCH#1 and each AMC  CLK2 of each of the 12 AMCs is connected to both MCHs  CLK3 is a point-to-point connection between MCH#2 and each AMC MCH Modules

34. Enclosures & ComponentsBackplanesSystem PlatformsSwitches, Knobs & LEDsCabinets 34 Topologies  Star  Dual star  Proprietary (mesh, daisy chain, ect.) Protocols (defined in the AMC specification) AMC.1 – PCI Express / Advanced Switching AMC.2 – Ethernet AMC.3 – Storage Interfaces AMC.4 – Rapid I/O -> future subsidiaries of AMC -> proprietary backplane protocols Topology and protocol MCH Modules

35. Enclosures & ComponentsBackplanesSystem PlatformsSwitches, Knobs & LEDsCabinets 35 The MCH and Backplane Fabric Interface differential pair impedances shall be 100Ω +/-10% Fabric Interface Ports should be LVDS compliant Signal lengths, within a pair, should be matched to better than 0.5mm Tx and Rx pairs within a channel should be each matched to better than 2.54mm Tx and Rx pairs may be unmatched to each other Fabric Interface Interconnect

36. Enclosures & ComponentsBackplanesSystem PlatformsSwitches, Knobs & LEDsCabinets 36 All clocks shall be M-LVDS according to EIA/TIA-899 Signal lengths, within a pair, should be matched to better than 0.5mm All implemented clocks shall be 100 Ohm terminated at the MCH CLK2 shall be terminated with 16.5Ohm at the AMC followed by a serial 16.5 Ohm resistor to each MCH MCH1MCH2 CLK1 from MCH1 is routed to CLK1 on each AMC CLK2 from MCH2 is routed to CLK3 on each AMC Redundant Clock Architecture

37. Enclosures & ComponentsBackplanesSystem PlatformsSwitches, Knobs & LEDsCabinets 37 Cooling Unit