T. Gorski, et al., U. Wisconsin, November 08, 2011 Calorimeter Trigger Upgrade - 1 Upgrade Cal. Trigger R&D M. Bachtis, A. Belknap, M. Cepeda, S. Dasu, E. Friis, R. Fobes, T. Gorski, M. Grothe, P. Klabbers, I. Ojalvo, I. Ross, W.H. Smith Physics Department K. Compton, A. Farmahini-Farahani, T. Gregerson, M. Schulte, D. Seemuth ECE Department U. Wisconsin – Madison Upgrade Trigger Meeting November 8, 2011

T. Gorski, et al., U. Wisconsin, November 08, 2011 Calorimeter Trigger Upgrade - 2 AMC13 MMC: Collaboration between Wisconsin and Boston University Wisconsin reference circuit on AMC13 Tongue 2 board Wisconsin design for MMC software Version 1.2 Supports: Monitoring of available voltage & temperature sensors on T2 (+12V, +3.3V, ambient temperature) Arbitration with Crate MCH for delivery of payload +12V power Successfully tested with both NAT and Vadatech MCHs Remote transfers from Linux PC to T2 Spartan 6 via custom IPMI commands and MMC SPI interface BU/UW AMC13 MMC Integration BU/UW

T. Gorski, et al., U. Wisconsin, November 08, 2011 Calorimeter Trigger Upgrade - 3 Wisconsin MMC on Boston University AMC13 BU/UW AMC13 MMC Integration BU/UW Spartan-6 (TTC Processor ) on Tongue 2 Virtex-6 (DAQ Processor ) on Tongue 1

T. Gorski, et al., U. Wisconsin, November 08, 2011 Calorimeter Trigger Upgrade - 4 Vadatech UTC002 MCH (courtesy of Vadatech Corp.) NAT MCH (need FW Version 2.10 for AMC13 support) MMC Console startup with NAT-MCH MMC console (COM port) BU/UW AMC13 MMC Integration BU/UW

T. Gorski, et al., U. Wisconsin, November 08, 2011 Calorimeter Trigger Upgrade - 5 UW MMC Code Special adapter cable for programming (UW lab) JTAGIC3 Programmer (~$200 USD) Version 1.2 downloadable at 1p2_download AVR Studio 5 Project IPMI Custom Command Spec Sample Linux custom command programs using ipmitool interface to NAT MCH Still to do: Evaluate ipmitool interface to Vadatech Auto-detection of Spartan-6 SPI configuration interface (v 1.3)

T. Gorski, et al., U. Wisconsin, November 08, 2011 Calorimeter Trigger Upgrade - 6 Microblaze Processor Demonstrator on AMC13 V6 Microblaze Processor Demonstrator on AMC13 V6 Mod to add 2 nd USB FT232R COM interface (S6 pass-through) for V6 Microblaze Console Console I/O for DDR3 Memory Test Includes Microblaze, MPMC and GbE cores + clock, UART, etc. Usage for XC6VLX130T: Slice Regs: 6% Slice LUTs: 11% Block RAM: 30% (includes 128 KB as processor store) Next Steps: GbE and TCP/IP implementation (lwIP) IPbus Server (UDP/TCP)

T. Gorski, et al., U. Wisconsin, November 08, 2011 Calorimeter Trigger Upgrade - 7 UW Calorimeter Trigger Processor (CTP) Prototype UW Calorimeter Trigger Processor (CTP) Prototype MMC Link Clock Conditioning Circuitry SDRAM 12-Channel Optical Receiver Secondary Power Supplies Ports 8-11 (MCH2) 12-Channel Optical Transmitter Front Panel Side Backplane Side IPMI TTC/DAQ to AMC13 12-Channel Optical Receiver FPGA Image Flash (Parallel) Up to 6.4 Gbps Up to 9.6 Gbps Ports 4-7 (MCH1) Ports (BP fabric) Ports (BP fabric) GbE LHC Clock 48 inputs × Gbps 16 bidir. BP Up to 6.4 Gbps Up to 6.4 Gbps Front End FPGA XC6VHX250T (-2 GTX links) 12x8 Region Processing FPGA XC6VHX250T (-2 GTX links) Output 2:1 Mux

T. Gorski, et al., U. Wisconsin, November 08, 2011 Calorimeter Trigger Upgrade - 8 UW CTP CAD Screen Shot Current Status: Updating connections to get favorable routes Mostly capacitors and power supplies! Have 16 XC6VHX250T FPGAs from Xilinx donation First boards at end of Q V Power Supplies Front End FPGA Reg. Proc. FPGA MMC 48X TP RX Links 12X Tx Links

T. Gorski, et al., U. Wisconsin, November 08, 2011 Calorimeter Trigger Upgrade Point-to Point Backplane Connection Legend: 24 towers in φ CTP η = Custom Backplane Fabric (VT892 Style Crate) Custom Backplane Fabric (VT892 Style Crate) η = 0 η = CTP CIO-L CIO-U PxPy Φ On/off Crate Paths Φ Intra-Crate η Concept: Define a passive fabric for the otherwise unused ports and of AMC slots 2-11 to support the Compact Calorimeter Trigger & other architectures Compact Trigger Use Example

T. Gorski, et al., U. Wisconsin, November 08, 2011 Calorimeter Trigger Upgrade - 10 MicroTCA Backplane Custom Fabric Block Diagram

T. Gorski, et al., U. Wisconsin, November 08, 2011 Calorimeter Trigger Upgrade - 11 Compact Trigger Hardware Crosspoint I/O (CIO) Compact Trigger Hardware Crosspoint I/O (CIO) MMC Secondary Power Supplies Front Panel Side Backplane Side IPMI QSFP+ 4 ch Transceiver Up to 6.4 Gbps 16 bidir. BP Up to 6.4 Gbps 16× Up To 6.4 Gbps Ports 8-11 Tx (MCH2) Ports 4-7 Tx (MCH1) Ports Tx Ports 4-8 Rx (MCH1) Ports 8-11 Rx (MCH2) Ports Rx 2:1 Mux Up to 6.4 Gbps Fan- out QSFP+ 4 ch Transceiver Ports (BP fabric)

T. Gorski, et al., U. Wisconsin, November 08, 2011 Calorimeter Trigger Upgrade differential pairs added to unconnected ports of VT892-type backplane Slots 2-5, 8-11 have geographically consistent port assignments are “left/right”, 2 connections per direction are “up/down”, 2 connections per direction Slots 1/ are hubs for inter-crate connections and have horizonal or vertical port symmetry Crates can be chained left/right or up/down with optical connections (e.g., CIO card) All slots also have dual star connections to MCH slots on ports 4-7 (MCH1) and 8-11 (MCH2) Slots allocated to minimize physical distances between endpoints Plan: Commission Vadatech to add fabric to VT892-type backplane Issue PO in 2011 Estimate delivery in Q2 of 2012 Vadatech will issue new part number, backplane will be compatible with existing VT892 applications MicroTCA Backplane Custom Passive Fabric Custom Passive Fabric MicroTCA Backplane Custom Passive Fabric Custom Passive Fabric