1. Michigan State University 7/12/2015 1 The Standard L2 Crate James T. Linnemann Michigan State University FNAL L2 Workshop December 19, 1997

2. Michigan State University 7/12/2015 2 L3 MPMMPM WorkerWorker AdminAdmin MBTMBT Dec Alpha (Unix) VME Standard Crate JTL, MSU 12/18/97 128 TCC VBDVBD Inputs MBus SCL Outputs to Global (preprocessors only) L2 Answer L2 HWFW (Global only) 8 VME slots minimum

3. Michigan State University 7/12/2015 3 Bit3 MPM l PCI Card for PC, cable, and VME master l Add Multiport Memory Module l Perform general VME I/O, generate interrupts l Download parameters for run l Run begin/end commands l Collect Monitoring information preferably, already placed in MPM by Administrator Alpha If necessary, can collect from other modules

4. Michigan State University 7/12/2015 4 VBD l VME Master to read out to L3 l Not interruptable during Readout l Probably 10-20 MB/s effective l Must read from SAME set of VME addresses every event some of wordcounts may be zero faster if fewer addresses intent is readout from Worker Alpha

5. Michigan State University 7/12/2015 5 Alphas l Up to 1 GIP Alpha 21164 on VME card small local disk for bootup Enet to Dec Unix Alpha for user.EXE, debugging l All Mbus I/O via MBT card Mbus DMA input 80-100 MB/s Mbus bidirectional programmed I/O 20 MB/s? l 64b parallel I/O l 2 per crate Workerformatting, Output to Global Administratorhousekeeping, L3 R/O

6. Michigan State University 7/12/2015 6 MBT Magic Bus Transceiver l Vme slave; Mbus Master and slave Administrator controls card(s) l 7-8 Cypress Hotlink inputs 160 or 320 MB/s in Copper Cables  broadcast to Alphas (Workers & Admin) on Mbus normal data Input path l 2 Cypress Outputs Preprocessor output to L2 Global input MBT’s

7. Michigan State University 7/12/2015 7 MBT, continued l Serial Command Link (SCL) Receiver broadcast L1 to Alphas on Mbus –synchronization check –L1 Qualifiers Queue L2 for Administrator Mbus reads l 128 b Parallel I/O Global uses to send L2 decision to L2 HWFW Misc communication/control signals (VBD?)

8. Michigan State University 7/12/2015 8 Standard Crate Uses l Global JUST Standard Crate described so far l Cal: more workers l Standard Crate can also be used with non-Alpha, non-MBus pre-preprocessor Cypress inputs to Worker via MBT –format, massage data for Global handle L2, L3 buffering & I/O, most of monitoring Completely standard data movement software –User code testable once data structure fixed Penalty: extra latency (lose a buffer) –“pre-preprocessor”

9. Michigan State University 7/12/2015 9 SLIC: Serial Link Input Card l 16 Cypress serial inputs VME slave card (single slot?) l 4 TI DSP’s, up to 2 GIPS each l more inputs, CPU / slot than Alpha l output via Hotlink to MBT l Readout via Worker Alpha via MBT Acts as pre-preprocessor l test registers on all inputs (eg. SCL)

10. Michigan State University 7/12/2015 10 SFO: SCL Fanout l Receives L1 SCL information l Fans out as Cypress output to 16 SLIC cards event synchronization L1 Qualifiers l functional blocks all from MBT l No VME interface required except for testing? need not be in VME crate?

11. Michigan State University 7/12/2015 11 Standard Crate with SLIC JTL, MSU 12/18/97 L3 MPMMPM WorkerWorker AdminAdmin MBTMBT Dec Alpha (Unix) VME TCC VBDVBD Inputs MBus SCL Outputs to Global 10 VME slots minimum SFOSFO SLICSLIC Inputs

12. Michigan State University 7/12/2015 12 Fiber Input Converter (FIC) l Convert Fiber Input to Cu Cypress Hotlink What Cypress speed? 160 or 320? What Speed Fiber? LED or Laser? l Front end to either SLIC or MBT avoids variants of complex card l No VME needed (need not live in VME crate) l Need if inputs are long haul from platform ? (vs. transformers?) l Harder (more expensive, fewer channels) if full-speed g-link conversion needed

13. Michigan State University 7/12/2015 13 Standard Crate with FIC to SLIC JTL, MSU 12/18/97 L3 MPMMPM WorkerWorker AdminAdmin MBTMBT Dec Alpha (Unix) VME TCC VBDVBD Inputs MBus SCL Outputs to Global 11 VME slots minimum SFOSFO SLICSLIC FICFIC Inputs

14. Michigan State University 7/12/2015 14 Standard Crate with FIC to MBT JTL, MSU 12/18/97 L3 MPMMPM WorkerWorker AdminAdmin MBTMBT Dec Alpha (Unix) VME TCC VBDVBD MBus SCL Outputs to Global 9 VME slots minimum FICFIC Inputs

15. Michigan State University 7/12/2015 15 SCL Fanout Questions l Modest project, small production run l Needed only by SLIC’s l 11channels for crate filled with SLIC’s l When? Only by Commissioning no trigger framework: fake SCL on SLIC l Who? MBT designer, in series? SLIC designer or someone else? –after relevant MBT blocks designed

16. Michigan State University 7/12/2015 16 FIC: L2CFT from L1 CFT trigger l Presently, plan g-link 1.3Gb/s = 100MB/s L1CFT: 100B (50 tracks)/fiber to STT in 1  s –L1CFT plans to send fixed length, pad w/ trailing zeros l 4 g-link inputs per card max l 8 fibers = 2 cards for L2CFT l Advantage of g-link FIC: could accept raw data (e.g. for CPS) l 320MB/s Cu Cypress + transformer??? only if lower to 24 tracks, and time budget to 2  s cheaper, 8 inputs, single card for L2CFT –no buffering needed? Fiber or copper+Xformer for platform inputs L2 CFT, perhaps L2 FPS? l Who needs what speed? L1 trigger info: just do fiber to copper? –Presently: plan How many channels per card? 4 if glink; else 8 HOW MANY INPUT CHANNELS? –CFT=_________CPS=_____________ What are breakpoints for cost: LED vs Laser –160 vs 320 vs faster? l Who? When needed? commercial building blocks? Modest project

17. Michigan State University 7/12/2015 17 FIC: Raw Data Input l Split of raw data fiber requires 1.3 Gb/s g-link l needed if do CPS no cable count yet use as part of STT? –More likely, recycle part of VRB input

18. Michigan State University 7/12/2015 18 MBT Simplifications: are all sources intelligent? l Enforce padding to 16 B? No? probably can’t if accepting raw data l Enforce maximum event size? Try. Input FIFOs hold 16 worst-case M+P events –need definition from EVERY know source Truncate if overflow anyway (no marker added!) –In-band marker makes assumptions about data formats! –OK if processors can recognize w/o extra work l OK for L2-formatted inputs (trailers broken) l what about raw fiber data? l SAME issues for SLIC inputs

19. Michigan State University 7/12/2015 19 MBT Testing Questions l VME OR MBus Control/Setup Fake data for inputs, outputs Loopback test of output(s) to inputs at full speed –VME readback of filled FIFO’s needed l MBus only: need MBus, Alphas Broadcast input test Parallel I/O test Mbus Control/Setup l SCL Test Jig? SCL L1formatting + standard input SCL L2: need Alpha? Check with SCL designers: Walter Knopf in Barsotti group

20. Michigan State University 7/12/2015 20 Development System Questions l Digital Unix Alpha required for debugging compile, link at any Alpha; serve disk anywhere? l Most user software needs only simulator with correct data format and buffer structure should build into simulator l Data movement software from Global & Cal MINOR modifications –specific qualifiers needed

21. Michigan State University 7/12/2015 21 Development System, II l How long do which systems stay at home? Current estimate is 50K for a Standard Crate Attempt communication with Global before commissioning--requires extra development crate Timing may force production of Alpha cards early –lose potential for later speedup?

22. Michigan State University 7/12/2015 22 Test Stand at Fermi l Global, Cal-like, Mu/Track-like, Data Source l Incomplete system-- no HWFW not enough parts for full code of any/all crates –except maybe full playback for Global –could reconfigure if need be--painful!

23. Michigan State University 7/12/2015 23