2. New ROS design + gradual installation New TSC design + gradual installation Bottleneck at increased luminosities Improves maintainability and performance… Future connection to Tracker? C. F. Bedoya June 26th, 2012 2 * Theta Trigger Board (TRB) * Sector Collector relocation New DTTF? Improve maintainability and performance

3. C. F. Bedoya June 26th, 2012 3 Muon Long Term strategy working group Previous: Track Trigger Task Force M. Mannelli W. Smith O. Buchmüller Various forums, scopes are interrelated ~Phase 2 ~Phase 1

4. C. F. Bedoya June 26th, 2012 4 Electronics Change Review (ECR) outcome: The plan for installation of new infrastructure, appears sound and the project should proceed. The plan for manufacturing of electronics modules was endorsed subject to actual availability of the optical components. Electronics Change Review (ECR) outcome: The plan for installation of new infrastructure, appears sound and the project should proceed. The plan for manufacturing of electronics modules was endorsed subject to actual availability of the optical components. Installation Readiness Review (IRR) in October https://indico.cern.ch/conferenceDisplay.py?confId=191271

5. Goal: Replace SC crate with simple CuOF electronics and place TSC (Trigger Sector Collector) and ROS (Read Out Server) in USC during LS1 -ROS -TSC C. F. Bedoya June 26 th, 2012 5

6. CuOF Mezzanine 6  Equalizer restores the data quality and the DC balance (LMH0024)  Laser driver (ONET1191) sets the modulation signal for the VCSEL (OPTOWELL TP85- LCP1F). In the same package, a photodiode measures the light for implementing a feedback loop to compensate the laser ageing (operation in closed loop).  The VCSEL diodes connect to fibers through custom LC adapters electrical input Optical output 6/6/12DT Sector Collector Re-location ECR Each CuOF mezzanine contains 8 copper to optical links. PROTOTYPE PRODUCED BEING TESTED AT TORINO, MADRID, BOLOGNA PROTOTYPE PRODUCED BEING TESTED AT TORINO, MADRID, BOLOGNA S. Maselli

7. 7 The Slow Control with Spartan Xilinx 6/6/12DT Sector Collector Re-location ECR 50 meters Copper cable into target area 50 meters Optical fibers output target area Irradiation conditions expected: -10 12 particles/cm -2 Si 1MeV equivalent neutrons - 7.5 10 10 particles/cm 2 High Energy Hadrons - 42 Gy Dose which is approximately more than 30 years HL-LHC (including uncertainty factor 3.15) First results positive, further report soon CUOF Irradiation at H4IRRAD May-June 2012 The 0 th version of mother board CUOF Irradiation at H4IRRAD May-June 2012 The 0 th version of mother board S. Maselli

8. CuOF Mother Board mechanics 86/6/12DT Sector Collector Re-location ECR Electrical signal (LVDS) enter from the front of the crate through the (up to 40 m) cables that come from the Minicrates. Optical signals through MTP connectors will be extracted from the back of the crate (up to 60 m fibers). The mother board includes 3 fiber patch cords that will connect the mezzanines to an MTP (12 channels) adapters on the back of the board. Next actions: Produce a Motherboard prototype Find adequate fanout Next actions: Produce a Motherboard prototype Find adequate fanout S. Maselli

9. Goal: Replace SC crate with simple CuOF electronics and place TSC (Trigger Sector Collector) and ROS (Read Out Server) in USC during LS1 -ROS -TSC C. F. Bedoya June 26 th, 2012 9

10. 10 R. Travaglini et al OFCU-TSC produced Test set-up built First tests on going

11. 11 R. Travaglini et al -Eye opening quite small, risk of having signal integrity problems -In addition we see some unlock problems with the optical chain -> We need to work on insuring link reliability -Eye opening quite small, risk of having signal integrity problems -In addition we see some unlock problems with the optical chain -> We need to work on insuring link reliability

12. Tolerable skews – current system Test a@P5 : the TSC mezzanines can reabsorb skews up to ±6.25 ns All muon barrel sectors 12 All 96 fibers inside each Trunk cable < 1.2 ns June 26th, 2012 12 We should have no problem (we don´t need all 96 fibers within ±6.25 ns either)

13. Goal: Replace SC crate with simple CuOF electronics and place TSC (Trigger Sector Collector) and ROS (Read Out Server) in USC during LS1 -ROS -TSC C. F. Bedoya June 26 th, 2012 13

14. First OFCU-RO prototype designed, fabricated and mounted Problem with the 25th channel Dual receiver: Communication with distributor and manufacturer didn’t clarify the problem Falling back to a different solution C. F. Bedoya June 26 th, 2012 14 Custom backplanes produced and mounted Mechanical tolerances validated Further tests waiting for other electronic boards to be ready (VME_patch and TSC_rear) TSC_rear being mounted Work at present being done on TSC to ROS link firmware implementation A. Navarro, C. F. Bedoya

15. Detects: unlocks, parity errors, misalignments, etc. (similar to final system) No real BER test can be performed with this system, but real TDC data is checked at 100 kHz L1A rate (chamber hits can be simulated) A two-day run test has been done, no errors found but further checks need to be performed Minicrate + 40 m LVDS cable (final) + CuOF mezz from Torino + 62 m Fiber from CERN + OFCU-RO + ROS C. F. Bedoya June 26 th, 2012 15 A. Navarro, C. F. Bedoya Images showing the 25th channel problem

16. Goal: Replace SC crate with simple CuOF electronics and place TSC (Trigger Sector Collector) and ROS (Read Out Server) in USC during LS1 -ROS -TSC C. F. Bedoya June 26 th, 2012 16

17. June 26 th, 2012 17 Purchase CERN Draka 96 cables/fiber in June (THAT IS NOW!!!) * Purchase in batches: - Readout fibers - Trigger fibers (maybe 2 batches) * Test them (continuity and length) at CERN-TS-EL-OF labCERN-TS-EL-OF * Store them in false ceiling of 904 * Do we want Wheel 0 fiber shorter? * Will DTTF work with 6 BX different delays??? (30 meters versus 60 meters => 6 BXs) Advantages: * Debug a fraction in parallel (allowing larger latency) (It will only serve for new TSC, DTTF needs one full wedge) * Make estimate of total volume of cable slack to be stored in cable trays * Calculate disposition of cable trays that are needed to be installed in S1 * Make estimate of total volume of cable slack to be stored in cable trays * Calculate disposition of cable trays that are needed to be installed in S1 Need to take a decision on fiber length to place order

18. DTTF TSC DT-DSS ROS DDU * TSC to be installed as close as possible to DTTF to minimize L1A latency. * Closest we got is S1D07-08 -Additional cable trays to be installed below the false floor to store extra slack from trunk cables -In addition quite some space required for fibers to be installed between racks: using upper cable trays and the ones below S1 C. F. Bedoya June 6th, 2012 18 60 fibers LC-LC ROUTED BELOW S1 60 fibers LC-LC ROUTED ON TOP 20 fibers LC-LC To S2G16 20 fibers LC-LC To S2G16 360 fibers LC-LC 10 meters ROUTED ON TOP Fibers from UXC ROUTED UNDER FALSE FLOOR

20. D. Dattola

21. C. F. Bedoya June 26th, 2012 21 Negligible impact in the propagation time due to fiber bending ( ~x0s ps)

22. C. F. Bedoya June 26th, 2012 22 OLD: TSC+60.8 m +3.6 m = 323 ns NEW: CUOF+62m+OFCU+1 m+ TSC + 10 m = 326 ns + CuOF (~3 ns?)+ 10 m (50 ns) = 379 ns NEW-OLD = 56 ns => 3 BXs We expect an increase in latency of 3 BXs TSC OptoRX DTTF 60.8 m 3.6 m TSC OptoRX DTTF 62 m 10 m CUOFOFCU 1 m

23. C. F. Bedoya June 26th, 2012 23 4 BXs budget in GMT input (DTTF?) 5 BXs budget CSCs 3 BXs expected increase of latency before DTTF External wheel primitives are forwarded to CSC Will this have an impact on CSC latency path? Discussed with CSC about latency increase: - It affects them, but it should be fine. (caveat: new CSCTF not designed yet) CMS total latency may increase up to 12 BXs more (DTTF ?). Discussed with CSC about latency increase: - It affects them, but it should be fine. (caveat: new CSCTF not designed yet) CMS total latency may increase up to 12 BXs more (DTTF ?).

24. June 26th, 2012 24 S. Ventura Inheriting the solution developed for the upgraded secondary links to control to CUOF boards and the OFCU- TSC Not needed for commissioning of the CUOF-OFCU chain, can arrive later

25. C. F. Bedoya June 26th, 2012 25 -Under development by Estonian group -Serializer board (Minicrate output stage) + Deserializer board (ROS or TSC input stage) -Based in a Spartan 6 evaluation board -Compact and flexible system: * link evaluation (BER, predefined patterns, loops, external synchronization signals, etc) * Production tests for the rest of the electronics * Fiber test after installation ( with an CuOF and a OFCU) * Easy to grow: can simulate various Minicrates for slice tests at 904 First prototypes expected very soon

26. C. F. Bedoya June 26th, 2012 26 CONCERS: * Reliability (functionality…) inserting the optical chain: old pattern units don’t work, link TSC does not stay looked for long, different terminations different behaviors * Fan-outs and CUOF mechanical constrains * Schedule: production is very tight Recommendation from ECR panel: Plan for 1 week of operation of a full crate (CUOF and OFCU-TSC, ROS) at normal temperature. SPLITTING OF SIGNALS Think about introducing an optical transmitter in the OFCU to have a signal splitting?

27. DT LS1 upgrade project milestones 2012 June -- new TRBs and CuOF prototypes tested for radiation tolerance Jun 2012 2012 June -- DT system Electronics Change Review 2012 Nov -- Installation plan review/ milestones reassessment 2013 March -- Fiber trunk cables ready for installation 2013 May -- new TRB theta ready for installation 2013 July -- CuOF-OFCu system ready for installation in one test wheel (YB-1?) 2013 Oct – PLAN A: Complete CuOF-OFCu system ready for installation in five wheels 2013 Oct – PLAN B: Reinstall current Sector Collector system in test wheel 27

28. C. F. Bedoya June 6th, 2012 28 Vmepc replacement DCS pc replacement DT-DSS relocation Fibers installation All USC fibers USC crates installation Wheel by wheel staged: Commissioning and Synchronization -LVDS recabling -CUOF installation -OFCU installation -ROS&TSC relocation Cooling tests? Launch production? (imo a little late…) Order fibers

29. LS1 Concise Schedule 29

31. 6/6/12DT Sector Collector Re-location ECR31 Water in CuOF up.Top crate. CuOF down.Top crate. CuOF up.Bottom crate. CuOF down.Bottom crate. Water out At B904, use the same set up used in 2007 for SC crate cooling tests. One rack can be filled with dummy CuOF mother boards with the same power consumption that the finals and similar heat distribution. Heat Exchangers, water cooling, turbine, air deflector, etc. similar to the final system. Temperature sensors for temperature reading. CuOF Temperature Thermal Picture The goal to measure the air impedance and to study how to maximize the air tightness. CuOF Cooling Tests S. Maselli

32. C. F. Bedoya June 26th, 2012 32 PRESENT system: 75A@5.2V, 1 A3100/crate75A@5.2V FUTURE system: 72A@4.3V, 2 A3050/crate72A@4.3V Output voltage 4.3 Volts (instead of present 5.2 Volts), to reduce heat dissipation No concerns regarding power dissipation No impact on 48V or 3-phase distribution BEFOREAFTER LS1 (The UXC racks are rated 3kW in average, with a peak of 4kW, though in our experience, proper cooling depends on the actual air impedance of the system)

33. 6/6/12DT Sector Collector Re-location ECR33  Signal integrity studies with OFCu (TRG and RO) ( July-August 2012)  Functional firmware with FPGA on I2C communication side (July-August 2012)  Finalize motherboard design, patch cords, LC adapters (September 2012)  Mother board prototype production (October 2012)  Integration of mother board + mezzanine with real Minicrate/Chamber. Cosmic test? (Autumn 2012)  Start PCB production (mother board + mezzanine) and material procurement launched (Jan 2013)  CuOF system ready for installation in one wheel (July 2013)  Complete CuOF system ready for installation in five wheels (October 2012) CuOF Future Milestones

34. DT LS1 work schedule fundaments It should not interfere with ordinary chambers + minicrates maintenance It should not interfere with TRB replacement work the current Sector Collector system should be used for tests of maintenance and TRB work All ancillary and infrastructure work (fibers, cables, crates) is anticipated to earlier possible The SC replacement work starts after repaired MC and replaced TRBs are stable. However one can parallelize work in different wheels Availability of power and services, and of CMS DAQ or miniDAQ at all times is of paramount importance 34

35. Plan A and plan B According to the LS1 plan drawn by technical coordination at the Divonne workshop, there is a window of opportunity between july and oct 2013 for performing the full SC relocation, reconnection and test of the new system in one test wheel (YB- 1), where at that moment the DT maintenance and TRB replacement work is already over We will take that opportunity so that, in case of major problems, we can reinstall the old system In case of fallback, fibers, crates, etc… will be in a ready to connect state, which will allow us to attempt the relocation again in a regular winter shutdown 35

36. Latency increase OFCu latency + 1m cable+ TSC cable equal = 11.4 ns Input to OFCu laser driver + 60m fiber trunk cable+ OFCu+ 1m cable +TSC cable equal = 326 ns CuOF latency to be added 10m fiber TSC-DTTF to be added Current system :TSC- DTTF fiber 305ns Difference: 326ns + CuOF + 30ns -305ns = 51ns +CuOF =3BXs? 36

37. Schedule- milestones CuOF-OFCu system ready for installation in one wheel July 2013 Complete CuOF-OFCu system ready for installation in five wheels Oct 2013 37

38. 6/6/12DT Sector Collector Re-location ECR38  CuOF mezzanine components selection and first prototypes (2011)  Radiation test for devices selection (October 2011)  CUOF Mezzanine prototype produced (February 2012)  Prototype testing (March 2012 – now)  CuOF mezzanine prototype delivered to different Labs for testing (April 2012)  Functional firmware with FPGA on CAN communication side (May 2012)  0 th version of mother board prototype production (May 2012)  Radiation test mezzanine + motherboard (May-June 2012)  DT System Electronic Change Review (June 2012) CuOF Milestones Accomplished

39. Fiber trunk cables in new system 1 trunk cable / 2 sectors ( 96 fibers in 8 ribbons of 12) 6 trunk cables/wheel + 1 spare => 35 trunk cables in total REQUIRE HIGH UNIFORMITY ~1-2 ns WITHIN the TRUNK ; more tolerant btwn trunks 39

40. Need to take a decision on fiber length

41. Goal: Replace SC crate with simple CuOF electronics and place TSC (Trigger Sector Collector) and ROS (Read Out Server) in USC during LS1 -ROS -TSC * Reliability for 2015- 2018 running is improved * Future upgrades are decoupled from LHC shutdowns C. F. Bedoya June 6th, 2012 41 * 1 to 1 channel Cu to OF conversion * “Analog” optical conversion: no multiplexing, no digitalization, no ser/deserialization * Limit artificial connectivity walls * Minimize latency impact * Reuse present ROS/TSC as a first stage (gradual impact) * Interface with DDU and DTTF can remain unchanged (common joint point for future upgrades)

42. C. F. Bedoya June 6th, 2012 42 Optical Splitters New TSC New ROS DDU Optical Splitters

43. DTTF Second level of DT read-out and trigger C. F. Bedoya June 6th, 2012 43 On detector

44. 10 Sector Collector crates (2/wheel): 60 ROS, 60 TSC, VME interface Contains the second level of: readout - ROS: Data merging and data quality monitoring trigger - TSC: Multiplexing and sorting sector trigger data Complex electronic system => MAIN TASK is MULTIPLEXING UXC level 2 Near C. F. Bedoya June 6th, 2012 44 Limits connectivity, single point of failure

45. The motivation is not the physics performance but the fact that aging and other risks may jeopardize detector operation and contribute to an accelerated degradation - Impact of a failure in one SC part compromises a large fraction of the detector - Recovery time can become significantly large (weeks) until access is granted Part failingAffected region%DT affected A3100Half a wheel in trigger and read-out10% LINCOHalf a wheel in trigger and read-out10% TIMHalf a wheel in trigger and read-out10% ROS1 Sector in the readout1.7% TSC1 Sector in the trigger1.7% C. F. Bedoya March 19th, 2012 45 But… also, we think this modification is a necessary change to allow future modifications that are forced to happen in a tight LHC schedule and happen simultaneously with a system that is already working Time to develop and commission electronics in UXC >>> electronics in USC

46. C. F. Bedoya June 26th, 2012 46