1. electronic department A photonic network for data acquisition systems for deep-sea neutrino telescopes Presentation on behalf of the KM3NeT consortium by Jelle Hogenbirk Home institute: Nikhef Amsterdam

2. electronic department This talk is dedicated to Dr. Charles Kao VLVnT 2009 Athens 10 October 2009Jelle Hogenbirk et.al. 2 The part of this year's award associated with Mr. Kao underscores the fact that optical fibers carry an increasing fraction of phone calls, television programs, and internet traffic into homes. Data can move down silicon fiber more quickly than through copper wire because nothing is faster than light, and light signaling offers higher bandwidth for electronic circuitry. Encoding information in the form of light pulses rather than as electric pulses allows more data to flow down a line. Kao's principal achievement was in making the fiber more efficient; by excluding impurities in the fiber material, he developed a material that absorbed less of the light carrying signals over long distances. For more information please consult: http://www.ieeeghn.org/wiki/index.php/Oral-History:Charles_Kao physics Nobel prize winner 2009

3. electronic department Outline of this talk Requirements System setup  CW lasers (continuous wave)  R-EAM’s (reflective electro absorption modulator)  DWDM technology (Dense Wavelength Division Multiplexer)  bidirectional optical signaling with multiple λ’s /fibre Realized items Further developments VLVnT 2009 Athens 10 October 2009Jelle Hogenbirk et.al. 3 Development team: Peter Healey 1 Mar van der Hoek 3 Jelle Hogenbirk 2 Peter Jansweijer 2 Sander Mos 2 Henk Peek 2 David Smith 1 1 Center for Integrated Photonics 2 Nikhef 3 VanderHoekPhotonics

4. electronic department A facility network VLVnT 2009 Athens 10 October 2009Jelle Hogenbirk et.al. 4 3 years ago and taking progress in technology in account the starting point for the DAQ system requirements were:  All data to shore  Preferable: synchronous data readout  Integrated clock and event time system  Proven technology including COTS (commercial of the shelf) components  A node network for about 6000 clients.  Flexible interfacing to the network must be guaranteed over its life time of > 15 years after deployment.  Taking KM3NeT scale into account, optimize designs in electrical power consumption on seabed facility dependence to RAMS (reliability, availability,maintainability, safety) criteria and keep the network affordable

5. electronic department electronic-photonic front end design idea VLVnT 2009 Athens 10 October 2009Jelle Hogenbirk et.al. 5 From PMT’s 0214515 I 0 I 1 I x identifier DDDDDDDDDDD Trigger all Zener diodes at the same time and The delay times are tuned to 100 ps serialized output after optical trigger electric output to optical modulator 2R or 3R ? modulator unit CW + readout clock pulse Later the clk pulse is the “heartbeat” 3 15 1,6 nsec 3,2 nsec I 0 I 1 I x 0 1 2 3 4 5 Pulse detector & gain flattening ~ 7ns Example 16 PMT’s and 4 identifiers => 20 data bits. Optical trigger repetition rate: 1,6 nsec 3,2 nsec 80 160 psec sample pulse width. If “D” delay 100 psec then the system adapts to 10Gb/s optical transmission technology. Photonic pulse stream e.g. every 2 nsec resistor ToT signal PMT 2 ToT signal PMT 5 # PMT’s D

6. electronic department Recovering PMT’s Time over Threshold on shore VLVnT 2009 Athens 10 October 2009Jelle Hogenbirk et.al. 6 Hit 1 Hit 2 Late hit? PMT 2 PMT 5 2 nsec Readout pulses the “heartbeats” x +.. 1 2 3 4 5 6 7 8 # PMT 1 2 3 4 5 100 psec 1 2 3 4 5 2 nsec Original PMT Pulse ToT Readout pulses x+.. Recovering PMT’s ToT Sub-sea Shore Related pulses

7. electronic department Signal path and loop-timing scheme VLVnT 2009 Athens 10 October 2009Jelle Hogenbirk et.al. 7 7 Modulator (gate) Generating CW + heartbeat signal On one fiber to/from OM 2x(N+1) AWG DWDM Optical receiver Circulator Reflective Modulator Optical Amplifiers Power splitters to feed up to 100 units Single shared feed fibre with DWDM seed plus clock / framing on 1 Burst-mode Optical receiver PMT electronics tap 1 2+3 N+ (N+1) 1 (N+1) AWG FSR Gated Semicondutor Optical Amplifier for Signal propagation time measurements CDR & controller 20% 10% To Gated SOA 30% OPTICAL MODULE 2.0 km of single fiber CW seed + heartbeat and in opposite direction modulated signal back to shore Mirror (for 100km loop timing) Sub-sea Shore

8. electronic department Measurement Results VLVnT 2009 Athens 10 October 2009Jelle Hogenbirk et.al. 8 Santec 1558.7nm (back-to-back) Laser Backscatter impact on 10G/s 2km SMF28 in the R-EAM link

9. electronic department 5 Detection Unit options sub-sea network VLVnT 2009 Athens 10 October 2009Jelle Hogenbirk et.al. 9 May be in JB or DU Strings of 20 OMs over 20 floors To JB OM1 1 fibre to each OM 20 DU12543 20-fibre ribbon connection to string 100ch AWG To JB 20ch cyclic AWGs OM1 1 fibre to each OM 20 WDM ADMs DU12543 Single fibre interface to each string (a) Single AWG* ribbon connectors (b) Multiple AWGs* + ADM** single-fibre connectors *AWG (Arrayed Wave Guide) is the applied hardware for DWDM (Dense Wavelength Division Multiplexing) technology **ADM (Add Drop Multiplexer) take out # wavelengths from a wavelength comb on a fibre and put them back on after external access

10. electronic department Test bench SPARK VLVnT 2009 Athens 10 October 2009Jelle Hogenbirk et.al. 10 cw ch 17 cw ch 18 cw tun DWDM combiner R-EAM DWDM PIN driver clk data driver clk data driver clk data receiver clk data clk data 17 18 19 AWG 17 18 19 R-EAM SOA to sub-seafrom shore to shorefrom sub-sea sub-clk Sophisticated Photonic Architecture Readout for KM3Net laboratory optical network test setup for 10Gb/s FPGA 20 km fiber (without optical amplifiers) And tested at 100 km (with optical amplifiers) Optical connector for flexible use of SPARK Sub-seaShore

11. electronic department Realized SPARK setup for 10Gb/s VLVnT 2009 Athens 10 October 2009Jelle Hogenbirk et.al. 11

12. electronic department Results pulse Transmission over 10 km VLVnT 2009 Athens 10 October 2009Jelle Hogenbirk et.al. 12 48.80 ps jitter mainly from P-N change over in the electronic circuitry Refer to next presentation of Peter Jansweijer

13. electronic department 10 Gb/s Eye Pattern VLVnT 2009 Athens 10 October 2009Jelle Hogenbirk et.al. 13 Received signal after a 10 km connection at receiver output BER figure shows Signal Quality 72.4 mV/div Clock Rec: 10,3125 Gb/s Time 16.2 ps/div Trig: Pattern 5.1 mV LBW 4.13 MHz Delay 40.1552 ns Bit 113 BER is Bit Error Rate The more open “eye” The better SNR (Signal to Noise Ratio)

14. electronic department Node Interface Kit VLVnT 2009 Athens 10 October 2009Jelle Hogenbirk et.al. 14 shore DM laser R-EAM PIN CW laser FPGA Mem PIN 311 Mhz clock GbE 311 Mhz clock GPS Receiver and reference clock SPARK Light e.g. OM “Heartbeat” with embedded SC up to 12x 10 Gb/s 10 Gb/s Continuous wave laser PMT data TTC Gen. I/O including a basic firmware for the 10 gb/s network end-node Evaluation board Altera Stratix IV GT determining the functionality in the end-node FPGA interface outside world to the optical network Typ. power Stratix GT SERDES: 171 mW at 10.3 Gbps Altera Stratix IV GT sampling now Xilinx Virtex 6 HXT sampling Q1 2010 Optical Network (transparent for the data transmission format)

15. electronic department Node Interface Kit VLVnT 2009 Athens 10 October 2009Jelle Hogenbirk et.al. 15 shore DM laser R-EAM PIN CW laser FPGA Mem PIN 311 Mhz clock GbE 311 Mhz clock GPS Receiver and reference clock e.g. OM “Heartbeat” with embedded SC up to 12x 10 Gb/s 10 Gb/s Continuous wave laser PMT data TTC Gen. I/O end-node Evaluation board Altera Stratix IV GT PMT readout, TTC and general I/O Functionality hard/firmware to be implemented by the client FPGA Typ. power Stratix GT SERDES: 171 mW at 10.3 Gbps Altera Stratix IV GT sampling now Xilinx Virtex 6 HXT sampling Q1 2010 DWDM (depicted 1 channel) SPARK

16. electronic department Example of NIK Node implementation VLVnT 2009 Athens 10 October 2009Jelle Hogenbirk et.al. 16 FPGA Altera Stratix IV POWER Board CDR R-EAM driver PIN R-EAM 3D COMPASS HMC5843 ADC LED Beacon PMT control PMT LVDS signals Acoustic Sensor Optical Network Sensors: -Temperature? -Voltage? -Water? PMT’s I2CI2C I 2 C Bus SPI 622Mbps 10Gbps 31 LVDS signals 10 - 14V 1V8, 3V3, 5V Control Spare I/O Octopus Board Mezzanine Boards All I/O 3v3 or 1v8 or LVDS for the Multiple PMT Optical Module SPARK

17. electronic department A photonic network for data acquisition systems for deep-sea neutrino telescopes VLVnT 2009 Athens 10 October 2009Jelle Hogenbirk et.al.17

18. electronic department VLVnT 2009 Athens 10 October 2009Jelle Hogenbirk et.al. 18 Expertise is the last thing you need for an animated discussion Thank you and remember