Presentation is loading. Please wait.

Presentation is loading. Please wait.

Hardware Requirements for Optical Circuit Switched Data Center Networks Nathan Farrington 1 Yeshaiahu Fainman 1 Hong Liu 2 George Papen 1 Amin Vahdat 1,2.

Similar presentations


Presentation on theme: "Hardware Requirements for Optical Circuit Switched Data Center Networks Nathan Farrington 1 Yeshaiahu Fainman 1 Hong Liu 2 George Papen 1 Amin Vahdat 1,2."— Presentation transcript:

1 Hardware Requirements for Optical Circuit Switched Data Center Networks Nathan Farrington 1 Yeshaiahu Fainman 1 Hong Liu 2 George Papen 1 Amin Vahdat 1,2 UCSD 1 Google 2 OFC/NFOEC 2011

2 In a Nutshell Problem: Data center network bandwidth is very expensive (10G: 12.5W/port, $500+/port) Helios Solution: Use both traditional EPS + 3D MEMS OCS … best of both worlds New Problem: Network performance is worse This Talk: Figuring out which hardware components need to be replaced in order to get better performance OTuH3 Room 502A 3:00pm Nathan Farrington 2

3 Bisection Bandwidth 10% Electrical (10:1 Oversubscribed) 100% ElectricalHelios Example 10% Electrical + 90% Optical Cost$6.3 M Power96.5 kW Cables6,656 Example: N=64 pods * k=1024 hosts/pod = 64K hosts total; 8 wavelengths OTuH3 Room 502A 3:00pm Nathan Farrington 3 N pods, k-ports each k switches, N-ports each

4 Bisection Bandwidth 10% Electrical (10:1 Oversubscribed) 100% ElectricalHelios Example 10% Electrical + 90% Optical Cost$6.3 M$62.3 M Power96.5 kW950.3 kW Cables6,65665,536 Example: N=64 pods * k=1024 hosts/pod = 64K hosts total; 8 wavelengths OTuH3 Room 502A 3:00pm Nathan Farrington 4 N pods, k-ports each k switches, N-ports each

5 Bisection Bandwidth 10% Electrical (10:1 Oversubscribed) 100% ElectricalHelios Example 10% Electrical + 90% Optical Cost$6.3 M$62.2 M$22.1 M2.8x Less Power96.5 kW950.3 kW157.2 kW6.0x Less Cables6,65665,53614,0164.7x Less Example: N=64 pods * k=1024 hosts/pod = 64K hosts total; 8 wavelengths OTuH3 Room 502A 3:00pm Nathan Farrington 5 Fewer Core Switches Fewer Core Switches N pods, k-ports each Less than k switches, N-ports each

6 How can we close the gaps? OTuH3 Room 502A 3:00pm 6 Nathan Farrington In this experiment, performance is 20% worse.

7 The life of a bit 17ms 15ms OTuH3 Room 502A 3:00pm 7 Nathan Farrington CDR: Clock/Data Recovery DFE: Decision Feedback Equalizer EPS: Electronic Packet Switch FFE: Feed-Forward Equalizer LD: Laser Driver OCS: Optical Circuit Switch PD: Photodetector PHY: Physical Layer Device SFI: SFP+ Electrical Interface SFP+: A 10G Transceiver Form Factor SMF: Single-mode Fiber TIA: Transimpedance Amplifier VGA: Variable Gain Amplifier XAUI: 10G Ethernet Attachment Unit Interface

8 OTuH3 Room 502A 3:00pm 8 Nathan Farrington

9 T 1 : Command Processing OTuH3 Room 502A 3:00pm Nathan Farrington 9 New! Old Embedded Linux microprocessor TL1 session over TCP (ASCII) 5ms per packet FPGA UDP (binary) 10 μ s per packet

10 T 2 : Mirror Reconfiguration OTuH3 Room 502A 3:00pm Nathan Farrington 10 New! Old Glimmerglass 2004 device Not optimized for this application 12ms average More power Smaller mirrors 100 μ s to 1ms

11 T 3 : Receiver Initialization OTuH3 Room 502A 3:00pm Nathan Farrington 11 New! Old NetLogic AEL2005 PHY Not optimized for LOS FFE/DFE: 600ms; VGA: 15ms No EDC (we are using SMF) Burst-mode TIA from 10G EPONs 200ns to 2 μ s

12 10μs 50x 100μs – 1ms 17x – 170x 200ns – 2μs 7500x – 75,000x OTuH3 Room 502A 3:00pm 12 Nathan Farrington

13 5MB50MB500MB5GB OTuH3 Room 502A 3:00pm Nathan Farrington 13 Definition of “better performance”: high throughput for quickly changing network traffic

14 Related Work N. Farrington, G. Porter, S. Radhakrishnan, H. Bazzaz, V. Subramanya, Y. Fainman, G. Papen, A. Vahdat. “Helios: A Hybrid Electrical/Optical Switch Architecture for Modular Data Centers.” In ACM SIGCOMM L. Schares, X.J. Zhang, R. Wagle, D. Rajan, P. Selo, S.P. Chang, J. Giles, K. Hildrum, D. Kuchta, J. Wolf, E. Schenfeld. “A reconfigurable interconnect fabric with optical circuit switch and software optimizer for stream computing systems.” In OFC/NFOEC 2009, paper OTuA OTuH3 Room 502A 3:00pm Nathan Farrington 14

15 Contact Information Mr. Nathan Farrington PhD Candidate University of California, San Diego Department of Computer Science and Engineering 9500 Gilman Drive, M/C 0404 La Jolla, CA USA Phone: Website: OTuH3 Room 502A 3:00pm Nathan Farrington 15


Download ppt "Hardware Requirements for Optical Circuit Switched Data Center Networks Nathan Farrington 1 Yeshaiahu Fainman 1 Hong Liu 2 George Papen 1 Amin Vahdat 1,2."

Similar presentations


Ads by Google