Photonic Networks on Chip Yiğit Kültür CMPE 511 – Computer Architecture Term Paper Presentation 27/11/2008.

Slides:



Advertisements
Similar presentations
CSE 413: Computer Networks
Advertisements

Electrical and Computer Engineering UAH System Level Optical Interconnect Optical Fiber Computer Interconnect: The Simultaneous Multiprocessor Exchange.
Comparison Of Network On Chip Topologies Ahmet Salih BÜYÜKKAYHAN Fall.
QuT: A Low-Power Optical Network-on-chip
A Novel 3D Layer-Multiplexed On-Chip Network
Presentation of Designing Efficient Irregular Networks for Heterogeneous Systems-on-Chip by Christian Neeb and Norbert Wehn and Workload Driven Synthesis.
1 Agenda TMA2 Feedback TMA3 T821 Bock 2. 2 Packet Switching.
REAL-TIME COMMUNICATION ANALYSIS FOR NOCS WITH WORMHOLE SWITCHING Presented by Sina Gholamian, 1 09/11/2011.
MULTICORE PROCESSOR TECHNOLOGY.  Introduction  history  Why multi-core ?  What do you mean by multicore?  Multi core architecture  Comparison of.
Optical communications & networking - an Overview
Module 3.4: Switching Circuit Switching Packet Switching K. Salah.
Internetworking Fundamentals (Lecture #1) Andres Rengifo Copyright 2008.
MICRO-MODEM RELIABILITY SOLUTION FOR NOC COMMUNICATIONS Arkadiy Morgenshtein, Evgeny Bolotin, Israel Cidon, Avinoam Kolodny, Ran Ginosar Technion – Israel.
IP I/O Memory Hard Disk Single Core IP I/O Memory Hard Disk IP Bus Multi-Core IP R R R R R R R R R R R R R R R R R R R R R R R R R R R R R R R R Networks.
NUMA Mult. CSE 471 Aut 011 Interconnection Networks for Multiprocessors Buses have limitations for scalability: –Physical (number of devices that can be.
1 Advances in Optical Switching Mohammad Ilyas, PhD College of Engineering & Computer Science Florida Atlantic University Boca Raton, Florida USA
EE 4272Spring, 2003 Chapter 9: Circuit Switching Switching Networks Circuit-Switching Networks Circuit-Switching Concept  Space-Division Switching  Time-Division.
Issues in System-Level Direct Networks Jason D. Bakos.
M. F. Chiang 1, Z. Ghassemlooy 1, W. P. Ng 1, H. Le Minh 2, and A. Abd El Aziz 1 1. Optical Communications Research Group School of Computing, Engineering.
COLUMBIA UNIVERSITY Interconnects Jim Tomkins: “Exascale System Interconnect Requirements” Jeff Vetter: “IAA Interconnect Workshop Recap and HPC Application.
RFAD LAB, YONSEI University IEEE TRANSACTIONS ON COMPUTERS, VOL. 57, NO. 9, SEPTEMBER 2008 Photonic Networks-on-Chip for Future Generations of Chip Multiprocessors.
1 Introduction to Optical Networks. 2 Telecommunications Network Architecture.
All Optical Switching Architectures. Introduction Optical switches are necessary for achieving reliable, fast and flexible modular communication means.
Chapter 1: Overview Lecturer: Alias Mohd Telecommunications Department Faculty of Electrical Engineering UTM SET 4573: Data Communication and Switching.
Data Communications and Networking
ROBERT HENDRY, GILBERT HENDRY, KEREN BERGMAN LIGHTWAVE RESEARCH LAB COLUMBIA UNIVERSITY HPEC 2011 TDM Photonic Network using Deposited Materials.
1 The Turn Model for Adaptive Routing. 2 Summary Introduction to Direct Networks. Deadlocks in Wormhole Routing. System Model. Partially Adaptive Routing.
Interconnect Networks
On-Chip Networks and Testing
Networks for Distributed Systems n network types n Connection-oriented and connectionless communication n switching technologies l circuit l packet.
Déjà Vu Switching for Multiplane NoCs NOCS’12 University of Pittsburgh Ahmed Abousamra Rami MelhemAlex Jones.
Computer Concepts 2014 Chapter 5 Local Area Networks.
QoS Support in High-Speed, Wormhole Routing Networks Mario Gerla, B. Kannan, Bruce Kwan, Prasasth Palanti,Simon Walton.
Data and Computer Communications Chapter 10 – Circuit Switching and Packet Switching (Wide Area Networks)
1 Optical Burst Switching (OBS). 2 Optical Internet IP runs over an all-optical WDM layer –OXCs interconnected by fiber links –IP routers attached to.
Data and Computer Communications Circuit Switching and Packet Switching.
William Stallings Data and Computer Communications 7 th Edition Chapter 1 Data Communications and Networks Overview.
1 CHAPTER 8 TELECOMMUNICATIONSANDNETWORKS. 2 TELECOMMUNICATIONS Telecommunications: Communication of all types of information, including digital data,
CS 8501 Networks-on-Chip (NoCs) Lukasz Szafaryn 15 FEB 10.
50 th Annual Allerton Conference, 2012 On the Capacity of Bufferless Networks-on-Chip Alex Shpiner, Erez Kantor, Pu Li, Israel Cidon and Isaac Keslassy.
RF network in SoC1 SoC Test Architecture with RF/Wireless Connectivity 1. D. Zhao, S. Upadhyaya, M. Margala, “A new SoC test architecture with RF/wireless.
NETWORKING FUNDAMENTALS. Network+ Guide to Networks, 4e2.
MULTICORE PROCESSOR TECHNOLOGY.  Introduction  history  Why multi-core ?  What do you mean by multicore?  Multi core architecture  Comparison of.
Department of Electronic Engineering City University of Hong Kong EE3900 Computer Networks Protocols and Architecture Slide 1 Use of Standard Protocols.
By Nasir Mahmood.  The NoC solution brings a networking method to on-chip communication.
Unit III Bandwidth Utilization: Multiplexing and Spectrum Spreading In practical life the bandwidth available of links is limited. The proper utilization.
HPEC 2007, Lexington, MA18-20 September, 2007 On-Chip Photonic Communications for High Performance Multi-Core Processors Keren Bergman, Luca Carloni, Columbia.
Interconnect Networks Basics. Generic parallel/distributed system architecture On-chip interconnects (manycore processor) Off-chip interconnects (clusters.
Assaf Shacham, Keren Bergman, Luca P. Carloni Presented for HPCAN Session by: Millad Ghane NOCS’07.
Team LDPC, SoC Lab. Graduate Institute of CSIE, NTU Implementing LDPC Decoding on Network-On-Chip T. Theocharides, G. Link, N. Vijaykrishnan, M. J. Irwin.
McGraw-Hill©The McGraw-Hill Companies, Inc., 2000 CH. 8: SWITCHING & DATAGRAM NETWORKS 7.1.
CCNA3 Module 4 Brierley Module 4. CCNA3 Module 4 Brierley Topics LAN congestion and its effect on network performance Advantages of LAN segmentation in.
Spring EE 437 Lillevik 437s06-l22 University of Portland School of Engineering Advanced Computer Architecture Lecture 22 Distributed computer Interconnection.
Effective bandwidth with link pipelining Pipeline the flight and transmission of packets over the links Overlap the sending overhead with the transport.
Data Communication & Networking. Data communication Not to be confused with telecommunication –Any process that permits the passage from a sender to one.
A Low-Area Interconnect Architecture for Chip Multiprocessors Zhiyi Yu and Bevan Baas VLSI Computation Lab ECE Department, UC Davis.
OPTICAL SWITCHING Presented by, VIVEK.S.M S7 EC ROLL NO:
Data and Computer Communications 8 th and 9 th Edition by William Stallings Chapter 10 – Circuit Switching and Packet Switching.
Connectors, Repeaters, Hubs, Bridges, Switches, Routers, NIC’s
Network-on-Chip Paradigm Erman Doğan. OUTLINE SoC Communication Basics  Bus Architecture  Pros, Cons and Alternatives NoC  Why NoC?  Components 
McGraw-Hill©The McGraw-Hill Companies, Inc., 2000 Muhammad Waseem Iqbal Lecture # 20 Data Communication.
Packet Switching Datagram Approach Virtual Circuit Approach
Analysis of a Chip Multiprocessor Using Scientific Applications
OPTICAL PACKET SWITCHING
Multiprocessor network topologies
Leveraging Optical Technology in Future Bus-based Chip Multiprocessors
Chapter 3 Part 3 Switching and Bridging
Optical communications & networking - an Overview
Multiprocessors and Multi-computers
Presentation transcript:

Photonic Networks on Chip Yiğit Kültür CMPE 511 – Computer Architecture Term Paper Presentation 27/11/2008

Contents  Introduction  Architecture Overview  Network Design  Analysis and Comparison  Conclusion

Introduction Multi-Core Architectures  Local processing frequencies reached fundamental performance limits: Further speed increase leads to tighter bounds on the logic coherently accessed on chip Associated power dissipation increases in an exponential fashion

Introduction Multi-Core Architectures  As a result processor manufacturers are introducing products based on multi-core architectures Aim is to optimize performance-per-watt by operating multiple parallel processors at lower clock frequencies

Introduction Multi-Core Architectures  AMD Opteron  Intel Montecito  Sun Niagara  IBM Cell  Power5

Introduction Emergence of a Key Bottleneck  Within the next few years, performance gains will come from increases in the number of processor cores per chip Global intrachip communications infrastructure will appear as a key bottleneck  Challange is to realize Enormous bandwidth capacity Low latency Power efficiency

Introduction Low-latency high-bandwidth: How?  Packet-switched networks Made of carefully engineered links Represent a shared medium that is highly scalable Provide enough bandwidth  But... Communication infrastructure is the major power consumer Power dissipation budget limit will be achieved

Introduction Photonic Technology  Photonic interconnection networks Low power dissipation independent of capacity Ultra-high throughput Minimal access latencies  Why less power? Once a photonic path is established, the data is transmitted end to end without the need for repeating, regeneration and buffering

Introduction Photonic Technology  Is photonic technology cheap enough? Since 2006, high-speed optical communications directly between silicon die are possible at a price-performance point competitive with traditional electrical interconnects

Contents  Introduction  Architecture Overview  Network Design  Analysis and Comparison  Conclusion

Architecture Overview Phonotonic NoC  Hybrid Approach Photonic interconnection network  Transmits high-bandwidth messages Electronic control network  Topologically identical to the photonic network  Controls the photonic network with small control messages

Architecture Overview Phonotonic NoC  Before transmitting a photonic message, an electronic control packet (path-setup packet) is routed in the electronic network acquires and sets up a photonic path for the message  Photonic message is transmitted without buffering once the path is acquired

Architecture Overview Photonic NoC  Main advantage of photonic paths is bit-rate transparency Photonic switches switch on or off once per message Energy dissipation does not depend on the bit-rate  whereas Traditional CMOS routers switch with every bit of transmitted data

Architecture Overview Photonic NoC  Another advantage is low loss in optical waveguides Power dissipated on a photonic link is completely independent of the transmission distance No matter if 2 cores are 2mm or 2cm apart

Architecture Overview Photonic NoC  2X2 photonic switching elements Capable of switching messages in a sub nanosecond switching time  Switches are arranged as a 2D matrix and organized in groups of four Each group is controlled by an electronic router to construct a 4X4 switch  Convenient for planar 2D topologies such as mesh and torus

Architecture Overview Photonic NoC  Each node includes a network gateway to serve as a photonic network interface Electronic/Optical (E/O) and Optical/Electronic (O/E) conversions Clock synchronization and recovery Serialization/deserialization  Wavelength division multiplexing is used at network gateways to provide larger data capacity Optical equivalent of using parallel wires

Architecture Overview Life of a Packet on Photonic NoC  Write operation from a processor in Node A to a memory in Node B 1.A path-setup packet is sent on the electronic control network  Includes information on the destination address of Node B and additional control information such as priority and flow id 2.Path-setup packet is routed in the electronic control network  Reserves the photonic switches along the path  At every router in the path, the next hop is decided according to the routing algorithm used 3.Path-setup packet reaches the destination Photonic path is reserved A fast light pulse is sent on the photonic path from Node B to Node A to indicate that the path is reserved

Architecture Overview Life of a Packet on Photonic NoC 4.The photonic message starts from Node A follows path from switch to switch until it reaches Node B 5.Message transmission completed 6.Path-teardown packet is sent from Node B to Node A on the electronic control network to release the path 7.Photonic message is checked for errors and a small acknowledgement packet is sent from Node B to Node A on the electronic control network

Contents  Introduction  Architecture Overview  Network Design  Analysis and Comparison  Conclusion

Network Design Building Blocks  Broadband Photonic Switching Element (PSE)  Based on a ring senator structure  Switch is a waveguide intersection positioned between two ring resonators  OFF State  Resonant frequency of the rings is different from the wavelength on which the optical data stream is modulated  Light passes through uninterrupted  ON State  Electrical current is injected to contracts surrounding the rings so that resonance of the rings shift  Light gets in the resonance and it is coupled into the rings making a right angle turn

Network Design Building Blocks  Broadband Photonic Switching Element (PSE)  Fast  30 ps switching time  Small  12 μm ring diameter  Low power consumption  <0.5 mW (ON)  ~0(OFF)

Network Design Building Blocks  PSEs are interconnected by silicon waveguides which carry photonic signals  PSEs are organized as groups of four  Electronic Router controls the quadruple, forming a 4X4 switch  Electronic Router is connected to the network with metal lines  Control packets are received in the electronic router, processed and sent to the next hop while PSEs are switched ON and OFF accordingly  Once a control packet completes the whole path, a chain of arranged PSEs are ready to transmit the photonic message  Small size  70 μm X 70 μm

Network Design Building Blocks  4X4 Switch is blocking  Constructing a nonblocking 4X4 switch requires an extremely complex structure Negative impact on the area Optical signal integrity  U-turns are forbidden to limit blocking

Network Design Topology  The communication requirements for a chip multiprocessor are best served by a 2D regular topology such as mesh and torus  A regular 2D topology requires 5X5 switches Too complex to implement using photonic technology  How to construct the topology with 4X4 switches? Use a folded torus topology as a base Add access points for the gateways  Facilitate injection and ejection without interference with the through traffic  Avoid blocking between injected and ejected traffic which may be caused by the switches’ internal blocking

Network Design Topology

 Avoid internal blocking by a set of injection-ejection rules: Injected messages make a turn at the gateway switch, according to their destination and enter the torus network through an injection switch Messages are ejected from the torus network when they arrive to the ejection switch associated with their final destination

Network Design Topology

Network Design Routing  Each message is encoded with two intermediate and a final address, encapsulated within one another  Routing: 1.1st intermediate address directs the message to the injection switch 2.Message is routed on the torus using plain XY dimension order routing to the 2nd intermediate address which is the ejection switch 3.Final address directs the message to the destination gateway

Network Design Flow Control  Flow control technique greatly differs from common fully electronic NoCs Electronic control packets are exchanged to acquire photonic paths Data are only transmitted with a very high bandwidth once the path is acquired Path setup latency >> Transmission latency  Control messages are very small and do not require large resources in terms of additional circuitry or power

Contents  Introduction  Architecture Overview  Network Design  Analysis and Comparison  Conclusion

Analysis and Comparison Power Dissipation  Case Study Setup 16-node CMP where each processor requires  BW peak = 1024 Gb/s  BW avg = 800 Gb/s Traffic driven by the processors is assumed to be uniform Both networks use a mesh topology and XY dimension order routing

Analysis and Comparison Power Dissipation  Reference Electronic Network 4X4 mesh, where each router is integrated in one processor tile PW=765W  Photonic Network 8X8 photonic mesh 256 photonic switching elements organized as 64 4X4 switches PW=30W(96% less power dissipation)

Contents  Introduction  Architecture Overview  Network Design  Analysis and Comparison  Conclusion

Conclusion  The advantages of photonic medium High transmission bandwidth Low power consumption  Recent (i.e. since 2006) advances make photonic technology practical for NoCs Fabrication of silicon photonic devices Integration of photonic devices in CMOS electronic circuits  Next generation of NoCs will possibly use photonic technology

References  On the Design of a Photonic Network-on-Chip Assaf Shacham, Keren Bergman, Luca P. Carloni First International Symposium on Networks-on-Chip (NOCS'07), pp , 2007  Photonic Networks-on-Chip: Opportunities and Challenges Michele Petracca, Keren Bergman, Luca P. Carloni IEEE International Symposium on Circuits and Systems 2008 (ISCAS 2008), pp , May 2008  The Case for Low-Power Photonic Networks on Chip Assaf Shacham, Keren Bergman, Luca P. Carloni Proceedings of the 44th Annual Conference on Design Automation, pp , 2007  Maximizing GFLOPS-per-Watt: High-Bandwidth, Low Power Photonic On-Chip Networks Shacham, K Bergman, LP Carloni IBM P=ac2 Conference, October 2006