ElasticTree: Saving Energy in Data Center Networks 許倫愷 2013/5/28.

Slides:



Advertisements
Similar presentations
Greening Backbone Networks Shutting Off Cables in Bundled Links Will Fisher, Martin Suchara, and Jennifer Rexford Princeton University.
Advertisements

Data Center Networking with Multipath TCP
Improving Datacenter Performance and Robustness with Multipath TCP
Deconstructing Datacenter Packet Transport Mohammad Alizadeh, Shuang Yang, Sachin Katti, Nick McKeown, Balaji Prabhakar, Scott Shenker Stanford University.
Jaringan Komputer Lanjut Packet Switching Network.
Improving Datacenter Performance and Robustness with Multipath TCP Costin Raiciu, Sebastien Barre, Christopher Pluntke, Adam Greenhalgh, Damon Wischik,
ElasticTree: Saving Energy in Data Center Networks Brandon Heller, Srini Seetharaman, Priya Mahadevan, Yiannis Yiakoumis, Puneed Sharma, Sujata Banerjee,
1 Advancing Supercomputer Performance Through Interconnection Topology Synthesis Yi Zhu, Michael Taylor, Scott B. Baden and Chung-Kuan Cheng Department.
PFabric: Minimal Near-Optimal Datacenter Transport Mohammad Alizadeh Shuang Yang, Milad Sharif, Sachin Katti, Nick McKeown, Balaji Prabhakar, Scott Shenker.
An Analytical Model for Worst-case Reorder Buffer Size of Multi-path Minimal Routing NoCs Gaoming Du 1, Miao Li 1, Zhonghai Lu 2, Minglun Gao 1, Chunhua.
SIGCOMM 2003 Making Intra-Domain Routing Robust to Changing and Uncertain Traffic Demands: Understanding Fundamental Tradeoffs David Applegate Edith Cohen.
Towards Virtual Routers as a Service 6th GI/ITG KuVS Workshop on “Future Internet” November 22, 2010 Hannover Zdravko Bozakov.
Optimizing genetic algorithm strategies for evolving networks Matthew Berryman.
ElasticTree: Saving Energy in Data Center Networks Very offended by KALYAN MANDA LEI XIA.
“ElasticTree: Saving energy in data center networks“ by Brandon Heller, Seetharaman, Mahadevan, Yiakoumis, Sharma, Banerjee, McKeown presented by Nicoara.
Datacenter Network Topologies
Ashish Gupta Under Guidance of Prof. B.N. Jain Department of Computer Science and Engineering Advanced Networking Laboratory.
A Comparison of Layering and Stream Replication Video Multicast Schemes Taehyun Kim and Mostafa H. Ammar.
Traffic Engineering With Traditional IP Routing Protocols
FireFly: A Reconfigurable Wireless Datacenter Fabric using Free-Space Optics Navid Hamedazimi, Zafar Qazi, Himanshu Gupta, Vyas Sekar, Samir Das, Jon.
A Scalable, Commodity Data Center Network Architecture Mohammad Al-Fares, Alexander Loukissas, Amin Vahdat Presented by Gregory Peaker and Tyler Maclean.
A Scalable, Commodity Data Center Network Architecture.
1 Algorithms for Bandwidth Efficient Multicast Routing in Multi-channel Multi-radio Wireless Mesh Networks Hoang Lan Nguyen and Uyen Trang Nguyen Presenter:
Performance and Power Efficient On-Chip Communication Using Adaptive Virtual Point-to-Point Connections M. Modarressi, H. Sarbazi-Azad, and A. Tavakkol.
Energy Aware Network Operations Authors: Priya Mahadevan, Puneet Sharma, Sujata Banerjee, Parthasarathy Ranganathan HP Labs IEEE Global Internet Symposium.
Not All Microseconds are Equal: Fine-Grained Per-Flow Measurements with Reference Latency Interpolation Myungjin Lee †, Nick Duffield‡, Ramana Rao Kompella†
Exploiting Virtualization for Delivering Cloud based IPTV Services Speaker : 吳靖緯 MA0G IEEE Conference on Computer Communications Workshops.
Identifying and Using Energy Critical Paths Nedeljko Vasić with Dejan Novaković, Satyam Shekhar, Prateek Bhurat, Marco Canini, and Dejan Kostić EPFL, Switzerland.
Cost-Performance Tradeoffs in MPLS and IP Routing Selma Yilmaz Ibrahim Matta Boston University.
DaVinci: Dynamically Adaptive Virtual Networks for a Customized Internet Jennifer Rexford Princeton University With Jiayue He, Rui Zhang-Shen, Ying Li,
Network Aware Resource Allocation in Distributed Clouds.
Copyright © 2011, Programming Your Network at Run-time for Big Data Applications 張晏誌 指導老師:王國禎 教授.
CS : Software Defined Networks 3rd Lecture 28/3/2013
A Distributed Energy Saving Approach for Ethernet Switches in Data Centers Weisheng Si 1, Javid Taheri 2, Albert Zomaya 2 1 School of Computing, Engineering,
David G. Andersen CMU Guohui Wang, T. S. Eugene Ng Rice Michael Kaminsky, Dina Papagiannaki, Michael A. Kozuch, Michael Ryan Intel Labs Pittsburgh 1 c-Through:
Budapest University of Technology and Economics Department of Telecommunications and Media Informatics Optimized QoS Protection of Ethernet Trees Tibor.
1 Finding Constant From Change: Revisiting Network Performance Aware Optimizations on IaaS Clouds Yifan Gong, Bingsheng He, Dan Li Nanyang Technological.
TOMA: A Viable Solution for Large- Scale Multicast Service Support Li Lao, Jun-Hong Cui, and Mario Gerla UCLA and University of Connecticut Networking.
A.SATHEESH Department of Software Engineering Periyar Maniammai University Tamil Nadu.
Scalable Multi-Class Traffic Management in Data Center Backbone Networks Amitabha Ghosh (UtopiaCompression) Sangtae Ha (Princeton) Edward Crabbe (Google)
Joint Power Optimization Through VM Placement and Flow Scheduling in Data Centers DAWEI LI, JIE WU (TEMPLE UNIVERISTY) ZHIYONG LIU, AND FA ZHANG (CHINESE.
VL2: A Scalable and Flexible Data Center Network Albert Greenberg, James R. Hamilton, Navendu Jain, Srikanth Kandula, Changhoon Kim, Parantap Lahiri, David.
Paper # – 2009 A Comparison of Heterogeneous Video Multicast schemes: Layered encoding or Stream Replication Authors: Taehyun Kim and Mostafa H.
Mobile Agent Migration Problem Yingyue Xu. Energy efficiency requirement of sensor networks Mobile agent computing paradigm Data fusion, distributed processing.
DaVinci: Dynamically Adaptive Virtual Networks for a Customized Internet Jiayue He, Rui Zhang-Shen, Ying Li, Cheng-Yen Lee, Jennifer Rexford, and Mung.
Intradomain Traffic Engineering By Behzad Akbari These slides are based in part upon slides of J. Rexford (Princeton university)
Real-Time Performance Analysis of Adaptive Link Rate Baoke Zhang, Karthikeyan Sabhanatarajan, Ann Gordon-Ross*, Alan D. George* This work was supported.
Dzmitry Kliazovich University of Luxembourg, Luxembourg
SYMBIOTIC ROUTING IN FUTURE DATA CENTER 工科三 陳泰穎. Outline 1. CamCube 1. Traditional data center 2. The problems 3. CamCube philosophy 4. Feature 5. What’s.
Interconnect Networks Basics. Generic parallel/distributed system architecture On-chip interconnects (manycore processor) Off-chip interconnects (clusters.
Theophilus Benson*, Ashok Anand*, Aditya Akella*, Ming Zhang + *University of Wisconsin, Madison + Microsoft Research.
1 Traffic Engineering By Kavitha Ganapa. 2 Introduction Traffic engineering is concerned with the issue of performance evaluation and optimization of.
Internet Traffic Engineering Motivation: –The Fish problem, congested links. –Two properties of IP routing Destination based Local optimization TE: optimizing.
1 Scalability and Accuracy in a Large-Scale Network Emulator Nov. 12, 2003 Byung-Gon Chun.
Schedulers for Hybrid Data Center Network Neelakandan Manihatty Bojan 2 nd Year PhD Student Advisor: Dr. Andrew W. Moore Eurosys Doctoral Workshop, 18.
A Hierarchical Edge Cloud Architecture for Mobile Computing IEEE INFOCOM 2016 Liang Tong, Yong Li and Wei Gao University of Tennessee – Knoxville 1.
Data Center Architectures
Chen Qian, Xin Li University of Kentucky
Energy Aware Network Operations
Yiting Xia, T. S. Eugene Ng Rice University
Data Center Network Architectures
Hydra: Leveraging Functional Slicing for Efficient Distributed SDN Controllers Yiyang Chang, Ashkan Rezaei, Balajee Vamanan, Jahangir Hasan, Sanjay Rao.
Chuanxiong Guo, et al, Microsoft Research Asia, SIGCOMM 2008
Improving Datacenter Performance and Robustness with Multipath TCP
A Study of Group-Tree Matching in Large Scale Group Communications
Improving Datacenter Performance and Robustness with Multipath TCP
ElasticTree Michael Fruchtman.
ElasticTree: Saving Energy in Data Center Networks
Data Center Architectures
Towards Predictable Datacenter Networks
Presentation transcript:

ElasticTree: Saving Energy in Data Center Networks 許倫愷 2013/5/28

About the paper Brandon Heller, Srini Seetharaman, Priya Mahadevan, Yiannis Yiakoumis, Puneet Sharma, Sujata Banerjee, Nick McKeown NSDI’10 (USENIX conference on Networked systems design and implementation) Citation: pages

Outline The big picture Introduction ElasticTree system Analysis Conclusion

Outline The big picture Introduction ElasticTree system Analysis Conclusion

The motivation

Very inefficient!! Desired

Why wasting power Provisioning for peak Time varying traffic demands Low efficiency at low loads

The goal of ElasticTree

The approach… Turn off unneeded links and switches

The challenge Performance Fault tolerance Scalability

Outline The big picture Introduction ElasticTree system Analysis Conclusion

Introduction What is ElasticTree: ElasticTree is a system for dynamically adapting the energy consumption of a data center network What does it do: Finding minimum-power network subsets across a range of traffic patterns Trade-off: energy efficiency, performance and robustness

Introduction

Data center network (Traditional) 2N Tree: One failure can cut the effective bisection bandwidth in half; two failures can disconnect servers

Data center network Fat tree : SIGCOMM 2008, A Scalable, Commodity Data Center Network Architecture

Data center network provision for peak workload Traffic varies daily, weekly, monthly, and yearly.

Energy Proportionality The strategy: turn off the links and switches that we don’t need

Outline The big picture Introduction ElasticTree system Analysis Conclusion

ElasticTree ElasticTree is a system for dynamically adapting the energy consumption of a data center network

ElasticTree If 0.2 Gbps of traffic per host,1 Gbps link…

ElasticTree 13/20 switches and 28/48 links stay active ElasticTree reduces network power by 38%

ElasticTree The optimizer : find the minimum- power network subset which satisfies current traffic conditions

Optimizer As traffic conditions change, the optimizer continuously re-computes the optimal network subset 3 approaches: Formal Model, Greedy Bin-Packing, Topology-aware Heuristic

Optimizer comparison

Formal model Finding the optimal flow assignment alone is an NP- complete problem for integer flows. Derived from standard multi-commodity flow (MCF) problem The model outputs a subset of the original topology, plus the routes taken by each flow to satisfy the traffic matrix O(n^3.5+)

Greedy Bin-Packing Strategy: choose the leftmost one with sufficient capacity O(n^2+) 1G link

Greedy Bin-Packing 1G link

Topo-aware Heuristic 1. does not compute the set of flow routes 2. assumes perfectly divisible flows => pack every link to full utilization and reduce TCP bandwidth => starter subset Decoupling power optimization from routing : => can be applied alongside any fat tree routing algorithm

Topo-aware Heuristic An edge switch doesn’t care which aggregation switches are active, but instead, how many are active

Topo-aware Heuristic Decoupling power optimization from routing

Optimizer comparison

Outline The big picture Introduction ElasticTree system Analysis Conclusion

How to test K = 6, fat tree OpenFlow

Analysis Traffic pattern: Near: servers communicate only with other servers through their edge switch Far: servers communicate only with servers in other pods

Analysis Random demand: Individual aggregation/core switches turning on/off

Analysis 70% to outside, 30% inside DCN Different traffic load

Analysis: redundancy If only the MST is on => no redundancy => no fault tolerance

Analysis: redundancy +MST: additive cost, multiplicative benefit

Analysis: latency Need safety margin!! Ethernet overheads (preamble, inter-frame spacing, and the CRC) cause the egress buffer to fill up Packets either get dropped or significantly delayed

Analysis: latency Safety margin is the amount of capacity reserved at every link by the optimizer Traffic overload is the amount each host sends and receives beyond the original traffic matrix Trade-off between Energy and Performance

Outline The big picture Introduction ElasticTree system Analysis Conclusion

Summary

Reference The paper The slide (by the author) A youtube video (by the author, too)

Questions

Thank you!