Diagnosing Spatio-Temporal Internet Congestion Properties Leiwen Deng Aleksandar Kuzmanovic EECS Department Northwestern University

Slides:



Advertisements
Similar presentations
pathChirp Efficient Available Bandwidth Estimation
Advertisements

U NIVERSITY OF M ASSACHUSETTS, A MHERST Department of Computer Science R3: Robust Replication Routing in Wireless Networks with Diverse Connectivity Characteristics.
User-level Internet Path Diagnosis Ratul Mahajan, Neil Spring, David Wetherall and Thomas Anderson Designed by Yao Zhao.
June 3, A New Multipath Routing Protocol for Ad Hoc Wireless Networks Amit Gupta and Amit Vyas.
Are You Moved by Your Social Network Application? Gregory Peaker.
The Power of Explicit Congestion Notification Aleksandar Kuzmanovic Northwestern University
1 Modeling and Taming Parallel TCP on the Wide Area Network Dong Lu,Yi Qiao Peter Dinda, Fabian Bustamante Department of Computer Science Northwestern.
An Algebraic Approach to Practical and Scalable Overlay Network Monitoring Yan Chen, David Bindel, Hanhee Song, Randy H. Katz Presented by Mahesh Balakrishnan.
U NIVERSITY OF M ASSACHUSETTS, A MHERST Department of Computer Science Informed Detour Selection Helps Reliability Boulat A. Bash.
Exploring Tradeoffs in Failure Detection in P2P Networks Shelley Zhuang, Ion Stoica, Randy Katz HIIT Short Course August 18-20, 2003.
Internet Iso-bar: A Scalable Overlay Distance Monitoring System Yan Chen, Lili Qiu, Chris Overton and Randy H. Katz.
1 A Suite of Schemes for User-level Network Diagnosis without Infrastructure Yao Zhao, Yan Chen Lab for Internet and Security Technology, Northwestern.
Monitoring Persistently Congested Internet Links Leiwen (Karl) Deng Aleksandar Kuzmanovic Northwestern University
Aleksandar Kuzmanovic & Edward W. Knightly A Performance vs. Trust Perspective in the Design of End-Point Congestion Control Protocols.
Delayed Internet Routing Convergence Craig Labovitz, Abha Ahuja, Abhijit Bose, Farham Jahanian Presented By Harpal Singh Bassali.
A General approach to MPLS Path Protection using Segments Ashish Gupta Ashish Gupta.
PAM A Measurement Study of Internet Delay Asymmetry Abhinav PathakPurdue University Himabindu PuchaPurdue University Ying ZhangUniversity of Michigan.
1 TCP-LP: A Distributed Algorithm for Low Priority Data Transfer Aleksandar Kuzmanovic, Edward W. Knightly Department of Electrical and Computer Engineering.
1 End-to-End Detection of Shared Bottlenecks Sridhar Machiraju and Weidong Cui Sahara Winter Retreat 2003.
1 Drafting Behind Akamai (Travelocity-Based Detouring) AoJan Su, David R. Choffnes, Aleksandar Kuzmanovic, and Fabian E. Bustamante Department of Electrical.
User-level Internet Path Diagnosis R. Mahajan, N. Spring, D. Wetherall and T. Anderson.
FTDCS 2003 Network Tomography based Unresponsive Flow Detection and Control Authors Ahsan Habib, Bharat Bhragava Presenter Mohamed.
Adaptive Self-Configuring Sensor Network Topologies ns-2 simulation & performance analysis Zhenghua Fu Ben Greenstein Petros Zerfos.
Yao Zhao 1, Yan Chen 1, David Bindel 2 Towards Unbiased End-to-End Diagnosis 1.Lab for Internet & Security Tech, Northwestern Univ 2.EECS department, UC.
Ningning HuCarnegie Mellon University1 A Measurement Study of Internet Bottlenecks Ningning Hu (CMU) Joint work with Li Erran Li (Bell Lab) Zhuoqing Morley.
What Lies Beneath: Understanding Internet Congestion Leiwen Deng Aleksandar Kuzmanovic Northwestern University Bruce Davie, Cisco Systems
1 Lecture 25: Interconnection Networks Topics: communication latency, centralized and decentralized switches, routing, deadlocks (Appendix E) Review session,
The Delta Routing Project Low-loss Routing for Hybrid Private Networks George Porter (UCB) Minwen Ji, Ph.D. (SRC - HP Labs)
A General approach to MPLS Path Protection using Segments Ashish Gupta Ashish Gupta.
Scalable and Deterministic Overlay Network Diagnosis Yao Zhao, Yan Chen Northwestern Lab for Internet and Security Technology (LIST) Dept. of Computer.
Computer Science 1 Characterizing Link Properties Using “Loss-pairs” Jun Liu (joint work with Prof. Mark Crovella)
Building a Strong Foundation for a Future Internet Jennifer Rexford ’91 Computer Science Department (and Electrical Engineering and the Center for IT Policy)
Improving the Reliability of Internet Paths with One-hop Source Routing Krishna Gummadi, Harsha Madhyastha Steve Gribble, Hank Levy, David Wetherall Department.
Ao-Jan Su, David R. Choffnes, Fabián E. Bustamante and Aleksandar Kuzmanovic Department of EECS Northwestern University Relative Network Positioning via.
CS An Overlay Routing Scheme For Moving Large Files Su Zhang Kai Xu.
End-to-end QoE Optimization Through Overlay Network Deployment Bart De Vleeschauwer, Filip De Turck, Bart Dhoedt and Piet Demeester Ghent University -
Internet Routing Dynamics and NSIS Related Considerations draft-shen-nsis-routing-00.txt Charles Shen, Henning Schulzrinne, Sung-Hyuck Lee IETF#61 – Washington.
Overlay Network Physical LayerR : router Overlay Layer N R R R R R N.
A Routing Underlay for Overlay Networks Akihiro Nakao Larry Peterson Andy Bavier SIGCOMM’03 Reviewer: Jing lu.
Comparison of Public End-to-End Bandwidth Estimation tools on High-Speed Links Alok Shriram, Margaret Murray, Young Hyun, Nevil Brownlee, Andre Broido,
Packet Dispersion in IEEE Wireless Networks Mingzhe Li, Mark Claypool and Bob Kinicki WPI Computer Science Department Worcester, MA 01609
CS551: End-to-End Packet Dynamics Paxon’99 Christos Papadopoulos (
Packet switching network Data is divided into packets. Transfer of information as payload in data packets Packets undergo random delays & possible loss.
Detecting the Long-Range Dependence in the Internet Traffic with Packet Trains Péter Hága, Gábor Vattay Department Of Physics of Complex Systems Eötvös.
SenProbe: Path Capacity Estimation in Wireless Sensor Networks Tony Sun, Ling-Jyh Chen, Guang Yang M. Y. Sanadidi, Mario Gerla.
N. Hu (CMU)L. Li (Bell labs) Z. M. Mao. (U. Michigan) P. Steenkiste (CMU) J. Wang (AT&T) Infocom 2005 Presented By Mohammad Malli PhD student seminar Planete.
PathChirp Spatio-Temporal Available Bandwidth Estimation Vinay Ribeiro Rolf Riedi, Richard Baraniuk Rice University.
Maximizing Lifetime per Unit Cost in Wireless Sensor Networks
Symbiotic Routing in Future Data Centers Hussam Abu-Libdeh Paolo Costa Antony Rowstron Greg O’Shea Austin Donnelly MICROSOFT RESEARCH Presented By Deng.
A Wakeup Scheme for Sensor Networks: Achieving Balance between Energy Saving and End-to-end Delay Xue Yang, Nitin H.Vaidya Department of Electrical and.
Troubleshooting Mesh Networks Lili Qiu Joint Work with Victor Bahl, Ananth Rao, Lidong Zhou Microsoft Research Mesh Networking Summit 2004.
A Reliability-oriented Transmission Service in Wireless Sensor Networks Yunhuai Liu, Yanmin Zhu and Lionel Ni Computer Science and Engineering Hong Kong.
Stochastic Fair Blue An Algorithm For Enforcing Fairness Wu-chang Feng (OGI/OHSU) Dilip Kandlur (IBM) Debanjan Saha (Tellium) Kang Shin (University of.
NetQuest: A Flexible Framework for Large-Scale Network Measurement Lili Qiu University of Texas at Austin Joint work with Han Hee Song.
Bing Wang, Wei Wei, Hieu Dinh, Wei Zeng, Krishna R. Pattipati (Fellow IEEE) IEEE Transactions on Mobile Computing, March 2012.
Improving Fault Tolerance in AODV Matthew J. Miller Jungmin So.
1 Effective Diagnosis of Routing Disruptions from End Systems Ying Zhang Z. Morley Mao Ming Zhang.
Efficient Geographic Routing in Multihop Wireless Networks Seungjoon Lee*, Bobby Bhattacharjee*, and Suman Banerjee** *Department of Computer Science University.
Access Link Capacity Monitoring with TFRC Probe Ling-Jyh Chen, Tony Sun, Dan Xu, M. Y. Sanadidi, Mario Gerla Computer Science Department, University of.
© 2006 Andreas Haeberlen, MPI-SWS 1 Monarch: A Tool to Emulate Transport Protocol Flows over the Internet at Large Andreas Haeberlen MPI-SWS / Rice University.
Problem: Internet diagnostics and forensics
Monitoring Persistently Congested Internet Links
Monitoring Network Bias
DDoS Attack Detection under SDN Context
Pong: Diagnosing Spatio-Temporal Internet Congestion Properties
Ling-Jyh Chen, Mario Gerla Computer Science Department, UCLA
Tony Sun, Guang Yang, Ling-Jyh Chen, M. Y. Sanadidi, Mario Gerla
2019/5/13 A Weighted ECMP Load Balancing Scheme for Data Centers Using P4 Switches Presenter:Hung-Yen Wang Authors:Peng Wang, George Trimponias, Hong Xu,
pathChirp Efficient Available Bandwidth Estimation
pathChirp Efficient Available Bandwidth Estimation
Presentation transcript:

Diagnosing Spatio-Temporal Internet Congestion Properties Leiwen Deng Aleksandar Kuzmanovic EECS Department Northwestern University

A. KuzmanovicDiagnosing Spatio-Temporal Internet Congestion Properties 2 Problem Detect congestion events on an end-to-end path and reveal their spatio-temporal properties: –Where they happen (edge, core, intra-AS, inter-AS)? –How long they last / frequently occur? SD

A. KuzmanovicDiagnosing Spatio-Temporal Internet Congestion Properties 3 Why Do We Care? Fault diagnosis Advanced congestion control Distributed monitoring systems Overlay design We want to know! SD

A. KuzmanovicDiagnosing Spatio-Temporal Internet Congestion Properties 4 Challenges Congestion events relatively infrequent –Measure queuing delay instead of Ploss No/low support from the network –Combine e2e with probes to intermediate nodes Path asymmetry –Measurements still possible via “measurable pairs”

A. KuzmanovicDiagnosing Spatio-Temporal Internet Congestion Properties 5 Outline Methodology Implementation (Pong) Validation Measurements Results

A. KuzmanovicDiagnosing Spatio-Temporal Internet Congestion Properties 6 Methodology Highlights Coordinated probing –Send 4, 3, or 2 packets from two endpoints Quality of Measurability (QoM) –Able to deterministically detect its own inaccuracy Self-adaptivity –Switch between different probing schemes based on QoM and path properties

A. KuzmanovicDiagnosing Spatio-Temporal Internet Congestion Properties 7 Coordinated Probing SD Probe f s d b 4-p probing: a symmetric path scenario f probeb probes probed probe,,,

A. KuzmanovicDiagnosing Spatio-Temporal Internet Congestion Properties 8 Coordinated Probing SD f s d b ΔfsΔfs ΔfdΔfd Half-path queuing delay Locating Congestion Points Tracing Congestion Status Probe ΔdΔd ΔbΔb ΔfΔf ΔsΔs

A. KuzmanovicDiagnosing Spatio-Temporal Internet Congestion Properties 9 Locating Congestion Points SD Probe ΔfsΔfs ΔfdΔfd ΔfsΔfs ΔfdΔfd ΔfsΔfs ΔfdΔfd ΔfsΔfs ΔfsΔfs ΔfdΔfd ΔfdΔfd 1. Probe Scheduling Sequentially probe (4-p) nodes on the path

A. KuzmanovicDiagnosing Spatio-Temporal Internet Congestion Properties 10 Locating Congestion Points Correlate probes to neighboring nodes SD Probe 2. Switch Point Approach Detect Switch Point Congestion

A. KuzmanovicDiagnosing Spatio-Temporal Internet Congestion Properties 11 Tracing Congestion Status SD Probe Link 1 (Located Congestion Point) Link 1 Congestion Status Time Congestion Reuse probes sent to un-congested routers

A. KuzmanovicDiagnosing Spatio-Temporal Internet Congestion Properties 12 Measurable Pairs S D f s b d Measurable Pair Complementary d probe Congestion 4-p probing scenario

A. KuzmanovicDiagnosing Spatio-Temporal Internet Congestion Properties 13 Quality of Measurability S D f s b d Measurable Pair Complementary d probe Congestion Condition: Δf +Δb ≈Δs +Δd max(Δf +Δb, Δs +Δd) QoM 4p = 1 − |(Δf +Δb) − (Δs +Δd)|

A. KuzmanovicDiagnosing Spatio-Temporal Internet Congestion Properties 14 Experiments 400 PlanetLab nodes Measure each pair for 1 hour 23,351 paths within 8 days

A. KuzmanovicDiagnosing Spatio-Temporal Internet Congestion Properties 15 Results Edge vs. core –Edge more frequently congested than the core: 14 times on average Intra-AS vs. Inter-AS –Edge: Intra-AS > Inter-AS –Core: Intra-AS < Inter-AS Time domain –Edges: congestion events clustered in time –Core: congestion events dispersed in time Links vs. Paths –Links: 12% congested, 3% considerably –Paths: 20% considerably congested

A. KuzmanovicDiagnosing Spatio-Temporal Internet Congestion Properties 16 Conclusions Spatio-temporal Internet congestion properties New methodology –Coordinated probing –Detect its own inaccuracy –Self adaptive to path properties –Handles path asymmetries Implemented, deployed, evaluated, measured –High accuracy in both spatial and temporal domains Future work: –Triggered monitoring system to learn more