SCALABLESCALABLE Ankit Singla, P. Brighten Godfrey Kevin Fall, Sylvia Ratnasamy, Gianluca Iannaccone ON.

Slides:



Advertisements
Similar presentations
1 S4: Small State and Small Stretch Routing for Large Wireless Sensor Networks Yun Mao 2, Feng Wang 1, Lili Qiu 1, Simon S. Lam 1, Jonathan M. Smith 2.
Advertisements

P2P data retrieval DHT (Distributed Hash Tables) Partially based on Hellerstein’s presentation at VLDB2004.
Ion Stoica, Robert Morris, David Karger, M. Frans Kaashoek, Hari Balakrishnan MIT and Berkeley presented by Daniel Figueiredo Chord: A Scalable Peer-to-peer.
Peer to Peer and Distributed Hash Tables
Pastry Peter Druschel, Rice University Antony Rowstron, Microsoft Research UK Some slides are borrowed from the original presentation by the authors.
Scalable Content-Addressable Network Lintao Liu
TAP: A Novel Tunneling Approach for Anonymity in Structured P2P Systems Yingwu Zhu and Yiming Hu University of Cincinnati.
Compact Routing in Theory and Practice Lenore J. Cowen Tufts University.
CHORD – peer to peer lookup protocol Shankar Karthik Vaithianathan & Aravind Sivaraman University of Central Florida.
Lecture 5 - Routing On the Flat Labels M.Sc Ilya Nikolaevskiy Helsinki Institute for Information Technology (HIIT)
Chord: A scalable peer-to- peer lookup service for Internet applications Ion Stoica, Robert Morris, David Karger, M. Frans Kaashock, Hari Balakrishnan.
Massively Distributed Database Systems Distributed Hash Spring 2014 Ki-Joune Li Pusan National University.
Sylvia Ratnasamy, Paul Francis, Mark Handley, Richard Karp, Scott Schenker Presented by Greg Nims.
Geographic Routing Without Location Information A. Rao, S. Ratnasamy, C. Papadimitriou, S. Shenker, I. Stoica Paper and Slides by Presented by Ryan Carr.
Geometry of large networks (computer science perspective) Dmitri Krioukov (CAIDA/UCSD) AIM, November 2011.
Symphony: Distributed Hashing in a Small World Gurmeet Singh Manku Mayank Bawa Prabhakar Raghavan Presented by Satpreet Singh.
Common approach 1. Define space: assign random ID (160-bit) to each node and key 2. Define a metric topology in this space,  that is, the space of keys.
Scribe: A Large-Scale and Decentralized Application-Level Multicast Infrastructure Miguel Castro, Peter Druschel, Anne-Marie Kermarrec, and Antony L. T.
IPSN/SPOTS 2007 Beacon Location Service A Location Service for Point-to-Point Routing in Wireless Sensor Networks EECS Department University of California,
CPSC 689: Discrete Algorithms for Mobile and Wireless Systems Spring 2009 Prof. Jennifer Welch.
Sylvia Ratnasamy, Paul Francis, Mark Handley, Richard Karp, Scott Shenker A Scalable, Content- Addressable Network (CAN) ACIRI U.C.Berkeley Tahoe Networks.
Positive Feedback Loops in DHTs or Be Careful How You Simulate January 13, 2004 Sean Rhea, Dennis Geels, Timothy Roscoe, and John Kubiatowicz From “Handling.
Distributed Lookup Systems
Ad Hoc Networks Routing
CS 268: Ad Hoc Routing Kevin Lai Feb 20, Ad Hoc Motivation  Internet goal: decentralized control -someone still has to deploy.
1 Load Balance and Efficient Hierarchical Data-Centric Storage in Sensor Networks Yao Zhao, List Lab, Northwestern Univ Yan Chen, List Lab, Northwestern.
1 CS 194: Distributed Systems Distributed Hash Tables Scott Shenker and Ion Stoica Computer Science Division Department of Electrical Engineering and Computer.
CS 268: Overlay Networks: Distributed Hash Tables Kevin Lai May 1, 2001.
1 Load Balance and Efficient Hierarchical Data-Centric Storage in Sensor Networks Yao Zhao, List Lab, Northwestern Univ Yan Chen, List Lab, Northwestern.
Beacon Vector Routing: Scalable Point-to-Point Routing in Wireless Sensornets.
Geographic Routing Without Location Information A. Rao, C. Papadimitriou, S. Shenker, and I. Stoica In Proceedings of the 9th Annual international Conference.
On Self Adaptive Routing in Dynamic Environments -- A probabilistic routing scheme Haiyong Xie, Lili Qiu, Yang Richard Yang and Yin Yale, MR and.
Ad Hoc Wireless Routing COS 461: Computer Networks
A Scalable Location Service for Geographic Ad Hoc Routing Jinyang Li, John Jannotti, Douglas S. J. De Couto, David R. Karger, Robert Morris MIT Laboratory.
1 A scalable Content- Addressable Network Sylvia Rathnasamy, Paul Francis, Mark Handley, Richard Karp, Scott Shenker Pirammanayagam Manickavasagam.
CS 453 Computer Networks Lecture 24 IP Routing. See…
P2P Architecture Case Study: Gnutella Network
Itrat Rasool Quadri ST ID COE-543 Wireless and Mobile Networks
PIC: Practical Internet Coordinates for Distance Estimation Manuel Costa joint work with Miguel Castro, Ant Rowstron, Peter Key Microsoft Research Cambridge.
The Impact of DHT Routing Geometry on Resilience and Proximity K. Gummadi, R. Gummadi..,S.Gribble, S. Ratnasamy, S. Shenker, I. Stoica.
Information-Centric Networks07a-1 Week 7 / Paper 1 Internet Indirection Infrastructure –Ion Stoica, Daniel Adkins, Shelley Zhuang, Scott Shenker, Sonesh.
Network Layer4-1 Chapter 4: Network Layer r 4. 1 Introduction r 4.2 Virtual circuit and datagram networks r 4.3 What’s inside a router r 4.4 IP: Internet.
Chi-Cheng Lin, Winona State University CS 313 Introduction to Computer Networking & Telecommunication Chapter 5 Network Layer.
Ion Stoica, Robert Morris, David Karger, M. Frans Kaashoek, Hari Balakrishnan MIT and Berkeley presented by Daniel Figueiredo Chord: A Scalable Peer-to-peer.
Efficient Labeling Scheme for Scale-Free Networks The scheme in detailsPerformance of the scheme First we fix the number of hubs (to O(log(N))) and show.
GPSR: Greedy Perimeter Stateless Routing for Wireless Networks EECS 600 Advanced Network Research, Spring 2005 Shudong Jin February 14, 2005.
Scalable Content- Addressable Networks Prepared by Kuhan Paramsothy March 5, 2007.
Peer to Peer A Survey and comparison of peer-to-peer overlay network schemes And so on… Chulhyun Park
MobiQuitous 2007 Towards Scalable and Robust Service Discovery in Ubiquitous Computing Environments via Multi-hop Clustering Wei Gao.
CarNet/Grid: Scalable Ad-Hoc Geographic Routing Robert Morris MIT / LCS
A Scalable Routing Protocol for Ad Hoc Networks Eric Arnaud Id:
P2P Group Meeting (ICS/FORTH) Monday, 28 March, 2005 A Scalable Content-Addressable Network Sylvia Ratnasamy, Paul Francis, Mark Handley, Richard Karp,
Topologically-Aware Overlay Construction and Sever Selection Sylvia Ratnasamy, Mark Handley, Richard Karp, Scott Shenker.
LOOKING UP DATA IN P2P SYSTEMS Hari Balakrishnan M. Frans Kaashoek David Karger Robert Morris Ion Stoica MIT LCS.
Two Peer-to-Peer Networking Approaches Ken Calvert Net Seminar, 23 October 2001 Note: Many slides “borrowed” from S. Ratnasamy’s Qualifying Exam talk.
Energy Efficient Data Management for Wireless Sensor Networks with Data Sink Failure Hyunyoung Lee, Kyoungsook Lee, Lan Lin and Andreas Klappenecker †
Spring 2000CS 4611 Routing Outline Algorithms Scalability.
Nick McKeown CS244 Lecture 17 Chord: A Scalable Peer-to-peer Lookup Service for Internet Applications [Stoica et al 2001]
CS694 - DHT1 Distributed Hash Table Systems Hui Zhang University of Southern California.
Mobile Networks and Applications (January 2007) Presented by J.H. Su ( 蘇至浩 ) 2016/3/21 OPLab, IM, NTU 1 Joint Design of Routing and Medium Access Control.
Incrementally Improving Lookup Latency in Distributed Hash Table Systems Hui Zhang 1, Ashish Goel 2, Ramesh Govindan 1 1 University of Southern California.
BUFFALO: Bloom Filter Forwarding Architecture for Large Organizations Minlan Yu Princeton University Joint work with Alex Fabrikant,
Routing Scalability Mingwei Hu Tarek Elgamal. Background Routing Scheme A mechanism that can delivers network packets from any node to any other nodes.
Revisiting Ethernet: Plug-and-play made scalable and efficient
Plethora: Infrastructure and System Design
Accessing nearby copies of replicated objects
Turning Heterogeneity into an Advantage in Overlay Routing
Department of Computer Science University of York
A Scalable Content Addressable Network
MIT LCS Proceedings of the 2001 ACM SIGCOMM Conference
Presentation transcript:

SCALABLESCALABLE Ankit Singla, P. Brighten Godfrey Kevin Fall, Sylvia Ratnasamy, Gianluca Iannaccone ON

Scalable Routing N UMBER OF N ODES = n N OT V ERY S CALABLE ! S HORTEST -P ATH R OUTING ? R OUTING S TATE /N ODE

Scalable Routing S TRUCTURED T OPOLOGIES 3 4, 11 6, 20 But, what about general topologies?

Scalable Routing H IERARCHY Inefficient Location-dependent addressing s t 4

Why Not DNS/DHTs? Arbitrarily long paths! 5 W HERE IS A? A R IGHT N EXT TO Y OU, S ILLY !

Local Name Resolution Why local name-resolution matters – Google: 400ms delay = 0.59% searches/user – Time for name-resolution is a significant fraction of latency for short flows (which are the majority) – Fate sharing property 6

Arbitrary names – independent of location Useful primitive – Mobility – Security – Simplified management 7 Flat Names

Another Way to Scale Compact Routing – [Thorup & Zwick ’01, Abraham et al. ’04] – Idea: accept (slightly) longer paths, get lower state – State => Stretch 8

... Compact Routing N UMBER OF N ODES = n R OUTING S TATE /N ODE 9

Algorithm != Protocol N OT DISTRIBUTED N OT DYNAMIC 10

Disco 11 * Assumption: partial source routes are of size O(polylog(n))..

Disco Local Name Resolution Name Resolution NDDisco: Name-Dependent Distributed Compact Routing 12

NDDisco 13 s Addr (t) = (L(t), b, t) t L(t) b

NDDisco 14 s t' L(t') For nearby nodes, the approximation can be poor!

NDDisco 15 s t' L(t) t

NDDisco 16 s L(t) Destination can help! t

Disco Local Name Resolution Name Resolution NDDisco: Name-Dependent Distributed Compact Routing Name Resolution 17

Name Resolution Name -> Address mappings stored in DHT over landmarks Similar to prior work [BVR, S4] Arbitrarily high stretch for address lookup! 18 s t

Disco Local Name Resolution Name Resolution NDDisco: Name-Dependent Distributed Compact Routing Local Name Resolution 19

Local Name Resolution t s 20 ? L(t) Smells like hash functions!

Sloppy Groups Increasing h() E VERYONE A GREES ON T HIS P ART t G(t) 21

Address Dissemination Requirements: – Low diameter for quick dissemination of addresses – Low messaging overhead – Fault tolerance Increasing h() 22

Address Dissemination Predecessor, successor and small O(1) number of fingers Distance-vector style dissemination of addresses 23 Increasing h()

1: Overlay Topology Predecessor, successor and small O(1) number of fingers – Fault tolerance: Use landmarks to fix overlay when broken – Miserly messaging: each node hears each address O(1) times – We don’t care about routing, only diameter, which is small! Increasing h() 24

2: Dissemination Protocol Disseminate new addresses learnt to overlay neighbors Record where each address was learnt from (distance vector-like) Always forward away from the direction received from – Avoids count-to-infinity problem because of ordered space Increasing h() 25

Handling Failures: Example No soft-state required! Update only on changes Increasing h() G ET N EW N EIGHBOR F ROM L ANDMARK W ITHDRAW A DDRESSES L EARNT FROM X 26 X

Routing in Disco 27 w(t) s computes h(t) w(t) = Longest-prefix match for h(t) in Vicinity(s) First : s w(t) L(t) t Later: s L(t) t s t L(t)

Protocol Messages Estimating ‘n’: synopses exchanged with neighbors Landmark and Vicinity updates: path vector style Sloppy-group bootstrap through landmarks Address-dissemination: distance-vector style 28 s

Summary 29

Evaluation Protocols – Disco – NDDisco – S4 [Mao et al ‘07] – VRR [Caesar et al ‘06] refer to paper Topologies – Router-level Internet topology (n = 192,244) – AS-level Internet topology (n = 30,610) – Geometric random graphs, mean degree 8 – G(n, m), mean degree 8 30

State S HORTEST P ATH P ROTOCOL 31 NDD ISCO S4 G EOMETRIC R ANDOM G RAPHS OF I NCREASING S IZE

State 32 L ONG T AIL S4 D ISCO NDD ISCO R OUTER -L EVEL I NTERNET T OPOLOGY

First-Packet Stretch G EOMETRIC RANDOM GRAPH NODES R OUTER -L EVEL I NTERNET T OPOLOGY L ARGE F IRST -P ACKET S TRETCH D ISCO S4 D ISCO L IMITED BY S MALL P ATH - LENGTHS IN T OPOLOGY

Later-Packets Stretch G EOMETRIC RANDOM GRAPH NODES R OUTER -L EVEL I NTERNET T OPOLOGY 34 D ISCO < 1.2 N EAR -I DENTICAL S4 D ISCO

Are the Landmarks Clobbered? AS-L EVEL I NTERNET T OPOLOGY 35 ~4 IN EVERY 10,000 EDGES SEE MORE CONGESTION D ISCO

Conclusion 36

Thank You Questions?