Drafting Behind Akamai (Travelocity-Based Detouring) Dr. Yingwu Zhu.

Slides:



Advertisements
Similar presentations
Dynamic Replica Placement for Scalable Content Delivery Yan Chen, Randy H. Katz, John D. Kubiatowicz {yanchen, randy, EECS Department.
Advertisements

Relative Network Positioning via CDN Redirections A. Su, D. Choffnes, F. Bustamante, A. Kuzmanovic ICDCS 2008 Presented by: Imranul Hoque.
IPv6 seen from DNS Dr. WANG Xin, CNNIC Labs 25 Aug 2009.
1 Server Selection & Content Distribution Networks (slides by Srini Seshan, CS CMU)
Dynamic Routing Scalable Infrastructure Workshop, AfNOG2008.
On the Effectiveness of Measurement Reuse for Performance-Based Detouring David Choffnes Fabian Bustamante Fabian Bustamante Northwestern University INFOCOM.
DNS, Web, TCP Sequence Numbers EE122 Discussion 10/19/2011.
1 Routing and Scheduling in Web Server Clusters. 2 Reference The State of the Art in Locally Distributed Web-server Systems Valeria Cardellini, Emiliano.
SCAN: A Dynamic, Scalable, and Efficient Content Distribution Network Yan Chen, Randy H. Katz, John D. Kubiatowicz {yanchen, randy,
Cis e-commerce -- lecture #6: Content Distribution Networks and P2P (based on notes from Dr Peter McBurney © )
An Analysis of Internet Content Delivery Systems Stefan Saroiu, Krishna P. Gommadi, Richard J. Dunn, Steven D. Gribble, and Henry M. Levy Proceedings of.
King : Estimating latency between arbitrary Internet end hosts Krishna Gummadi, Stefan Saroiu Steven D. Gribble University of Washington Presented by:
U NIVERSITY OF M ASSACHUSETTS, A MHERST Department of Computer Science Informed Detour Selection Helps Reliability Boulat A. Bash.
CDNs & Replication Prof. Vern Paxson EE122 Fall 2007 TAs: Lisa Fowler, Daniel Killebrew, Jorge Ortiz.
Understanding the Network and User-Targeting Properties of Web Advertising Networks Yong Wang 1,2 Daniel Burgener 1 Aleksandar Kuzmanovic 1 Gabriel Maciá-Fernández.
IMC 2004Jeff Pang 1 Availability, Usage, and Deployment Characteristics of the Domain Name System Jeffrey Pang *, James Hendricks *, Aditya Akella *, Roberto.
Anycast Jennifer Rexford Advanced Computer Networks Tuesdays/Thursdays 1:30pm-2:50pm.
Drafting Behind Akamai (Travelocity-Based Detouring) Aleksandar Kuzmanovic Northwestern University Joint work with: A. Su, D. Choffnes, and F. Bustamante.
1 Drafting Behind Akamai (Travelocity-Based Detouring) AoJan Su, David R. Choffnes, Aleksandar Kuzmanovic, and Fabian E. Bustamante Department of Electrical.
1 Web Content Delivery Reading: Section and COS 461: Computer Networks Spring 2007 (MW 1:30-2:50 in Friend 004) Ioannis Avramopoulos Instructor:
Web Caching and CDNs March 3, Content Distribution Motivation –Network path from server to client is slow/congested –Web server is overloaded Web.
Caching and Content Distribution Networks. Web Caching r As an example, we use the web to illustrate caching and other related issues browser Web Proxy.
Content Distribution Networks (CDNs) Mike Freedman COS 461: Computer Networks Lectures: MW 10-10:50am in Architecture N101
Content Distribution Network (CDN) Performance Punit Shah CSE581 Internet Technologies OGI, OHSU 2002, Jan 16th.
Information-Centric Networks05a-1 Week 5 / Paper 1 On the use and performance of content distribution networks –Balachander Krishnamurthy, Craig Wills,
1 Content Distribution Networks. 2 Replication Issues Request distribution: how to transparently distribute requests for content among replication servers.
Active Network Applications Tom Anderson University of Washington.
A User Experience-based Cloud Service Redeployment Mechanism KANG Yu.
Sipat Triukose, Zhihua Wen, Michael Rabinovich WWW 2011 Presented by Ye Tian for Course CS05112.
 Zhichun Li  The Robust and Secure Systems group at NEC Research Labs  Northwestern University  Tsinghua University 2.
Redirection and Load Balancing
1. 1.Charting the CDNs(locating all their content and DNS servers). 2.Assessing their server availability. 3.Quantifying their world-wide delay performance.
{ Content Distribution Networks ECE544 Dhananjay Makwana Principal Software Engineer, Semandex Networks 5/2/14ECE544.
Improving the Reliability of Internet Paths with One-hop Source Routing Krishna Gummadi, Harsha Madhyastha Steve Gribble, Hank Levy, David Wetherall Department.
Ao-Jan Su, David R. Choffnes, Fabián E. Bustamante and Aleksandar Kuzmanovic Department of EECS Northwestern University Relative Network Positioning via.
Taming the Torrent: A Practical Approach to Reducing Cross-ISP Traffic in Peer-to-Peer Systems David R. Choffnes and Fabián E. Bustamante Speaker: Wally.
1 Chapter 6: Proxy Server in Internet and Intranet Designs Designs That Include Proxy Server Essential Proxy Server Design Concepts Data Protection in.
Application-Layer Anycasting By Samarat Bhattacharjee et al. Presented by Matt Miller September 30, 2002.
CDN Brokering* Presented By Nick Arnold Authors Alexandros Biliris, et. Al.
CPSC 441: Multimedia Networking1 Outline r Scalable Streaming Techniques r Content Distribution Networks.
2: Application Layer1 Chapter 2 outline r 2.1 Principles of app layer protocols r 2.2 Web and HTTP r 2.3 FTP r 2.4 Electronic Mail r 2.5 DNS r 2.6 Socket.
1 On the Placement of Web Server Replicas Lili Qiu, Microsoft Research Venkata N. Padmanabhan, Microsoft Research Geoffrey M. Voelker, UCSD IEEE INFOCOM’2001,
 An Internet Protocol address (IP address) is a numerical label assigned to each device (e.g., computer, printer) participating in a computer network.
Advanced Networking Lab. Given two IP addresses, the estimation algorithm for the path and latency between them is as follows: Step 1: Map IP addresses.
Strong Cache Consistency Support for Domain Name System Xin Chen, Haining Wang, Sansi Ren and Xiaodong Zhang College of William and Mary, Williamsburg,
TOMA: A Viable Solution for Large- Scale Multicast Service Support Li Lao, Jun-Hong Cui, and Mario Gerla UCLA and University of Connecticut Networking.
Making the Best of the Best-Effort Service (2) Advanced Multimedia University of Palestine University of Palestine Eng. Wisam Zaqoot Eng. Wisam Zaqoot.
Content distribution networks (CDNs) r The content providers are the CDN customers. Content replication r CDN company installs hundreds of CDN servers.
Measuring and Evaluating Large-Scale CDNs Huang et al. An offensive analysis Daniel Burgener John Otto F'09 - EECS 440 Adv Net - 7 Oct 2009.
Globally Distributed Content Delivery Presenter: Baoning Wu 03/25/2003.
Content Distribution Network, Proxy CDN: Distributed Environment
IEEE MEDIA INDEPENDENT HANDOVER Title: An existing use of DNS Date Submitted: Authors or Sources: H Anthony Chan Abstract: Current.
Skynet: A Cloud-Based Data Transfer Architecture Aleksandar Kuzmanovic
CS 6401 Overlay Networks Outline Overlay networks overview Routing overlays Resilient Overlay Networks Content Distribution Networks.
Algorithms and Techniques in Structured Scalable Peer-to-Peer Networks
THE INTERNET INTRODUCTION TO BUSINESS TECHNOLOGY.
An Analysis of Internet Content Delivery Systems 19 rd November, 2007 Youngsub CSE, SNU.
Content Distribution Networks (CDNs)
John S. Otto Mario A. Sánchez John P. Rula Fabián E. Bustamante Northwestern, EECS.
Drafting Behind Akamai (Travelocity-Based Detouring) Ao-Jan Su, David R. Choffnes, Aleksandar Kuzmanovic and Fabián E. Bustamante Department of EECS Northwestern.
By Cheng-Lin Tsao Felipe Santos Ruhull Alam Bhuiyan
CloudFront: Living on the Edge
Early Measurements of a Cluster-based Architecture for P2P Systems
On the Use and Performance of Content Distribution Networks
Content Distribution Networks
AWS Cloud Computing Masaki.
Network Applications: Multi-Server Request Routing
Content Delivery and Remote DNS services
EE 122: Lecture 22 (Overlay Networks)
Presentation transcript:

Drafting Behind Akamai (Travelocity-Based Detouring) Dr. Yingwu Zhu

Motivation Overlay networks – Build the “view” of the underlying network – Passive and active measurements To determine overlay paths according to some metric, e.g., latency? Redundant, non-scalable, & overhead (expensive!) What common service we may need in place? – An Internet weather-report service

Proposed Approach Fact – CDNs (e.g., Akamai) perform extensive network and server measurements Publish the results through DNS over short time scales Can overlay networks recycle measurements collected by production CDNs? – Significantly reduce the amount of measurements (a complementary service) – No new infrastructure need to be deployed – Inherit the robustness of DNS – Easy integration with existing systems

CDN-Driven One-Hop Source Routing S A1 An A2 …….. D DNS ServerEnE2E1

Key Questions How does Akamai work? – DNS translation – How many web replicas does a client see? – Impact of different sites (e.g., Yahoo vs. NY Times)? – DNS redirection dynamics? – Network or server latency? An example application: one-hop source routing – Mapping CDN servers to overlay nodes – Low-overhead protocols for exploiting CDN redirections

6 DNS “Black Magic” Web Client Akamai High-Level DNS Server Akamai Low-Level DNS Server Local DNS Server PCWorld Authoritative DNS Server PCWorld Web Server Akamai Edge Server Root DNS Server Top-Level Domain DNS Server http request/response images.pcworld.com CNAME: a1694.g.akamai.net images.pcworld.com a1694.g.akmai.net 2 ip addresses of Akamai Edge Servers 2 ip addresses of Akamai Edge Servers fetch image files

7 Measuring Akamai 2-months long measurement 140 PlanetLab (PL) nodes – 50 US and Canada, 35 Europe, 18 Asia, 8 South America, the rest randomly scattered Every 20 sec, each PL node queries an appropriate CNAME for – Yahoo, CNN, Fox News, NY Times, etc. PL Node Akamai Edge Server 2 Akamai Edge Server 3 Akamai Low-Level DNS Server.…… Akamai Edge Server 1

8 Initial Results day night BerkeleyPurdue

9 Server Diversity for Yahoo Good overlay-to-CDN mapping candidates Majority of PL nodes see between 10 and 50 Akamai edge-servers Nodes far away from Akamai hot-spots

10 Multiple Akamai Customers Amazon is not hosted on UMass and LBNL Yahoo and NYTimes are not hosted in U. Oregon FEMA is poor!

11 Redirection Dynamics BerkeleyBrazil Korea

12 Key Questions How does Akamai work? – DNS translation – How many web replicas does a client see? – Impact of different sites (e.g., Yahoo vs. NY Times)? – DNS redirection dynamics? – Network or server latency? Potentials for one-hop source routing? – Mapping CDN servers to overlay nodes – Low-overhead protocols for exploiting CDN redirections

13 Methodology Planet Lab Node Akamai Low-Level DNS Server 10 Best Akamai Edge Servers ………

14 Do CDN redirections correlate to network latencies? (1) Rank = r1+r2-1 – 16 means perfect correlation – 0 means poor correlation Brazil is poorMIT and Amsterdam are excellent

15 Do CDN redirections correlate to network latencies? (2) CNN is poor! 70% paths are among best 10% 97% better than average

16 Akamai-Driven One-Hop Source Routing S A1 An A2 …….. D DNS Server Redirection dynamics sufficiently small for network control EnE2E1 Redirections driven by network conditions Potential for CDN-to-overlay mapping

17 Methodology Source Akamai Low-Level DNS Server Destination Direct Path Akamai path 3 Akamai path 1 ……..... Akamai path 10 Akamai path 2 Akamai path 1 Akamai path 2 Akamai path 3 Akamai path 10

18 Akamai-driven source routing (1) 80% Taiwan 15% Japan 5 % U.S. 75% U.K. 25% U.S. Taiwan-UKUK-Taiwan

19 Akamai-driven source routing (2) Direct paths better than Akamai paths 25% of Akamai paths better than direct paths Akamai and direct paths have similar performance Experiment: US (6), Europe (3), S. America (2), Asia (3)

20 Path pruning Fact – Not always is Akamai-driven path better than the direct one Practical issues – How frequently to make a decision whether to use the direct or the Akamai path? – Should one use the first (of the 2 paths) returned by Akamai (FAS) the better (of the 2 paths) returned by Akamai (BTAS)

21 Path Pruning Result Direct path accounts for 78% of the gain 2 hours update frequency before the performance declines BTAS better than FAS

22 Conclusions Reuse measurements performed by CDNs Reverse-engineering Akamai – DNS redirections sufficiently small – Strong correlation to network conditions – All clients see a large number of paths CDN-driven one-hop source routing – 25% of Akamai paths outperform direct paths – 50% of nodes “discovered” by Akamai outperform direct paths – Low-overhead pruning algorithms Global Internet “weather-report” service for little to no cost