Information-Centric Networks Section # 5.1: Content Distribution Instructor: George Xylomenos Department: Informatics.

Slides:



Advertisements
Similar presentations
Information-Centric Networks05c-1 Week 5 / Paper 3 Democratizing content publication with Coral –Michael J. Freedman, Eric Freudenthal, David Mazières.
Advertisements

CHAPTER 15 WEBPAGE OPTIMIZATION. LEARNING OBJECTIVES How to test your web-page performance How browser and server interactions impact performance What.
Akamai Content Delivery Network Slides from Bruce Maggs.
1 Server Selection & Content Distribution Networks (slides by Srini Seshan, CS CMU)
On the Effectiveness of Measurement Reuse for Performance-Based Detouring David Choffnes Fabian Bustamante Fabian Bustamante Northwestern University INFOCOM.
1 Content Delivery Networks iBAND2 May 24, 1999 Dave Farber CTO Sandpiper Networks, Inc.
Information-Centric Networks03c-1 Week 3 / Paper 3 The design and implementation of a next generation name service for the Internet –Venugopalan Ramasubramanian.
1 Routing and Scheduling in Web Server Clusters. 2 Reference The State of the Art in Locally Distributed Web-server Systems Valeria Cardellini, Emiliano.
A Taxonomy and Survey of Content Delivery Networks Meng-Huan Wu 2011/10/26 1.
Spring 2003CS 4611 Content Distribution Networks Outline Implementation Techniques Hashing Schemes Redirection Strategies.
Logically Centralized, Physically Distributed Mark Stuart Day Cisco Systems.
An Analysis of Internet Content Delivery Systems Stefan Saroiu, Krishna P. Gommadi, Richard J. Dunn, Steven D. Gribble, and Henry M. Levy Proceedings of.
1 A Comparison of Load Balancing Techniques for Scalable Web Servers Haakon Bryhni, University of Oslo Espen Klovning and Øivind Kure, Telenor Reserch.
CDNs & Replication Prof. Vern Paxson EE122 Fall 2007 TAs: Lisa Fowler, Daniel Killebrew, Jorge Ortiz.
Flash Crowds And Denial of Service Attacks: Characterization and Implications for CDNs and Web Sites Aaron Beach Cs395 network security.
1 Drafting Behind Akamai (Travelocity-Based Detouring) AoJan Su, David R. Choffnes, Aleksandar Kuzmanovic, and Fabian E. Bustamante Department of Electrical.
Web Caching and CDNs March 3, Content Distribution Motivation –Network path from server to client is slow/congested –Web server is overloaded Web.
The Medusa Proxy A Tool For Exploring User- Perceived Web Performance Mimika Koletsou and Geoffrey M. Voelker University of California, San Diego Proceeding.
Content Delivery Networks. History Early 1990s sees 100% growth in internet traffic per year 1994 o Netscape forms and releases their first browser.
Web Content Delivery Networks Yogesh Bhumralkar. CDN: Motivations zCongestion in the Internet. zWeb Servers sometimes become overloaded due to too many.
Caching and Content Distribution Networks. Web Caching r As an example, we use the web to illustrate caching and other related issues browser Web Proxy.
Content Delivery Networks (CDN) Dr. Yingwu Zhu Reverse Proxy Reverse Proxy Reverse Proxy Intranet Web Cache Architecure Browser Local ISP cache L4 Switch.
Content Distribution Networks (CDNs) Mike Freedman COS 461: Computer Networks Lectures: MW 10-10:50am in Architecture N101
CSCI-1680 Web Performance and Content Distribution Based partly on lecture notes by Scott Shenker and John Jannotti Rodrigo Fonseca.
Content Distribution Network (CDN) Performance Punit Shah CSE581 Internet Technologies OGI, OHSU 2002, Jan 16th.
Information-Centric Networks05a-1 Week 5 / Paper 1 On the use and performance of content distribution networks –Balachander Krishnamurthy, Craig Wills,
CS 4700 / CS 5700 Network Fundamentals Lecture 17.5: Project 5 Hints (Getting a job at Akamai) Revised 3/31/2014.
1 Content Distribution Networks. 2 Replication Issues Request distribution: how to transparently distribute requests for content among replication servers.
On the Use and Performance of Content Distribution Networks Balachander Krishnamurthy Craig Wills Yin Zhang Presenter: Wei Zhang CSE Department of Lehigh.
Content Distribution March 8, : Application Layer1.
Information-Centric Networks03a-1 Week 3 / Paper 1 What DNS is not –Paul Vixie –CACM, December 2009, vol. 52, no. 12 Main point –“DNS is many things to.
{ Content Distribution Networks ECE544 Dhananjay Makwana Principal Software Engineer, Semandex Networks 5/2/14ECE544.
Krerk Piromsopa. Advance Net-Centric Computing Technology Krerk Piromsopa. Department of Computer Engineering. Chulalongkorn University.
CDN Brokering* Presented By Nick Arnold Authors Alexandros Biliris, et. Al.
Information-Centric Networks06a-1 Week 6 / Paper 1 Untangling the Web from DNS –Michael Walfish, Hari Balakrishnan and Scott Shenker –Networked Systems.
Strong Cache Consistency Support for Domain Name System Xin Chen, Haining Wang, Sansi Ren and Xiaodong Zhang College of William and Mary, Williamsburg,
ECO-DNS: Expected Consistency Optimization for DNS Chen Stephanos Matsumoto Adrian Perrig © 2013 Stephanos Matsumoto1.
Streaming and Content Delivery SECTIONS 7.4 AND 7.5.
Information-Centric Networks Section # 3.2: DNS Issues Instructor: George Xylomenos Department: Informatics.
Information-Centric Networks Section # 5.3: Content Distribution Instructor: George Xylomenos Department: Informatics.
Information-Centric Networks Section # 6.3: Evolved Naming & Resolution Instructor: George Xylomenos Department: Informatics.
Information-Centric Networks Section # 9.3: Clean Slate Instructor: George Xylomenos Department: Informatics.
Globally Distributed Content Delivery Presenter: Baoning Wu 03/25/2003.
Information-Centric Networks Section # 7.2: Evolved Addressing & Forwarding Instructor: George Xylomenos Department: Informatics.
Information-Centric Networks Section # 10.2: Publish/Subscribe Instructor: George Xylomenos Department: Informatics.
Information-Centric Networks Section # 3.3: DNS Issues Instructor: George Xylomenos Department: Informatics.
Information-Centric Networks Section # 3.1: DNS Issues Instructor: George Xylomenos Department: Informatics.
Information-Centric Networks Section # 6.2: Evolved Naming & Resolution Instructor: George Xylomenos Department: Informatics.
Information-Centric Networks Section # 2.1: Internet Evolution Instructor: George Xylomenos Department: Informatics.
Information-Centric Networks Section # 7.1: Evolved Addressing & Forwarding Instructor: George Xylomenos Department: Informatics.
Information-Centric Networks Section # 2.2: Internet Evolution Instructor: George Xylomenos Department: Informatics.
Information-Centric Networks Section # 1.1: Introduction Instructor: George Xylomenos Department: Informatics.
Information-Centric Networks Section # 6.1: Evolved Naming & Resolution Instructor: George Xylomenos Department: Informatics.
Information-Centric Networks Section # 10.3: Publish/Subscribe Instructor: George Xylomenos Department: Informatics.
Information-Centric Networks Section # 4.1: Routing Issues Instructor: George Xylomenos Department: Informatics.
CS 6401 Overlay Networks Outline Overlay networks overview Routing overlays Resilient Overlay Networks Content Distribution Networks.
Information-Centric Networks Section # 4.2: Routing Issues Instructor: George Xylomenos Department: Informatics.
Information-Centric Networks Section # 13.2: Alternatives Instructor: George Xylomenos Department: Informatics.
Information-Centric Networks Section # 2.3: Internet Evolution Instructor: George Xylomenos Department: Informatics.
On the Effect of Server Adaptation for Web Content Delivery IMW ’ 02, Marseille, Nov Joint work with Balachander Krishnamurthy (AT&T) Craig Wills.
Content Delivery Networks: Status and Trends Speaker: Shao-Fen Chou Advisor: Dr. Ho-Ting Wu 5/8/
John S. Otto Mario A. Sánchez John P. Rula Fabián E. Bustamante Northwestern, EECS.
Performance Evaluation of Redirection Schemes in Content Distribution Networks Jussi Kangasharju, Keith W. Ross Institut Eurecom Jim W. Roberts France.
Whole Page Performance Leeann Bent and Geoffrey M. Voelker University of California, San Diego.
Energy Conservation in Content Distribution Networks
Ad-blocker circumvention System
Co* Projects : CoDNS, CoDeploy, CoMon
On the Use and Performance of Content Distribution Networks
Content Distribution Networks
Existing CDNs Fail to Address these Challenges
Presentation transcript:

Information-Centric Networks Section # 5.1: Content Distribution Instructor: George Xylomenos Department: Informatics

Funding These educational materials have been developed as part of the instructors educational tasks. The “Athens University of Economics and Business Open Courses” project only funded the reformatting of these educational materials. The project is being implemented as part of the Operational Program “Instruction and Lifelong Learning” and is co- financed by the European Union (European Social Fund) and national funds.

Licencing These educational materials are subject to a Creative Commons License.

Information-Centric Networks05a-4 Week 5 / Paper 1 On the use and performance of content distribution networks –Balachander Krishnamurthy, Craig Wills, Yin Zhang –IMC Workshop, 2001 Main point –CDNs offload work from origin servers –How are CDNs used? DNS redirection and URL rewriting –How do CDNs perform? DNS lookups may not be worthwhile –Note: things have changed a lot since 2001!

Information-Centric Networks05a-5 Introduction Content Distribution Network (CDN) –A collection of servers for content delivery –May be collocated with origin server or widespread –The origin server’s is cached/replicated at CDN servers –The CDN tries to locate a server “close” to the client –Origin servers are aware of CDNs CDNs use mostly proprietary algorithms –What techniques are employed? –How much are CDNs used? –What kind of content is offloaded? –How can their performance be measured? –How do CDNs perform against each other and the origin server?

Information-Centric Networks05a-6 CDN techniques How to direct a client to the right CDN server? DNS redirection: select server during DNS resolution –The CDN controls the authoritative DNS server –Decides based on load and proximity –Full-site: origin server is hidden behind the CDN –Partial-site: URLs embedded in pages modified for the CDN URL rewriting: dynamic rewriting of embedded URLs –The returned page has the selected IP addresses replaced Mixed mode –First URL rewriting with DNS name of CDN server –Then DNS redirection depending on load and location

Information-Centric Networks05a-7 Use of CDNs How much are CDNs used? –This study is 10 year old, around when CDN use exploded –17-30% of popular sites were found to use CDNs Found either CDN DNS names or CDN DNS servers –Most sites used Akamai at that time A custom list of sites was created to reflect other CDNs Change characteristics of content –Less than 1% of the returned content changed –CDNs are used mostly for static content (images) Nature of requested content –96-98% of objects were images –40-60% of bytes were images –CDN cached images had a 20-30% higher hit rate

Information-Centric Networks05a-8 Measurement methodology Client-side study of image content delivery –Response latency and download time Content for study: the canonical page –A large set of pages was analyzed –A page with 18 images of specific sizes was chosen –A similar page was found in each CDN –Similar pages were found in sites that do not use a CDN Study description –Record DNS lookup time –Use httperf to download all images so as to prime the CDN –Fetch all images (from the CDN) and record the download time –Clients from the NIMI measurement infrastructure, no caching –Measurements were repeated one year later

Information-Centric Networks05a-9 Response time results Total DNS plus download time results –CDNs performed better than origin servers CDNs improved during the second measurement period –One CDN had problems with high DNS lookup times URL rewriting CDNs avoid additional DNS lookups –DNS redirection CDNs worked best overall But they also had the highest number of servers! Download time only –Isolates the results of CDN server selection –Akamai was the most inconsistent!

Information-Centric Networks05a-10 DNS load balancing DNS load balancing versus CDN server selection –CDNs return low TTLs to allow timely selection of servers –Is this worth the trouble of the additional lookups? –Modified test to remember CDN returned IP address –Mixed results for download time Some times the new IP address is not better (may even be worse) –Bad results for total response time Even if download time is OK, the extra DNS lookup has a cost –Result: the small TTL is not generally a good idea! It may lead to small or no gains in download time Plus it requires an extra DNS lookup Also, it overloads DNS (but CDNs do not really care) –But, again, this is a 10 year old study

End of Section # 5.1 Course: Information-Centric Networks, Section # 5.1: Content Distribution Instructor: George Xylomenos, Department: Informatics