Client Side Mirror Selection Will Lefevers CS 526 Advanced Internet and Web Systems.

Slides:

Advertisements

Similar presentations

The Transmission Control Protocol (TCP) carries most Internet traffic, so performance of the Internet depends to a great extent on how well TCP works.

Advertisements

Support for high performance UDP/TCP applications Xing Li

Measuring IP Performance Geoff Huston Telstra. What are you trying to measure? User experience –Responsiveness –Sustained Throughput –Application performance.

Working at a Small-Medium Business or ISP

Streaming Video over the Internet

Ningning HuCarnegie Mellon University1 Optimizing Network Performance In Replicated Hosting Peter Steenkiste (CMU) with Ningning Hu (CMU), Oliver Spatscheck.

Computer Networks Performance Metrics Advanced Computer Networks Fall 2013.

Computer Networks Performance Metrics Computer Networks Term B10.

Spring 2000CS 4611 Introduction Outline Statistical Multiplexing Inter-Process Communication Network Architecture Performance Metrics.

Top Causes for Poor Application Performance Case Studies Mike Canney.

Web Server Benchmarking Using the Internet Protocol Traffic and Network Emulator Carey Williamson, Rob Simmonds, Martin Arlitt et al. University of Calgary.

Advanced Networks 1. Delayed Internet Routing Convergence 2. The Impact of Internet Policy and Topology on Delayed Routing Convergence.

Ahmed El-Hassany CISC856: CISC 856 TCP/IP and Upper Layer Protocols Slides adopted from: Injong Rhee, Lisong Xu.

Maximizing End-to-End Network Performance Thomas Hacker University of Michigan October 5, 2001.

Peer-to-Peer Based Multimedia Distribution Service Zhe Xiang, Qian Zhang, Wenwu Zhu, Zhensheng Zhang IEEE Transactions on Multimedia, Vol. 6, No. 2, April.

Network Measurement Bandwidth Analysis. Why measure bandwidth? Network congestion has increased tremendously. Network congestion has increased tremendously.

All rights reserved © 2006, Alcatel Accelerating TCP Traffic on Broadband Access Networks  Ing-Jyh Tsang 

Draft-constantine-ippm-tcp-throughput-tm-02.txt 1 TCP Throughput Testing Methodology IETF 77 Anaheim Barry Constantine Reinhard.

1 Content Distribution Networks. 2 Replication Issues Request distribution: how to transparently distribute requests for content among replication servers.

Working at a Small-Medium Business or ISP

User-Perceived Performance Measurement on the Internet Bill Tice Thomas Hildebrandt CS 6255 November 6, 2003.

Advanced Network Architecture Research Group 2001/11/149 th International Conference on Network Protocols Scalable Socket Buffer Tuning for High-Performance.

Experiences in Design and Implementation of a High Performance Transport Protocol Yunhong Gu, Xinwei Hong, and Robert L. Grossman National Center for Data.

Global NetWatch Copyright © 2003 Global NetWatch, Inc. Factors Affecting Web Performance Getting Maximum Performance Out Of Your Web Server.

ALICE data access WLCG data WG revival 4 October 2013.

Cisco – Chapter 11 Routers All You Ever Wanted To Know But Were Afraid to Ask.

1 Investigating Internet Performance USF 2003 RET Program Tahvia Shaw.

Maximizing End-to-End Network Performance Thomas Hacker University of Michigan October 26, 2001.

An Efficient Approach for Content Delivery in Overlay Networks Mohammad Malli Chadi Barakat, Walid Dabbous Planete Project To appear in proceedings of.

Sharing Information across Congestion Windows CSE222A Project Presentation March 15, 2005 Apurva Sharma.

Computer Networks Performance Metrics. Performance Metrics Outline Generic Performance Metrics Network performance Measures Components of Hop and End-to-End.

IT 347 Final Review Winter 2011 J.J. Ekstrom. IT 347 Course Topics Network Models Protocols and Encapsulation Reliable Delivery / Sliding Window Clients,

1 TCP/IP Internetting ä Subnet layer ä Links stations on same subnet ä Often IEEE LAN standards ä PPP for telephone connections ä TCP/IP specifies.

3: Transport Layer3-1 Where we are in chapter 3 Last time: r TCP m Reliable transfer m Flow control m Connection management r principles of congestion.

workshop eugene, oregon Network Performance Metrics Unix/IP Preparation Course July 19, 2009 Eugene, Oregon, USA Original Materials.

Resilient Overlay Networks By David Andersen, Hari Balakrishnan, Frans Kaashoek, and Robert Morris MIT RON Paper from ACM Oct Advanced Operating.

Advanced Network Architecture Research Group 2001/11/74 th Asia-Pacific Symposium on Information and Telecommunication Technologies Design and Implementation.

TCP behavior of a Busy Internet Server: Analysis and Improvements Y2K Oct.10 Joo Young Hwang Computer Engineering Research Laboratory KAIST. EECS.

HighSpeed TCP for High Bandwidth-Delay Product Networks Raj Kettimuthu.

Rate Control Rate control tunes the packet sending rate. No more than one packet can be sent during each packet sending period. Additive Increase: Every.

Cisco 3 - Switch Perrine. J Page 111/6/2015 Chapter 5 At which layer of the 3-layer design component would users with common interests be grouped? 1.Access.

Networking Fundamentals. Basics Network – collection of nodes and links that cooperate for communication Nodes – computer systems –Internal (routers,

LEGS: A WSRF Service to Estimate Latency between Arbitrary Hosts on the Internet R.Vijayprasanth 1, R. Kavithaa 2,3 and Raj Kettimuthu 2,3 1 Coimbatore.

Masaki Hirabaru NICT Koganei 3rd e-VLBI Workshop October 6, 2004 Makuhari, Japan Performance Measurement on Large Bandwidth-Delay Product.

1 Capacity Dimensioning Based on Traffic Measurement in the Internet Kazumine Osaka University Shingo Ata (Osaka City Univ.)

Network design Topic 2 Existing network infrastructure.

2010 kigali, rwanda Network Performance Metrics Unix/IP Preparation Course May 23, 2010 Kigali, Rwanda Original Materials by.

CS 6401 Overlay Networks Outline Overlay networks overview Routing overlays Resilient Overlay Networks Content Distribution Networks.

Chapter 11.4 END-TO-END ISSUES. Optical Internet Optical technology Protocol translates availability of gigabit bandwidth in user-perceived QoS.

Internet Connectivity and Performance for the HEP Community. Presented at HEPNT-HEPiX, October 6, 1999 by Warren Matthews Funded by DOE/MICS Internet End-to-end.

Development of a QoE Model Himadeepa Karlapudi 03/07/03.

TCP continued. Discussion – TCP Throughput TCP will most likely generate the saw tooth type of traffic. – A rough estimate is that the congestion window.

Midterm Review Chapter 1: Introduction Chapter 2: Application Layer

09/13/04 CDA 6506 Network Architecture and Client/Server Computing Peer-to-Peer Computing and Content Distribution Networks by Zornitza Genova Prodanoff.

A special acknowledge goes to J.F Kurose and K.W. Ross Some of the slides used in this lecture are adapted from their original slides that accompany the.

Samuel Wood Manikandan Punniyakotti Supervisors: Brad Smith, Katia Obraczka, JJ Garcia-Luna-Aceves

© 2007 Cisco Systems, Inc. All rights reserved.Cisco Public 1 Version 4.1 Routing Working at a Small-to-Medium Business or ISP – Chapter 6.

Network Processing Systems Design

Accelerating Peer-to-Peer Networks for Video Streaming

Working at a Small-to-Medium Business or ISP – Chapter 6

LESSON Networking Fundamentals Understand TCP/IP.

Network Tools and Utilities

Mohammad Malli Chadi Barakat, Walid Dabbous Alcatel meeting

Support for high performance UDP/TCP applications

Review First mile problem Internet End Users Last mile

Inferring Queue Sizes in Access Networks by Active Measurement

FAST TCP : From Theory to Experiments

Working at a Small-to-Medium Business or ISP – Chapter 6

Low-Latency Adaptive Streaming Over TCP

Requirements Definition

Presentation transcript:

Client Side Mirror Selection Will Lefevers CS 526 Advanced Internet and Web Systems

Client Side Mirror Selection ● Defining Success ● Hurdles To Overcome ● Selecting a Mirror ● The Ideal Metric ● Implementation ● Alternatives

Defining Success ● What Defines Good? – Speed(?) – Connection Stability – Burstability – Cost ● Characteristics of Download Mirrors – Large Files / Heavy Loads – Longer-Term Connections

Hurdles To Overcome ● Backbone Issues – Congestion – Routing Efficiency – Geographical Distance And The Speed of Light – Abilene Class (OC-48) ExampleExample ● Local ISP Issues – Distance to Pipe/Backbone – BGP and IOS Efficiency – Multihoming /Peering Configurations – Poor Design and Congestion

More Hurdles To Overcome ● MAN/LAN Issues – Poor Design (Least Standardization / Planning / Investment) – Congestion (Least Concern for Scalability) – Hubs Versus Switching(Topo-Specific) – Collision Domains – Tokens and Congestion (Long Delays) – The Weakest Link ● MTR Example

Selecting a Mirror ● Random (User Selection) ● Geographic Proximity -- Normally Misleading ● TLD/”Name Brand” -- Routes or Topography? ● Latency / Ping Alone -- Fast Server, No Pipe ● Throughput Alone -- Heavy Load, Unresponsive ● Connection Stability -- RTT Variance ● Backbone Packet Loss – User Will Feel It ● Reachability – Sometimes Up, Sometimes Down

Selecting a Mirror ● Infrastructure Methods – Router's Pick (Cisco IOS and certain BGPs only) – Helper Services and Servers (NLANR) – Edge Servers and Caching (Akamai) ● Criteria for Mirrors – Ability to Fill the Pipe (Most Efficient Delivery) – Ability to Recover From Congestion (Lost Packets) ● Because of the OSI Model's Encapsulation, All Problems Have The Same Symptom

The Ideal Metric ● Bandwidth-Delay Product (BDP) – “Bottleneck” Link Bandwidth – Round Trip Time (RTT) – Ideal for Longer Distance Connections (Bing) ● Overcomes TCP Issues: – Reliability and the TCP Window – Default TCP Buffers (OS) and Socket Buffers (App) ● Window Scaling, TCP Autotuning, MTU Path Discovery Will All Help

Implementation ● The Common Case: Javascript ● Estimating BDP – BING-like w/ Different Size ICMP Echo Requests – Privileges and Abuse ● Shortcuts (Ping + Download Test) – Small Files Aren’t Representative – Large Files Aren’t Fast – Is There An Ideal Size? – Which File Do We Test?

Implementation ● Read In Mirrorlist and Strip ● Check Which Servers Are Up ● Record RTTs and Create Preferred List ● Throughput-Test the Fastest Five Servers ● Stack Results by BDP and Start D/L w/ Fastest – Fallback Capability? – Recheck Servers Periodically? – Network ‘Weather’ Awareness?

Alternatives to Mirrors ● Swarming Technologies (Torrents) ● Compression With Rsync, Sftp, Scp ● Multi-Source/Partial Downloads (Getright, Gnutella) ● Distributed Fileshares (Freenet) ● Sneakernet…

Client Side Mirror Selection ● Defining Success ● Hurdles To Overcome ● Selecting a Mirror ● The Ideal Metric ● Implementation ● Alternatives Questions?