Handling Web Hotspots at Dynamic Content Web Sites Using DotSlash Weibin Zhao Henning Schulzrinne Columbia University Dagstuhl.

Slides:



Advertisements
Similar presentations
The vMatrix: A Network Of Virtual Machine Monitors For Dynamic Content Distribution Amr A. Awadallah Mendel Rosenblum Stanford.
Advertisements

Performance Testing - Kanwalpreet Singh.
Efficient Event-based Resource Discovery Wei Yan*, Songlin Hu*, Vinod Muthusamy +, Hans-Arno Jacobsen +, Li Zha* * Chinese Academy of Sciences, Beijing.
Prime’ Senior Project. Presentation Outline What is Our Project? Problem Definition What does our system do? How does the system work? Implementation.
XENMON: QOS MONITORING AND PERFORMANCE PROFILING TOOL Diwaker Gupta, Rob Gardner, Ludmila Cherkasova 1.
U NIVERSITY OF M ASSACHUSETTS, A MHERST – Department of Computer Science Dynamic Provisioning for Multi-tier Internet Applications Bhuvan Urgaonkar, Prashant.
Spring 2003CS 4611 Content Distribution Networks Outline Implementation Techniques Hashing Schemes Redirection Strategies.
DotSlash – A Web Hotspot Rescue System Weibin Zhao Henning Schulzrinne Department of Computer Science Columbia University June 11, 2004.
Creating WordPress Websites. Creating a site on your computer Local server Local WordPress installation Setting Up Dreamweaver.
Peer-to-peer systems for autonomic VoIP and web hotspot handling
Handling Web Hotspots at Dynamic Content Web Sites Using DotSlash Weibin Zhao Henning Schulzrinne Columbia University NYMAN’04.
Multiple Tiers in Action
RDMA ENABLED WEB SERVER Rajat Sharma. Objective  To implement a Web Server serving HTTP client requests through RDMA replacing the traditional TCP/IP.
Adaptive Content Delivery for Scalable Web Servers Authors: Rahul Pradhan and Mark Claypool Presented by: David Finkel Computer Science Department Worcester.
Capacity planning for web sites. Promoting a web site Thoughts on increasing web site traffic but… Two possible scenarios…
Internet Real Time (IRT) Lab at Columbia University Professor: Henning Schulzrinne Columbia University Presenter: Suman Srinivasan, PhD student
Towards Autonomic Computing: Service Discovery and Web Hotspot Rescue Weibin Zhao Department of Computer Science Columbia University.
DotSlash: Providing Dynamic Scalability to Web Applications Weibin Zhao and Henning Schulzrinne Department of Computer Science, Columbia University More.
Understanding Factors That Influence Performance of a Web Server Presentation CS535 Project By Thiru.
March 31, 2005Thomson1 Advanced Network Services: P2P VoIP, location-based services and self-managing server farms Henning Schulzrinne (and members of.
22-Aug-15 | 1 |1 | Help! I need more servers! What do I do? Scaling a PHP application.
Sys Prog & Scripting - HW Univ1 Systems Programming & Scripting Lecture 15: PHP Introduction.
U NIVERSITY OF M ASSACHUSETTS, A MHERST Department of Computer Science Black-box and Gray-box Strategies for Virtual Machine Migration Timothy Wood, Prashant.
Computer Science 1 Resource Overbooking and Application Profiling in Shared Hosting Platforms Bhuvan Urgaonkar Prashant Shenoy Timothy Roscoe † UMASS Amherst.
Active Network Applications Tom Anderson University of Washington.
M. Taimoor Khan * Java Server Pages (JSP) is a server-side programming technology that enables the creation of dynamic,
Introduction to HP LoadRunner Getting Familiar with LoadRunner >>>>>>>>>>>>>>>>>>>>>>
 Zhichun Li  The Robust and Secure Systems group at NEC Research Labs  Northwestern University  Tsinghua University 2.
5 September 2015 Culrur-exp project CULTURe EXchange Platform (CULTUR-EXP) project kick-off meeting, August 2013, Tbilisi, Georgia Joint Operational.
Performance of Web Applications Introduction One of the success-critical quality characteristics of Web applications is system performance. What.
SEDA: An Architecture for Well-Conditioned, Scalable Internet Services
Database Replication Policies for Dynamic Content Applications Gokul Soundararajan, Cristiana Amza, Ashvin Goel University of Toronto EuroSys 2006: Leuven,
U NIVERSITY OF M ASSACHUSETTS, A MHERST – Department of Computer Science An Analytical Model for Multi-tier Internet Services and its Applications Bhuvan.
Profile Driven Component Placement for Cluster-based Online Services Christopher Stewart (University of Rochester) Kai Shen (University of Rochester) Sandhya.
DotSlash An Automated Web Hotspot Rescue System Jonathan Bulava CSC8530 – Distributed Systems Dr. Paul Schragger.
Workload-driven Analysis of File Systems in Shared Multi-Tier Data-Centers over InfiniBand K. Vaidyanathan P. Balaji H. –W. Jin D.K. Panda Network-Based.
Peer-to-peer systems for autonomic VoIP and web hotspot handling Kundan Singh, Weibin Zhao and Henning Schulzrinne Internet Real Time Laboratory Computer.
Scaling Dynamic Content Applications through Data Replication - Opportunities for Compiler Optimizations Cristiana Amza UofT.
Module 11: Implementing ISA Server 2004 Enterprise Edition.
1 Specification and Implementation of Dynamic Web Site Benchmarks Sameh Elnikety Department of Computer Science Rice University.
DotSlash: Handling Web Hotspots at Dynamic Content Web Sites Weibin Zhao Henning Schulzrinne Department of Computer Science Columbia.
Design and Evaluation of a Model for Multi-tiered Internet Applications Bhuvan Urgaonkar Internship project talk – Services Management Middleware Dept,
1 Database mini workshop: reconstressing athena RECONSTRESSing: stress testing COOL reading of athena reconstruction clients Database mini workshop, CERN.
1 Admission Control and Request Scheduling in E-Commerce Web Sites Sameh Elnikety, EPFL Erich Nahum, IBM Watson John Tracey, IBM Watson Willy Zwaenepoel,
(c) Lindsay Bradford1 Varying Resource Consumption to achieve Scalable Web Services Lindsay Bradford Centre for Information Technology Innovation.
Empirical Quantification of Opportunities for Content Adaptation in Web Servers Michael Gopshtein and Dror Feitelson School of Engineering and Computer.
DotSlash – or how to deal with 15 minutes of fame Weibin Zhao Henning Schulzrinne Columbia University CATT/WICAT Annual Research Review November 14, 2003.
Managing Web Server Performance with AutoTune Agents by Y. Diao, J. L. Hellerstein, S. Parekh, J. P. Bigus Presented by Changha Lee.
Display Page (HTML/CSS)
EuroSys Doctoral Workshop 2011 Resource Provisioning of Web Applications in Heterogeneous Cloud Jiang Dejun Supervisor: Guillaume Pierre
Web Cache. What is Cache? Cache is the storing of data temporarily to improve performance. Cache exist in a variety of areas such as your CPU, Hard Disk.
John S. Otto Mario A. Sánchez John P. Rula Fabián E. Bustamante Northwestern, EECS.
Free, online, technical courses Take a free online course. Microsoft Virtual Academy.
CERN IT Department CH-1211 Genève 23 Switzerland t Load testing & benchmarks on Oracle RAC Romain Basset – IT PSS DP.
Dynamic Resource Allocation for Shared Data Centers Using Online Measurements By- Abhishek Chandra, Weibo Gong and Prashant Shenoy.
Web and Proxy Server.
Managing State Chapter 13.
Abhinav Kamra, Vishal Misra CS Department Columbia University
Coral: A Peer-to-peer Content Distribution Network
Web Protocols and Practice
Database Replication and Monitoring
Introduction to PHP FdSc Module 109 Server side scripting and
PHP / MySQL Introduction
Overview Introduction VPS Understanding VPS Architecture
Moodle Scalability What is Scalability?
DotSlash: An Automated Web Hotspot Rescue System
Admission Control and Request Scheduling in E-Commerce Web Sites
PHP and Forms.
Co-operative Server Pool for Hotspot Rescue Service
Client-Server Model: Requesting a Web Page
Presentation transcript:

Handling Web Hotspots at Dynamic Content Web Sites Using DotSlash Weibin Zhao Henning Schulzrinne Columbia University Dagstuhl Workshop October 4-6, 2004

09/10/2004 DotSlash2 The Problem Web hotspots Short-term dramatic surge of request rate Flash crowds, the Slashdot effect Dynamic content web sites CPU-bound, request rate supported is low Hard to cache dynamic content Bottleneck at different servers Database server: on-line bookstore (Amazon) Web server: auction (eBay), bulletin board (Slashdot)

09/10/2004 DotSlash3 Our Approach: DotSlash Rescue system Different sites, mutual aid Cost effective: for rare events Self-configuring Build an adaptive distributed web server system on the fly (fully automated) server directory mutual-aid community server directory

09/10/2004 DotSlash4 Aside: Solution Approaches Change client side behavior see NYU Coral system prefix URL with Coral URL Change server only our approach could use P2P network, but really need capacity estimation, not ID mapping

09/10/2004 DotSlash5 DotSlash Overview Workload monitoring: CPU/Link Rescue server discovery: different sites Load migration: HTTP redirect, DNS-RR Dynamic virtual hosting: on the fly Adaptive rescue control: desired load region originrescue (1) (2) (1) (2)(3) reverse caching proxy Static content DNS client1 client2

09/10/2004 DotSlash6 Implementation Apache module Dynamic DNS: dot-slash.net Service discovery: enhanced SLP BINDmSLP HTTP SHM SLP DNS DSRP Other DotsdApache Dotsd Mod_dots client

09/10/2004 DotSlash7 DotSlash for Dynamic Content Remove the web server bottleneck Dynamic script replication LAMP configuration origin serverdatabase rescue server MySQLApache (5) PHP (6) PHP (1) (2) (3) client (4)

09/10/2004 DotSlash8 Dynamic Script Replication Operations at rescue server Map a redirected URI to a script file Trigger 404 handler if the script file not found Retrieve the script file Handle file inclusions Set query variables Run the script by invoking native include Operations at origin server If a request is from a rescue server and for dynamic content, return the script file

09/10/2004 DotSlash9 Handling File Inclusions The problem A replicated script may include files that are located at the origin server Assume: included files under DocumentRoot Approaches Renaming inclusion statements Need to parse scripts: heavy weight Customized error handler Catch inclusion errors: light weight

09/10/2004 DotSlash10 Evaluation Experimental Setup Linux machines: Redhat 9.0 HC: 2 GHz CPU, 1 GB memory LC: 1 GHz CPU, 512 MB memory Apache: , DotSlash module PHP: 4.3.6, DotSlash extension MySQL: , open_files_limit, max_connection RUBBoS bulletin board benchmark 19 scripts: 1 KB to 7 KB 439 MB database

09/10/2004 DotSlash11 Increasing Max Request Rate: R No rescue: R=118 With rescue: R=245 #rescue servers: 9 Origin (HC)DB (HC) Rescue (LC) Configuration: Rescue (LC) 245/118>2 CPU: Origin=100% DB=45% CPU: Origin=55% DB=100%

09/10/2004 DotSlash12 Effectiveness No rescue: R=49 With rescue: R= /49=5 origin serverHCLC improvement25 #rescue servers910 Conclusion: remove web server bottleneck Origin (LC) DB (HC) Rescue (LC) Another Configuration: Comparison: #rescue server: 10 Rescue (LC)

09/10/2004 DotSlash13 CPU Utilization Control

09/10/2004 DotSlash14 Workload Migration

09/10/2004 DotSlash15 Handling Worst-Case Workload Settling time: 24 second #timeouts 921/113565

09/10/2004 DotSlash16 Reducing Settling Time and #Timeouts Assign different priorities to rescue requests and client requests Allocate rescue servers in parallel

09/10/2004 DotSlash17 Conclusions Prototype 10-fold improvement for static content web sites Removing the web server bottleneck for dynamic content web sites On-going work DNS-RR experiments PlanetLab experiments for dynamic content Real Slashdot test For further information