Dynamic Process Allocation in Apache Server

Slides:



Advertisements
Similar presentations
Dissemination-based Data Delivery Using Broadcast Disks.
Advertisements

Scheduling in Web Server Clusters CS 260 LECTURE 3 From: IBM Technical Report.
Hadi Goudarzi and Massoud Pedram
CS 443 Advanced OS Fabián E. Bustamante, Spring 2005 Resource Containers: A new Facility for Resource Management in Server Systems G. Banga, P. Druschel,
Cloud Control with Distributed Rate Limiting Raghaven et all Presented by: Brian Card CS Fall Kinicki 1.
LOAD BALANCING IN A CENTRALIZED DISTRIBUTED SYSTEM BY ANILA JAGANNATHAM ELENA HARRIS.
Copyright © 2001 Qusay H. Mahmoud RMI – Remote Method Invocation Introduction What is RMI? RMI System Architecture How does RMI work? Distributed Garbage.
Load Balancing of Elastic Traffic in Heterogeneous Wireless Networks Abdulfetah Khalid, Samuli Aalto and Pasi Lassila
XENMON: QOS MONITORING AND PERFORMANCE PROFILING TOOL Diwaker Gupta, Rob Gardner, Ludmila Cherkasova 1.
SEDA: An Architecture for Well- Conditioned, Scalable Internet Services Matt Welsh, David Culler, and Eric Brewer Computer Science Division University.
1 Routing and Scheduling in Web Server Clusters. 2 Reference The State of the Art in Locally Distributed Web-server Systems Valeria Cardellini, Emiliano.
The War Between Mice and Elephants Presented By Eric Wang Liang Guo and Ibrahim Matta Boston University ICNP
Dynamic Process Allocation in Apache Server Yu Cai.
The Museum Project The Museum Project Yoav Gvili & Asaf Stein Supervisor : Alexander Arlievsky.
End-to-End Analysis of Distributed Video-on-Demand Systems Padmavathi Mundur, Robert Simon, and Arun K. Sood IEEE Transactions on Multimedia, February.
UCB Notes on Optical Networks Jean Walrand EECS. UCB Outline Dynamic Configuration? Wavelength Assignment Too Much Bandwidth?
Page: 1 Director 1.0 TECHNION Department of Computer Science The Computer Communication Lab (236340) Summer 2002 Submitted by: David Schwartz Idan Zak.
Energy Efficient Web Server Cluster Andrew Krioukov, Sara Alspaugh, Laura Keys, David Culler, Randy Katz.
Differentiated Multimedia Web Services Using Quality Aware Transcoding S. Chandra, C.Schlatter Ellis and A.Vahdat InfoCom 2000, IEEE Journal on Selected.
An Adaptive Multi-Objective Scheduling Selection Framework For Continuous Query Processing Timothy M. Sutherland Bradford Pielech Yali Zhu Luping Ding.
LDU Parametrized Discrete-Time Multivariable MRAC and Application to A Web Cache System Ying Lu, Gang Tao and Tarek Abdelzaher University of Virginia.
Dynamic Process Allocation in Apache Server Yu Cai.
Admission Control and Dynamic Adaptation for a Proportional-Delay DiffServ-Enabled Web Server Yu Cai.
Understanding Factors That Influence Performance of a Web Server Presentation CS535 Project By Thiru.
1-1 Incentive Mechanisms for Large Collaborative Resource Sharing Objectives:  Why Resource harnessing  Resource sharing  Assumptions  Considerations.
Locality-Aware Request Distribution in Cluster-based Network Servers Presented by: Kevin Boos Authors: Vivek S. Pai, Mohit Aron, et al. Rice University.
Distributed Denial of Service Attack and Prevention Andrew Barkley Quoc Thong Le Gia Matt Dingfield Yashodhan Gokhale.
Server Load Balancing. Introduction Why is load balancing of servers needed? If there is only one web server responding to all the incoming HTTP requests.
Advanced Network Architecture Research Group 2001/11/149 th International Conference on Network Protocols Scalable Socket Buffer Tuning for High-Performance.
SEDA: An Architecture for Well-Conditioned, Scalable Internet Services
OPTIMAL SERVER PROVISIONING AND FREQUENCY ADJUSTMENT IN SERVER CLUSTERS Presented by: Xinying Zheng 09/13/ XINYING ZHENG, YU CAI MICHIGAN TECHNOLOGICAL.
1 A Feedback Control Architecture and Design Methodology for Service Delay Guarantees in Web Servers Presentation by Amitayu Das.
CHEN Ge CSIS, HKU March 9, Jigsaw W3C’s Java Web Server.
Budget-based Control for Interactive Services with Partial Execution 1 Yuxiong He, Zihao Ye, Qiang Fu, Sameh Elnikety Microsoft Research.
Presenter: Jonathan Murphy On Adaptive Routing in Wavelength-Routed Networks Authors: Ching-Fang Hsu Te-Lung Liu Nen-Fu Huang.
Advanced Network Architecture Research Group 2001/11/74 th Asia-Pacific Symposium on Information and Telecommunication Technologies Design and Implementation.
Managing Server Energy and Operational Costs Chen, Das, Qin, Sivasubramaniam, Wang, Gautam (Penn State) Sigmetrics 2005.
Providing Differentiated Levels of Service in Web Content Hosting Jussara Almeida, etc... First Workshop on Internet Server Performance, 1998 Computer.
Empirical Quantification of Opportunities for Content Adaptation in Web Servers Michael Gopshtein and Dror Feitelson School of Engineering and Computer.
Measuring the Capacity of a Web Server USENIX Sympo. on Internet Tech. and Sys. ‘ Koo-Min Ahn.
1 Review – The Internet’s Protocol Architecture. Protocols, Internetworking & the Internet 2 Introduction Internet standards Internet standards Layered.
Providing Differentiated Levels of Service in Web Content Hosting J ussara Almeida, Mihaela Dabu, Anand Manikutty and Pei Cao First Workshop on Internet.
Basic Edge Core switch Training for Summit Communication.
A Strategy to Compute the InfiniBand Arbitration Tables
100% Exam Passing Guarantee & Money Back Assurance
Understanding Solutions
Corelite Architecture: Achieving Rated Weight Fairness
WWW and HTTP King Fahd University of Petroleum & Minerals
Topics discussed in this section:
Improving searches through community clustering of information
Analyzing Security and Energy Tradeoffs in Autonomic Capacity Management Wei Wu.
Regulating Data Flow in J2EE Application Server
Measuring Service in Multi-Class Networks
CSI 400/500 Operating Systems Spring 2009
Liang Chen Advisor: Gagan Agrawal Computer Science & Engineering
Routing.
B.Ramamurthy Appendix A
Analysis and Evaluation of a New MAC Protocol
Zhen Xiao, Qi Chen, and Haipeng Luo May 2013
A tool for locating QoS failures on an Internet path
Identifying Slow HTTP DoS/DDoS Attacks against Web Servers DEPARTMENT ANDDepartment of Computer Science & Information SPECIALIZATIONTechnology, University.
Supporting Time-Sensitive Applications on a Commodity OS
Advisor: Yeong-Sung, Lin, Ph.D. Presented by Yu-Ren, Hsieh
Outline System architecture Experiments
Outline System architecture Current work Experiments Next Steps
University of Houston Quality of Service Datacom II Lecture 3
Routing.
COMP755 Advanced Operating Systems
Computer Networks Protocols
Queueing Problem The performance of network systems rely on different delays. Propagation/processing/transmission/queueing delays Which delay is affected.
Presentation transcript:

Dynamic Process Allocation in Apache Server Xiaobo Zhou Yu Cai Ganesh K. Godavari C. Edward Chow

Introduction Degrading DDoS attacks. We want a web server system which can provide clients with differentiated services of proportional response time Two ways: A) admission control and traffic classification: classify the incoming traffic into different queues with different QoS requirement. B) dynamic resource management (our focus): dynamically control the number of processes assigned to each class.

System Architect

Problem Formulation We use M /M /1 queue to model the web server traffic. Proportional-delay of response time for two classes 1 and 2. Assumption of processing rate:

Problem Formulation We want to achieve the resource allocation by process allocation in Apache. The ratio of process allocation can be calculated by:

Process Allocation Strategies 1. A Fixed Process Allocation Strategy 32 total processes, 3:1 ratio, so assign 24:8 to each port. No control over the number of active processes. 2. An Adaptive Process Allocation Strategy Assure all allocated processes are active If non-active, proportionally decrease the processes If all active, proportionally increase the processes

Dynamic Process Allocation Algorithm

Implementation in Apache We modify Apache to make it listen to two ports (80, 8000). The traffic of class 1 will be routed to port 80, and class 2 to port 8000 by admission control. We dynamically control the number of processes allocated for each port, while maintaining a process ratio specified in a ratio file. It is achieved by modifying the child_main() function in http_main.c file of apache. The Process forking and killing is still handled by Apache itself.

System Implementation

Performance Evaluation Use two HP PC(PIII 1GHz, 516M RAM, Redhat 9, 100M Ethernet connection) as router and task web server. Use four HP PC(PIII 233MHz, 96M RAM, Redhat 9, 100M Ethernet connection) to generate http request. Use Httperf and Webbench as the request generator. They can generate http requests with Poisson distribution. The apache we used is version 1.3.29. In the experiments, the system first warmed up for 100 time units. We collect the response time during the next 1000 time units. We average the result after 50 runs. Then we change the system load and repeat the above process.

Fixed Process Adaptation

Fixed Process Adaptation We set the arrival rate ratio to be 3:1, and want to achieve response time ratio 1:3. We calculate the ratio and assign the max number of processes to each port. Since we have no control over the ratio of active process, the result show it is not possible to achieve proportional response time without dynamic process adaptation.

With Dynamic Process Adaptation

With Dynamic Process Adaptation

With Dynamic Process Adaptation

With Dynamic Process Adaptation With dynamic process adaptation, we have better control over the ratio of active process. Therefore, we can achieve proportional response time at range 30% – 80 % system load. It the load is too light or too heavy, it is hard to control.

Class 1 Fixed and Class 2 Change

Class 1 Fixed and Class 2 Change We set class 1 traffic at 40% system load, and change the class 2 traffic, so the overall system load is from 40 - 90%. We can achieve proportional response time when class 2 traffic is not too light(<15%) or too heavy(>40%).

Class 1 change and Class 2 fixed

Class 1 change and Class 2 fixed We set class 2 traffic at 10% system load, and change the class 1 traffic, so the overall system load is from 10 - 80%. We can achieve proportional response time when the traffic is not too light(<40%).

Future Work Find better dynamic process allocation algorithm dealing with light traffic and heavy traffic. Combine admission control and traffic classification together Add feedback and notification mechanism in the system.