1. Yaksha: A Self-Tuning Controller for Managing the Performance of 3-Tiered Web Sites Abhinav Kamra, Vishal Misra CS Department Columbia University Erich Nahum IBM TJ Watson Research Center

2. Dynamic Content Online shopping Amazon, BestBuy News snippets http://news.google.com/ Current weather conditions Real-time stock tickers

3. Dynamic Content Generation 3-Tier Structure: Web Server: Static web pages App Server: CGI / Java servlets Database Server: Backend Data Store http Database Server Web Server App Server

4. Major Problems Overloaded Web Sites: The “Slashdot Effect” Unanticipated load causes site to crash Unresponsive Web Sites: The “Abandoned Shopping Cart’’ Unacceptable delays lead to reduced usage

5. Admission Control To prevent overload, perform admission control: Notion of capacity in the system Identify the job ahead of time & amount of work generated Only let jobs in if they won’t overload system Once you reach full capacity: Make jobs wait Drop jobs Load Throughput Actual Ideal

6. Why Self-Tuning ? Parameter Setting Lots of experimentation Workload characterization Re-done for every system change

7. Outline Motivation & Background The ‘Yaksha’ Controller Architecture Modeling Design Self-Tuning Experimental Environment Experimental Results Summary and Conclusions

8. The ‘Yaksha’ Controller Architecture Intercepts HTTP requests Decides whether to accept or reject new connections Maintains several measurement-based estimates: Per connection Response and Sojourn times Per customer-class based estimates Per query-type based estimates http Database Server Web Server App Server Yaksha Clients

9. Reference Input = Desired Response/Sojourn times = Incoming job acceptance probability Modeling Web Server Controller  + –

10. Modeling System Abstraction M/GI/1 Processor Sharing Queue Linearization approximation Open loop transfer function

11. Proportional Integral (PI) Control Zero steady state error Closed loop transfer function Design

12. Design (contd.) Setting system parameters Fix controller time constant to 10 sec Fix phase margin at 45 degrees Bilinear transform to convert to digital form

13. Self-Tuning ‘Pure gain’ open loop transfer function Effective arrival rate ‘Tuned’ transfer function Running average for p a

14. Parameter Setting Parameters w/o Self-Tuning Expected input rate Expected connection drop rate Target response time Parameters with Self-Tuning Target response time

15. Outline Motivation & Background The ‘Yaksha’ Controller Experimental Environment Setup & Methodology Software & Hardware Experimental Results Summary and Conclusions

16. Experimental Setup Workload Generator SQL Database ServerWeb/App Server Lightweight Proxy Controller

17. http TomcatMySQL SQL Emulated Clients Emulated Clients Remote Browser Emulator Session duration Think time Markov model Load is a function of the number of clients

18. Software Workload GeneratorTPC-W 1.0.1 Lightweight ProxyTinyproxy 1.6.1 Web/App ServerTomcat 4.1.27 Database ServerMySQL 4.1.0 Workload Generator SQL Database ServerWeb/App Server Lightweight Proxy Controller

19. Hardware CPUIntel Pentium 1.7 GHz Memory512 MB Disk12 GB, 12 ms, 5400 RPM Network100 Mbps Ethernet http Tinyproxy/ Tomcat MySQL SQL TPC-W Client

20. Outline Motivation & Background The ‘Yaksha’ Controller Experimental Environment Experimental Results Response time control Throughput control Self-tuning Model validation Summary and Conclusions

21. Results: Response time control

22. Results: Throughput control

23. Results: Self-tuning

25. Results: Model Validation

26. Summary & Future Work Presented the ‘Yaksha’ Control System PI admission control for http connections Overload prevention Response time bounds Self-Tuning Control Future Work Throughput maximization

27. Thank You!

28. Related Work Admission Control for Static Content Web Servers: Bhatti99, Li00, Voigt01, Pradhan02 Provide throughput/response time/BW guarantees Control Tarek01, Tarek02, Hellerstein01, Hellerstein02, Welsh03 Control theory for resource management Admission control for Apache, Lotus notes Dynamic Content: Dynaserver project at Rice TPC-W Benchmarks

29. Results: Throughput control - P a