Presentation is loading. Please wait.

Presentation is loading. Please wait.

SODA : a Service-On-Demand Architecture An Utility Computing Perspective Xuxian Jiang Purdue University 04/10/2003.

Similar presentations


Presentation on theme: "SODA : a Service-On-Demand Architecture An Utility Computing Perspective Xuxian Jiang Purdue University 04/10/2003."— Presentation transcript:

1 SODA : a Service-On-Demand Architecture An Utility Computing Perspective Xuxian Jiang Purdue University 04/10/2003

2 2 Introduction Essential Idea  Provide computation as utility, just as water and power etc. Utility Computing has been widely recognized and adopted by industry and academia  IBM Oceano  HP Utility Data Center  PlanetLab  Opus

3 3 Today’s Talk Application Service Hosting from Utility Computing Perspective

4 Challenges ?

5 Virtual node Physical node Virtual Link Physical Link Utility demandShared Utility Infrastructure On-demand creation of services Virtualization of services Isolation between services

6 Solution ?

7 7 Outline System Overview  Related/Previous Work On-Demand Service Creation Service Isolation/Virtualization Conclusion

8 System Overview Node Deployment (CODA)  Dynamic Node Membership  Node Priming Service Deployment  Service On-Demand Instantiation  Service Activation  Service Teardown

9 Related Work Node Deployment (CODA) Oceano Emulab Beowulf Flexible configuration OS-Agnostic Dynamic clusters CODA Config tools for Linux computing clusters Utility OS for hosted Web services with dynamic load. Configures static sub-clusters for emulation experiments. Similar to COD Douglas E. Comer and Xuxian Jiang “Running Linux On Back-end Computers In the Xinu Lab ” Technical Report, Department of Computer Sciences, Purdue University, West Lafayette, IN, 2003Running Linux On Back-end Computers In the Xinu Lab

10 Related Work (cont’d) Service Deployment (SODA) Denali Opus PlanetLab Infrastructure Deployment Service-Agnostic Clusters of Slices SODA Internet-scale testbed Scalable isolation kernel Overlay Peering Utility Services Xuxian Jiang and Dongyan Xu “SODA: a Service-On-Demand Architecture for Application Service Hosting Utility Platforms” to appear in Proceedings of The 12th IEEE International Symposium on High Performance Distributed Computing (HPDC-12), Seattle, WA, June, 2003SODA: a Service-On-Demand Architecture for Application Service Hosting Utility PlatformsHPDC-12

11 Outline SODA Overview  Related/Previous Work On-Demand Service Creation Service Isolation/Virtualization Conclusion

12 12 On Demand - How? Node deployment (CODA)  Hardware configuration  Node priming Service deployment (SODA)  Service download  Service activation  Service resizing  Service teardown

13 … Node Deployment (CODA) A.K.A. Xinu Back-end Testbed

14 14 Application Service Deployment (SODA) Service Download  Similar with kernel image download Key Entities:  Service Agent  Service Master  Service Daemon  Service Switch

15 SODA Master SODA Agent Host OS Guest OS Service S SODA Daemon Host OS Guest OS Service S SODA Daemon Host OS Guest OS Service S’ SODA Daemon Guest OS Service S’ Service Switch for S Service Switch for S’ Service Request From Clients Service Creation Request From ASP Virtual Server

16 Outline SODA Overview  Related/Previous Work On-Demand Service Creation Service Isolation/Virtualization Conclusion

17 Service Isolation - How ? Resource Virtualization  CPU Cycles  Network Bandwidth  Memory Size  Disk Storage Virtual Machine  GuestOS (UML) Isolation Kernel  Proportional Scheduler CPU, Network Bandwidth, Memory  Virtual Server Internetworking Host OS … GuestOS Virtual Server One Physical node

18 18 VM-based Isolation Features Administrative Isolation Fault/Intrusion Isolation Resource Isolation

19 19 VM-based Sample Services Scenario: 1. One web service 2. One honeynet hosting

20 20 Isolation Kernel CPU Isolation Network Out-bound Bandwidth Isolation Memory Usage Limit

21 CPU Isolation Original Linux CPU SchedulerLinux CPU Fair Scheduler Scenario: 1) CPU-intensive: green2) IO-intensive: blue 3) Web: red

22 Service Virtualization & Load Balancing - How ? Virtual Server Virtual Cluster Service Switch Client Request

23 23 Service Virtualization + Load Balancing Host OS Guest OS Httpd-a Guest OS foo Scenario: 1. Res a :Res b = 1:2 2. Req a :Req b = 1:2 Distribution of requests by Service Switch Response time from virtual service node Host OS Guest OS bar Guest OS Httpd-b

24 24 Service Bootstrapping Time Linux Configuration Image sizeTime(seattle)Time(tacoma) Rootfs_tomrtbt_1.7.20 5 15 MB2.0 sec.3.0 sec. Rootfs_base_1.029.3 MB3.0 sec.4.0 sec. Root_fs_lfs_4.0400 MB4.0 sec.16.0 sec. Root_fs.rh-7.2- server.pristine.2002101 2 253 MB22.0 sec.42.0 sec. seattle: Dell PowerEdge server with 2.66GHz Intel Xeon processor and 2GB RAM tacoma: Dell desktop PC with 1.8GHz Intel Pentium 4 processor and 768MB RAM

25 Slow Down factor Scenario: 1. Virtual service node with service switch 2. Service running in host OS with service switch 3. Service running in host OS without service switch System callVM (cycles)Linux getpid27,2761,208 geteuid26,6481,064 dup226,9041,084 mmap27,8641,208 munmap27,0441,200 gettimeofday37,0041,368

26 Outline SODA Overview  Related/Previous Work On-Demand Service Creation Service Isolation/Virtualization Conclusion

27 27 Conclusion Design and Implementation of SODA architecture  Highly Efficient On-demand Service Priming  Satisfactory Service Isolation VM-based approach to address Application Service Hosting paradigm

28 28 Future Work Other VMs Resource Allocation Model & Algorithm Service Placement Service Migration  Freeze / Migrate/ Restart Security

29 29 Publication Xuxian Jiang, Dongyan Xu, "Protection of Application Service Hosting Platforms: an Operating System Perspective", submitted for publication, April 2003Protection of Application Service Hosting Platforms: an Operating System Perspective Xuxian Jiang and Dongyan Xu “SODA: a Service-On-Demand Architecture for Application Service Hosting Utility Platforms” to appear in Proceedings of The 12th IEEE International Symposium on High Performance Distributed Computing (HPDC- 12), Seattle, WA, June, 2003SODA: a Service-On-Demand Architecture for Application Service Hosting Utility PlatformsHPDC- 12 Douglas E. Comer and Xuxian Jiang “Running Linux On Back-end Computers In the Xinu Lab ” Technical report, Department of Computer Sciences, Purdue University, work in progress 2003Running Linux On Back-end Computers In the Xinu Lab Xuxian Jiang, Yu Dong, Dongyan Xu, Bharat Bhargava “GnuStream: A P2P Media Streaming System Prototype ” to appear in IEEE International Conference on Multimedia & Expo (ICME), July 2003GnuStream: A P2P Media Streaming System Prototype

30 30 References Services Migration [1.1, 09/01] Steven Osman, Dinesh Subhraveti, Gong Su, and Jason Nieh, "The Design and Implementation of Zap: A System for Migrating Computing Environments", Proceedings of the Fifth Symposium on Operating Systems Design and Implementation (OSDI 2002), Boston, MA, December 9-11, 2002, pp. 361- 376."The Design and Implementation of Zap: A System for Migrating Computing Environments" [1.2, 14/01] S. Ranjan, J. Rolia, H. Fu, and E. Knightly, "QoS-Driven Server Migration for Internet Data Centers", in Proceedings of IWQoS 2002, Miami, FL, May 2002."QoS-Driven Server Migration for Internet Data Centers" [1.3, 05/02] Amin Vahdat, Thomas Anderson, Michael Dahlin, David Culler, Eshwar Belani, Paul Eastham, and Chad Yoshikawa, "WebOS: Operating System Services For Wide Area Applications", in The Seventh IEEE Symposium on High Performance Distributed Computing, July 1998."WebOS: Operating System Services For Wide Area Applications" Utility Computing [2.1, 09/01] K. Appleby, S. Fakhouri, L. Fong, G. Goldszmidt, and M. Kalantar, "Oceano: SLA Based Management of a Computing Utility", in IFIP/IEEE Intl. Symp. on Integrated Network Management May 2001"Oceano: SLA Based Management of a Computing Utility" [2.2, 06/02] Andrew A. Chien, "Architecture of the Entropia Distributed Computing System, ", International Parallel and Distributed Processing Symposium April 2002"Architecture of the Entropia Distributed Computing System, " [2.3, 12/02] R. Figueiredo, P. Dinda, J. Fortes, "A Case For Grid Computing on Virtual Machines ", ICDCS 2003, to appear 2003"A Case For Grid Computing on Virtual Machines " Cluster [3.1, 11/01] Justin Moore, Jeff Chase "Cluster On Demand", CS Technical Report Duke University, May 2002 "Cluster On Demand"

31 31 References (2) Virtual Machine [4.1, 09/01] Andrew Whitaker, Marianne Shaw, and Steven D. Gribble, "Scale and Performance in the Denali Isolation Kernel" Proceedings of the Fifth Symposium on Operating System Design and Implementation (OSDI 2002), Boston, MA, December 2002"Scale and Performance in the Denali Isolation Kernel" [4.2, 15/01] George W. Dunlap, Samuel T. King, Sukru Cinar, Murtaza Basrai, Peter M. Chen, "ReVirt: Enabling Intrusion Analysis through Virtual-Machine Logging and Replay" Proceedings of the 2002 Symposium on Operating Systems Design and Implementation (OSDI),, Boston, MA, December 2002"ReVirt: Enabling Intrusion Analysis through Virtual-Machine Logging and Replay" [4.3, 15/01] C. P. Sapuntzakis, R. Chandra, B. Pfaff, J. Chow, M. S. Lam and M. Rosenblum, "Optimizing the Migration of Virtual Computers", in Proceedings of the Conference on Operating Systems Design and Implementation, December 2002."Optimizing the Migration of Virtual Computers" [4.4, 15/01] Emin Gun Sirer, Robert Grimm, Arthur J. Gregory and Brian N. Bershad, "Design and Implementation of a Distributed Virtual Machine for Networked Computers", in Proceedings of the Seventeenth Symposium on Operating Systems Principles, pages 202-216, Kiawah Island, South Carolina, December 1999."Design and Implementation of a Distributed Virtual Machine for Networked Computers" [4.5, 18/01] Peter M. Chen, Brian D. Noble, "When virtual is better than real", Proceedings of the 2001 Workshop on Hot Topics in Operating Systems (HotOS), May 2001. review [4.6, 01/02] Karim Yaghmour, "Adaptive Domain Environment for Operating Systems", Opersys Inc., June 2002."When virtual is better than real"review"Adaptive Domain Environment for Operating Systems"

32 32 References (3) Resource Management [5.1, 10/01] John Reumann, Ashish Mehra, Kang G. Shin, and Dilip Kandlur, "Virtual Services: A New Abstraction for Server Consolidation,'', in Proc. of USENIX 2000 Annual Technical Conference, June 18-23, 2000, San Diego, CA, U.S.A."Virtual Services: A New Abstraction for Server Consolidation,'' [5.2, 12/01] Bhuvan Urgaonkar, Prashant Shenoy and Timothy Roscoe, "Resource Overbooking and Application Profiling in Shared Hosting Platforms'', Proceedings of the Fifth Symposium on Operating Systems Design and Implementation (OSDI),, Boston, MA, December 2002"Resource Overbooking and Application Profiling in Shared Hosting Platforms'' [5.3, 13/01] Kai Shen, Hong Tang, Tao Yang, and Lingkun Chu, "Integrated Resource Management for Cluster-based Internet Services''. in Proc. of the 5th USENIX Symposium on Operating Systems Design and Implementation (OSDI'02), Boston MA, December 2002"Integrated Resource Management for Cluster-based Internet Services'' [5.4, 15/01] Gaurav Banga, Jeffrey C. Mogul and Peter Druschel "Resource containers: A new facility for resource management in server systems''. in Proceedings of the Third Symposium on Operating Systems Design and Implementation (OSDI),, New Orleans, LA, February 1999"Resource containers: A new facility for resource management in server systems'' [5.5, 15/01] Mohit Aron, Peter Druschel and Willy Zwaenepoel, "Cluster Reserves: A Mechanism for Resource Management in Cluster-based Network Servers". in Proceedings of the ACM SIGMETRICS Conference on Measurement and Modeling of Computer Systems, Santa Clara, CA, June 2000"Cluster Reserves: A Mechanism for Resource Management in Cluster-based Network Servers" [5.6, 17/01] Jose Renato Santos, Koustuv Dasgupta, G. (John) Janakiraman and Yoshio Turner, "Understanding service demand for adaptive allocation of distributed resources". in Proceedings of IEEE Global Internet Symposium (GLOBECOM '02), Taipei, Taiwan, November 17-21, 2002 "Understanding service demand for adaptive allocation of distributed resources"

33 33 References (4) Network Servers [6.1, 15/01] Mohit Aron, Darren Sanders, Peter Druschel and Willy Zwaenepoel, "Scalable Content-aware Request Distribution in Cluster-based Network Servers". in Proceedings of the USENIX 2000 Annual Technical Conference, San Diego, CA, Jun 2000"Scalable Content-aware Request Distribution in Cluster-based Network Servers" [6.2, 16/01] Matt Welsh, David Culler, and Eric Brewer. "SEDA: An Architecture for Well-Conditioned, Scalable Internet Services". in Proceedings of the Eighteenth Symposium on Operating Systems Principles (SOSP-18), Banff, Canada, October, 2001 [6.3, 16/01] Matt Welsh, David Culler. "Virtualization Considered Harmful: OS Design Directions for Well- Conditioned Services". in Proceedings of the 8th Workshop on Hot Topics in Operating Systems (HotOS VIII),, Schloss Elmau, Germany, May, 2001"SEDA: An Architecture for Well-Conditioned, Scalable Internet Services""Virtualization Considered Harmful: OS Design Directions for Well- Conditioned Services" [6.4, 04/02] Jeremy Kerr "Achieving Linear Scalability of Network Services through Load Balancing". "Research Proposal: Selection Algorithms & Dynamic Feedback in Network Load Balancer" "A review of currently available literature on load balancing " Course Project"Achieving Linear Scalability of Network Services through Load Balancing""Research Proposal: Selection Algorithms & Dynamic Feedback in Network Load Balancer""A review of currently available literature on load balancing " Linux-Based extension [7.1, 16/01] David Coulson, "UML-based pseudo-dedicated hosting service". OpenConsultancy 2002"UML-based pseudo-dedicated hosting service" [7.2, 17/01] Ashvin Goel, Luca Abeni, Charles Krasic, Jim Snow, and Jonathan Walpole, "Supporting time- sensitive applications on general-purpose operating systems.". In Proceedings of the Fifth USENIX Symposium on Operating Systems Design and Implementation Dec 2002"Supporting time- sensitive applications on general-purpose operating systems." [7.3, 05/02] Vijay Sundaram, Abhishek Chandra, Pawan Goyal and Prashant Shenoy, "Application Performance in the QLinux Multimedia Operating System ". Proceedings of the Eighth ACM Conference on Multimedia, Los Angeles, CA, pages 127-136, November 2000."Application Performance in the QLinux Multimedia Operating System "

34 34 References (5) Emulation & Network testbed [8.1, 18/01] Amin Vahdat, Ken Yocum, Kevin Walsh, Priya Mahadevan, Dejan Kostic, Jeff Chase, and David Becker, "Scalability and Accuracy in a Large-Scale Network Emulator". Proceedings of 5th Symposium on Operating Systems Design and Implementation (OSDI), Dec. 2002"Scalability and Accuracy in a Large-Scale Network Emulator" [8.2, 27/01] Christopher A. Telfer, "Implementation and Evaluation of Reconfigurable Network Testbed" Ph.D. Thesis March 2003 [chapters: 2 3 4 5 ]2345 [8.3, 05/02] White, Lepreau, Stoller, Ricci, Guruprasad, Newbold, Hibler, Barb, and Joglekar, "An Integrated Experimental Environment for Distributed Systems and Networks" 0SDI 2002 Dec 2002"An Integrated Experimental Environment for Distributed Systems and Networks" [8.4, 05/02] Larry Peterson, Tom Anderson David Culler, and Timothy Roscoe, "A Blueprint for Introducing Disruptive Technology into the Internet" Proceedings of the 1st ACM Work on Hot Topics in Networks (HotNets-I), Princeton, NJ October 28-29, 2002"A Blueprint for Introducing Disruptive Technology into the Internet" [8.5, 06/02] Xin Liu, Huaxia Xia, and Andrew Chien, "Network Emulation Tools for Modeling Grid Behaviors." The 3rd IEEE/ACM International Symposium on Cluster Computing and the Grid CCGrid 2003"Network Emulation Tools for Modeling Grid Behaviors."


Download ppt "SODA : a Service-On-Demand Architecture An Utility Computing Perspective Xuxian Jiang Purdue University 04/10/2003."

Similar presentations


Ads by Google