November 29, Our team: Undergrad Thomas de Ruiter, Anand Sawant, Ruben Verboon, … Grad Siqi Shen, Guo Yong, Nezih Yigitbasi Staff Henk Sips, Dick Epema, Alexandru Iosup, Otto Visser Collaborators Ion Stoica and the Mesos team (UC Berkeley), Thomas Fahringer, Radu Prodan, Vlad Nae (U. Innsbruck), Nicolae Tapus, Mihaela Balint, Vlad Posea (UPB), Derrick Kondo, Emmanuel Jeannot (INRIA), Assaf Schuster, Mark Silberstein, Orna Ben-Yehuda (Technion),... Introduction to Cloud Computing Alexandru Iosup Parallel and Distributed Systems Group Delft University of Technology The Netherlands SPEC RG Cloud Meeting

November 29,

3

What is Cloud Computing? 3. A Useful IT Service “Use only when you want! Pay only for what you use!” November 29, Q: What do you use? Q: Why not this level?

November 29, Agenda 1.What is Cloud Computing? 2.IaaS Clouds, the Core Idea 3.The IaaS Owner Perspective 4.The IaaS User Perspective 5.Reality Check 6.Conclusion

IaaS Cloud Computing VENI Massivizing Online Games using Cloud Computing

Joe Has an Idea ($$$) (Source: A. Antoniou, MSc Defense, TU Delft, Original idea: A. Iosup, 2011.) MusicWave

Big up-front commitment Load variability: NOT supported Solution #1 Buy or Rent … 10% (Source: A. Antoniou, MSc Defense, TU Delft, Original idea: A. Iosup, 2011.)

Solution #2 Deploy on IaaS Cloud (Source: A. Antoniou, MSc Defense, TU Delft, Original idea: V. Nae, 2008.) Q: So are we just shifting the problem to somebody else, that is, the IaaS cloud owner? NO big up-front commitment Load variability: supported

Inside an IaaS Cloud Data Center (Source: A. Antoniou, MSc Defense, TU Delft, Original idea: A. Iosup, 2011.)

Time and Cost Sharing Among Users User C User B MusicWave (Source: A. Antoniou, MSc Defense, TU Delft, 2012.)

Main Characteristics of IaaS Clouds 1.On-Demand Pay-per-Use 2.Elasticity (cloud concept of Scalability) 3.Resource Pooling 4.Fully automated IT services 5.Quality of Service November 29,

November 29, Agenda 1.What is Cloud Computing? 2.IaaS Clouds, the Core Idea 3.The IaaS Owner Perspective: How to Deploy a Cloud? 4.The IaaS User Perspective 5.Reality Check 6.Conclusion

IaaS Cloud Deployment Models Private On-premises Public Off-premises Hybrid (Source: A. Antoniou, MSc Defense, TU Delft, Original idea: Mell and Grance, NIST Spec.Pub , Sep 2011.)

Resource Sharing Models MusicWave November 29, MusicWave OtherApp Space-SharingTime-Sharing IaaS Clouds MusicWave OtherApp Q: Which one is better? Grids Host OS OtherApp

Virtualization November 29, Virtualization Host OS MusicWaveOtherApp Q: What to do now? Guest OS Virtual Resources VM Instance Applications Guest OS Virtual Resources VM Instance Applications Q: What is the problem?

November 29, 2015 Virtualization and The Full IaaS Stack 17 Guest OS Virtual Resources VM Instance Applications Physical Infrastructure Virtual Infrastructure Manager Virtual Machine Manager Guest OS Virtual Resources VM Instance Applications Virtual Machine Manager Guest OS Virtual Resources VM Instance Applications

The Virtual Machine Lifecycle November 29, (Source: A. Antoniou, MSc Defense, TU Delft, 2012.) Q: Is this fair?

Use Case: Amazon Elastic Compute Cloud (EC2) Prominent IaaS provider Datacenters all over the world Many VM instance types Per-hour charging November 29, InstanceCapacityUS$/hour m1.small0.10 m1.large0.38 c1.xlarge0.76

November 29, Agenda 1.What is Cloud Computing? 2.IaaS Clouds, the Core Idea 3.The IaaS Owner Perspective 4.The IaaS User Perspective: How to Use Clouds? How to Choose Clouds? 5.Reality Check 6.Conclusion

Workload November 29, MusicWaveOtherApp Time MusicWave OtherApp Load = 4 RunTime= 6

Use Case: Workloads of Zynga (Massively Social Gaming) November 29, Sources: CNN, Zynga. Source: InsideSocialGames.com “Zynga made more than $600M in 2010 from selling in-game virtual goods.” S. Greengard, CACM, Apr 2011 Selling in-game virtual goods: “Zynga made est. $270M in 2009 from.” 05/03/zynga-revenue/ 05/03/zynga-revenue/

Use Case: Workloads of Zynga (Massively Social Gaming) Load can grow very quickly November 29, Load

Provisioning and Allocation of Resources November 29, Load Time ProvisioningAllocation

Provisioning and Allocation of Resources November 29, Load Time ProvisioningAllocation Q: What is the interplay between provisioning and allocation?

Provisioning and Allocation Policies November 29, Where? When? How many? Time Load ProvisioningAllocation From where? Which type? etc. When? etc. Q: How many policies exist?Q: How to select a policy? (Source: A. Antoniou, MSc Defense, TU Delft, 2012.)

Use Case: Two Provisioning Policies, Compared November 29, Startup OnDemand Villegas, Antoniou, Sadjadi, Iosup. An Analysis of Provisioning and Allocation Policies for Infrastructure- as-a-Service Clouds, (submitted). PDS Tech.Rep

Use Case: Two Provisioning Policies, Compared Metrics for comparison Job Slowdown (JSD ): Ratio of actual runtime in the cloud and the runtime in a dedicated non-virtualized environment Charged Cost (C c ) Utility (U ) November 29, Q: Charged cost vs Total RunTime? Villegas, Antoniou, Sadjadi, Iosup. An Analysis of Provisioning and Allocation Policies for Infrastructure- as-a-Service Clouds, (submitted). PDS Tech.Rep

Use Case: Two Provisioning Policies, Compared Workloads November 29, Uniform IncreasingBursty Villegas, Antoniou, Sadjadi, Iosup. An Analysis of Provisioning and Allocation Policies for Infrastructure- as-a-Service Clouds, (submitted). PDS Tech.Rep

SystemHardwareVIMHypervisorMax VMs DAS4/Delft20 Dual quad- core 2.4 GHz 24 GB RAM 2x1 TB storage 64 FIU7 Pentium GHz 5 GB RAM 340 GB Storage 7 Amazon EC2unkown/various-20 Use Case: Two Provisioning Policies, Compared Environments November 29, Villegas, Antoniou, Sadjadi, Iosup. An Analysis of Provisioning and Allocation Policies for Infrastructure- as-a-Service Clouds, (submitted). PDS Tech.Rep

Use Case: Many Provisioning Policies, Compared Job Slowdown (JSD) November 29, Q: Why is OnDemand worse than Startup? A: waiting for machines to boot

Use Case: Many Provisioning Policies, Compared Charged Cost (C c ) November 29, Q: Why is OnDemand worse than Startup? A: VM thrashing Q: Why no OnDemand on Amazon EC2?

Use Case: Many Provisioning Policies, Compared Utility (U ) 33

November 29, Agenda 1.What is Cloud Computing? 2.IaaS Clouds, the Core Idea 3.The IaaS Owner Perspective 4.The IaaS User Perspective 5.Reality Check: Who Uses Public Commercial Clouds? 6.Conclusion

November 29, The Real IaaS Cloud “The path to abundance” On-demand capacity Cheap for short-term tasks Great for web apps (EIP, web crawl, DB ops, I/O) “The killer cyclone” Not so great performance for scientific applications (compute- or data-intensive) Tropical Cyclone Nargis (NASA, ISSS, 04/29/08) VS November 29, 2015

36 (Source:

Zynga zCloud: Hybrid Self-Hosted/EC2 After Zynga had large scale More efficient self-hosted servers Run at high utilization Use EC2 for unexpected demand November 29, (Sources: and

Other Cloud Customers 218 virtual CPUs 9TB/2TB block/S3 storage 6.5TB/2TB I/O per month November 29, (Source:

November 29, Agenda 1.What is Cloud Computing? 2.IaaS Clouds, the Core Idea 3.The IaaS Owner Perspective 4.The IaaS User Perspective 5.Reality Check 6.Conclusion

November 29, Conclusion Take-Home Message Cloud Computing = IaaS + PaaS + SaaS Core idea = lease vs self-own On-Demand, Pay-per-Use, Elastic, Pooled, Automated, QoS The Owner Perspective Time-Sharing Virtualization The User Perspective Variable workloads Provisioning and Allocation policies Reality Check: 100s of users

November 29, Thank you for your attention! Questions? Suggestions? Observations? Alexandru Iosup (or google “iosup”) Parallel and Distributed Systems Group Delft University of Technology More Info: Do not hesitate to contact me…