1. Cloud Computing, Overview and Challenges Marin Litoiu, York University

2. Cloud Computing, CASCON 2008 Content  IT Challenges  IT Trends  Cloud Computing  Clouds in Industry and Academia  Challenges in Cloud Computing

3. Cloud Computing, CASCON 2008 3 IT Challenges SWG Technical Interlock

4. Cloud Computing, CASCON 2008 4 Multiple forces are driving a transformation of the data center Accelerated pace of business and technology innovations Operational issues have IT at a break point Challenges Rising costs of systems and networking operations Explosion in volume of data and information Difficulty in deploying new applications and services Security of your assets & your clients’ information Landslide of compliance requirements Systems and applications need to be available Rising energy costs & rising energy demand Power & thermal issues inhibit operations Environmental compliance & governance mandates Costs & Service Delivery Business Resiliency & Security Energy Requirements SWG Technical Interlock

5. Cloud Computing, CASCON 2008 5  Driven by increasing numbers of physical systems, systems management has become the main IT cost component and is growing rapidly  Consolidations alone will not remedy this Many Servers, Much Capacity, Low Utilization = $140B unutilized server assets The Growing Cost of IT Management

6. Cloud Computing, CASCON 2008 6 Power and Heat Management  Data center power consumption and heat dissipation has become a significant IT problem.  50% of datacenters will have insufficient power and cooling capabilities by 2008 [Gartner]  The cost of power required to run servers is approaching 30% of the server acquisition cost  30% reduction in power would save $15B and reduce U.S. CO 2 emissions per year by 1.7%

7. Cloud Computing, CASCON 2008 7 Data source: Creating Energy-Efficient Data Centers, U.S. Department of Energy, Data Center Facilities and Engineering Conference, May 18, 2007 Data center IT Load Power and Cooling 55%45% IT Resources 65%35% Storage, networks, … Servers 80%20% Idle Typical resource usage Utilization How is energy typically used in the data center?

8. Cloud Computing, CASCON 2008 8 IT Trends SWG Technical Interlock

9. Cloud Computing, CASCON 2008 SaaS, Virtualization, Cloud Computing: “Google Trends”

10. Cloud Computing, CASCON 2008 10 IT Trends Virtualization Technologies SWG Technical Interlock

11. Cloud Computing, CASCON 2008 11 Virtualization – a substitution process  Creates virtual resources from real resources  Primarily accomplished with software and/or firmware Real Resources  Things with architected interfaces/functions  Often physical. May be centralized or distributed.  Examples: memory, disk drives, networks, servers Virtual Resources – substitutes for real resources  Same interfaces and functions as their real counterparts  Less constrained by physical limitations; may differ in attributes or numbers  Often of part of the underlying resource, but may span multiple resources  Virtualization separates the presentation of resources to users from the actual resources  Virtual resources have the same interfaces and functions as the real resources they replace, but can have different attributes/numbers that make this substitution worthwhile Virtualization Concept Users of Resources

12. Cloud Computing, CASCON 2008 12 Virtualization Functions and Benefits

13. Cloud Computing, CASCON 2008 Virtualization Creates New Management Challenges 13 Physical Server Installed Base (Millions) Source: IDC, May 2006 Server Mgt and Admin Costs $0 $50 $100 $150 $200 $250 $300 199619971998199920002001200220032004200520062007200820092010 Spending (US$B) New Server Spending Power and Cooling Costs 0 5 10 15 20 25 30 35 40 45 50 55 60 Virtual+Physical Server Installed Base (Millions) Virtualization Management Gap IDC projects that use of server virtualization will result in a significant increase in the number of servers (physical + virtual) to be managed The projected increase is not yet reflected in their forecast of server management costs Virtualization Creates New Management Challenges

14. Cloud Computing, CASCON 2008 14 IT Trends Software as a Service SWG Technical Interlock

15. Cloud Computing, CASCON 2008 15 SaaS – Growing paradigm of Software-as-a-Service  Delivering software functionality online, similar to the one installed on your machine. –Instead of buying a license for a software buy usage as you go buy a subscription use it for free  Architectures: –An instance for each client ( provide isolation and better security) This is hardware virtualization – One instance for all clients by virtual partitioning client data and configurations This is application virtualization (or multi-tenancy)

16. Cloud Computing, CASCON 2008 More on SaaS …  Flavours –Infrastructure as a Service –Platform as a Service –Software as a Service –Desktop as a Service 16 DesktopOffice Databases OS Network Database Storage CPU Servers Web servers ERP CRM Software dev tools

17. Cloud Computing, CASCON 2008 17 Cloud Computing SWG Technical Interlock

18. Cloud Computing, CASCON 2008 18 Service Consumers Component Library Cloud Administrator Datacenter Infrastructure Monitor & Manage Resources Component Vendors / Software Publishers Publish & Update Components Access Services IT Cloud View from Above: “IT Cloud”  Cloud computing is an emerging style of computing in which applications, data, and IT resources are provided as services to users over the web. SWG Technical Interlock

19. Cloud Computing, CASCON 2008 19

20. Cloud Computing, CASCON 2008 20 Industrial and Academic Clouds SWG Technical Interlock

21. Cloud Computing, CASCON 2008 21 Cloud Computing Players … …more everyday

22. Cloud Computing, CASCON 2008 Amazon Cloud: provides raw computing services  Amazon Web Services (AWS): –Compute Capacity (Elastic Cloud Computing) –Storage (Simple Storage Service), –SimpleDB –Simple Queue Service  Business model: charge per usage Standard InstancesLinux/UNIXWindows Small (Default)$0.10 per hour$0.125 per hour Large$0.40 per hour$0.50 per hour Extra Large$0.80 per hour$1.00 per hour

23. Cloud Computing, CASCON 2008 Google Cloud: provides high end services

24. Cloud Computing, CASCON 2008 Microsoft Cloud  Started to offer SaaS: MS Office, Exchange  Subscription base business model  Platform as a Service: Azure

25. Cloud Computing, CASCON 2008 IBM Cloud: tools and infrastructure to build your private or public cloud

26. Cloud Computing, CASCON 2008 NCSU Cloud: desktop virtualization

27. Cloud Computing, CASCON 2008 Centre of Excellence for Research in Adaptive Systems  Participants –IBM –Ontario Government –Ontario Cancer Institute –UofWaterloo, UofToronto, Queen’s, Carleton, York University –Other companies  Three complementary research thrusts to enable cloud computing –Service and resource virtualization: what do we offer in a cloud? –Programming models for web services: how do we add value? –Autonomic computing: how do we manage that?  Deliverables –A cloud infrastructure –Algorithms and methods to manage the cloud infrastructure –Services Tools in cloud Desktops Web services and applications –Demonstrate how emerging application can be run more effectively on a virtual infrastructure

28. Cloud Computing, CASCON 2008 CERAS Cloud Architecture End user: interacts with services Application Admin installs, configures, monitors U of Toronto U of Waterloo App Operating System Image App Operating System Image App User Services York University Hardware services Software Appliances (Linux, DB2, WAS, RAD, TPM, ITM, etc..) Hardware services Cloud Layer Network Web based Desktop applications Grid applications CLOUDMANAGEMENTCLOUDMANAGEMENT Admin Services Cloud Admin installs, configures, monitors

29. Cloud Computing, CASCON 2008 Cloud Challenges Security45% Integration with existing systems26% Loss of control over data26% Availability concerns25% Performance issues24% IT governance issues19% Regulatory/compliance concerns19% Dissatisfaction with vendor offerings/pricing12% Ability to bring systems back in-house11% Lack of customization opportunities11% Measuring ROI11% Not sure7% Other6% Greatest Concerns Surrounding Cloud Adoption at Your Company* (*Respondents selected up to three criteria. SOURCE: CIO Research Journal)

30. Cloud Computing, CASCON 2008 Questions, Feedback, Comments, Ideas, Aha- experiences, Insights,... 30