1. © 2009 Wipro Ltd - Confidential Private Cloud at Wipro Cloud computing based on Condor

2. © 2009 Wipro Ltd - Confidential 2 2 3 1 Background 2 Wipro Private Cloud System architecture 4 Use of Condor Agenda

3. © 2009 Wipro Ltd - Confidential 3 3 Need: Share physical infrastructure between multiple projects and CoE's (Center of Excellence) to reduce server sprawl and number of physical labs Provide an environment for evaluating new technologies, developing solutions and enabling collaboration between multiple labs Centralize infrastructure procurement and management Reduce infrastructure cost of CoE's by enabling multiple development environments Solution: Setup a private cloud for virtual compute and application infrastructure Build a self-service portal for on-demand provisioning to reduce process overheads Support multiple types of virtualization software Reuse existing physical infrastructure, procure minimal new infrastructure Background

4. © 2009 Wipro Ltd - Confidential 4 Wipro Private Cloud

5. © 2009 Wipro Ltd - Confidential 5 5 SaaS Mgmt Wipro Users SaaS User Intranet SaaSApp SaaS Enablers Wipro Cloud Portal / Web Services API Layer Physical Resource Pool - Servers, Storage, Network Managed Network Cloud Admin Cloud OA&M Portal Wipro Cloud Core Virtual Machines Shared Storage Virtual Appliances Application Services Automated Provisioning Multi-tenancy & Isolation Cloud Accounting & Auditing Performance & Fault Monitoring Automated Network & Security Developers Virtual Lab Managed Network Wipro Private Cloud

6. © 2009 Wipro Ltd - Confidential 6 6 Service ElementService Feature Compute Servers Virtual desktop – equivalent to 1.2GHz,512MB RAM,10GB HDD,25Mbps N/w Low End Server – equivalent to 2x1.2GHz, 2GB RAM, 20GB HDD, 25Mbps N/w High End Server – equivalent to 4x1.2GHz, 4GB RAM, 40GB HDD, 25Mbps N/w OS types Linux (CentOS, RHEL) and Windows XP/Server on Intel x86, x86_64 architecture Storage ISCSI (RAID 5), NFS and CIFS Data persistence across power-off, suspend & resume of VM’s Public images/ appliances Ready-to-use public images RHEL 5, Windows XP, LAMP (CentOS 5.2, Apache, Axis, Tomcat, MySQL, PHP, Python) Preconfigured Software load balancer, firewall appliances Network Isolation between CoE's resources IPSec, SSL based VPN Public and Private IP Addresses with NAT support Private images Can Upload VMware Server, VMware ESX and Xen Virtual Machine Image formats Reports Reporting on CPU, Storage and memory usage back to user Cloud Services catalogue

7. © 2009 Wipro Ltd - Confidential 7 7 L1 - Virtual Servers on demand Virtual servers, desktops, storage Migration assistance Self-service portal L2 – Application infrastructure on demand Appliances of standard software Managed backup, proactive monitoring and help-desk Itemized billing and charge-back L3 – Business service infrastructure on demand Scalable business services Multi-tenant application infrastructure (content management, identity management, database, load balancer, firewall,...) Levels of Service

8. © 2009 Wipro Ltd - Confidential 8 System Architecture

9. © 2009 Wipro Ltd - Confidential 9 9 Service Layer Load Balancer App Layer Virtual Machine Layer Bare-metal Layer Monitoring Cloud Management Provisioning Resource mgmt Workload mgmt Auto recovery Task & Process Automation Service LB - ActiveLB - passive Inst 1Inst 2Inst n VM 1VM 2VM n Provisioning Monitoring Performance Availability Alarms Billing Management Service Governor Policy enforcement Incident mgmt Optimizer Contention Network Control Alarms OA&M Portal & Web Service Gateway Customer OA & M Access Design, Test Package, Deploy Bare-metal design Standardize Automate Re-provisioning Virtual M/c design Standardize Automate Agile Caching Appliances Service design SLA’s, Policies, rules, priorities Packaging Custom agents Shared Services Billing parameters Configuration & Change mgmt Developers Business Users Operations Private Cloud – in Action

10. © 2009 Wipro Ltd - Confidential 10 © 2009 Wipro Ltd - Confidential 10 Architecture & Service layers Cloud service

11. © 2009 Wipro Ltd - Confidential 11 © 2009 Wipro Ltd - Confidential 11 Identity Management Bare-metal provisioning Storage provisioning N/W provisioning VM provisioning N/W Plug- in Storage Plug-in Bare-metal Plug-in VM Plug-in Grid Scheduler Service Governor Customer Portal Workflow Manager Cloud State VM Caching Web Service Gateway VM Repo Legend: Developed in Wipro 3rd Party components Charge-back N/W (nagios) Monitoring Nagios plug-in Alerts Metrics Monitor In Development System Components

12. © 2009 Wipro Ltd - Confidential 12 © 2009 Wipro Ltd - Confidential 12 Cloud Backbone 10.201.72.0/24 Cloud Mgmt 192.168.3.0/24 Project X 192.168.5.0/24 Project Y 192.168.6.0/24 Project Z 192.168.7.0/24 Mgmt Server HA Pair Router, firewall VPN Server, IPS, IDS, NAT Switch Fabric Cloud physical systems Storage VM Virtual Machines Virtual Storage Isolated network per project Deployment Example

13. © 2009 Wipro Ltd - Confidential 13 Use of Condor

14. © 2009 Wipro Ltd - Confidential 14 © 2009 Wipro Ltd - Confidential 14 Trusty old features – Flexibility – ClassAd mechanism, configurations and policies – Web Services API – High availability – Resource utilization of jobs Newer features we like – VM Universe – Partitionable Slots – Lease management – Integration with Amazon EC2 (public cloud) Proven in large scale deployments Condor-users and condor-admin support Open source Why Condor?

15. © 2009 Wipro Ltd - Confidential 15 © 2009 Wipro Ltd - Confidential 15 Mostly standard configuration A few custom class ads in jobs and machines Schedd and Collector configured in HA mode Condor spool for VM persistence Virtual machine provision request handled by Condor – VM job to physical machine match-making, file transfer Partitionable slots for dynamic partitioning of physical machine resources Customized condor_vm_* files for configuring and starting VM's – VLAN control, Swap disk and additional storage creation,... Lease management for limiting the number of running instances of a licensed image How are we using Condor?

16. © 2009 Wipro Ltd - Confidential 16 © 2009 Wipro Ltd - Confidential 16 Working with Condor: – With advanced Condor skills, a lot can be achieved without modifying condor code Workarounds: – Passing number of virtual CPUs to VMware – Patch to pass proxy username and password to gSOAP for EC2 integration – Patch to get VM resource usage details on ESX – Special configuration to handle 2 hour delay in detecting a few execute node failures (Thanks Todd!) Feature wish list: – Remote IWD support for VM universe, to avoid any file transfer – Live migration of VM jobs Observations, Workarounds, Wish list

17. © 2009 Wipro Ltd - Confidential nitin.narkhede@wipro.com sateesh.potturu@wipro.com Thank You