1. CS – 6703 GRID & CLOUD COMPUTING Dr. B. Chandramouli

2. Overall Syllabus Unit 1--Introduction Unit 2--Grid Services Unit 3--Virtualisation Unit 4--Programming model Unit 5--Security

3. Unit 1 - Syllabus Evolution of Distributed computing: Scalable computing over the Internet Technologies for network based systems Clusters of cooperative computers Grid computing Infrastructures Cloud computing Service oriented architecture Introduction to Grid Architecture and standards Elements of Grid Overview of Grid Architecture

4. Background Extension of what you read before…. – Distributed systems – Software architecture Discuss about “Computing” wrt – Large scale, big data, scientific problems and solutions – Virtual computing These computing requires – Multiple computers distributed globally and communicating with each other Results in “Computer to computer communication ( network)” for “computing”

5. COMMUNICATION ? Communication is the transfer of information from one place to another. The process of communication essentially involves the following three components: – Sender – Receiver – Medium

6. Components of Communication Sender :- – The component from where the information is transferred Receiver :- – The component to which the information is transferred. Medium:- – The component through which the information is transferred.

7. Computer Communication In computer communication the sender and the receiver are both computers and medium is electromagnetic waves, cables or some other physical media.

8. What is Networking ? Networking is a way of communication. The concept of connecting computers together to form computer network. A computer network is a communication system where a group of computers and other devices like printer are connected by cables and other hardware. This concept of connected computers sharing resources called networking.

9. Why Network ? To share – Data Messages – Printers – Hard disks – CD-ROMS – Modems – Other hard disk resources. Advantages of Networking : Networks allow efficient management of resources. Network helps keep information reliable and up-to-date. Networks help speed up data sharing. Transferring files across a network a network is always faster than non network. Services like E-mail allow communication among individuals.

10. Types of Networks L A N (Local Area Network) – If a network is confined to a single location, typically one building or complex, it is called local area network. The maximum distance from one end of a network to another is usually limited. Generally sending and receiving of messages through a physical connection such as a cable. W A N (Wide Area Network) – When the networks is spread over wide areas such as across cites, states or countries. It is called as a wide area network. Communication take place via telephone lines, satellites or physical cable. Best example is live telecast of sports. M A N (Metropolitan Area Network) – In between LAN and WAN is the metropolitan network. This networks that covers entire city, but uses LAN technology. Cable television networks are the examples of MAN s. The MAN s we are interested in carry information in the form of computer signals from one computer to another.

11. Components of networks Server:- – Computers that provide shared resources to network users. Clients:- – Computers that access shared network resources provided by a server. Media:- – The way in which the computers are connected. Resources:- – Files printers and other items to be used by network users

12. CATEGORIES OF NETWORK Server Based Network : – A server is a computer on a network that functions as a server and is not used as client. – A server is optimized to service requests from network clients – Servers perform wide variety of tasks. – Usually large networks have specialized servers for different tasks, e.g. File and print servers:- – Manage user access and use of file and printer resources. Application servers:- – Make the data on the server available to clients. Mail servers:- – Manage electronic messaging between network users. Communication servers:- – Handle data flow and E-mail messages.

14. CATEGORIES OF NETWORK… PEER TO PEER NETWORK : – In this there are no dedicated servers. – All the computers are equal and therefore are termed as peers. – The main advantage of this network is simple in design and maintenance. – It is usually expensive to set up as compared to server-based networks.

15. Topology Topology refers to the arrangement of computers, cables and other components on the network. Networks can be configured in to following basic topologies – Bus – Star – Ring

16. Bus / Star / Ring Bus topology : – This is also known as liner bus. It consists of several computers which are attached to a common cable called trunk line. This is also called as passive topology, in which computers are not responsible for transferring of data. In this failure of one computer does not affect the performance of the network Star topology : – In this computers are connected to a centralized device known as HUB. As each computer is connected to central point, this topology requires great deal of cabling. If the centralized controller fails, the entire network is disabled. Ring topology : – In this computers are connected through a single circle of cable. This is an active topology, as each computer acts like a repeater to boost the signal and sends it on to the next computer. Failure of one computer can affect the entire network.

17. INTERNET & INTRANET INTERNET – Internet is an inter-connection between several computers of different types belonging to various networks all over the globe. It is a networks of network. INTRANET – An intranet is a private computer network that uses Internet technologies to securely share any part of an organization's information or operational systems with its employees. Interconnectivity of two or more networks to form a single unit is called intranet. It may consist of many interlinked local area networks and also use leased lines in the wide area network

18. Some terminologies

19. WWW WORLD WIDE WEB : The World Wide Web (commonly abbreviated as the "Web") is a system of interlinked hypertext documents accessed via the Internet. With a Web browser, one can view Web pages that may contain text, images, videos, and other multimedia and navigate between them using hyperlinks

20. HYPERTEXT Hypertext is text, displayed on a computer, with references (hyperlinks) to other text that the reader can immediately access, usually by a mouse click or key press sequence

21. WEB BROWSER A web browser is a software application for retrieving, presenting, and traversing information resources on the World Wide Web. The major web browsers are Windows Internet Explorer, Mozilla Firefox, Apple Safari, Google Chrome, and Opera.

22. Web Pages / Hypertext A web page or webpage is a document or resource of information that is suitable for the World Wide Web and can be accessed through a web browser and displayed on a computer screen. This information is usually in HTML or XHTML format

23. Web Pages / Hypertext … WWW is the most popular method of accessing the internet. The main reason of popularity is due to usage of concept called hypertext. Hypertext is the new way of information storage and retrieval. Hypertext documents on the internet called as web pages. These web pages are created by using special language called hypertext markup language (HTML).

24. Internet Individual server / Network (Stores Web pages) / web pages are created by HTML WWW – Logical link between all web pages Global network of many networks ( Internet) Client with browser SW ISP

25. MULTIMEDIA & APPLICATIONS Multimedia is media and content that uses a combination of different content forms. Multimedia includes a combination of text, audio, still images, animation, video, and interactivity content forms. Multimedia Apps – Foreign language learning – Video games – Special effects in films – Animated advertisements

26. Internet of Things Major Technology evolution of today Use of internet( wireless) to connect common objects, sensors, computers, devices used in daily life IoT uses RFID, sensors, GPS( Global Positioning system) 3 Types of communication – H2H ( Human to Human) -- email, chat,Skype, facebook – H2T ( Human to Thing ) -- Voice commands to remote robo ( Open Gate), New location suggest good restaurants( apple watch) – T2T ( Thing to Thing ) – remote a/c controller to Home ac ( At 4:50 pm automatically send signal to power On AC at home)

27. Technologies in HW Multicore Processor ( HW) – Have more than 1 core to execute necessary functions Multi threading (OS) – OS gives the facility to execute an application in many paths(threads) Graphic Processor ( HW –> CPU + Graphic processing) – CPU is generally sequential processing compared to GPU which is parallel processing mainly suited for Graphic apps. ( Engg, scientific and 3D animation etc..) Networks ( as seen in previous slides) + Storage area network ( SAN) Virtualisation ( imitating as if physical devices are available)

30. Multithreading

31. Scaling – What and Why ? What ? – It is the ability of a computer application (software / OS) or product (hardware / network) to continue to function well with high reliability when the need goes high (up) or low (down) Why ? – Business growth forces organisation’s growth – No. of functions in an application increase over a period – No. of users increase – Users get spread across the globe – Demand for resources increase ( memory, proc speed etc.) – Data becomes huge

32. Need of more Computing Power: Grand Challenge Applications Solving technology problems using computer modeling, simulation and analysis Life Sciences Mechanical Design & Analysis (CAD/CAM) Aerospace Geographic Information Systems Geographic Information Systems

33. Local Cluster Inter Planet Grid 2100 Personal Device Main frames Global Grid PERFORMANCE+QoSPERFORMANCE+QoS Individual Group Department Campus State National Globe Administrative Barriers Enterprise Cluster/Grid Scalable Computing

34. Distributed system ? Definition: – A Set of nodes, connected by a network, which appear to its users as a single coherent system. – Examples Internet ( interconnection of globally distributed computers ) WWW ( Interlinked hypertext) Mobile network (interconnection of globally distributed computers and mobiles devices)

35. Why DS is important ? Resource sharing Load Sharing Improves scalability Improves reliability Geographically distributed Works during partial failure Parallel processing, so performance improved – PASS, dev by IBM in 1981 used in space shuttle. – Could have been done by 1 m/c – IBM did with 4 nodes for fault tolerance

36. Distributed Systems36 DS Evolution Late 70’s and early 80’s: synchronous with distributed processing Mid 80’s: no point of central control Late 80’s: peer structure and inter-connection configuration Later: more fine-grained distribution – Software is decomposed into components – Components can resides on different computers and be implemented with different languages

38. Distributed Systems38 Examples of Distributed Systems IT Service Architecture of a Swiss Bank – Service architecture consists of heterogeneous new and legacy components – Hardware platforms range from mainframes to NTs – Programming languages including Assembler, Cobol, C, C++, Java, … – Different types of middleware can be used to resolve distribution and heterogeneity Customer Information Services Authorization Services ATM Services Trading Services

39. Distributed Systems39 Transparency in Distributed Systems Distributed System Definition: A distributed system is a collection of autonomous hosts, heterogeneous in nature, that are connected through a computer network and coordinate with each other in such a way that users perceive the system as a single and integrated computing facility. Dimensions of transparency in DS – Access Transparency – Location Transparency – Migration Transparency – Replication Transparency – Concurrency Transparency – Scalability Transparency – Performance Transparency – Failure Transparency

40. DS categories Clusters – A computer cluster consists of a set of loosely or tightly connected computers that work together so that, in many respects, they can be viewed as a single system. Here, computer clusters have each node set to perform the same task ( homogeneous), controlled and scheduled by software Cloud – Internet-based computing, where different services — such as servers, storage and applications are delivered to an organization's computers and devices through the Internet. Grid – Grid computing is the collection of computer resources from multiple locations to reach a common goal. – The grid can be thought of as a distributed system with non-interactive workloads that involve a large number of files. – Grid computing is distinguished from conventional high performance computing systems such as clusters in that grid computers have each node set to perform a different task/application.

41. Distributed computingClusters Multiple computers connected together e.g LAN Each node performs same task Controlled by network software Mostly physically coupled Cloud Multiple computers connected together through Internet All hardware and software services provided by cloud provider without any knowledge to customers, You lease anything you want and pay for that only Grid Multiple computers from different locations connected together each perform different tasks and achieves ONE common goal Not physically coupled Order of increasing complexity

42. Centralised Vs Distributed CentralisedDistributed Many jobs done on a single CPUJobs are distributed to many CPUs which are interconnected Uses Shared memory, Variables conceptNO Shared memory, Variables concept Single global clock to sync opsNo global clock

43. CLUSTER ARCHITECTURE CLUSTERS FOR COOPERATIVE COMPUTING -

44. What is a cluster? A cluster is a type of parallel or distributed processing system, which consists of a collection of physically interconnected stand- alone computers cooperatively working together as a single, integrated computing resource. A typical cluster: – Network: Faster, closer connection than a typical network (LAN) – Low latency communication protocols ( Slowly responding …between service initiation to result) – Looser connection than SMP ( symmetric multi processor) Use ? – High Availability in comparison to standalone – High Performance in comparison to standalone – Scalable

45. A cluster of servers (S 1, S 2, …,S n) interconnected by a high-bandwidth system-area or local-area network with shared I/O devices and disk arrays. The cluster acts as a single computing node may be attached to the Internet through a gateway.

46. High-availability clusters implementations are best for mission-critical applications or databases, mail, file and print, web, or application servers.

47. Cluster High Performance thru Load Balancing

48. CLUSTER BENEFITS  The main benefits of clusters are: 1.Availability 2.Performance 3.Scalability  These benefits map to needs of today's enterprise business, education, military and scientific community infrastructures.

49. Grid computing

50. What’s Grid ? Similar to electric power grid Electric power grid makes the job of electricity users very very simple ! Similarly for making computing power as easy and as simple, computer grid is used.

51. GRID Computing visualisation

52. What’s Grid computing ? Grid computing is the collection of computer resources from multiple locations connected together to reach a common goal. The grid can be thought of as a distributed system with non-interactive workloads that involve a large number of files (data). Grid computing is distinguished from conventional high performance computing systems such as cluster computing in that grid computers have each node set to perform a different task/application Grid computers also tend to be more heterogeneous and geographically dispersed (thus not physically coupled) than cluster computers. Grid sizes are generally quite large. Although a single grid can be dedicated to a particular application, commonly a grid is used for a variety of purposes. Grids are often constructed with general-purpose grid middleware software libraries.middleware

53. An example computational Grid built over specialized computers at three resource sites at Wisconsin, Caltech, and Illinois.

54. GRID ARCHITECTURE

55. 5 Layers of Grid Architecture Fabric Layer – All physical hardware resources ( storage, sensors, computing servers, network etc) Connectivity Layer – Connects resources request to actual resources ( establishes communication) – user permission, data security etc. Resource services – Forming of various resources ( HW and SW) to run an application under collective operations Collective Layer – Responsible for Monitoring, diagnostics, replication, authorise and authenticate etc… Application Layer – All application, Control programs, SW dev kits reside here

56. Distributed Computing  GRID Distributed computing is an “older term” – Typically built around proprietary software and network – Tightly couples systems/organization Grid is an evolution of distributed computing – Dynamic – Geographically independent – Built around standards – Internet backbone – Open software

57. Criteria for a Grid: Large scale ( a few million resources) Geographically distributed Systems heterogeneous in nature Multiple Administrators Single, common Goal Coordinates resources that are not subject to centralized control. Uses standard, open, general-purpose protocols and interfaces. Delivers nontrivial qualities of service. Benefits Exploit Underutilized resources Load Balancing of Resource Virtualize resources across an enterprise Data Grids, Compute Grids Enable collaboration for virtual organizations

58. Grid Applications Data and computationally intensive applications: This technology has been applied to computationally-intensive scientific, mathematical, and academic problems like drug discovery, economic forecasting, seismic analysis, back office data processing in support of e-commerce A chemist may utilize hundreds of processors to screen thousands of compounds per hour. Teams of engineers worldwide pool resources to analyze terabytes of structural data. Meteorologists seek to visualize and analyze petabytes of climate data with enormous computational demands. Resource sharing – Computers, storage, sensors, networks, … – Sharing always conditional: issues of trust, policy, negotiation, payment, … Coordinated problem solving – distributed data analysis, computation, collaboration, …

59. Computational Grid Applications Biomedical research Industrial research Engineering research Studies in Physics and Chemistry

60. Grid Topologies Intragrid – Local grid within an organisation – Trust based on personal contracts Extragrid – Resources of a consortium of organisations connected through a (Virtual) Private Network – Trust based on Business to Business contracts Intergrid – Global sharing of resources through the internet – Trust based on certification

61. A typical view of Grid environment User Resource Broker Grid Resources Grid Information Service A User sends computation or data intensive application to Global Grids in order to speed up the execution of the application. A Resource Broker distribute the jobs in an application to the Grid resources based on user’s QoS requirements and details of available Grid resources for further executions. Grid Resources (Cluster, PC, Supercomputer, database, instruments, etc.) in the Global Grid execute the user jobs. Grid Information Service system collects the details of the available Grid resources and passes the information to the resource broker. Computation result Grid application Computational jobs Details of Grid resources Processed jobs 1 2 3 4

63. Elements of Grid Computing Resource sharing – Computers, data, storage, sensors, networks, … – Sharing always conditional: issues of trust, policy, negotiation, payment, … Coordinated problem solving – Beyond client-server: distributed data analysis, computation, collaboration, … Dynamic, multi-institutional virtual organizations – Community overlays on classic org structures – Large or small, static or dynamic

64. SOA

65. What are “Web Services” and SOA? What is a service ? – A service is a software entity ( which is available in a public domain) that can be discovered and invoked by other software systems. What is Web service ? – A Web service is a software system identified by a Uniform Resource Identifier (URI), whose public interfaces and bindings are defined and described using XML. Its definition can be discovered by other software systems. These systems may then interact with the Web service in a manner prescribed by its definition, using XML based messages conveyed by internet protocols What is SOA ? – A service-oriented architecture (SOA) is an architectural pattern in computer software design in which application components provide services to other components via a communications protocol, typically over a network. The principles of service-orientation are independent of any vendor, product or technology.

66. Web Services Basic Architecture Web services are consistent with established Service-Oriented Architecture(SOA) principles. Web Services Component – Service – Service Description Web services Roles – Service providers. – Service brokers – Service requestors. Web Services Operations – Publish – Find – Interact

67. The Conceptual Web Service Stacks Search and Find: UDDI Universal Discovery Description and Integration, for registries of Web services Description: WSDL Web Services Description Language, to describe networked XML-based services Messaging: SOAP Simple Object Access Protocol, to define a uniform way of passing XML-encoded data. Transport: Internet Protocol,HTTP, STMP, etc. Format: XML,Extensible Markup Language, to define structures of documents

68. Operations and Message Flow

69. CLOUD COMPUTING

70. Cloud computing ? Cloud computing is using the internet to access someone else's software running on someone else's hardware in someone else's data center.

71. “The National Institute of Standards and Technology (NIST) defines cloud computing as a "pay-per-use model for enabling available, convenient and on- demand network access to a shared pool of configurable computing resources (e.g., networks, servers, storage, applications and services) that can be rapidly provisioned and released with minimal management effort or service provider interaction." NIST Cloud Definition April 2009 71

72. 72 Architecture NIST Visual Model of Cloud Computing Definition

73. Cloud Computing - Services Software as a Service - SaaS Platform as a Service - PaaS Infrastructure as a Service - IaaS

74. 74 Cloud Deployment Models Public Cloud. Private Cloud. Community Cloud. Hybrid Cloud.

75. Cloud Security Forum Ref. Architecture 10/15/201375Cloud Reference Architecture(s) IIT-RTC

76. GRID Computing visualisation

78. Grid Vs Cloud Common to both – Maximise the use of existing resources – Economise computing cost – Uses abstraction extensively ( concepts looks similar) Grid – one large job is divided into many small portions and executed on multiple machines. – Meant for large scale computing Cloud – allow the users to avail of various services without investing in the underlying architecture ( HW,SW,NW) – offers many different services, from web hosting, right down to word processing

79. Grid Vs Cloud Grid ComputingCloud Computing Access to Shared computing power, storage and other resources Access to Leased computing power, storage and other resources Big Org. pay for the services ( Univ. / Govt) Users pay for the leased services Managed by providers and Users ( Univ. / Govt) Managed by Cloud providers only. No role for user. Big Org. Provide the services ( Univ. / Govt/ Research org.) Commercial companies provide services Handles huge amount of data, complex calculations ( e.g.weather forecast) Handles reasonable amount of data for commercial and other org. Uses open source technologyUses proprietary technology Suitable for research org. to carry out tasks like global climate modelling etc.. Suitable for business houses to effectively use computing without investing

80. Standards for GRID environment OGSA – Open Grid Service Architecture – defines requirements for framework for grid systems that support integration, virtualization and management. – Such a framework requires a core set of interfaces, expected behaviors, resource models bindings. OGSI OGSA-DAI Grid FTP WSRF and etc.

81. Part A -- 2 marks Questions 1.What are the 3 components of a network ? 2.What is world wide web (WWW) ? 3.What is webpage ? 4.What is meant by scaling ? 5.What is the need for scaling ? 6.What is multicore architecture ? 7.What is multi threading? 8.What is GPU ? How is it different from CPU ? 9.Define distributed system 10.What are the advantages of distributed systems? 11.List the categories of distributed computing systems? 12.Differentiate between centralized and distributed computing. 13.Define Clusters? 14.List the cluster computing benefits. 15.What is meant by Grid computing ? 16.What are the benefits of Grid computing ? 17.List 3 applications of Grid computing 18.What is meant by Cloud computing ? 19.List the deployment modes of cloud computing. 20.What are the 3 services offered by Cloud computing ? 21.List the essential characteristics of Cloud computing 22.Explain – Web Service. 23.Define Service oriented Architecture ( SOA) 24.What is ‘Internet of Things’ ?

82. Part B – Big Questions 1.Explain in detail the evolution of distributed computing 2.Explain with a diagram Cluster architecture 3.Explain with a diagram Grid architecture 4.Explain with a diagram Cloud architecture 5.Explain with a diagram the Service oriented architecture 6.Explain with neat diagrams, how high availability and high performance achieved through cooperative cluster environment 7.Write a short note on – Muticore processor – Multi threading – Graphic processor

83. End of Unit 1 Recap and discussions