The Anatomy of the Grid Mahdi Hamzeh Fall 2005 Class Presentation for the Parallel Processing Course. All figures and data are copyrights of their respective authors.

Outline Introduction Common requirements Our objectives The nature of grid architecture Relationship with other technologies Other perspective on grids References

Introduction The Grid  Coined in the mid-1990s  Group of participants  Varying degrees of prior relationship  Mutually Distrustful  Need to share resources to perform a task Direct access to software, data, sensors and computers Dynamic sharing relationships Sharing subject to a set of constraints  What, Who, When etc.  Industry  Science  Engineering Our purpose  Develop a detailed architecture  Roadmap

Introduction (contd) Real and specific problems  Coordinated resource sharing  Problem solving in dynamic multi-institutional virtual organization Why carefully study underlying technology?  Common concerns  Requirements Why not current distributed computing technologies is enough?  Does not accommodate the range of resource types  Does not provide the flexibility  Does not provide control on sharing relationships

Common requirements Highly flexible sharing relationships  Ranging Sophisticated and precise levels of control Sharing of varied resources  Programs  Files  Data  Computers  Sensors  Networks Diverse usage modes  Single user to multi-user  Performance sensitive to cost sensitive  Quality of service  Accounting

Our objectives Clarify the nature of VOs and Grid computing Contribute to the emergence of Grid computing Define clearly how Grid technologies relate to other technologies

The nature of grid architecture Interoperability  In a networked environment, interoperability means common protocols  VO users and resources negotiate, establish, manage, and exploit sharing relationships  Accommodating new participants dynamically Protocols  Specifies how distributed system elements interact with one another  Structure of the information exchanged during this interaction  Discover resources  Establish identity  Determine authorization  Initiate sharing  All must flexible and lightweight Services  access to computation  access to data  resource discovery Application programming interfaces and software development  Programming abstractions enable code sharing enhance application portability

GRID ARCHITECTURE Our goal  Identify requirements for general classes of component  Open architectural structure  Extensible Hourglass model Definition of core abstraction and protocols Foster, I., Kesselman, C. and Tuecke, S. The Anatomy of the Grid: Enabling Scalable Virtual Organizations. Intl. J. Supercomputer Applications, 2001

The layered Grid architecture and its relationship to the Internet protocol architecture Foster, I., Kesselman, C. and Tuecke, S. The Anatomy of the Grid: Enabling Scalable Virtual Organizations. Intl. J. Supercomputer Applications, 2001

Fabric The Grid Fabric layer provides the resources Operations  Enquiry  Resource management Resources  Computational resources  Storage resources  Network resources...

Connectivity Communication  Transport  Routing  Naming Authentication  Single sign-on  Delegation  Integration with various local security solutions Kerberos Unix security  User-based trust relationships

Resource Information protocols  Structure  State Management protocols  Negotiation  Monitoring  Initiation  Control  Accounting  Payment  Serve ‘requested protocol operations are consistent with the policy under which the resource is to be shared’

Collective Sharing behaviors  Directory services  coallocation-allocation, scheduling, and brokering services  Monitoring and diagnostics services  Data replication services  Grid-enabled programming systems  Workload management systems and collaboration frameworks  Software discovery services  Community authorization servers  Community accounting and payment services  Collaboratory services

Example of Implementation Foster, I., Kesselman, C. and Tuecke, S. The Anatomy of the Grid: Enabling Scalable Virtual Organizations. Intl. J. Supercomputer Applications, 2001

Application Foster, I., Kesselman, C. and Tuecke, S. The Anatomy of the Grid: Enabling Scalable Virtual Organizations. Intl. J. Supercomputer Applications, 2001

Architecture in practice Storage systems, computers, networks, code repositories, catalogs Fabric Communication (IP), service discovery (DNS), authentication, authorization, delegation Connectivity Access to computation; access to data; access to information about system structure, state, performance. Resource Resource discovery, resource brokering, system monitoring,community authorization, certificate revocation Collective (generic) Checkpointing, job management, failover, staging Collective (application-specific) Ray Tracing Solver coupler,distributed data archiver Multidisciplinary Simulation

Intergrid protocols Select and achieve widespread deployment of one set of protocols at the Connectivity and Resource layers Lesser extent, at the Collective layer

Relationship with other technologies World Wide Web  QoS Guarantees [ No ]  Distributed Resources [ Yes ]  De-centralized Coordination [ No ]  Standard/Open Protocols [ Yes ] Application and storage service providers  QoS Guarantees [ Yes ]  Distributed Resources [ Yes/No ]  De-centralized Coordination [ No ]  Standard/Open Protocols [ No ] Internet and peer-to-peer computing  QoS Guarantees [ No /No]  Distributed Resources [ Yes ]  De-centralized Coordination [ Yes ]  Standard/Open Protocols [ No ]

Other perspective on grids The Grid is a next-generation Internet The Grid is a source of free cycles The Grid requires a distributed operating system The Grid requires new programming models The Grid makes high-performance computers superfluous

References Berman, F. Fox, G. Hey, T. Grid Computing making the global infrastructure a reality, WILEY,2003. Foster,I.Grid Technologies & Applications: Architecture & Achievements, Foster, I., Kesselman, C. and Tuecke, S. The Anatomy of the Grid: Enabling Scalable Virtual Organizations. Intl. J. Supercomputer Applications, (to appear) Frey, J., Tannenbaum, T., Foster, I., Livny, M. and Tuecke, S., Condor-G: A Computation Management Agent for Multi-Institutional Grids. In 10th International Symposium on High Performance Distributed Computing, IEEE Press, Livny, M. High-Throughput Resource Management. In Foster, I. and Kesselman, C. eds. The Grid: Blueprint for a New Computing Infrastructure, Morgan Kaufmann, 1999 Stockinger, H., Samar, A., Allcock, W., Foster, I., Holtman, K. and Tierney, B., File and Object Replication in Data Grids. In IEEE Intl. Symp. on High Performance Distributed Computing, IEEE Press, Armstrong, R., Gannon, D., Geist, A., Keahey, K., Kohn, S.,McInnes, L. and Parker, S.Toward a Common Component Architecture for High Performance Scientific Computing. In Proc. 8th IEEE Symp. on High Performance Distributed Computing,

Questions ?