Presentation on theme: "Convergence Characteristics for Clusters, Grids, and P2P networks Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Lab. The University of."— Presentation transcript:
Convergence Characteristics for Clusters, Grids, and P2P networks Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Lab. The University of Melbourne Melbourne, Australia WW Grid Panel at the P2P conference, Linkoping, Sweden
2 Where Did I come From ? * * * * Melbourne Stockholm+Linkoping Singapore London
3 GRIDS the U. of Melbourne, The Gridbus Project: Conduct R&D in Distributed Computational Economy for Service-Oriented Computing: Architecture, Specification, and Open Source Reference Implementation in in Collaboration with Any Global Peers. Platform: Cluster, Grid, P2P for diverse applications. Distributed Application Composition Tools Grid Economy & Scheduling (via Nimrod-G Broker) GridSim Toolkit: Grid Modeling and Simulation (Java based): Libra: Economic Cluster Scheduler Grid Bank: Accounting and Transaction Management World Wide Grid (WWG) – A Global Testbed P2P/Jxta-based Compute Power Market Application Enabler Projects: Virtual Laboratory Toolset for Drug Design High-Energy Physics and the Grid Network (HEPGrid) Brain Activity Analysis on the Grid Future: Grid for Spam Management read only if sender pays!
5 Technology Evolution: Cluster, Grid, P2P
DesktopSMPs or SuperComputers Local Cluster Global Cluster/Grid PERFORMANCEPERFORMANCE Inter Planetary Grid! Individual Group Department Campus State National Globe Inter Planet Galaxy Administrative Barriers Enterprise Cluster/Grid ? Scalable Seamless Computing: Breaking Administrative Barriers
7 Basic Elements Security Resource Allocation & Scheduling Data locality Network Management System Management Resource Discovery Uniform Access Computational Economy Application Development Tools
10 A Typical Grid Computing Environment Grid Resource Broker Resource Broker Application Grid Information Service Grid Resource Broker database R2R2 R3R3 RNRN R1R1 R4R4 R5R5 R6R6 Grid Information Service 2
11 A Typical Grid Computing Environment Grid Resource Broker Resource Broker Application Grid Information Service Grid Resource Broker database R2R2 R3R3 RNRN R1R1 R4R4 R5R5 R6R6 Grid Information Service 2
12 A Typical P2P Computing Environment Peer Agent Application Peer Discovery Service Peer Agent P1P1 P3P3 pNpN P2P2 R7R7 Who can help ? Peer P 2, P 7 can help! pMpM Request Response p4p4 p5p5 Request Sorry, I am busy.
13 A Typical P2P Computing Environment Peer Agent Application Peer Discovery Service Peer Agent P1P1 P3P3 pNpN P2P2 R7R7 Who can help ? Peer P 2, P 7 can help! pMpM Request Response p4p4 p5p5 Request Sorry, I am busy.
14 Cluster, Grid, P2P: Characteristics CharacteristicClusterGridP2P PopulationCommodity Computers High-end computersEdge of network (desktop PC) OwnershipSingleMultiple DiscoveryMembership Services Centralised Index & Decentralised Info Decentralized User ManagementCentralisedDecentralised Resource managementCentralizedDistributed Allocation/SchedulingCentralisedDecentralised Inter-OperabilityVIA based?No standards yetNo standards Single System ImageYesNo Scalability100s1000?Millions? CapacityGuaranteedVaries, but highVaries ThroughputMediumHighVery High Speed(Lat. Bandwidth)Low, highHigh, Low
15 Nimrod-G: Modeling Distributed Computing in Economic Terms Grid Middleware Nimrod/G Client Grid Information Server(s) Schedule Advisor Trading Manager Nimrod-G Engine Grid Store Grid Explorer GE GIS TM TS RM & TS Grid Dispatcher RM: Local Resource Manager, TS: Trade Server Globus, Legion, Condor, etc. G G C L Globus enabled node. Legion enabled node. G L Condor enabled node. RM & TS CL
16 On-Demand Computing Cost Deadline Legion hosts Globus Hosts Bezek is in both Globus and Legion Domains
17 Active Sheet Nimrod-G: Transparent Spreadsheet Processing from PCs to Clusters to World-Wide Grids NimrodProxy Nimrod-G World-Wide Grid
18 MEG( MagnetoEncephaloGraphy) Data Analysis on the Grid: Brain Activity Analysis Life-electronics laboratory, AIST Data Analysis Provision of expertise in the analysis of brain function Provision of MEG analysis Data Generation Nimrod-G 64 sensors MEG Results Analysis All pairs (64x64) of MEG data by shifting the temporal region of MEG data over time: 0 to 29750: 64x64x29750 jobs World-Wide Grid [deadline, budget, optimization preference] [Collaboration with Osaka University, Japan]
20 Evolution Time Line
21 What is Cluster/Grid ? A type of parallel and distributed system that enables the sharing, selection, & aggregation of resources distributed in _____/_______ administrative domains depending on their availability, capability, performance, cost, and users quality of service requirements. A Single Multiple ClusterGrid
22 CPM: DC Economy-based P2P Computing (Jxta based Implementation) Accounting Bill Resources (Provider) User (Consumer) CPM Agent Trader Market Server Market Repository Job Management - Discovery - Membership
23 Drug Design: Data Intensive Computing on Grid It involves screening millions of chemical compounds (molecules) in the Chemical DataBase (CDB) to identify those having potential to serve as drug candidates. Protein Molecules Chemical Databases (legacy, in.MOL2 format) [Collaboration with WEHI for Medical Science, Melbourne]
24 Virtual Drug Design A Virtual Lab for Molecular Modeling for Drug Design on P2P Grid Screen 2K molecules in 30min. for $10 Grid Market Directory Resource Broker Grid Info. Service GTS Give me list PDBs sources Of type aldrich_300? service cost? (GTS - Grid Trade Server) PDB2 get mol.10 from pdb1 & screen it. Data Replica Catalogue service providers? GTS PDB1 mol.10 please? mol.5 please? (RB maps suitable Grid nodes and Protein DataBank)