International Grid Computing Enabled by HPIIS Networks Ian Foster Mathematics and Computer Science Division Argonne National Laboratory and Department of Computer Science The University of Chicago

ARGONNE CHICAGO Overview l Grid computing l Importance of international cooperation l My personal experiences with intl activities l The emergence of an intl Grid community l Emerging international Grid applications l Future directions

ARGONNE CHICAGO Grid Computing l Enabling new approaches to collaborative problem solving based on resource sharing in geographically distributed communities –Much as the Internet enabled new approaches based on remote collaboration –No central control, omniscience, strong trust l Two principal elements of an R&D agenda –Understanding these new approaches –Defining and creating the infrastructure required to support resource sharing

ARGONNE CHICAGO Grid Communities and Applications: NSF National Technology Grid

ARGONNE CHICAGO Grid Communities and Applications: Natl Earthquake Engineering Simulation l NEESgrid: national infrastructure to couple earthquake engineers with experimental facilities, databases, computers, & each other l On-demand access to experiments, data streams, computing, archives, collaboration NEESgrid: Argonne, Michigan, NCSA, UIUC, USC

ARGONNE CHICAGO What do we Mean by Infrastructure? l High-speed networks –Sine qua non for many applications l Protocols and services, e.g. –Authentication and authorization –Secure remote resource access –Resource discovery l Tools l Community Different elements closely interrelated

ARGONNE CHICAGO U.S. Experience: Infrastructure Builds Community Builds Infrastructure … l Early 90s –Gigabit testbeds, metacomputing l Mid to late 90s –Early experiments (e.g., I-WAY), academic software projects (e.g., Globus), application experiments l 2000 –Major application communities emerging –Major infrastructure deployments –Rich technology base –Grid Forum: >300 people, >90 orgs, 11 countries

ARGONNE CHICAGO International Grid Computing l International cooperation is important –Applications are often international in scope –Technology expertise is distributed –Cost of non-cooperation is high l International cooperation will not just happen but must be encouraged –Provide infrastructure –Engage application groups and computer scientists, demonstrate feasibility –Build community

ARGONNE CHICAGO Creation of an International Grid Community l 1995 I-WAY a defining event in the U.S. l NSF PACIs, NASA Info Power Grid follow l GUSTO launches large-scale intl cooperation l HPIIS networks and iGrid events promote international applications l : Increasing international contacts l 1999: Grid Forum and eGrid formed l 2000: European Data Grid, GriPhyN, PPDG l March 2001: 1 st Global Grid Forum meeting

ARGONNE CHICAGO GUSTO Computational Grid

ARGONNE CHICAGO International Grid Computing: Collaboration in Astrophysics

ARGONNE CHICAGO International Grid Computing: Mathematicians Solve NUG30 l Community=an informal collaboration of mathematicians and computer scientists l Condor-G delivers 3.46E8 CPU seconds in 7 days (peak 1009 processors) in U.S. and Italy (8 sites) l Solves NUG30 quadratic assignment problem 14,5,28,24,1,3,16,15, 10,9,21,2,4,29,25,22, 13,26,17,30,6,20,19, 8,18,7,27,12,11,23 MetaNEOS: Argonne, Iowa, Northwestern, Wisconsin

ARGONNE CHICAGO Grid Physics Network (GriPhyN) Enabling R&D for advanced data grid systems, focusing in particular on Virtual Data concept ATLAS CMS LIGO SDSS

ARGONNE CHICAGO Grid Forum History [Participants – Institutions – Countries] l November 1998: BOF at SC98 –Chairs Ian Foster (ANL), Bill Johnston (LBL/NAS) l June 1999: GF1 (San Jose NASA Ames) [150 – 50 – 4] –Initial structure discussions; formation of working groups l October 1999: GF2 (Chicago iCAIR) [130 – 60 – 4] –Focused on working group progress and Structure l March 2000: GF3 (San Diego SDSC) [160 – 70 – 7] –Finalized charters, begin detailed work l June 2000: GF4 (Redmond Microsoft) [120 – 60 – 6] –Increase in industry participation, first Grid Working Drafts l October 2000: GF5 (Boston Sun) [190 – 95 – 11] –New WG, increased industry participation l March 2001: GF6/Global Grid Forum 1 (Amsterdam) –Merging efforts with European Grid Forum (eGrid)

ARGONNE CHICAGO Current Grid Forum Groups Grid ForumeGrid ApplicationsAccounting Adv. Prog. Models Grid Performance Scheduling & Rsrc Mgmt Grid User Services Grid Info Services Remote Data Access Security Applications & Testbeds Programmin g Models Data Access Resource Management Performance Analysis Security Object Oriented Steering Grp

ARGONNE CHICAGO Proposed Global Grid Forum Global Grid Forum Applications Adv. Prog. Models Grid Performance Scheduling & Rsrc Mgmt Remote Data Access Security Applications & Testbeds Programmin g Models Data Access Resource Management Performance Analysis Security Accounting Grid User Services Grid Info Services Object Oriented Steering Group Advisory Board Single leadership team Annual Global Grid Forum Meeting alternating among regions Challenge: working group coordination

ARGONNE CHICAGO The Future l Current HPIIS networks have only served to stimulate interest! l Rapid evolution of Grid technologies and application concepts is increasing appetite for network capabilities l We are ready for far more aggressive R&D activities –TransOceanic Gigabit->Terabit Testbed –Production applications in numerous scientific applicationsand humanities?

ARGONNE CHICAGO Summary l International cooperation is particularly important for Grid computing l HPIIS has helped to stimulate the creation of an international Grid community –Dozens of international partnerships –Global Grid Forum: >300 people, >90 orgs, 11 countries l A tremendous success! l Timely to start thinking about how to build on this success in the future