National Computational Science Alliance Industrial Supercomputing Opening Talk to NCSA Strategic Industrial Partners Program Advisory Committee NCSA, University of Illinois at Urbana- Champaign, November 17,1998

National Computational Science Alliance President’s Information Technology Advisory Committee Interim Report More Long Term IT Research Needed –Fundamental Research in Software Development –R & D and Testbeds for Scalable Infrastructure –Increase Support for High End Computing Socio-Economic and Workforce Impacts –Address the Shortage of High-Tech Workers –Study Social and Economic Impacts of IT Adoption Modes and Management of Federal IT Research –Fund Projects of Broader Scope and Longer Duration –Virtual Centers for Expeditions into the 21st Century –NSF as Lead Agency for Coordinating IT Research

National Computational Science Alliance PITAC Draft Refinement of High-End Acquisition Recommendation Fund the Acquisition of the Most Powerful High-End Computing Systems to Support Long Term Basic Research in Science and Engineering Access for (Highest Priority): –ALL Academic Researchers –ALL Disciplines –ALL Universities Access for (Second Priority): –Government Researchers –Industrial Researchers

National Computational Science Alliance Emerging Multi-Agency Effort to Create a Persistent National Technology Grid NSF Establishes PACI Program DOE Raises the Bar –ASCI and SSP –Data and Visualization Corridors DoE Discussing with NSF: –How to Get Highest-End Capacity –PACI ET and AT Teams Linking to ASCI, SSP NASA and NSF on Information Power Grid DoD Mod. PET Innovating Infrastructure NIH Seen As Critical Partner

National Computational Science Alliance Deputy Director Bordogna on NSF Leadership in Information Technologies Three Important Priorities for NSF in the Area of IT for the Future: –The First Area Is Fundamental and High-Risk IT Research and Advanced Computation Research. –The Second Priority Area for NSF Is Competitive Access and Use of High-end Computing and Networking. –The Third Priority Is Investing in IT Education at All Levels. Congressional Testimony 10/6/98

National Computational Science Alliance NSF vBNS Provides the High Speed Backbone for the NSF PACI Experiment

National Computational Science Alliance Development of Computational Methods in Chemistry Awarded the 1998 Nobel Prize for Chemistry Walter Kohn –University of California at Santa Barbara, USA John A. Pople –Northwestern University, Evanston, Illinois, USA “to Walter Kohn for his development of the density-functional theory and to John Pople for his development of computational methods in quantum chemistry” Freon and Ozone

National Computational Science Alliance NCSA Users by System - SGI Origin Takes Off! Sep94 Nov94Jan95 Mar95 May95 Jul95 Sep95 Nov95Jan96 Mar96 May96 Jul96 Sep96 Nov96Jan97 Mar97 May97 Jul97 Sep97 Nov97Jan98 Mar98 May98 Jul98 Sep98 Number of Users SGI Power Challenge Array CM5 Convex C3880 Convex Exemplar Cray Y-MP Origin SPP-2000 C3880 (retired 10/95) SPP-1200 Y-MP (retired 12/94) Origin SPP-2000 CM-5 (retired 1/97) PCA (retired 7/98) (retired 5/98)

National Computational Science Alliance Solving 2D Navier-Stokes Kernel - Performance of Scalable Systems Preconditioned Conjugate Gradient Method With Multi-level Additive Schwarz Richardson Pre-conditioner (2D 1024x1024) Danesh Tafti, Rob Pennington, NCSA; Andrew Chien (UIUC, UCSD) Various Applications Sustaining 7 GF on 128 Processors NT Supercluster

National Computational Science Alliance Let’s Blow This Up! The Growth Rate of the National Capacity is Slowing Down Again Source: Quantum Research

National Computational Science Alliance Major Gap Has Developed in National Usage at NSF Supercomputer Centers Projection

National Computational Science Alliance The Transformation of an Industry in Five Years- TOP500 Systems by Vendor TOP500 Reports:

National Computational Science Alliance Distribution of the November 1998 Top 500 Fastest Installed Computers TOP500 Reports:

National Computational Science Alliance Industry Becomes Largest Segment of Top 500 Supercomputers Excluding Vendors and Cycle Shops 200/500 are Industry –Compared to 149/500 One Year Ago Broad Range of High End Computers –Mostly From 32 processors to 256 –64 Processors are Most Numerous State Farm is Fastest Site –#65 IBM SP-186p Merrill Lynch is Slowest Site –#500 Sun E Americas Dominant –Americas (124), Europe (54), Far East (22) TOP500 Reports:

National Computational Science Alliance Broad Industrial Use of Scientific/Technical and Data Computing 200 Computers from Nov Top 500

National Computational Science Alliance Vendors of Systems Owned by Industrial and Research Sectors in the Top 500 Industrial Sector Research Sector TOP500 Reports:

National Computational Science Alliance Architectures Selected by Industrial and Research Sites in Top500 Observations –2/3 are Shared Memory –Vectors Still Alive in Research NCSA Program Focus On: –Leading Edge Shared Memory –SGI and HP DSM Clusters –Sun SMP? –Price Performance MPP –Compaq & HP NT Supercluster –Data Management & Computing –Alliance Linux Supercluster –LANs (Condor and Symera) Industry Research TOP500 Reports:

National Computational Science Alliance Most Capacity in High End Computing Will Be Local The Emerging Wintel Supercomputer Linux, NT Scalable Clusters Condor, Symera LANs of Workstations Harvesting the Web

National Computational Science Alliance Clustered Shared Memory Architecture –Will Dominate for 5-10 Years –Builds on Market Supported Segments Scalability Has Acquired Two Dimensions –Parallelism of Shared Memory Nodes –Number of Shared Nodes in Cluster New Challenges for Supercomputing Users –Memory Hierarchies –Fault Tolerance –Hybrid Programming Models Capability Computing Will Be Done on Scalable Clusters of Shared Memory Modules

National Computational Science Alliance User Web Browser Output to User User Input Format Translator, Query Engine and Program Driver Workbench Server Results to User User Instructions and queries Application Programs (May have varying interfaces and be written in different languages) Results Instructions Information Sources (May be of varying formats) Information Queries NCSA Computational Biology Group The NCSA Information Workbench - An Architecture for Web-Based Computing

National Computational Science Alliance Structure & Function Pathways & Physiology Populations & Evolution Ecosystems Genomes Gene Products Using a Web Browser to Run Programs and Analyze Data Worldwide NCSA Biology Workbench Has Over 10,000 Users From Over 25 Countries

National Computational Science Alliance Environmental Hydrology Collaboration: From CAVE to Desktop Pietrowicz/NCSA-LES; Hibbard/Wisconsin Using Java and Java3d to Bring Collaboration and CAVE Capabilities To the Desktop Java Port of Cave5D, Enhanced With Java3D, Wand Control and Flock-of-birds Position Tracking Using NT