1. National Computational Science Alliance Supercomputing: Directions in Technology, Architecture and Applications Keynote Talk to Supercomputer’98 in Mannheim, Germany June 18, 1998

2. National Computational Science Alliance Supercomputing: Directions in Technology, Architecture and Applications Abstract "By using the results of the Top 500 over the last five years, one can easily trace out the complete transformation of the supercomputer industry. In 1993, none of the Top500 was made by a broadly based market driven company, while today over 3/4 of the Top500 are made by SGI, IBM, HP, or Sun. Similarly, vector architectures have been replaced in market share by microprocessor based SMPs. We now see a strong move to replace many MPPs and SMPs by the new architecture of Distributed Shared Memory (DSM) such as the SGI Origin or HP SPP series. A key trend is the move toward clusters of DSMs instead of monolithic MPPs. The next major change will be the emergence of Intel processors replacing RISC processors, particularly the Intel Merced processor which should become dominant shortly after 2000. A major battle will shape up between UNIX and Microsoft's NT operating systems, particularly at the lower end of the Top500. Finally, with each new architecture comes a new set of applications we can now attack. I will discuss how DSM will enable dynamic load balancing needed to support the multi-scale problems that teraflop machines will enable us to tackle."

3. National Computational Science Alliance NCSA is the Leading Edge Site for the National Computational Science Alliance www.ncsa.uiuc.edu

4. National Computational Science Alliance Scientific Applications Continue to Require Exponential Growth in Capacity MACHINE REQUIREMENT IN FLOPS 10 10 12 10 14 10 16 10 18 10 20 1995 NSF Capability 10 8 2000 NSF Leading Edge Molecular Dynamics for Biological Molecules Computational Cosmology Turbulent Convection in Stars Atomic/Diatomic Interaction QCD 10 12 MEMORYMEMORY BYTES BYTES 10 10 8 10 14 = Long Range Projections from Recent Applications Workshop = Next Step Projections by NSF Grand Challenge Research Teams = Recent Computations by NSF Grand Challenge Research Teams ASCI in 2004 100 year climate model in hours NSF in 2004 (Projected) From Bob Voigt, NSF

5. National Computational Science Alliance The Promise of the Teraflop - From Thunderstorm to National-Scale Simulation Simulation by Wilhelmson, et al.; Figure from Supercomputing and the Transformation of Science, Kaufmann and Smarr, Freeman, 1993

6. National Computational Science Alliance Accelerated Strategic Computing Initiative is Coupling DOE Defense Labs to Universities Access to ASCI Leading Edge Supercomputers Academic Strategic Alliances Program Data and Visualization Corridors http://www.llnl.gov/asci-alliances/centers.html

7. National Computational Science Alliance Comparison of the DoE ASCI and the NSF PACI Origin Array Scale Through FY99 www.lanl.gov/projects/asci/bluemtn /Hardware/schedule.html Los Alamos Origin System FY99 5-6000 processors NCSA Proposed System FY99 6x128 and 4x64=1024 processors

8. National Computational Science Alliance Future Upgrade Under Negotiation with NSF NCSA Combines Shared Memory Programming with Massive Parallelism CM-5 CM-2

9. National Computational Science Alliance The Exponential Growth of NCSA’s SGI Shared Memory Supercomputers Doubling Every Nine Months! Challenge Power Challenge Origin SN1

10. National Computational Science Alliance TOP500 Systems by Vendor TOP500 Reports: http://www.netlib.org/benchmark/top500.html CRI SGI IBM Convex HP Sun TMC Intel DEC Japanese Other 0 100 200 300 400 500 Jun-93 Nov-93 Jun-94 Nov-94 Jun-95 Nov-95 Jun-96 Nov-96 Jun-97 Nov-97 Jun-98 Number of Systems Other Japanese DEC Intel TMC Sun HP Convex IBM SGI CRI

11. National Computational Science Alliance Average User MFLOPS Number of Users 0 50 100 150 20406080 100120140160180200220240260280300 March, 1992 - February, 1993 Average Performance, Users > 0.5 CPU Hour Cray Y-MP4 / 64 Average Speed 70 MFLOPS Peak Speed MIPS R8000 Peak Speed Y-MP1 Why NCSA Switched From Vector to RISC Processors NCSA 1992 Supercomputing Community

12. National Computational Science Alliance Replacement of Shared Memory Vector Supercomputers by Microprocessor SMPs TOP500 Reports: http://www.netlib.org/benchmark/top500.html Top500 Installed SC’s Jun-93 Jun-94 Jun-95 Jun-96 Jun-97 Jun-98 0 100 200 300 400 500 MPP SMP/DSM PVP

13. National Computational Science Alliance Top500 Shared Memory Systems Vector ProcessorsMicroprocessors TOP500 Reports: http://www.netlib.org/benchmark/top500.html PVP Systems 0 100 200 300 Jun-93 Nov-93 Jun-94 Nov-94 Jun-95 Nov-95 Jun-96 Nov-96 Jun-97 Nov-97 Jun-98 Number of Systems Europe Japan USA SMP + DSM Systems 0 100 200 300 Jun-93 Nov-93 Jun-94 Nov-94 Jun-95 Nov-95 Jun-96 Nov-96 Jun-97 Nov-97 Jun-98 Number of Systems USA

14. National Computational Science Alliance Simulation of the Evolution of the Universe on a Massively Parallel Supercomputer 12 Billion Light Years 4 Billion Light Years Virgo Project - Evolving a Billion Pieces of Cold Dark Matter in a Hubble Volume - 688-processor CRAY T3E at Garching Computing Centre of the Max-Planck-Society http://www.mpg.de/universe.htm

15. National Computational Science Alliance Limitations of Uniform Grids for Complex Scientific and Engineering Problems Source: Greg Bryan, Mike Norman, NCSA 512x512x512 Run on 512-node CM-5 Gravitation Causes Continuous Increase in Density Until There is a Large Mass in a Single Grid Zone

16. National Computational Science Alliance Use of Shared Memory Adaptive Grids To Achieve Dynamic Load Balancing Source: Greg Bryan, Mike Norman, John Shalf, NCSA 64x64x64 Run with Seven Levels of Adaption on SGI Power Challenge, Locally Equivalent to 8192x8192x8192 Resolution

17. National Computational Science Alliance Extreme and Large PIs Dominant Usage of NCSA Origin January thru April, 1998

18. National Computational Science Alliance Disciplines Using the NCSA Origin 2000 CPU-Hours in March 1995

19. National Computational Science Alliance A Variety of Discipline Codes - Single Processor Performance Origin vs. T3E

20. National Computational Science Alliance Solving 2D Navier-Stokes Kernel - Performance of Scalable Systems Source: Danesh Tafti, NCSA Preconditioned Conjugate Gradient Method With Multi-level Additive Schwarz Richardson Pre-conditioner (2D 1024x1024)

21. National Computational Science Alliance Alliance PACS Origin2000 Repository http://scv.bu.edu/SCV/Origin2000/ Kadin Tseng, BU, Gary Jensen, NCSA, Chuck Swanson, SGI John Connolly, U Kentucky Developing Repository for HP Exemplar

22. National Computational Science Alliance NEC SX-5 –32 x 16 vector processor SMP –512 Processors –8 Gigaflop Peak Vector Processor IBM SP –256 x 16 RISC Processor SMP –4096 Processors –1 Gigaflop Peak RISC Processor SGI Origin Follow-on –32 x 128 RISC Processor DSM –4096 Processors –1 Gigaflop Peak EPIC Processor High-End Architecture 2000- Scalable Clusters of Shared Memory Modules Each is 4 Teraflops Peak

23. National Computational Science Alliance Emerging Portable Computing Standards HPF MPI OpenMP Hybrids of MPI and OpenMP

24. National Computational Science Alliance Basket of Applications Average Performance as Percentage of Linpack Performance 22% 25% 14%19% 33%26% Applications Codes: CFD Biomolecular Chemistry Materials QCD

25. National Computational Science Alliance Harnessing Distributed UNIX Workstations - University of Wisconsin Condor Pool Condor Cycles CondorView, Courtesy of Miron Livny, Todd Tannenbaum(UWisc)

26. National Computational Science Alliance NT Workstation Shipments Rapidly Surpassing UNIX Source: IDC, Wall Street Journal, 3/6/98

27. National Computational Science Alliance First Scaling Testing of ZEUS-MP on CRAY T3E and Origin vs. NT Supercluster “Supercomputer performance at mail-order prices”-- Jim Gray, Microsoft access.ncsa.uiuc.edu/CoverStories/SuperCluster/super.html Zeus-MP Hydro Code Running Under MPI Alliance Cosmology Team Andrew Chien, UIUC Rob Pennington, NCSA

28. National Computational Science Alliance NCSA NT Supercluster Solving Navier-Stokes Kernel Preconditioned Conjugate Gradient Method With Multi-level Additive Schwarz Richardson Pre-conditioner (2D 1024x1024) Single Processor Performance: MIPS R10k 117 MFLOPS Intel Pentium II 80 MFLOPS Danesh Tafti, Rob Pennington, Andrew Chien NCSA

29. National Computational Science Alliance Near Perfect Scaling of Cactus - 3D Dynamic Solver for the Einstein GR Equations Ratio of GFLOPs Origin = 2.5x NT SC Danesh Tafti, Rob Pennington, Andrew Chien NCSA Cactus was Developed by Paul Walker, MPI-Potsdam UIUC, NCSA

30. National Computational Science Alliance NCSA Symbio - A Distributed Object Framework Bringing Scalable Computing to NT Desktops http://access.ncsa.uiuc.edu/Features/Symbio/Symbio.html Parallel Computing on NT Clusters –Briand Sanderson, NCSA –Microsoft Co-Funds Development Features –Based on Microsoft DCOM –Batch or Interactive Modes –Application Development Wizards Current Status & Future Plans –Symbio Developer Preview 2 Released –Princeton University Testbed

31. National Computational Science Alliance The Road to Merced http://developer.intel.com/solutions/archive/issue5/focus.htm#FOUR