1. TG ’08, June 9-13, 2008 1 State of TeraGrid John Towns Co-Chair, TeraGrid Forum Director, Persistent Infrastructure National Center for Supercomputing Applications University of Illinois

2. TeraGrid ‘08, June 9-13, 2008 2 Our Vision of TeraGrid A large-scale operational cyberinfrastructure that provides very high-end computational capabilities for leading-edge research in the national open science community, while also reaching out to new users and communities to broaden the impact of cyberinfrastructure in research, education, and society A complex collaboration of over a dozen organizations and NSF awards working together to provide collective services that go beyond what can be provided by individual institutions More than just the sum of its parts

3. TeraGrid ‘08, June 9-13, 2008 3 TeraGrid: greater than the sum of its parts… Single unified allocations process Single point of contact for problem reporting Simplified access to high end resources for science and engineering –coordinated software environments –uniform access to heterogeneous resources to solve a single scientific problem Expertise in building national computing and data resources Leveraging extensive resources, expertise, R&D, and EOT –leveraging other activities at participant sites –learning from each other improves expertise of all TG staff Leadership in cyberinfrastructure development, deployment and support –demonstrating enablement of science not possible without the TeraGrid-coordinated human and technological resources

4. TeraGrid ‘08, June 9-13, 2008 4 TeraGrid Participants

5. TeraGrid ‘08, June 9-13, 2008 5 Allocations Process National peer-review process –allocates computational and data resources –makes recommendations on allocation of advanced direct support services Managed by TeraGrid –GIG and RP Participants in reviews –CORE Services award to manage shared responsibilities TACC: Meeting coordination SDSC: TG Central DB NCSA: POPS, TG Allocations group Currently awarding >1B Normalized Units of resources

6. TeraGrid Annual Review Panel Review held April 15-17, 2008 High-Level Findings –Things are going well… “The overall assessment of the panel is that the TeraGrid is doing an excellent job.” “The TeraGrid is among the best grids in the world with respect to providing resources to a broad and inclusive audience. ” –Over the next year, the TeraGrid should formulate a strategic plan address the problem of petascale data analysis seize the opportunity presented by Science Gateways formulate a definite plan to provide a global parallel file system continue to strive for better integration of management processes assess major risks and maintain a risk mitigation plan provide clearer milestones in future annual reports. TeraGrid Annual Review, April 15-16, 2008 6

7. TeraGrid Continues to Move Forward Growing user base and delivered usage –increasing diversity in disciplines the user community spans! Growing resources and capabilities –new awards and awardees Track 2a: Ranger @ TACC Track 2b: Kraken @ UTK/NICS –compute, data, visualization… –human! TeraGrid ‘08, June 9-13, 2008 7

8. 8 HPC User Community is Growing Source: TeraGrid Central Database

9. TeraGrid ‘08, June 9-13, 2008 9 Usage is also Growing.... Source: TeraGrid Central Database 3.95B NUs delivered in CY2007

10. TeraGrid ‘08, June 9-13, 2008 10 CY2007 Usage by Discipline 3.95B NUs delivered in CY2007 Molecular Biosciences 31% Chemistry 17% Physics 17% Astronomical Sciences 12% Materials Research 6% Earth Sciences 3% All 19 Others 4% Advanced Scientific Computing 2% Atmospheric Sciences 3% Chemical, Thermal Systems 5%

11. TeraGrid ‘08, June 9-13, 2008 11 TG Compute Resources: ~1.2PF Clusters: ~475TF –Purdue: 120TF Steele: DELL EM64T, 60TF Condor Pool: 60TF –NCSA: 116TF Abe: Dell PE1950 Blades, 90TF Tungsten: Dell PE1750, 16TF Mercury: IBM IA-64, 10TF –TACC: 62TF Lonestar: PE1955, 62TF –LONI: 51TF Queen Bee: Dell PE1950 Blades, 51TF –Indiana: 7TF Quarry: IBM HS21, 7TF –SDSC: 3.1TF TG Cluster: IBM IA-64, 3.1TF –ANL: 0.61TF TG Cluster: IBM IA-64, 0.61 TF –ORNL: 0.34TF NSTG: IBM IA-32, 0.34TF MPPs: ~765TF –TACC: 504TF Ranger: Sun Constellation, 504TF –UTK/NICS: 170TF Kraken: Cray XT4, 170TF –SDSC: 31.5TF BlueGene: IBM BlueGene/L, 17.2TF DataStar: IBM p655, 14.3TF –Indiana: 30.7TF Big Red: IBM JS21, 30.7TF –PSC: 21.3TF Big Ben: Cray XT3, 21.5 TF –NCAR: 5.7TF Frost: IBM BlueGene/L, 5.7TF SMPs: ~12.9TF –NCSA: 6.6TF Cobalt: SGI Altix, 6.6TF –PSC: 5TF Pople: SGI Altix, 5 TF –SDSC: 1.3TF DataStar: IBM p690s, 1.3TF

12. TG Data and Vis Resources Data Resources –Data Collections, Database and Local Disk Space SDSC: 400TB NCSA: 220TB (Projects Filesystems) Indiana: 100TB –Remote/Wide Area Disk Space Indiana: 535TB (Data Capacitor) SDSC: 150TB (GPFS-WAN) Visualization Resources –TACC: Maverick – Sun E25K, Nvidia Quadro FX 3000G (32) – serial and parallel, remote visualization applications –ANL: IA-32 Viz Cluster – IBM IA-32, Nvidia GeFORCE 6600GT (96) –Purdue: TeraDRE – Condor Pools, Nvidia GeForce 6600 GT (48) – graphics rendering –Indiana IU Render Portal –Windows Condor pool w/ Maya and Blender –educational emphasis TeraGrid ‘08, June 9-13, 2008 12

13. Looking Forward: plenty of challenges and opportunities Integrating new resources –Track 2c: [[TBA]] –Track 2d: ??? (and see below) Project planning –develop a much better integrated project plan spanning GIG and RP activities Strategic Planning –advised by both SAB and review committee to develop longer term vision and strategic plan Funding opportunities (stealing Steve’s thunder) –“TeraGrid III” solicitation defining the next generation of infrastructure for high end digital resources –Track 2d updated solicitation new opportunities for diversifying resources TeraGrid ‘08, June 9-13, 2008 13