O AK R IDGE N ATIONAL L ABORATORY U. S. D EPARTMENT OF E NERGY The Center for Computational Sciences 1 State of the CCS SOS 8 April 13, 2004 James B. White III (Trey) virtual Buddy Bland

O AK R IDGE N ATIONAL L ABORATORY U. S. D EPARTMENT OF E NERGY The Center for Computational Sciences 2 State of the CCS  CCS as a user facility  CCS as a DOE Advanced Computing Research Testbed (ACRT)  Future plans

O AK R IDGE N ATIONAL L ABORATORY U. S. D EPARTMENT OF E NERGY The Center for Computational Sciences 3 Facilities  Computer facility  40,000 ft 2 over two floors  36” raised floor (lower floor)  8 MW power, 3600 tons cooling  Office space for 450  Classrooms and training areas  Labs for visualization, computer science, and networking

O AK R IDGE N ATIONAL L ABORATORY U. S. D EPARTMENT OF E NERGY The Center for Computational Sciences 4 User Facility  CCS designated by DOE as a user facility  Supports users from academia and industry  Pursuing agreements with Boeing and Dow Chemical

O AK R IDGE N ATIONAL L ABORATORY U. S. D EPARTMENT OF E NERGY The Center for Computational Sciences 5 User Community 70% of usage is from users outside of ORNL Users come from all around the country

O AK R IDGE N ATIONAL L ABORATORY U. S. D EPARTMENT OF E NERGY The Center for Computational Sciences 6 FY03 Usage by Discipline

O AK R IDGE N ATIONAL L ABORATORY U. S. D EPARTMENT OF E NERGY The Center for Computational Sciences 7 CCS Usage Model  Small number of large projects  CCS supports liaisons for large projects  Center can be dedicated to single task of national importance  Human genome  HFIR restart  IPCC

O AK R IDGE N ATIONAL L ABORATORY U. S. D EPARTMENT OF E NERGY The Center for Computational Sciences 8 Advanced Computing Research Testbed  ACRT examines promising new computer architectures for DOE SC  Determine usability for SC applications  Work with vendors to improve systems  Application-based evaluations

O AK R IDGE N ATIONAL L ABORATORY U. S. D EPARTMENT OF E NERGY The Center for Computational Sciences 9 Past Evaluations KSR Intel Paragon MP X/PS Intel i/PSC Intel I/PSC Intel Paragon XP/S Compaq AlphaServer SC 2000 SRC Prototype 1999 GSN Switch 2000 IBM Winterhawk And Nighthawk 1999 IBM S IBM Power4 and Federation

O AK R IDGE N ATIONAL L ABORATORY U. S. D EPARTMENT OF E NERGY The Center for Computational Sciences 10 Current Evaluations  Cray X1 - scalable vector  SGI Altix - large shared memory  IBM Federation Cluster - interconnect 

O AK R IDGE N ATIONAL L ABORATORY U. S. D EPARTMENT OF E NERGY The Center for Computational Sciences 11 Cray X1  World’s largest X1  8 cabinets  256 MSPs, 3.2 TF  1 TB memory  32 TB local disk  Cabinets half populated to test topology and facilitate upgrade

O AK R IDGE N ATIONAL L ABORATORY U. S. D EPARTMENT OF E NERGY The Center for Computational Sciences 12 SGI Altix  Large memory, single-system image  256 Itanium2 processors  1.5 GHz, 6 GF, 6 MB cache  1.5 TF  2 TB shared memory (NUMA)  Targeting biology apps and data analysis

O AK R IDGE N ATIONAL L ABORATORY U. S. D EPARTMENT OF E NERGY The Center for Computational Sciences 13 IBM Federation Cluster  27 p690s  GHz Power4s  864 total processors  8 p655s  GHz Power4s  Login and GPFS

O AK R IDGE N ATIONAL L ABORATORY U. S. D EPARTMENT OF E NERGY The Center for Computational Sciences 14 Evaluation Plans  Cray X series  Upgrade X1 to 512 MSPs  Upgrade to 1024 X1E MSPs  Black Widow  Red Storm  10.5 TF in 2004  21 TF in 2005  Blue Gene at Argonne  Cray XD1 (OctigaBay)  SRC FPGA systems  IBM Power5  SGI Altix (larger images)  ADIC StorNext  Lustre

O AK R IDGE N ATIONAL L ABORATORY U. S. D EPARTMENT OF E NERGY The Center for Computational Sciences 15 Questions? James B. White III (Trey)