SAN DIEGO SUPERCOMPUTER CENTER at the UNIVERSITY OF CALIFORNIA; SAN DIEGO SDSC RP Update October 21, 2010

SAN DIEGO SUPERCOMPUTER CENTER at the UNIVERSITY OF CALIFORNIA; SAN DIEGO SDSC RP - Big Picture Staffing Bill Young (TSRI) – New SDSC HPC Cluster Platforms Manager Dave Hart (SDSC) – New NCAR User Services Manager Resources Dash In production for start-up allocations, ~15 projects now computing User Guide published: (also linked from TG website) Gordon On schedule for deployment 3Q11 *Trestles (new “DCL” award system) *EOT Programs Events SDSC 25 th Anniversary – Oct 12 *Grand Challenges in Data-Intensive Discovery- October SC’10 – Nov (stop by the SDSC booth 2239)

SAN DIEGO SUPERCOMPUTER CENTER at the UNIVERSITY OF CALIFORNIA; SAN DIEGO Trestles - Big Picture Proposed as a high-productivity system for modest- scale/gateway users Tailored to user/science needs Establish policies and queues to maintain good throughput times – continuous tuning of allocations/utilization/scheduling Also plan a queue for long-running jobs Will be operated in parallel with Gordon Nominal schedule 10/1/10 – Two test nodes 11/1/10 – Onsite build of production system starts 12/1/10 – Friendly users begin 01/1/11 –Full production Operations till Dec 2013

SAN DIEGO SUPERCOMPUTER CENTER at the UNIVERSITY OF CALIFORNIA; SAN DIEGO Trestles - System Description System ComponentConfiguration AMD MAGNY-COURS COMPUTE NODE Sockets4 Cores32 Clock Speed2.4 GHz Flop Speed307 Gflop/s Memory capacity64 GB Memory bandwidth171 GB/s STREAM Triad bandwidth100 GB/s Flash memory (SSD)120 GB FULL SYSTEM Total compute nodes324 Total compute cores10,368 Peak performance100 Tflop/s Total memory20.7 TB Total memory bandwidth55.4 TB/s Total flash memory39 TB QDR INFINIBAND INTERCONNECT TopologyFat tree Link bandwidth8 GB/s (bidrectional) Peak bisection bandwidth5.2 TB/s (bidirectional) MPI latency1.3 us DISK I/O SUBSYSTEM File systemsNFS, Lustre Storage capacity (usable)150 TB: Dec PB : June PB: July 2012 I/O bandwidth50 GB/s

SAN DIEGO SUPERCOMPUTER CENTER at the UNIVERSITY OF CALIFORNIA; SAN DIEGO Trestles - Configuring for productivity Plan to allocate ~70% of the theoretically available SUs The common practice is to allocate 80% (or more), which can result in high wait times. A 70% maximum will allow the scheduler to better satisfy a mix of scheduling modes, provide an opportunity to assess the impact of the other changes, and may be revised upward as we collect more data. Cap allocation per project at 1.5M SUs/year (~2.5% of annual total). Because projects with large percentage allocations dominate resource consumption and drive up queue waits, this cap not only creates room for more users, but also should reduce queue waits across the board. Allow new users to request up to 50,000 SUs in startup allocations, and front-load the SUs offered during the first few allocations cycles. This should foster expanding the user community from the outset and accelerate the frequently slow start-up for new systems. Configure the job queues and resource schedulers for lower expansion factors and generally faster turnaround. System data and user feedback will be used to make adjustments to these in order to achieve the optimum performance for each of the job classes

SAN DIEGO SUPERCOMPUTER CENTER at the UNIVERSITY OF CALIFORNIA; SAN DIEGO Right now we’re ahead of schedule with HW in this week

SAN DIEGO SUPERCOMPUTER CENTER at the UNIVERSITY OF CALIFORNIA; SAN DIEGO SDSC Summer High School Research Program Six-week paid internships to help increase awareness of the life science industry and related fields of research to students in the San Diego region Students gained exposure to career options, hands-on laboratory experience, work readiness skills, and mentoring by a company or research scientists The success of the program has led to plans for future internships 23 students participated at SDSC Ended with a student poster presentation and reception August 12

SAN DIEGO SUPERCOMPUTER CENTER at the UNIVERSITY OF CALIFORNIA; SAN DIEGO Student Poster Session