Report on CSU HPC (High-Performance Computing) Study Ricky Yu–Kwong Kwok Co-Chair, Research Advisory Committee ISTeC August 18,

Slides:



Advertisements
Similar presentations
Supercomputing Institute for Advanced Computational Research © 2009 Regents of the University of Minnesota. All rights reserved. The Minnesota Supercomputing.
Advertisements

C3.ca in Atlantic Canada Virendra Bhavsar Director, Advanced Computational Research Laboratory (ACRL) Faculty of Computer Science University of New Brunswick.
Project Proposal.
An Institute for Theory and Computation In Molecular and Materials Sciences at the University of Florida Theory & Computation for Atomic & Molecular Materials.
Presentation to Educational Policy Committee Department of Biology Revised March, 2013 Biology Department: Position Requests.
HPC - High Performance Productivity Computing and Future Computational Systems: A Research Engineer’s Perspective Dr. Robert C. Singleterry Jr. NASA Langley.
Workshop on HPC in India Grid Middleware for High Performance Computing Sathish Vadhiyar Grid Applications Research Lab (GARL) Supercomputer Education.
S. Gadomski, "ATLAS computing in Geneva", journee de reflexion, 14 Sept ATLAS computing in Geneva Szymon Gadomski description of the hardware the.
Lecture 1: History of Operating System
The Golden Age of Biology DNA -> RNA -> Proteins -> Metabolites Genomics Technologies MECHANISMS OF LIFE Health Care Diagnostics Medicines Animal Products.
Bioinformatics: a Multidisciplinary Challenge Ron Y. Pinter Dept. of Computer Science Technion March 12, 2003.
Top500: Red Storm An abstract. Matt Baumert 04/22/2008.
1 Aug 7, 2004 GPU Req GPU Requirements for Large Scale Scientific Applications “Begin with the end in mind…” Dr. Mark Seager Asst DH for Advanced Technology.
Title US-CMS User Facilities Vivian O’Dell US CMS Physics Meeting May 18, 2001.
Earth Simulator Jari Halla-aho Pekka Keränen. Architecture MIMD type distributed memory 640 Nodes, 8 vector processors each. 16GB shared memory per node.
Data-Intensive Science (eScience) Ed Lazowska Bill & Melinda Gates Chair in Computer Science & Engineering University of Washington August 2011.
Bio/CS 251 Introduction to Bioinformatics. Class Web Site This site will contain all important documents.
O AK R IDGE N ATIONAL L ABORATORY U.S. D EPARTMENT OF E NERGY Cluster Computing Applications Project Parallelizing BLAST Research Alliance of Minorities.
David A. Lifka Chief Technical Officer Cornell Theory Center Data Intensive Computing Enabling Seamless High Performance Computing.
Approaching a Data Center Guy Almes meetings — Tempe 5 February 2007.
Apr 18, 2013ISTeC Big Data Forum, Colorado State University1 “Big Data” at the Natural Resource Ecology Laboratory Randall B. Boone Research Scientist,
Prof. H. J. Siegel Abell Endowed Chair Distinguished Professor of Electrical and Computer Engineering and Professor of Computer Science ISTeC Research.
Introduction to Computer and Programming CS-101 Lecture 6 By : Lecturer : Omer Salih Dawood Department of Computer Science College of Arts and Science.
Heterogeneous community Research computing at CSU There is HPC Activities in all 8 colleges Computing being done by Professional staff as well as grad.
A Web Crawler Design for Data Mining
ISG We build general capability Introduction to Olympus Shawn T. Brown, PhD ISG MISSION 2.0 Lead Director of Public Health Applications Pittsburgh Supercomputing.
Cluster Computing Applications for Bioinformatics Thurs., Aug. 9, 2007 Introduction to cluster computing Working with Linux operating systems Overview.
SAN DIEGO SUPERCOMPUTER CENTER NUCRI Advisory Board Meeting November 9, 2006 Science Gateways on the TeraGrid Nancy Wilkins-Diehr TeraGrid Area Director.
Fall 2000M.B. Ibáñez Lecture 01 Introduction What is an Operating System? The Evolution of Operating Systems Course Outline.
U.S. Department of Energy Office of Science Advanced Scientific Computing Research Program NERSC Users Group Meeting Department of Energy Update September.
CSU HPC (High-Performance Computing) Study Ricky Yu–Kwong Kwok Co-Chair, Research Advisory Committee ISTeC November 10, 2008 Presented.
Invitation to Computer Science 5 th Edition Chapter 6 An Introduction to System Software and Virtual Machine s.
The Balance Between Theoretical and Practical Work Within Electrical and Computer Engineering Courses Dr. Bahawodin Baha March Development Partnerships.
Computer Laboratory Practicing at the Faculty of Natural Science and Mathematics Vesna Veličković Marko Milošević Workshop on Lab Practicing in Computer.
Fundamental Programming: Fundamental Programming K.Chinnasarn, Ph.D.
Aliya Sadeque BIOC 599 Supervisory Committee Meeting Wednesday December 19, 2007.
1. 2 IBM p690 SUR Grant Patricia J. Teller, Ph.D. Department of Computer Science The University of Texas at El Paso High-Performance Computing / HPC at.
Bioinformatics Core Facility Guglielmo Roma January 2011.
Data Management Recommendation ISTeC Data Management Committee.
Introduction to Computing Muhammad Saeed. Topics Course Description Overview of Areas Contact Information.
Introduction to Bioinformatics (Lecture for CS397-CXZ Algorithms in Bioinformatics) Jan. 21, 2004 ChengXiang Zhai Department of Computer Science University.
STAR Off-line Computing Capabilities at LBNL/NERSC Doug Olson, LBNL STAR Collaboration Meeting 2 August 1999, BNL.
Introduction to Bioinformatics Dr. Rybarczyk, PhD University of North Carolina-Chapel Hill
NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE Capability Computing – High-End Resources Wayne Pfeiffer Deputy Director NPACI & SDSC NPACI.
11/15/04PittGrid1 PittGrid: Campus-Wide Computing Environment Hassan Karimi School of Information Sciences Ralph Roskies Pittsburgh Supercomputing Center.
1 OFFICE OF ADVANCED SCIENTIFIC COMPUTING RESEARCH The NERSC Center --From A DOE Program Manager’s Perspective-- A Presentation to the NERSC Users Group.
EScience: Techniques and Technologies for 21st Century Discovery Ed Lazowska Bill & Melinda Gates Chair in Computer Science & Engineering Computer Science.
Comprehensive Scientific Support Of Large Scale Parallel Computation David Skinner, NERSC.
ISG We build general capability Introduction to Olympus Shawn T. Brown, PhD ISG MISSION 2.0 Lead Director of Public Health Applications Pittsburgh Supercomputing.
Power and Cooling at Texas Advanced Computing Center Tommy Minyard, Ph.D. Director of Advanced Computing Systems 42 nd HPC User Forum September 8, 2011.
Cheating The School of Network Computing, the Faculty of Information Technology and Monash as a whole regard cheating as a serious offence. Where assignments.
Computer System Evolution. Yesterday’s Computers filled Rooms IBM Selective Sequence Electroinic Calculator, 1948.
HPC University Requirements Analysis Team Training Analysis Summary Meeting at PSC September Mary Ann Leung, Ph.D.
Presenter: Bradley Green.  What is Bioinformatics?  Brief History of Bioinformatics  Development  Computer Science and Bioinformatics  Current Applications.
Introduction to Data Analysis with R on HPC Texas Advanced Computing Center Feb
Scientific Computing at Fermilab Lothar Bauerdick, Deputy Head Scientific Computing Division 1 of 7 10k slot tape robots.
A Web Based Job Submission System for a Physics Computing Cluster David Jones IOP Particle Physics 2004 Birmingham 1.
INTRODUCTION TO XSEDE. INTRODUCTION  Extreme Science and Engineering Discovery Environment (XSEDE)  “most advanced, powerful, and robust collection.
An Brief Introduction Charlie Taylor Associate Director, Research Computing UF Research Computing.
Compute and Storage For the Farm at Jlab
Invitation to Computer Science 6th Edition
Accelerated B.S./M.S An approved Accelerated BS/MS program allows an undergraduate student to take up to 6 graduate level credits as an undergraduate.
MATLAB Distributed, and Other Toolboxes
CS422 Principles of Database Systems Course Overview
KEY CONCEPT Entire genomes are sequenced, studied, and compared.
ANALYSIS OF USER SUBMISSION BEHAVIOR ON HPC AND HTC
Resource Allocation for Distributed Streaming Applications
KEY CONCEPT Entire genomes are sequenced, studied, and compared.
KEY CONCEPT Entire genomes are sequenced, studied, and compared.
Presentation transcript:

Report on CSU HPC (High-Performance Computing) Study Ricky Yu–Kwong Kwok Co-Chair, Research Advisory Committee ISTeC August 18, 2008 Presented to CSU CRAD

2 Outline 1. Motivation for the Study 2. Interpretations of Findings 3. Summary of Findings 4. Representative HPC Activities 5. CoGrid Job Submission System 6. HPC Forum (9/3/2008)

3 Motivation for the Study HPC is a 3 rd way of conducting research and discovery To assess current activities and future opportunities To look at current systems at CSU To make CSU more competitive in the research arena Study Motivation

4 Interpretations of Findings 37 responses  26 departments, 31 research areas HPC is “hot” at CSU! 1/3 of users have no immediate access to HPC resources  rely on other departments within CSU OR other organizations outside CSU  may be subject to strict resource restrictions Interpretations of Findings

5 Scattered resources Majority of users pessimistic about their HPC needs being met in future Advanced visualization needs require enhancement Need to “advertise” GRAD 510/511 courses Space limitations for HPC hardware??? Consultancy? Affinity groups? Interpretations of Findings

6 Summary of Findings 37 responses  26 departments, 31 research areas Besides CoGrid node, Bioinformatics cluster and HP Half Dome system, 8 additional HPC resources, e.g., (see Table 2 in the Report)  CIRA – 32-processor cluster  Chemical and Biological Engineering – 32-node Linux cluster  Mathematics – 42-node cluster  Some more new resources to come (e.g., new HP donations) Summary of Findings

7 Usage of HPC Summary of Findings

8 Nature of Usage Summary of Findings

9 Algorithms Used Summary of Findings

10 HPC Resource Used Summary of Findings

11 HPC Needs Met? Current Future Summary of Findings

12 Visualization Needs Met? Current Future Summary of Findings

13 Compiler Used Summary of Findings

14 Language Used Summary of Findings

15 Be Involved in Future HPC Activities? Summary of Findings

16 Aware of GRAD 510/511? Summary of Findings

17 Required Follow-Up? Summary of Findings

18 Presentation Outline 1. Motivation of the Study 2. Interpretations of Findings 3. Summary of Findings 4. Representative HPC Activities 5. CoGrid Job Submission System 6. HPC Forum

19 Small-angle X-ray Scattering (SAXS) To understand biological systems Determine 3-D structure Monte Carlo simulations for data modeling Computationally intensive  HPC Representative HPC Activities

20 Genomic Analysis Study the evolution of functional DNA sequences Comparative phylogenomic analysis Highly computationally intensive  cluster of Linux machines with 8 – 32 nodes Representative HPC Activities

21 Proteomics Large-scale study of proteins Searching methods to analyze mass spectrometry data Sequence matching Access to large databases Representative HPC Activities

22 Pattern Analysis Investigate unexplained phenomena from high-dimensional, massive data sets Mathematical theory  efficient algorithms  exploring, understanding, modeling massive data sets PAL lab (Pattern Analysis Laboratory)  42-node cluster with 156 GB total memory, over 5 TB disk storage Representative HPC Activities

23 CoGrid Job Submission System Sharing of geographically distributed computational resources Batch processing of jobs  Job description  Resource requirements  Execution  Monitoring CoGrid

24 HPC Forum (9/3/2008) 1. Introduction and ISTeC Overview: HJ 2. Background on CSU’s HPC History and Activities: Pat Burns 3. Findings from ISTeC’s HPC Survey: Ricky 4. Advanced Networking Capabilities at CSU: Scott Baily, Director of ACNS 5. Educational Activities in HPC: Sanjay Rajopadhye and Wim Bohm (Computer Science) 6. Plan for an ISTeC Visualization Facility: HJ 7. NERSC and the INCITE Program as a Viable Alternative: Josh Ladd (Mathematics) 8. Open Discussion – Faculty Needs and Directions

25 Summary Motivation: To look at current systems in CSU and future HPC needs Presented interpretations and findings of the survey Discussed representative HPC activities Introduced CoGrid job submission system, as a possible campus-wide resource management model HPC Forum for further discussions